GENERIC HEAD from 2013-08-20 12:33:35 UTC, r254562M, vmcore.28 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #2 r254562M: Wed Aug 21 10:49:10 CEST 2013 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32154857472 (30665 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 73813991 free (102095 frags, 9213987 blocks, 0.1% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 22850188 free (940 frags, 2856156 blocks, 0.0% fragmentation) Mounting local file systems:. Writing entropy file:. Setting hostname: t1.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=401bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff80713140(0xffffffff815968d0) 0.013783549 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered lock order reversal: 1st 0xfffffe07860d7c18 bufwait (bufwait) @ kern/vfs_bio.c:3053 2nd 0xfffff80015983c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e145300 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e1453b0 witness_checkorder() at witness_checkorder+0xd4f/frame 0xfffffe081e145440 _sx_xlock() at _sx_xlock+0x75/frame 0xfffffe081e145480 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xfffffe081e1454c0 ufs_direnter() at ufs_direnter+0x688/frame 0xfffffe081e145580 ufs_mkdir() at ufs_mkdir+0x863/frame 0xfffffe081e145780 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xfffffe081e1457b0 kern_mkdirat() at kern_mkdirat+0x20e/frame 0xfffffe081e1459a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e145ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e145ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80093978a, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Wed Aug 21 11:01:13 CEST 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: Aug 21 11:01:23 t1 su: pho to root on /dev/pts/0 20130821 11:01:31 all (1/1): mountu.sh panic: __rw_wlock_hard: recursing but non-recursive rw pmap pv list @ ../../../amd64/amd64/pmap.c:2519 cpuid = 19 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e05bd10 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e05bdc0 vpanic() at vpanic+0x126/frame 0xfffffe081e05be00 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e05be70 __rw_wlock_hard() at __rw_wlock_hard+0x12c/frame 0xfffffe081e05bfa0 _rw_wlock_cookie() at _rw_wlock_cookie+0x177/frame 0xfffffe081e05bff0 pmap_pv_demote_pde() at pmap_pv_demote_pde+0x137/frame 0xfffffe081e05c080 pmap_demote_pde_locked() at pmap_demote_pde_locked+0x4a3/frame 0xfffffe081e05c110 pmap_demote_pde() at pmap_demote_pde+0x31/frame 0xfffffe081e05c150 pmap_remove_write() at pmap_remove_write+0x2c4/frame 0xfffffe081e05c1c0 vm_object_page_remove_write() at vm_object_page_remove_write+0x61/frame 0xfffffe081e05c1f0 vm_object_page_clean() at vm_object_page_clean+0x22f/frame 0xfffffe081e05c280 vflush() at vflush+0x2c0/frame 0xfffffe081e05c3c0 ffs_flushfiles() at ffs_flushfiles+0x101/frame 0xfffffe081e05c430 softdep_flushfiles() at softdep_flushfiles+0x17f/frame 0xfffffe081e05c490 ffs_mount() at ffs_mount+0x6b8/frame 0xfffffe081e05c6b0 vfs_donmount() at vfs_donmount+0xf3e/frame 0xfffffe081e05c960 sys_nmount() at sys_nmount+0x72/frame 0xfffffe081e05c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e05cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e05cab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a9df8a, rsp = 0x7fffffffc708, rbp = 0x7fffffffcc70 --- KDB: enter: panic [ thread pid 1199 tid 100143 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 1199 tid 100143 td 0xfffff80015c66920 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e05bdc0 vpanic() at vpanic+0x146/frame 0xfffffe081e05be00 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e05be70 __rw_wlock_hard() at __rw_wlock_hard+0x12c/frame 0xfffffe081e05bfa0 _rw_wlock_cookie() at _rw_wlock_cookie+0x177/frame 0xfffffe081e05bff0 pmap_pv_demote_pde() at pmap_pv_demote_pde+0x137/frame 0xfffffe081e05c080 pmap_demote_pde_locked() at pmap_demote_pde_locked+0x4a3/frame 0xfffffe081e05c110 pmap_demote_pde() at pmap_demote_pde+0x31/frame 0xfffffe081e05c150 pmap_remove_write() at pmap_remove_write+0x2c4/frame 0xfffffe081e05c1c0 vm_object_page_remove_write() at vm_object_page_remove_write+0x61/frame 0xfffffe081e05c1f0 vm_object_page_clean() at vm_object_page_clean+0x22f/frame 0xfffffe081e05c280 vflush() at vflush+0x2c0/frame 0xfffffe081e05c3c0 ffs_flushfiles() at ffs_flushfiles+0x101/frame 0xfffffe081e05c430 softdep_flushfiles() at softdep_flushfiles+0x17f/frame 0xfffffe081e05c490 ffs_mount() at ffs_mount+0x6b8/frame 0xfffffe081e05c6b0 vfs_donmount() at vfs_donmount+0xf3e/frame 0xfffffe081e05c960 sys_nmount() at sys_nmount+0x72/frame 0xfffffe081e05c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e05cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e05cab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a9df8a, rsp = 0x7fffffffc708, rbp = 0x7fffffffcc70 --- db:0:bt> show allpcpu Current CPU: 19 cpuid = 0 dynamic pcpu = 0x559280 curthread = 0xfffff8000b221920: pid 11 "idle: cpu0" curpcb = 0xfffffe07fc5fcb80 fpcurthread = none idlethread = 0xfffff8000b221920: tid 100003 "idle: cpu0" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1010 commontssp = 0xffffffff815f1010 rsp0 = 0xfffffe07fc5fcb80 gs32p = 0xffffffff815f2a68 ldt = 0xffffffff815f2aa8 tss = 0xffffffff815f2a98 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe087b204280 curthread = 0xfffff8000b221490: pid 11 "idle: cpu1" curpcb = 0xfffffe078ac2cb80 fpcurthread = none idlethread = 0xfffff8000b221490: tid 100004 "idle: cpu1" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1078 commontssp = 0xffffffff815f1078 rsp0 = 0xfffffe078ac2cb80 gs32p = 0xffffffff815f2ad0 ldt = 0xffffffff815f2b10 tss = 0xffffffff815f2b00 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe087b20b280 curthread = 0xfffff8000b221000: pid 11 "idle: cpu2" curpcb = 0xfffffe078ac31b80 fpcurthread = none idlethread = 0xfffff8000b221000: tid 100005 "idle: cpu2" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f10e0 commontssp = 0xffffffff815f10e0 rsp0 = 0xfffffe078ac31b80 gs32p = 0xffffffff815f2b38 ldt = 0xffffffff815f2b78 tss = 0xffffffff815f2b68 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe087b212280 curthread = 0xfffff8000b231000: pid 11 "idle: cpu3" curpcb = 0xfffffe078ac36b80 fpcurthread = none idlethread = 0xfffff8000b231000: tid 100006 "idle: cpu3" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1148 commontssp = 0xffffffff815f1148 rsp0 = 0xfffffe078ac36b80 gs32p = 0xffffffff815f2ba0 ldt = 0xffffffff815f2be0 tss = 0xffffffff815f2bd0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe087b219280 curthread = 0xfffff8000b230920: pid 11 "idle: cpu4" curpcb = 0xfffffe078ac3bb80 fpcurthread = none idlethread = 0xfffff8000b230920: tid 100007 "idle: cpu4" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f11b0 commontssp = 0xffffffff815f11b0 rsp0 = 0xfffffe078ac3bb80 gs32p = 0xffffffff815f2c08 ldt = 0xffffffff815f2c48 tss = 0xffffffff815f2c38 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe087b220280 curthread = 0xfffff8000b230490: pid 11 "idle: cpu5" curpcb = 0xfffffe078ac40b80 fpcurthread = none idlethread = 0xfffff8000b230490: tid 100008 "idle: cpu5" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1218 commontssp = 0xffffffff815f1218 rsp0 = 0xfffffe078ac40b80 gs32p = 0xffffffff815f2c70 ldt = 0xffffffff815f2cb0 tss = 0xffffffff815f2ca0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe087b227280 curthread = 0xfffff8000b230000: pid 11 "idle: cpu6" curpcb = 0xfffffe078ac45b80 fpcurthread = none idlethread = 0xfffff8000b230000: tid 100009 "idle: cpu6" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1280 commontssp = 0xffffffff815f1280 rsp0 = 0xfffffe078ac45b80 gs32p = 0xffffffff815f2cd8 ldt = 0xffffffff815f2d18 tss = 0xffffffff815f2d08 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe087b22e280 curthread = 0xfffff8000b222920: pid 11 "idle: cpu7" curpcb = 0xfffffe078ac4ab80 fpcurthread = none idlethread = 0xfffff8000b222920: tid 100010 "idle: cpu7" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f12e8 commontssp = 0xffffffff815f12e8 rsp0 = 0xfffffe078ac4ab80 gs32p = 0xffffffff815f2d40 ldt = 0xffffffff815f2d80 tss = 0xffffffff815f2d70 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe087b235280 curthread = 0xfffff8000b232920: pid 11 "idle: cpu8" curpcb = 0xfffffe078ac4fb80 fpcurthread = none idlethread = 0xfffff8000b232920: tid 100011 "idle: cpu8" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1350 commontssp = 0xffffffff815f1350 rsp0 = 0xfffffe078ac4fb80 gs32p = 0xffffffff815f2da8 ldt = 0xffffffff815f2de8 tss = 0xffffffff815f2dd8 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe087b23c280 curthread = 0xfffff8000b232490: pid 11 "idle: cpu9" curpcb = 0xfffffe078ac54b80 fpcurthread = none idlethread = 0xfffff8000b232490: tid 100012 "idle: cpu9" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f13b8 commontssp = 0xffffffff815f13b8 rsp0 = 0xfffffe078ac54b80 gs32p = 0xffffffff815f2e10 ldt = 0xffffffff815f2e50 tss = 0xffffffff815f2e40 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe087b243280 curthread = 0xfffff8000b232000: pid 11 "idle: cpu10" curpcb = 0xfffffe078ac59b80 fpcurthread = none idlethread = 0xfffff8000b232000: tid 100013 "idle: cpu10" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1420 commontssp = 0xffffffff815f1420 rsp0 = 0xfffffe078ac59b80 gs32p = 0xffffffff815f2e78 ldt = 0xffffffff815f2eb8 tss = 0xffffffff815f2ea8 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe087b24a280 curthread = 0xfffff80015c72920: pid 1200 "grep" curpcb = 0xfffffe081e1c7b80 fpcurthread = 0xfffff80015c72920: pid 1200 "grep" idlethread = 0xfffff8000b231920: tid 100014 "idle: cpu11" curpmap = 0xfffff80015929468 tssp = 0xffffffff815f1488 commontssp = 0xffffffff815f1488 rsp0 = 0xfffffe081e1c7b80 gs32p = 0xffffffff815f2ee0 ldt = 0xffffffff815f2f20 tss = 0xffffffff815f2f10 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe087b251280 curthread = 0xfffff8000b231490: pid 11 "idle: cpu12" curpcb = 0xfffffe078ac63b80 fpcurthread = none idlethread = 0xfffff8000b231490: tid 100015 "idle: cpu12" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f14f0 commontssp = 0xffffffff815f14f0 rsp0 = 0xfffffe078ac63b80 gs32p = 0xffffffff815f2f48 ldt = 0xffffffff815f2f88 tss = 0xffffffff815f2f78 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe087b258280 curthread = 0xfffff8000b234490: pid 11 "idle: cpu13" curpcb = 0xfffffe078ac68b80 fpcurthread = none idlethread = 0xfffff8000b234490: tid 100016 "idle: cpu13" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1558 commontssp = 0xffffffff815f1558 rsp0 = 0xfffffe078ac68b80 gs32p = 0xffffffff815f2fb0 ldt = 0xffffffff815f2ff0 tss = 0xffffffff815f2fe0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe087b25f280 curthread = 0xfffff8000b234000: pid 11 "idle: cpu14" curpcb = 0xfffffe078ac6db80 fpcurthread = none idlethread = 0xfffff8000b234000: tid 100017 "idle: cpu14" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f15c0 commontssp = 0xffffffff815f15c0 rsp0 = 0xfffffe078ac6db80 gs32p = 0xffffffff815f3018 ldt = 0xffffffff815f3058 tss = 0xffffffff815f3048 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe087b266280 curthread = 0xfffff8000b233920: pid 11 "idle: cpu15" curpcb = 0xfffffe078ac72b80 fpcurthread = none idlethread = 0xfffff8000b233920: tid 100018 "idle: cpu15" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1628 commontssp = 0xffffffff815f1628 rsp0 = 0xfffffe078ac72b80 gs32p = 0xffffffff815f3080 ldt = 0xffffffff815f30c0 tss = 0xffffffff815f30b0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe087b26d280 curthread = 0xfffff8000b233490: pid 11 "idle: cpu16" curpcb = 0xfffffe078ac77b80 fpcurthread = none idlethread = 0xfffff8000b233490: tid 100019 "idle: cpu16" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1690 commontssp = 0xffffffff815f1690 rsp0 = 0xfffffe078ac77b80 gs32p = 0xffffffff815f30e8 ldt = 0xffffffff815f3128 tss = 0xffffffff815f3118 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe087b274280 curthread = 0xfffff8000b233000: pid 11 "idle: cpu17" curpcb = 0xfffffe078ac7cb80 fpcurthread = none idlethread = 0xfffff8000b233000: tid 100020 "idle: cpu17" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f16f8 commontssp = 0xffffffff815f16f8 rsp0 = 0xfffffe078ac7cb80 gs32p = 0xffffffff815f3150 ldt = 0xffffffff815f3190 tss = 0xffffffff815f3180 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe087b27b280 curthread = 0xfffff8000b23a000: pid 11 "idle: cpu18" curpcb = 0xfffffe078ac81b80 fpcurthread = none idlethread = 0xfffff8000b23a000: tid 100021 "idle: cpu18" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1760 commontssp = 0xffffffff815f1760 rsp0 = 0xfffffe078ac81b80 gs32p = 0xffffffff815f31b8 ldt = 0xffffffff815f31f8 tss = 0xffffffff815f31e8 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe087b282280 curthread = 0xfffff80015c66920: pid 1199 "mount" curpcb = 0xfffffe081e05cb80 fpcurthread = none idlethread = 0xfffff8000b235920: tid 100022 "idle: cpu19" curpmap = 0xfffff80015b65798 tssp = 0xffffffff815f17c8 commontssp = 0xffffffff815f17c8 rsp0 = 0xfffffe081e05cb80 gs32p = 0xffffffff815f3220 ldt = 0xffffffff815f3260 tss = 0xffffffff815f3250 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe087b289280 curthread = 0xfffff8000b235490: pid 11 "idle: cpu20" curpcb = 0xfffffe078ac8bb80 fpcurthread = none idlethread = 0xfffff8000b235490: tid 100023 "idle: cpu20" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1830 commontssp = 0xffffffff815f1830 rsp0 = 0xfffffe078ac8bb80 gs32p = 0xffffffff815f3288 ldt = 0xffffffff815f32c8 tss = 0xffffffff815f32b8 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe087b290280 curthread = 0xfffff8000b235000: pid 11 "idle: cpu21" curpcb = 0xfffffe078ac90b80 fpcurthread = none idlethread = 0xfffff8000b235000: tid 100024 "idle: cpu21" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1898 commontssp = 0xffffffff815f1898 rsp0 = 0xfffffe078ac90b80 gs32p = 0xffffffff815f32f0 ldt = 0xffffffff815f3330 tss = 0xffffffff815f3320 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe087b297280 curthread = 0xfffff8000b234920: pid 11 "idle: cpu22" curpcb = 0xfffffe078ac95b80 fpcurthread = none idlethread = 0xfffff8000b234920: tid 100025 "idle: cpu22" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1900 commontssp = 0xffffffff815f1900 rsp0 = 0xfffffe078ac95b80 gs32p = 0xffffffff815f3358 ldt = 0xffffffff815f3398 tss = 0xffffffff815f3388 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe087b29e280 curthread = 0xfffff8000b23b920: pid 11 "idle: cpu23" curpcb = 0xfffffe078ac9ab80 fpcurthread = none idlethread = 0xfffff8000b23b920: tid 100026 "idle: cpu23" curpmap = 0xffffffff815d9b08 tssp = 0xffffffff815f1968 commontssp = 0xffffffff815f1968 rsp0 = 0xfffffe078ac9ab80 gs32p = 0xffffffff815f33c0 ldt = 0xffffffff815f3400 tss = 0xffffffff815f33f0 spin locks held: db:0:allpcpu> show alllocks Process 1200 (grep) thread 0xfffff80015c72920 (100213) exclusive sleep mutex pmap (pmap) r = 0 (0xfffff80015929468) locked @ amd64/amd64/pmap.c:3552 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff81583f00) locked @ amd64/amd64/pmap.c:3551 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff800159293b0) locked @ vm/vm_map.c:3816 Process 1199 (mount) thread 0xfffff80015c66920 (100143) exclusive sleep mutex pmap (pmap) r = 0 (0xfffff8002b1fc600) locked @ amd64/amd64/pmap.c:4789 exclusive rw pmap pv list (pmap pv list) r = 0 (0xffffffff815846c0) locked @ amd64/amd64/pmap.c:4784 shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff81583f00) locked @ amd64/amd64/pmap.c:4780 exclusive rw vm object (vm object) r = 0 (0xfffff800159c0700) locked @ kern/vfs_subr.c:2531 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80069e48c98) locked @ kern/vfs_subr.c:2510 exclusive sleep mutex Giant (Giant) r = 0 (0xffffffff815d9f28) locked @ kern/vfs_mount.c:1094 db:0:alllocks> show lockedvnods Locked vnodes 0xfffff80069e48c30: tag ufs, type VREG usecount 1, writecount 1, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff800159c0700 ref 1 pages 1608 lock type ufs: EXCL by thread 0xfffff80015c66920 (pid 1199, mount, tid 100143) #0 0xffffffff8089e4a9 at __lockmgr_args+0x9a9 #1 0xffffffff80b142f2 at ffs_lock+0x92 #2 0xffffffff80d66825 at VOP_LOCK1_APV+0xf5 #3 0xffffffff80978746 at _vn_lock+0xc6 #4 0xffffffff8096509a at vflush+0x19a #5 0xffffffff80b0f711 at ffs_flushfiles+0x101 #6 0xffffffff80af7f5f at softdep_flushfiles+0x17f #7 0xffffffff80b10808 at ffs_mount+0x6b8 #8 0xffffffff80959d3e at vfs_donmount+0xf3e #9 0xffffffff80958dd2 at sys_nmount+0x72 #10 0xffffffff80cbba52 at amd64_syscall+0x282 #11 0xffffffff80c9ed9b at Xfast_syscall+0xfb ino 4, on dev md5a db:0:lockedvnods> show mount 0xfffff800155dab58 /dev/da0p2 on / (ufs) 0xfffff800155db000 devfs on /dev (devfs) 0xfffff8002b02c3c8 /dev/da0p3 on /tmp (ufs) 0xfffff8002b03d790 procfs on /proc (procfs) 0xfffff80069e5a790 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1200 1175 1058 0 RL+ CPU 11 grep 1199 1175 1058 0 R+ CPU 19 mount 1197 1175 1058 65534 S+ nanslp 0xffffffff81386961 mountu 1192 0 0 0 DL mdwait 0xfffff80015d8c800 [md5] 1175 1058 1058 0 S+ wait 0xfffff80069af7970 sh 1058 1055 1058 0 S+ wait 0xfffff80015a24000 sh 1055 1053 1055 0 S+ wait 0xfffff80015986000 bash 1053 1052 1053 0 S+ pause 0xfffff8002b146560 csh 1052 1048 1052 1001 S+ wait 0xfffff8001585a4b8 su 1048 1047 1048 1001 Ss+ wait 0xfffff80015bd94b8 bash 1047 1045 1045 1001 S select 0xfffff8001509adc0 sshd 1045 952 1045 0 Ss select 0xfffff80015a31940 sshd 1043 1 1043 0 Ss+ ttyin 0xfffff8000b34a8a8 getty 1042 1 1042 0 Ss+ ttyin 0xfffff8000b34aca8 getty 1041 1 1041 0 Ss+ ttyin 0xfffff8000b34b0a8 getty 1040 1 1040 0 Ss+ ttyin 0xfffff8000b34b4a8 getty 1039 1 1039 0 Ss+ ttyin 0xfffff8000b34b8a8 getty 1038 1 1038 0 Ss+ ttyin 0xfffff8000b34bca8 getty 1037 1 1037 0 Ss+ ttyin 0xfffff8000b34c0a8 getty 1036 1 1036 0 Ss+ ttyin 0xfffff8000b34c4a8 getty 1035 1 1035 0 Ss+ ttyin 0xfffff8000b34c8a8 getty 962 1 962 0 Ss nanslp 0xffffffff81386967 cron 958 1 958 25 Ss pause 0xfffff8002b147a18 sendmail 955 1 955 0 Ss select 0xfffff80015f47240 sendmail 952 1 952 0 Ss select 0xfffff800695835c0 sshd 924 1 924 0 Ss select 0xfffff800695836c0 powerd 921 1 921 0 Ss select 0xfffff80015c70940 ntpd 883 881 881 0 S (threaded) nfsd 100200 S rpcsvc 0xfffff80069642ea0 nfsd: service 100199 S rpcsvc 0xfffff80069642f20 nfsd: service 100198 S rpcsvc 0xfffff800696f3020 nfsd: service 100197 S rpcsvc 0xfffff80069ab0d20 nfsd: master 881 1 881 0 Ss select 0xfffff800159941c0 nfsd 875 1 875 0 Ss select 0xfffff800695837c0 mountd 868 864 864 0 S select 0xfffff80015866d40 nfsuserd 867 864 864 0 S select 0xfffff800696c4640 nfsuserd 866 864 864 0 S select 0xfffff80015fdf1c0 nfsuserd 865 864 864 0 S select 0xfffff80015f473c0 nfsuserd 864 1 864 0 Ss pause 0xfffff800698880a8 nfsuserd 834 1 834 0 Ss select 0xfffff8002b101540 rpcbind 821 1 821 0 Ss select 0xfffff80015a31e40 syslogd 692 1 692 0 Ss select 0xfffff80015ac4e40 devd 675 1 675 0 Ss select 0xfffff80069699540 moused 17 0 0 0 DL sdflush 0xffffffff8157ca04 [softdepflush] 16 0 0 0 DL vlruwt 0xfffff8001514a4b8 [vnlru] 9 0 0 0 DL syncer 0xffffffff81575d30 [syncer] 8 0 0 0 DL psleep 0xffffffff81575704 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff8157e00c [pagezero] 6 0 0 0 DL psleep 0xffffffff8157d740 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815f0884 [pagedaemon] 4 0 0 0 DL idle 0xfffff8000b220970 [enc_daemon0] 3 0 0 0 DL ccb_scan 0xffffffff8134fbb0 [xpt_thrd] 2 0 0 0 DL waiting_ 0xffffffff815e4688 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100119 D - 0xfffffe0001163e18 [usbus2] 100118 D - 0xfffffe0001163dc0 [usbus2] 100117 D - 0xfffffe0001163d68 [usbus2] 100116 D - 0xfffffe0001163d10 [usbus2] 100114 D - 0xfffffe000115c1b0 [usbus1] 100113 D - 0xfffffe000115c158 [usbus1] 100112 D - 0xfffffe000115c100 [usbus1] 100111 D - 0xfffffe000115c0a8 [usbus1] 100074 D - 0xfffffe0000ea9e18 [usbus0] 100073 D - 0xfffffe0000ea9dc0 [usbus0] 100072 D - 0xfffffe0000ea9d68 [usbus0] 100071 D - 0xfffffe0000ea9d10 [usbus0] 14 0 0 0 DL - 0xffffffff81368e08 [yarrow] 13 0 0 0 DL (threaded) [geom] 100055 D - 0xffffffff815d8f98 [g_down] 100054 D - 0xffffffff815d8f90 [g_up] 100053 D - 0xffffffff815d8f88 [g_event] 12 0 0 0 WL (threaded) [intr] 100122 I [swi0: uart] 100121 I [irq287: hdac1] 100120 I [irq286: ahci0] 100115 I [irq20: ehci1] 100110 I [irq285: xhci0] 100109 I [irq284: igb1:link] 100107 I [irq283: igb1:que 7] 100105 I [irq282: igb1:que 6] 100103 I [irq281: igb1:que 5] 100101 I [irq280: igb1:que 4] 100099 I [irq279: igb1:que 3] 100097 I [irq278: igb1:que 2] 100095 I [irq277: igb1:que 1] 100093 I [irq276: igb1:que 0] 100092 I [irq275: igb0:link] 100090 I [irq274: igb0:que 7] 100088 I [irq273: igb0:que 6] 100086 I [irq272: igb0:que 5] 100084 I [irq271: igb0:que 4] 100082 I [irq270: igb0:que 3] 100080 I [irq269: igb0:que 2] 100078 I [irq268: igb0:que 1] 100076 I [irq267: igb0:que 0] 100075 I [irq266: hdac0] 100070 I [irq22: ehci0] 100069 I [irq265: isci0] 100068 I [irq264: isci0] 100067 I [swi6: task queue] 100062 I [swi2: cambio] 100061 I [swi5: fast taskq] 100058 I [swi6: Giant taskq] 100052 I [swi4: clock] 100051 I [swi4: clock] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi3: vm] 100027 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100026 Run CPU 23 [idle: cpu23] 100025 Run CPU 22 [idle: cpu22] 100024 Run CPU 21 [idle: cpu21] 100023 Run CPU 20 [idle: cpu20] 100022 CanRun [idle: cpu19] 100021 Run CPU 18 [idle: cpu18] 100020 Run CPU 17 [idle: cpu17] 100019 Run CPU 16 [idle: cpu16] 100018 Run CPU 15 [idle: cpu15] 100017 Run CPU 14 [idle: cpu14] 100016 Run CPU 13 [idle: cpu13] 100015 Run CPU 12 [idle: cpu12] 100014 CanRun [idle: cpu11] 100013 Run CPU 10 [idle: cpu10] 100012 Run CPU 9 [idle: cpu9] 100011 Run CPU 8 [idle: cpu8] 100010 Run CPU 7 [idle: cpu7] 100009 Run CPU 6 [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 Run CPU 4 [idle: cpu4] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffff8000b220000 [init] 10 0 0 0 DL audit_wo 0xffffffff815e7df8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100124 D - 0xffffffff813857b1 [deadlkres] 100123 D - 0xfffff80014094b00 [mca taskq] 100108 D - 0xfffff8000c86aa00 [igb1 que] 100106 D - 0xfffff8000c86ad00 [igb1 que] 100104 D - 0xfffff8000c86b100 [igb1 que] 100102 D - 0xfffff8000c86b400 [igb1 que] 100100 D - 0xfffff8000c86b700 [igb1 que] 100098 D - 0xfffff8000c86ba00 [igb1 que] 100096 D - 0xfffff8000c86bd00 [igb1 que] 100094 D - 0xfffff8000c86c100 [igb1 que] 100091 D - 0xfffff8000c86c500 [igb0 que] 100089 D - 0xfffff8000c86c800 [igb0 que] 100087 D - 0xfffff8000c86cb00 [igb0 que] 100085 D - 0xfffff8000c86ce00 [igb0 que] 100083 D - 0xfffff8000c86d200 [igb0 que] 100081 D - 0xfffff8000c86d500 [igb0 que] 100079 D - 0xfffff8000c7d4600 [igb0 que] 100077 D - 0xfffff8000c7d4900 [igb0 que] 100066 D - 0xfffff8000b40e300 [kqueue taskq] 100065 D - 0xfffff8000b40e700 [acpi_task_2] 100064 D - 0xfffff8000b40e700 [acpi_task_1] 100063 D - 0xfffff8000b40e700 [acpi_task_0] 100060 D - 0xfffff8000b40ec00 [ffs_trim taskq] 100059 D - 0xfffff8000b40ee00 [thread taskq] 100056 D - 0xfffff8000b213300 [firmware taskq] 100000 D swapin 0xffffffff815d9098 [swapper] db:0:ps> allt Tracing command grep pid 1200 tid 100213 td 0xfffff80015c72920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc597ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc597d00 trap() at trap+0x42/frame 0xfffffe07fc597f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc597f20 --- trap 0x13, rip = 0xffffffff808b8786, rsp = 0xfffffe07fc597fe0, rbp = 0xfffffe081e1c7430 --- __curthread() at __curthread+0x16/frame 0xfffffe081e1c7430 _rw_wlock_cookie() at _rw_wlock_cookie+0x64/frame 0xfffffe081e1c7480 pmap_enter() at pmap_enter+0x748/frame 0xfffffe081e1c7550 vm_fault_hold() at vm_fault_hold+0x178e/frame 0xfffffe081e1c77a0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1c77e0 trap_pfault() at trap_pfault+0x1bb/frame 0xfffffe081e1c7890 trap() at trap+0x52b/frame 0xfffffe081e1c7ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e1c7ab0 --- trap 0xc, rip = 0x800f08420, rsp = 0x7fffffffca60, rbp = 0x7fffffffcac0 --- Tracing command mount pid 1199 tid 100143 td 0xfffff80015c66920 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e05bdc0 vpanic() at vpanic+0x146/frame 0xfffffe081e05be00 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e05be70 __rw_wlock_hard() at __rw_wlock_hard+0x12c/frame 0xfffffe081e05bfa0 _rw_wlock_cookie() at _rw_wlock_cookie+0x177/frame 0xfffffe081e05bff0 pmap_pv_demote_pde() at pmap_pv_demote_pde+0x137/frame 0xfffffe081e05c080 pmap_demote_pde_locked() at pmap_demote_pde_locked+0x4a3/frame 0xfffffe081e05c110 pmap_demote_pde() at pmap_demote_pde+0x31/frame 0xfffffe081e05c150 pmap_remove_write() at pmap_remove_write+0x2c4/frame 0xfffffe081e05c1c0 vm_object_page_remove_write() at vm_object_page_remove_write+0x61/frame 0xfffffe081e05c1f0 vm_object_page_clean() at vm_object_page_clean+0x22f/frame 0xfffffe081e05c280 vflush() at vflush+0x2c0/frame 0xfffffe081e05c3c0 ffs_flushfiles() at ffs_flushfiles+0x101/frame 0xfffffe081e05c430 softdep_flushfiles() at softdep_flushfiles+0x17f/frame 0xfffffe081e05c490 ffs_mount() at ffs_mount+0x6b8/frame 0xfffffe081e05c6b0 vfs_donmount() at vfs_donmount+0xf3e/frame 0xfffffe081e05c960 sys_nmount() at sys_nmount+0x72/frame 0xfffffe081e05c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e05cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e05cab0 --- syscall (378, FreeBSD ELF64, sys_nmount), rip = 0x800a9df8a, rsp = 0x7fffffffc708, rbp = 0x7fffffffcc70 --- Tracing command mountu pid 1197 tid 100237 td 0xfffff80069b3e490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e240750 mi_switch() at mi_switch+0x179/frame 0xfffffe081e240790 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e2407d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e240840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e240870 _sleep() at _sleep+0x300/frame 0xfffffe081e240900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe081e240960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe081e2409a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e240ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e240ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800929d5a, rsp = 0x7fffffffd6a8, rbp = 0x7fffffffd700 --- Tracing command md5 pid 1192 tid 100155 td 0xfffff80015e96490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0988e0 mi_switch() at mi_switch+0x179/frame 0xfffffe081e098920 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e098960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081e098990 _sleep() at _sleep+0x33d/frame 0xfffffe081e098a20 md_kthread() at md_kthread+0xd5/frame 0xfffffe081e098a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e098ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e098ab0 --- trap 0, rip = 0, rsp = 0xfffffe081e098b70, rbp = 0 --- Tracing command sh pid 1175 tid 100242 td 0xfffff80069b3e000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e259560 mi_switch() at mi_switch+0x179/frame 0xfffffe081e2595a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e2595e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e259650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e259680 _sleep() at _sleep+0x320/frame 0xfffffe081e259710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081e2597b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081e2599a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e259ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e259ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d39eda, rsp = 0x7fffffffd5f8, rbp = 0x7fffffffd6a0 --- Tracing command sh pid 1058 tid 100138 td 0xfffff80015a33490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e043560 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0435a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0435e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e043650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e043680 _sleep() at _sleep+0x320/frame 0xfffffe081e043710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081e0437b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081e0439a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e043ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e043ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d39eda, rsp = 0x7fffffffd3c8, rbp = 0x7fffffffd470 --- Tracing command bash pid 1055 tid 100165 td 0xfffff80015989490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0ca560 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0ca5a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0ca5e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0ca650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0ca680 _sleep() at _sleep+0x320/frame 0xfffffe081e0ca710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081e0ca7b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081e0ca9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0caab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0caab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8010a2eda, rsp = 0x7fffffffd278, rbp = 0x7fffffffd2c0 --- Tracing command csh pid 1053 tid 100182 td 0xfffff8002b138920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e11f760 mi_switch() at mi_switch+0x179/frame 0xfffffe081e11f7a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e11f7e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e11f850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e11f880 _sleep() at _sleep+0x320/frame 0xfffffe081e11f910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xfffffe081e11f970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe081e11f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e11fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e11fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800d4a22a, rsp = 0x7fffffffcde8, rbp = 0x7fffffffce60 --- Tracing command su pid 1052 tid 100157 td 0xfffff8001585c920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0a2560 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0a25a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0a25e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0a2650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0a2680 _sleep() at _sleep+0x320/frame 0xfffffe081e0a2710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081e0a27b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081e0a29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0a2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0a2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800edbeda, rsp = 0x7fffffffd478, rbp = 0x7fffffffd9f0 --- Tracing command bash pid 1048 tid 100209 td 0xfffff80015be1920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1b3560 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1b35a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1b35e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1b3650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1b3680 _sleep() at _sleep+0x320/frame 0xfffffe081e1b3710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081e1b37b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081e1b39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1b3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1b3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8010a2eda, rsp = 0x7fffffffd4d8, rbp = 0x7fffffffd520 --- Tracing command sshd pid 1047 tid 100226 td 0xfffff800695ae000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e209590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e2095d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e209610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e209680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e2096b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e209720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e209760 kern_select() at kern_select+0x892/frame 0xfffffe081e209960 sys_select() at sys_select+0x54/frame 0xfffffe081e2099a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e209ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e209ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1045 tid 100225 td 0xfffff80069eda490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e204630 mi_switch() at mi_switch+0x179/frame 0xfffffe081e204670 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e2046b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e204720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e204750 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e2047c0 seltdwait() at seltdwait+0x78/frame 0xfffffe081e204800 sys_poll() at sys_poll+0x37c/frame 0xfffffe081e2049a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e204ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e204ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80251508a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command getty pid 1043 tid 100150 td 0xfffff80015c66490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e07f620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e07f660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e07f6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e07f710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e07f740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e07f7b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e07f7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e07f840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e07f870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e07f8d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e07f910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e07f950 sys_read() at sys_read+0x63/frame 0xfffffe081e07f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e07fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e07fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1042 tid 100219 td 0xfffff80069eda920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1e5620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1e5660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1e56a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1e5710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1e5740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1e57b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1e57e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1e5840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1e5870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1e58d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1e5910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1e5950 sys_read() at sys_read+0x63/frame 0xfffffe081e1e59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1e5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1e5ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1041 tid 100137 td 0xfffff80015989920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e03e620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e03e660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e03e6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e03e710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e03e740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e03e7b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e03e7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e03e840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e03e870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e03e8d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e03e910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e03e950 sys_read() at sys_read+0x63/frame 0xfffffe081e03e9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e03eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e03eab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1040 tid 100216 td 0xfffff80069dd3000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1d6620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1d6660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1d66a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1d6710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1d6740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1d67b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1d67e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1d6840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1d6870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1d68d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1d6910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1d6950 sys_read() at sys_read+0x63/frame 0xfffffe081e1d69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1d6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1d6ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1039 tid 100224 td 0xfffff80069b3f920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1fe620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1fe660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1fe6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1fe710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1fe740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1fe7b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1fe7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1fe840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1fe870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1fe8d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1fe910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1fe950 sys_read() at sys_read+0x63/frame 0xfffffe081e1fe9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1feab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1feab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1038 tid 100223 td 0xfffff80069dd2000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1f9620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1f9660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1f96a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1f9710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1f9740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1f97b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1f97e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1f9840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1f9870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1f98d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1f9910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1f9950 sys_read() at sys_read+0x63/frame 0xfffffe081e1f99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1f9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1f9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1037 tid 100222 td 0xfffff80069dd2490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1f4620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1f4660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1f46a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1f4710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1f4740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1f47b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1f47e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1f4840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1f4870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1f48d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1f4910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1f4950 sys_read() at sys_read+0x63/frame 0xfffffe081e1f49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1f4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1f4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1036 tid 100221 td 0xfffff80069dd2920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1ef620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1ef660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1ef6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1ef710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1ef740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1ef7b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1ef7e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e1ef840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e1ef870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1ef8d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e1ef910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e1ef950 sys_read() at sys_read+0x63/frame 0xfffffe081e1ef9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1efab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1efab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1035 tid 100187 td 0xfffff8006969a000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e145620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e145660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1456a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e145710 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e145740 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1457b0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e1457e0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e145840 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e145870 devfs_read_f() at devfs_read_f+0x7f/frame 0xfffffe081e1458d0 dofileread() at dofileread+0x7b/frame 0xfffffe081e145910 kern_readv() at kern_readv+0x48/frame 0xfffffe081e145950 sys_read() at sys_read+0x63/frame 0xfffffe081e1459a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e145ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e145ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fcaa, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command cron pid 962 tid 100212 td 0xfffff80015dac000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1c2750 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1c2790 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1c27d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1c2840 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e1c2870 _sleep() at _sleep+0x300/frame 0xfffffe081e1c2900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe081e1c2960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe081e1c29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1c2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1c2ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d4ed5a, rsp = 0x7fffffffdb28, rbp = 0x7fffffffdd00 --- Tracing command sendmail pid 958 tid 100210 td 0xfffff8002b1f6000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1b8760 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1b87a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1b87e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1b8850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1b8880 _sleep() at _sleep+0x320/frame 0xfffffe081e1b8910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xfffffe081e1b8970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe081e1b89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1b8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1b8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80139822a, rsp = 0x7fffffffc818, rbp = 0x7fffffffc830 --- Tracing command sendmail pid 955 tid 100202 td 0xfffff80069b04920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e190580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1905c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e190600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e190670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e1906a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e190720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e190760 kern_select() at kern_select+0x892/frame 0xfffffe081e190960 sys_select() at sys_select+0x54/frame 0xfffffe081e1909a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e190ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e190ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801459c2a, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 952 tid 100208 td 0xfffff8002b1f6490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e1ae590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1ae5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1ae610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e1ae680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1ae6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e1ae720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e1ae760 kern_select() at kern_select+0x892/frame 0xfffffe081e1ae960 sys_select() at sys_select+0x54/frame 0xfffffe081e1ae9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e1aeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e1aeab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80257cc2a, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 924 tid 100163 td 0xfffff8002b060490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0c0580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0c05c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0c0600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0c0670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e0c06a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e0c0720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e0c0760 kern_select() at kern_select+0x892/frame 0xfffffe081e0c0960 sys_select() at sys_select+0x54/frame 0xfffffe081e0c09a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0c0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0c0ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5dc2a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 921 tid 100171 td 0xfffff80015913920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0e8590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0e85d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0e8610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0e8680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0e86b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e0e8720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e0e8760 kern_select() at kern_select+0x892/frame 0xfffffe081e0e8960 sys_select() at sys_select+0x54/frame 0xfffffe081e0e89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0e8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0e8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c8c2a, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 883 tid 100200 td 0xfffff80015fda000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e186730 mi_switch() at mi_switch+0x179/frame 0xfffffe081e186770 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1867b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e186820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e186850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e1868d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xfffffe081e186a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e186a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e186ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e186ab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100199 td 0xfffff80015fda490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e181730 mi_switch() at mi_switch+0x179/frame 0xfffffe081e181770 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1817b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e181820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e181850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e1818d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xfffffe081e181a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e181a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e181ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e181ab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100198 td 0xfffff80015fda920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e17c730 mi_switch() at mi_switch+0x179/frame 0xfffffe081e17c770 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e17c7b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e17c820 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e17c850 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e17c8d0 svc_run_internal() at svc_run_internal+0x9c7/frame 0xfffffe081e17ca60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e17ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e17cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e17cab0 --- trap 0xc, rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100197 td 0xfffff80015923490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e176ea0 mi_switch() at mi_switch+0x179/frame 0xfffffe081e176ee0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e176f20 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e176f90 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e176fc0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e177040 svc_run_internal() at svc_run_internal+0x9c7/frame 0xfffffe081e1771d0 svc_run() at svc_run+0xd4/frame 0xfffffe081e177210 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xfffffe081e177370 nfssvc_nfsd() at nfssvc_nfsd+0x103/frame 0xfffffe081e177970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xfffffe081e1779a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e177ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e177ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x80088be8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 881 tid 100173 td 0xfffff8001585c000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0f2590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0f25d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0f2610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0f2680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0f26b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e0f2720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e0f2760 kern_select() at kern_select+0x892/frame 0xfffffe081e0f2960 sys_select() at sys_select+0x54/frame 0xfffffe081e0f29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0f2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0f2ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094cc2a, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 875 tid 100172 td 0xfffff80015dac920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0ed590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0ed5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0ed610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0ed680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0ed6b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e0ed720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e0ed760 kern_select() at kern_select+0x892/frame 0xfffffe081e0ed960 sys_select() at sys_select+0x54/frame 0xfffffe081e0ed9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0edab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0edab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b64c2a, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 868 tid 100196 td 0xfffff80069a03920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e172580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1725c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e172600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e172670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e1726a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e172720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e172760 kern_select() at kern_select+0x892/frame 0xfffffe081e172960 sys_select() at sys_select+0x54/frame 0xfffffe081e1729a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e172ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e172ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 867 tid 100195 td 0xfffff80069a0f000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e16d580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e16d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e16d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e16d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e16d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e16d720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e16d760 kern_select() at kern_select+0x892/frame 0xfffffe081e16d960 sys_select() at sys_select+0x54/frame 0xfffffe081e16d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e16dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e16dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 866 tid 100145 td 0xfffff80015d35490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e066580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0665c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e066600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e066670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e0666a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e066720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e066760 kern_select() at kern_select+0x892/frame 0xfffffe081e066960 sys_select() at sys_select+0x54/frame 0xfffffe081e0669a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e066ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e066ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 865 tid 100164 td 0xfffff80015fee920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0c5580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0c55c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0c5600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0c5670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e0c56a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e0c5720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e0c5760 kern_select() at kern_select+0x892/frame 0xfffffe081e0c5960 sys_select() at sys_select+0x54/frame 0xfffffe081e0c59a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0c5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0c5ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094bc2a, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 864 tid 100194 td 0xfffff800695ae490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e168760 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1687a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e1687e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e168850 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e168880 _sleep() at _sleep+0x320/frame 0xfffffe081e168910 kern_sigsuspend() at kern_sigsuspend+0xcd/frame 0xfffffe081e168970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe081e1689a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e168ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e168ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80088a22a, rsp = 0x7fffffffdb38, rbp = 0x7fffffffdd00 --- Tracing command rpcbind pid 834 tid 100188 td 0xfffff80015b83000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e14a620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e14a660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e14a6a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e14a710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e14a740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e14a7c0 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e14a800 sys_poll() at sys_poll+0x37c/frame 0xfffffe081e14a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e14aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e14aab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800d0508a, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command syslogd pid 821 tid 100190 td 0xfffff80015a27000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e154590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1545d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e154610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e154680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1546b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e154720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e154760 kern_select() at kern_select+0x892/frame 0xfffffe081e154960 sys_select() at sys_select+0x54/frame 0xfffffe081e1549a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e154ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e154ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b62c2a, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 692 tid 100161 td 0xfffff80015bed000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0b6580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0b65c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0b6600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0b6670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e0b66a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fe/frame 0xfffffe081e0b6720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e0b6760 kern_select() at kern_select+0x892/frame 0xfffffe081e0b6960 sys_select() at sys_select+0x54/frame 0xfffffe081e0b69a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0b6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0b6ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x44cb6a, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 675 tid 100179 td 0xfffff80015913490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e110590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e1105d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e110610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e110680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e1106b0 _cv_wait_sig() at _cv_wait_sig+0x1e2/frame 0xfffffe081e110720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e110760 kern_select() at kern_select+0x892/frame 0xfffffe081e110960 sys_select() at sys_select+0x54/frame 0xfffffe081e1109a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e110ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e110ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d88c2a, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100134 td 0xfffff80015097920 sched_switch() at sched_switch+0x482/frame 0xfffffe081de938f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081de93930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081de93970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081de939a0 _sleep() at _sleep+0x312/frame 0xfffffe081de93a30 softdep_flush() at softdep_flush+0x20c/frame 0xfffffe081de93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081de93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081de93ab0 --- trap 0, rip = 0, rsp = 0xfffffe081de93b70, rbp = 0 --- Tracing command vnlru pid 16 tid 100133 td 0xfffff80015146000 sched_switch() at sched_switch+0x482/frame 0xfffffe081de8e8c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081de8e900 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081de8e940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081de8e970 _sleep() at _sleep+0x312/frame 0xfffffe081de8ea00 vnlru_proc() at vnlru_proc+0x11c/frame 0xfffffe081de8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081de8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081de8eab0 --- trap 0, rip = 0, rsp = 0xfffffe081de8eb70, rbp = 0 --- Tracing command syncer pid 9 tid 100132 td 0xfffff80015146490 sched_switch() at sched_switch+0x482/frame 0xfffffe081de898b0 mi_switch() at mi_switch+0x179/frame 0xfffffe081de898f0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081de89930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081de89960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fe/frame 0xfffffe081de899e0 sched_sync() at sched_sync+0x5e6/frame 0xfffffe081de89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081de89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081de89ab0 --- trap 0, rip = 0, rsp = 0xfffffe081de89b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100131 td 0xfffff80015146920 sched_switch() at sched_switch+0x482/frame 0xfffffe081de84900 mi_switch() at mi_switch+0x179/frame 0xfffffe081de84940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081de84980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081de849b0 _sleep() at _sleep+0x312/frame 0xfffffe081de84a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe081de84a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081de84ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081de84ab0 --- trap 0, rip = 0, rsp = 0xfffffe081de84b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100130 td 0xfffff80014001920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ddff900 mi_switch() at mi_switch+0x179/frame 0xfffffe081ddff940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ddff980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081ddff9b0 _sleep() at _sleep+0x312/frame 0xfffffe081ddffa40 vm_pagezero() at vm_pagezero+0x88/frame 0xfffffe081ddffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ddffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ddffab0 --- trap 0, rip = 0, rsp = 0xfffffe081ddffb70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100129 td 0xfffff80015096000 sched_switch() at sched_switch+0x482/frame 0xfffffe081ddfa8c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081ddfa900 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ddfa940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ddfa970 _sleep() at _sleep+0x33d/frame 0xfffffe081ddfaa00 vm_daemon() at vm_daemon+0x7e/frame 0xfffffe081ddfaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ddfaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ddfaab0 --- trap 0, rip = 0, rsp = 0xfffffe081ddfab70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100128 td 0xfffff80015096490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ddf58a0 mi_switch() at mi_switch+0x179/frame 0xfffffe081ddf58e0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ddf5920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081ddf5950 _sleep() at _sleep+0x312/frame 0xfffffe081ddf59e0 vm_pageout() at vm_pageout+0x237/frame 0xfffffe081ddf5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ddf5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ddf5ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ddf5b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100127 td 0xfffff80015096920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ddf08c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081ddf0900 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ddf0940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ddf0970 _sleep() at _sleep+0x33d/frame 0xfffffe081ddf0a00 enc_daemon() at enc_daemon+0x109/frame 0xfffffe081ddf0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ddf0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ddf0ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ddf0b70, rbp = 0 --- Tracing command xpt_thrd pid 3 tid 100126 td 0xfffff80015097000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dcab900 mi_switch() at mi_switch+0x179/frame 0xfffffe081dcab940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dcab980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dcab9b0 _sleep() at _sleep+0x33d/frame 0xfffffe081dcaba40 xpt_scanner_thread() at xpt_scanner_thread+0xdc/frame 0xfffffe081dcaba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dcabab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dcabab0 --- trap 0, rip = 0, rsp = 0xfffffe081dcabb70, rbp = 0 --- Tracing command sctp_iterator pid 2 tid 100125 td 0xfffff8000c9fd000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dca6910 mi_switch() at mi_switch+0x179/frame 0xfffffe081dca6950 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dca6990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dca69c0 _sleep() at _sleep+0x33d/frame 0xfffffe081dca6a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081dca6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dca6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dca6ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dca6b70, rbp = 0 --- Tracing command usb pid 15 tid 100119 td 0xfffff8000c89a920 sched_switch() at sched_switch+0x482/frame 0xfffffe081bc04920 mi_switch() at mi_switch+0x179/frame 0xfffffe081bc04960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081bc049a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081bc049d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081bc04a40 usb_process() at usb_process+0xd4/frame 0xfffffe081bc04a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bc04ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bc04ab0 --- trap 0, rip = 0, rsp = 0xfffffe081bc04b70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffff8000c8b1000 sched_switch() at sched_switch+0x482/frame 0xfffffe081bbfe920 mi_switch() at mi_switch+0x179/frame 0xfffffe081bbfe960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081bbfe9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081bbfe9d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081bbfea40 usb_process() at usb_process+0xd4/frame 0xfffffe081bbfea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bbfeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bbfeab0 --- trap 0, rip = 0, rsp = 0xfffffe081bbfeb70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffff8000c8b1490 sched_switch() at sched_switch+0x482/frame 0xfffffe081bbf9920 mi_switch() at mi_switch+0x179/frame 0xfffffe081bbf9960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081bbf99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081bbf99d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081bbf9a40 usb_process() at usb_process+0xd4/frame 0xfffffe081bbf9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bbf9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bbf9ab0 --- trap 0, rip = 0, rsp = 0xfffffe081bbf9b70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffff8000c8b1920 sched_switch() at sched_switch+0x482/frame 0xfffffe081bbf4920 mi_switch() at mi_switch+0x179/frame 0xfffffe081bbf4960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081bbf49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081bbf49d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081bbf4a40 usb_process() at usb_process+0xd4/frame 0xfffffe081bbf4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bbf4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bbf4ab0 --- trap 0, rip = 0, rsp = 0xfffffe081bbf4b70, rbp = 0 --- Tracing command usb pid 15 tid 100114 td 0xfffff8000c899000 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba67920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba67960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba679a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba679d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081ba67a40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba67a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba67ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba67b70, rbp = 0 --- Tracing command usb pid 15 tid 100113 td 0xfffff8000c899490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba62920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba62960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba629a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba629d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081ba62a40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba62a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba62ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba62b70, rbp = 0 --- Tracing command usb pid 15 tid 100112 td 0xfffff8000c899920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba5d920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba5d960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba5d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba5d9d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081ba5da40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba5da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba5dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba5dab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba5db70, rbp = 0 --- Tracing command usb pid 15 tid 100111 td 0xfffff8000c89a000 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba58920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba58960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba589a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba589d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe081ba58a40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba58a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba58ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba58ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba58b70, rbp = 0 --- Tracing command usb pid 15 tid 100074 td 0xfffff8000b428920 sched_switch() at sched_switch+0x482/frame 0xfffffe00002f3920 mi_switch() at mi_switch+0x179/frame 0xfffffe00002f3960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00002f39a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00002f39d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe00002f3a40 usb_process() at usb_process+0xd4/frame 0xfffffe00002f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002f3ab0 --- trap 0, rip = 0, rsp = 0xfffffe00002f3b70, rbp = 0 --- Tracing command usb pid 15 tid 100073 td 0xfffff8000c846000 sched_switch() at sched_switch+0x482/frame 0xfffffe00002ee920 mi_switch() at mi_switch+0x179/frame 0xfffffe00002ee960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00002ee9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00002ee9d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe00002eea40 usb_process() at usb_process+0xd4/frame 0xfffffe00002eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002eeab0 --- trap 0, rip = 0, rsp = 0xfffffe00002eeb70, rbp = 0 --- Tracing command usb pid 15 tid 100072 td 0xfffff8000c846490 sched_switch() at sched_switch+0x482/frame 0xfffffe00002e9920 mi_switch() at mi_switch+0x179/frame 0xfffffe00002e9960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00002e99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00002e99d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe00002e9a40 usb_process() at usb_process+0xd4/frame 0xfffffe00002e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002e9ab0 --- trap 0, rip = 0, rsp = 0xfffffe00002e9b70, rbp = 0 --- Tracing command usb pid 15 tid 100071 td 0xfffff8000c846920 sched_switch() at sched_switch+0x482/frame 0xfffffe00002e4920 mi_switch() at mi_switch+0x179/frame 0xfffffe00002e4960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00002e49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00002e49d0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe00002e4a40 usb_process() at usb_process+0xd4/frame 0xfffffe00002e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002e4ab0 --- trap 0, rip = 0, rsp = 0xfffffe00002e4b70, rbp = 0 --- Tracing command yarrow pid 14 tid 100057 td 0xfffff8000b281490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad358f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad35930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad35970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe078ad359a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xfffffe078ad35a30 random_kthread() at random_kthread+0x68/frame 0xfffffe078ad35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad35ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad35b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff8000b26f920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad2b8d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad2b910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad2b950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad2b980 _sleep() at _sleep+0x33d/frame 0xfffffe078ad2ba10 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe078ad2ba60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe078ad2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad2bab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad2bb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff8000b270000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad268f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad26930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad26970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad269a0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad26a30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xfffffe078ad26a60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe078ad26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad26ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad26b70, rbp = 0 --- Tracing command geom pid 13 tid 100053 td 0xfffff8000b270490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad218f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad21930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad21970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad219a0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad21a30 g_run_events() at g_run_events+0x4f4/frame 0xfffffe078ad21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad21ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad21b70, rbp = 0 --- Tracing command intr pid 12 tid 100122 td 0xfffff80014001000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dc929f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dc92a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081dc92a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dc92ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dc92ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dc92b70, rbp = 0 --- Tracing command intr pid 12 tid 100121 td 0xfffff80014001490 sched_switch() at sched_switch+0x482/frame 0xfffffe081dc8a9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dc8aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081dc8aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dc8aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dc8aab0 --- trap 0, rip = 0, rsp = 0xfffffe081dc8ab70, rbp = 0 --- Tracing command intr pid 12 tid 100120 td 0xfffff8000c89a490 sched_switch() at sched_switch+0x482/frame 0xfffffe081bc099f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081bc09a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081bc09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bc09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bc09ab0 --- trap 0, rip = 0, rsp = 0xfffffe081bc09b70, rbp = 0 --- Tracing command intr pid 12 tid 100115 td 0xfffff8000c893920 sched_switch() at sched_switch+0x482/frame 0xfffffe081bbef9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081bbefa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081bbefa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081bbefab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081bbefab0 --- trap 0, rip = 0, rsp = 0xfffffe081bbefb70, rbp = 0 --- Tracing command intr pid 12 tid 100110 td 0xfffff8000c892000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff8000c892490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff8000c893000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff8000c889490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff8000c88e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff8000c88e920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffff8000c888000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffff8000c888920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffff8000c871000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffff8000c871920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffff8000c872000 sched_switch() at sched_switch+0x482/frame 0xfffffe00003979f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000397a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000397a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000397ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000397ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000397b70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff8000c86f490 sched_switch() at sched_switch+0x482/frame 0xfffffe000038d9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe000038da30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000038da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000038dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000038dab0 --- trap 0, rip = 0, rsp = 0xfffffe000038db70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff8000c870000 sched_switch() at sched_switch+0x482/frame 0xfffffe00003839f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000383a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000383a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000383ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000383ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000383b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff8000c870920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003799f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000379a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000379a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000379ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000379ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000379b70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff8000c86e000 sched_switch() at sched_switch+0x482/frame 0xfffffe000036f9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe000036fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000036fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000036fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000036fab0 --- trap 0, rip = 0, rsp = 0xfffffe000036fb70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000c86e920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003659f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000365a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000365a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000365ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000365ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000365b70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffff8000c864000 sched_switch() at sched_switch+0x482/frame 0xfffffe000035b9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe000035ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe000035ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000035bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000035bab0 --- trap 0, rip = 0, rsp = 0xfffffe000035bb70, rbp = 0 --- Tracing command intr pid 12 tid 100078 td 0xfffff8000c864920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003519f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000351a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000351a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000351ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000351ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000351b70, rbp = 0 --- Tracing command intr pid 12 tid 100076 td 0xfffff8000c865490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003479f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000347a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000347a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000347ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000347ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000347b70, rbp = 0 --- Tracing command intr pid 12 tid 100075 td 0xfffff8000b428490 sched_switch() at sched_switch+0x482/frame 0xfffffe00002f89f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00002f8a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00002f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002f8ab0 --- trap 0, rip = 0, rsp = 0xfffffe00002f8b70, rbp = 0 --- Tracing command intr pid 12 tid 100070 td 0xfffff8000b414920 sched_switch() at sched_switch+0x482/frame 0xfffffe00002df9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00002dfa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00002dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00002dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00002dfab0 --- trap 0, rip = 0, rsp = 0xfffffe00002dfb70, rbp = 0 --- Tracing command intr pid 12 tid 100069 td 0xfffff8000b427000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100068 td 0xfffff8000b427490 sched_switch() at sched_switch+0x482/frame 0xfffffe078adad9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078adada30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078adada70 fork_exit() at fork_exit+0x84/frame 0xfffffe078adadab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078adadab0 --- trap 0, rip = 0, rsp = 0xfffffe078adadb70, rbp = 0 --- Tracing command intr pid 12 tid 100067 td 0xfffff8000b427920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad679f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad67a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ad67a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad67ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad67ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad67b70, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffff8000b414000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad4e9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad4ea30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ad4ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad4eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad4eab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad4eb70, rbp = 0 --- Tracing command intr pid 12 tid 100061 td 0xfffff8000b414490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100058 td 0xfffff8000b281000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad3a9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad3aa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ad3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad3aab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad3ab70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff8000b270920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000b271000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000b26e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000b26e490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff8000b26e920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000b26f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff8000b26f490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff8000b26a490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff8000b26a920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff8000b26b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff8000b26b490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff8000b26b920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff8000b265920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff8000b269000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff8000b269490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff8000b269920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000b26a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000b264000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000b264490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000b264920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000b265000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff8000b265490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000b23a490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff8000b23a920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aca99f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078aca9a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078aca9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aca9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aca9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aca9b70, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff8000b23b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xfffff8000b23b490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ac9f9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ac9fa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ac9fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac9fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac9fab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac9fb70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff8000b23b920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5ebce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5ebd00 trap() at trap+0x42/frame 0xfffffe07fc5ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5ebf20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5ebfe0, rbp = 0xfffffe078ac9a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac9a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac9a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac9a9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac9a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac9aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac9aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac9aab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac9ab70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff8000b234920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5e4ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5e4d00 trap() at trap+0x42/frame 0xfffffe07fc5e4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5e4f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5e4fe0, rbp = 0xfffffe078ac95930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac95930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac95980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac959a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac959c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac95a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac95ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac95ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac95b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000b235000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5ddce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5ddd00 trap() at trap+0x42/frame 0xfffffe07fc5ddf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5ddf20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5ddfe0, rbp = 0xfffffe078ac90930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac90930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac90980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac909a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac909c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac90ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac90b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000b235490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5d6ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5d6d00 trap() at trap+0x42/frame 0xfffffe07fc5d6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5d6f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5d6fe0, rbp = 0xfffffe078ac8b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac8b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac8b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac8b9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac8b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac8bab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac8bb70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000b235920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ac86960 mi_switch() at mi_switch+0x179/frame 0xfffffe078ac869a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078ac869c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac86ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac86b70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000b23a000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5c8ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5c8d00 trap() at trap+0x42/frame 0xfffffe07fc5c8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5c8f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5c8fe0, rbp = 0xfffffe078ac81930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac81930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac81980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac819a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac819c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac81ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac81b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000b233000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5c1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5c1d00 trap() at trap+0x42/frame 0xfffffe07fc5c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5c1f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5c1fe0, rbp = 0xfffffe078ac7c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac7c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac7c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac7c9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac7c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac7cab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac7cb70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000b233490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5bace0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5bad00 trap() at trap+0x42/frame 0xfffffe07fc5baf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5baf20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5bafe0, rbp = 0xfffffe078ac77930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac77930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac77980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac779a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac779c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac77ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac77b70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000b233920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5b3ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5b3d00 trap() at trap+0x42/frame 0xfffffe07fc5b3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5b3f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5b3fe0, rbp = 0xfffffe078ac72930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac72930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac72980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac729a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac729c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac72ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac72b70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000b234000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5acce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5acd00 trap() at trap+0x42/frame 0xfffffe07fc5acf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5acf20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5acfe0, rbp = 0xfffffe078ac6d930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac6d930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac6d980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac6d9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac6d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac6dab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac6db70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000b234490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc5a5ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc5a5d00 trap() at trap+0x42/frame 0xfffffe07fc5a5f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc5a5f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc5a5fe0, rbp = 0xfffffe078ac68930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac68930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac68980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac689a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac689c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac68ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac68b70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000b231490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc59ece0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc59ed00 trap() at trap+0x42/frame 0xfffffe07fc59ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc59ef20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc59efe0, rbp = 0xfffffe078ac63930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac63930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac63980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac639a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac639c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac63ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac63b70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b231920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ac5e960 mi_switch() at mi_switch+0x179/frame 0xfffffe078ac5e9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078ac5e9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac5eab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac5eb70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b232000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc590ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc590d00 trap() at trap+0x42/frame 0xfffffe07fc590f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc590f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc590fe0, rbp = 0xfffffe078ac59930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac59930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac59980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac599a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac599c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac59ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac59b70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b232490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc589ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc589d00 trap() at trap+0x42/frame 0xfffffe07fc589f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc589f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc589fe0, rbp = 0xfffffe078ac54930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac54930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac54980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac549a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac549c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac54ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac54b70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000b232920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc582ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc582d00 trap() at trap+0x42/frame 0xfffffe07fc582f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc582f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc582fe0, rbp = 0xfffffe078ac4f930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac4f930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac4f980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac4f9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac4f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac4fab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac4fb70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000b222920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc57bce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc57bd00 trap() at trap+0x42/frame 0xfffffe07fc57bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc57bf20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc57bfe0, rbp = 0xfffffe078ac4a930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac4a930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac4a980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac4a9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac4a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac4aab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac4ab70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000b230000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc574ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc574d00 trap() at trap+0x42/frame 0xfffffe07fc574f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc574f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc574fe0, rbp = 0xfffffe078ac45930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac45930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac45980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac459a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac459c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac45ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac45b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000b230490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc56dce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc56dd00 trap() at trap+0x42/frame 0xfffffe07fc56df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc56df20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc56dfe0, rbp = 0xfffffe078ac40930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac40930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac40980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac409a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac409c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac40ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac40b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b230920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc566ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc566d00 trap() at trap+0x42/frame 0xfffffe07fc566f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc566f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc566fe0, rbp = 0xfffffe078ac3b930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac3b930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac3b980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac3b9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac3b9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac3bab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac3bb70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b231000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc55fce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc55fd00 trap() at trap+0x42/frame 0xfffffe07fc55ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc55ff20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc55ffe0, rbp = 0xfffffe078ac36930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac36930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac36980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac369a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac369c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac36a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac36ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac36ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac36b70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000b221000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc558ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc558d00 trap() at trap+0x42/frame 0xfffffe07fc558f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc558f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc558fe0, rbp = 0xfffffe078ac31930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac31930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac31980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac319a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac319c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac31ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac31b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b221490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc551ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc551d00 trap() at trap+0x42/frame 0xfffffe07fc551f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc551f20 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xfffffe07fc551fe0, rbp = 0xfffffe078ac2c930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe078ac2c930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe078ac2c980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe078ac2c9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe078ac2c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078ac2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ac2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ac2cab0 --- trap 0, rip = 0, rsp = 0xfffffe078ac2cb70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000b221920 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff815822e0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xffffffff81582300 trap() at trap+0x42/frame 0xffffffff81582520 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81582520 --- trap 0x13, rip = 0xffffffff80c99c26, rsp = 0xffffffff815825e0, rbp = 0xfffffe07fc5fc930 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xfffffe07fc5fc930 acpi_cpu_idle() at acpi_cpu_idle+0x13b/frame 0xfffffe07fc5fc980 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe07fc5fc9a0 cpu_idle() at cpu_idle+0x93/frame 0xfffffe07fc5fc9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe07fc5fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fc5fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fc5fcab0 --- trap 0, rip = 0, rsp = 0xfffffe07fc5fcb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b222000 sched_switch() at sched_switch+0x482/frame 0xfffffe07fc5f7560 mi_switch() at mi_switch+0x179/frame 0xfffffe07fc5f75a0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe07fc5f75e0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe07fc5f7650 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe07fc5f7680 _sleep() at _sleep+0x320/frame 0xfffffe07fc5f7710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe07fc5f77b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe07fc5f79a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe07fc5f7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe07fc5f7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41323a, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b222490 sched_switch() at sched_switch+0x482/frame 0xfffffe07fc5f28f0 mi_switch() at mi_switch+0x179/frame 0xfffffe07fc5f2930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe07fc5f2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe07fc5f29a0 _cv_wait() at _cv_wait+0x1df/frame 0xfffffe07fc5f2a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe07fc5f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe07fc5f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe07fc5f2ab0 --- trap 0, rip = 0, rsp = 0xfffffe07fc5f2b70, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff8000c9fd490 sched_switch() at sched_switch+0x482/frame 0xfffffe081dca0890 mi_switch() at mi_switch+0x179/frame 0xfffffe081dca08d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dca0910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dca0940 _sleep() at _sleep+0x312/frame 0xfffffe081dca09d0 pause_sbt() at pause_sbt+0x70/frame 0xfffffe081dca0a20 deadlkres() at deadlkres+0x66/frame 0xfffffe081dca0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dca0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dca0ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dca0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff8000c9fd920 sched_switch() at sched_switch+0x482/frame 0xfffffe081dc9b900 mi_switch() at mi_switch+0x179/frame 0xfffffe081dc9b940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dc9b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dc9b9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe081dc9ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe081dc9ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dc9bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dc9bab0 --- trap 0, rip = 0, rsp = 0xfffffe081dc9bb70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff8000c892920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba27900 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba27940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba27980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba279b0 _sleep() at _sleep+0x33d/frame 0xfffffe081ba27a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081ba27a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba27ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba27ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba27b70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8000c893490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba1d900 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba1d940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba1d980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba1d9b0 _sleep() at _sleep+0x33d/frame 0xfffffe081ba1da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081ba1da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba1dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba1dab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba1db70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000c889920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba13900 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba13940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba13980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba139b0 _sleep() at _sleep+0x33d/frame 0xfffffe081ba13a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081ba13a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba13ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba13ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba13b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000c88e490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba09900 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba09940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba09980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba099b0 _sleep() at _sleep+0x33d/frame 0xfffffe081ba09a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081ba09a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba09ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba09ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba09b70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000c872920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003ff900 mi_switch() at mi_switch+0x179/frame 0xfffffe00003ff940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003ff980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003ff9b0 _sleep() at _sleep+0x33d/frame 0xfffffe00003ffa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ffab0 --- trap 0, rip = 0, rsp = 0xfffffe00003ffb70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000c888490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003f5900 mi_switch() at mi_switch+0x179/frame 0xfffffe00003f5940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003f5980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003f59b0 _sleep() at _sleep+0x33d/frame 0xfffffe00003f5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f5ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003f5b70, rbp = 0 --- Tracing command kernel pid 0 tid 100096 td 0xfffff8000c889000 sched_switch() at sched_switch+0x482/frame 0xfffffe00003eb900 mi_switch() at mi_switch+0x179/frame 0xfffffe00003eb940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003eb980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003eb9b0 _sleep() at _sleep+0x33d/frame 0xfffffe00003eba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ebab0 --- trap 0, rip = 0, rsp = 0xfffffe00003ebb70, rbp = 0 --- Tracing command kernel pid 0 tid 100094 td 0xfffff8000c871490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003e1900 mi_switch() at mi_switch+0x179/frame 0xfffffe00003e1940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003e1980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003e19b0 _sleep() at _sleep+0x33d/frame 0xfffffe00003e1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003e1ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003e1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff8000c872490 sched_switch() at sched_switch+0x482/frame 0xfffffe0000392900 mi_switch() at mi_switch+0x179/frame 0xfffffe0000392940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe0000392980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003929b0 _sleep() at _sleep+0x33d/frame 0xfffffe0000392a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000392a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000392ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000392ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000392b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff8000c86f920 sched_switch() at sched_switch+0x482/frame 0xfffffe0000388900 mi_switch() at mi_switch+0x179/frame 0xfffffe0000388940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe0000388980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003889b0 _sleep() at _sleep+0x33d/frame 0xfffffe0000388a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000388a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000388ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000388ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000388b70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff8000c870490 sched_switch() at sched_switch+0x482/frame 0xfffffe000037e900 mi_switch() at mi_switch+0x179/frame 0xfffffe000037e940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe000037e980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000037e9b0 _sleep() at _sleep+0x33d/frame 0xfffffe000037ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe000037ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037eab0 --- trap 0, rip = 0, rsp = 0xfffffe000037eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff8000c865920 sched_switch() at sched_switch+0x482/frame 0xfffffe0000374900 mi_switch() at mi_switch+0x179/frame 0xfffffe0000374940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe0000374980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003749b0 _sleep() at _sleep+0x33d/frame 0xfffffe0000374a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000374a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000374ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000374ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000374b70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff8000c86e490 sched_switch() at sched_switch+0x482/frame 0xfffffe000036a900 mi_switch() at mi_switch+0x179/frame 0xfffffe000036a940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe000036a980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000036a9b0 _sleep() at _sleep+0x33d/frame 0xfffffe000036aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe000036aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000036aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000036aab0 --- trap 0, rip = 0, rsp = 0xfffffe000036ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffff8000c86f000 sched_switch() at sched_switch+0x482/frame 0xfffffe0000360900 mi_switch() at mi_switch+0x179/frame 0xfffffe0000360940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe0000360980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003609b0 _sleep() at _sleep+0x33d/frame 0xfffffe0000360a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000360a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000360ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000360ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000360b70, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffff8000c864490 sched_switch() at sched_switch+0x482/frame 0xfffffe0000356900 mi_switch() at mi_switch+0x179/frame 0xfffffe0000356940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe0000356980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003569b0 _sleep() at _sleep+0x33d/frame 0xfffffe0000356a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe0000356a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000356ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000356ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000356b70, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff8000c865000 sched_switch() at sched_switch+0x482/frame 0xfffffe000034c900 mi_switch() at mi_switch+0x179/frame 0xfffffe000034c940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe000034c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000034c9b0 _sleep() at _sleep+0x33d/frame 0xfffffe000034ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe000034ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000034cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000034cab0 --- trap 0, rip = 0, rsp = 0xfffffe000034cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000b428000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad62900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad62940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad62980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad629b0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad62a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ad62a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad62ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad62ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad62b70, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff8000b410000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad5d900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad5d940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad5d980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad5d9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ad5da40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ad5da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad5dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad5dab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad5db70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000b410490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad58900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad58940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad58980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad589b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ad58a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ad58a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad58ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad58ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad58b70, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff8000b410920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad53900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad53940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad53980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad539b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ad53a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ad53a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad53ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad53ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad53b70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff8000b271490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad44900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad44940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad44980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad449b0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad44a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ad44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad44ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad44b70, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff8000b271920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad3f900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad3f940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad3f980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad3f9b0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad3fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ad3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad3fab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad3fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff8000b281920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ad30900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ad30940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ad30980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ad309b0 _sleep() at _sleep+0x33d/frame 0xfffffe078ad30a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ad30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ad30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ad30ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ad30b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff815d9560 sched_switch() at sched_switch+0x482/frame 0xffffffff818a69e0 mi_switch() at mi_switch+0x179/frame 0xffffffff818a6a20 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff818a6a60 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff818a6a90 _sleep() at _sleep+0x312/frame 0xffffffff818a6b20 swapper() at swapper+0x211/frame 0xffffffff818a6b70 btext() at btext+0x2c db:0:allt> call doadump Dumping 1208 out of 31644 MB:..2%..11%..22%..31%..42%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 19 (kgdb) bt #0 doadump (textdump=0xd) at pcpu.h:236 #1 0xffffffff8033c535 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8033c21d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff8034047f in db_script_exec (scriptname=0xffffffff815cdc80 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8033c21d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff8033bf94 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033e940 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff808f35c3 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cbadeb in trap (frame=0xfffffe081e05bcf0) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80c9eab2 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff808f2d9e in kdb_enter (why=0xffffffff80f8220d "panic", msg=) at cpufunc.h:63 #11 0xffffffff808bc986 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff808bc836 in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xffffffff808b8b3c in __rw_wlock_hard (c=0xffffffff815846d8, tid=0xfffff80015c66920, file=0xffffffff80fd4d4a "../../../amd64/amd64/pmap.c", line=0x9d7) at ../../../kern/kern_rwlock.c:731 #14 0xffffffff808b8907 in _rw_wlock_cookie (c=0xffffffff815846d8, file=0xffffffff80fd4d4a "../../../amd64/amd64/pmap.c", line=0x9d7) at ../../../kern/kern_rwlock.c:269 #15 0xffffffff80cb7f97 in pmap_pv_demote_pde (pmap=0xfffff8002b1fc600, va=0x801400000, pa=0x16ee00000, lockp=0xfffffe081e05c130) at ../../../amd64/amd64/pmap.c:2519 #16 0xffffffff80cac7f3 in pmap_demote_pde_locked (pmap=0xfffff8002b1fc600, pde=0xfffff8013f363050, va=0x801400000, lockp=0xfffffe081e05c130) at ../../../amd64/amd64/pmap.c:2816 #17 0xffffffff80cacf31 in pmap_demote_pde (pmap=0xfffff8002b1fc600, pde=0xfffff8013f363050, va=0x801400000) at ../../../amd64/amd64/pmap.c:2698 #18 0xffffffff80cb3684 in pmap_remove_write (m=0xfffff807d53b3980) at ../../../amd64/amd64/pmap.c:4803 #19 0xffffffff80b42741 in vm_object_page_remove_write (p=0xfffff807d53b3980, flags=0x0, clearobjflags=0xfffffe081e05c220) at ../../../vm/vm_object.c:813 #20 0xffffffff80b425bf in vm_object_page_clean (object=0xfffff800159c0700, start=0x0, end=0x0, flags=0x0) at ../../../vm/vm_object.c:885 #21 0xffffffff809651c0 in vflush (mp=0xfffff80069e5a790, rootrefs=0x0, flags=0x4, td=0xfffff80015c66920) at ../../../kern/vfs_subr.c:2532 #22 0xffffffff80b0f711 in ffs_flushfiles (mp=0xfffff80069e5a790, flags=0x4, td=0xfffff80015c66920) at ../../../ufs/ffs/ffs_vfsops.c:1405 #23 0xffffffff80af7f5f in softdep_flushfiles (oldmnt=0xfffff80069e5a790, flags=0x4, td=0xfffff80015c66920) at ../../../ufs/ffs/ffs_softdep.c:1973 #24 0xffffffff80b10808 in ffs_mount (mp=0xfffff80069e5a790) at ../../../ufs/ffs/ffs_vfsops.c:291 #25 0xffffffff80959d3e in vfs_donmount (td=0xfffff80015c66920, fsflags=, fsoptions=0xfffff80069811000) at ../../../kern/vfs_mount.c:949 #26 0xffffffff80958dd2 in sys_nmount (td=0xfffff80015c66920, uap=) at ../../../kern/vfs_mount.c:417 #27 0xffffffff80cbba52 in amd64_syscall (td=0xfffff80015c66920, traced=0x0) at subr_syscall.c:134 #28 0xffffffff80c9ed9b in Xfast_syscall () at ../../../amd64/amd64/exception.S:391 #29 0x0000000800a9df8a in ?? () (kgdb) f 13 #13 0xffffffff808b8b3c in __rw_wlock_hard (c=0xffffffff815846d8, tid=0xfffff80015c66920, file=0xffffffff80fd4d4a "../../../amd64/amd64/pmap.c", line=0x9d7) at ../../../kern/kern_rwlock.c:731 731 KASSERT(rw->lock_object.lo_flags & LO_RECURSABLE, (kgdb) l 726 return; 727 728 rw = rwlock2rw(c); 729 730 if (rw_wlocked(rw)) { 731 KASSERT(rw->lock_object.lo_flags & LO_RECURSABLE, 732 ("%s: recursing but non-recursive rw %s @ %s:%d\n", 733 __func__, rw->lock_object.lo_name, file, line)); 734 rw->rw_recurse++; 735 if (LOCK_LOG_TEST(&rw->lock_object, 0)) (kgdb) info loc rw = (struct rwlock *) 0xffffffff815846c0 ts = (struct turnstile *) 0xfffff80069e5a790 owner = (volatile struct thread *) 0xffffffff815846c0 spintries = 0x0 i = 0x6bd980 v = 0xffffffff812effd8 x = 0xffffffff812effd8 spin_cnt = 0x0 sleep_cnt = 0x0 sleep_time = 0x0 (kgdb) p *rw $2 = {lock_object = {lo_name = 0xffffffff80f8b753 "pmap pv list", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe00006bd980}, rw_lock = 0xfffff80015c66920} (kgdb) f 15 #15 0xffffffff80cb7f97 in pmap_pv_demote_pde (pmap=0xfffff8002b1fc600, va=0x801400000, pa=0x16ee00000, lockp=0xfffffe081e05c130) at ../../../amd64/amd64/pmap.c:2519 2519 CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa); (kgdb) l 2514 2515 rw_assert(&pvh_global_lock, RA_LOCKED); 2516 PMAP_LOCK_ASSERT(pmap, MA_OWNED); 2517 KASSERT((pa & PDRMASK) == 0, 2518 ("pmap_pv_demote_pde: pa is not 2mpage aligned")); 2519 CHANGE_PV_LIST_LOCK_TO_PHYS(lockp, pa); 2520 2521 /* 2522 * Transfer the 2mpage's pv entry for this mapping to the first 2523 * page's pv list. Once this transfer begins, the pv list lock (kgdb) info loc _lockp = (struct rwlock **) 0xfffffe081e05c130 _new_lock = (struct rwlock *) 0xffffffff815846c0 pvh = (struct md_page *) 0x0 pc = (struct pv_chunk *) 0xfffff8013f388000 pv = 0x25500000000 va_last = 0xfffff807d40578c0 m = 0xffffffff80fd4d4a bit = 0xfffff800 field = 0x15c66920 (kgdb) p *pmap $3 = {pm_mtx = {lock_object = {lo_name = 0xffffffff80f8b74e "pmap", lo_flags = 0x1430000, lo_data = 0x0, lo_witness = 0xfffffe00006bd900}, mtx_lock = 0xfffff80015c66920}, pm_pml4 = 0xfffff8013f2d7000, pm_pvchunk = {tqh_first = 0xfffff8013f388000, tqh_last = 0xfffff8013f315008}, pm_active = { __bits = {0x0}}, pm_stats = {resident_count = 0x851, wired_count = 0x0}, pm_root = {rt_root = 0xfffff8013f32a480, rt_flags = 0x0}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/amd64/pmap.c =================================================================== --- /usr/src/sys/amd64/amd64/pmap.c (revision 254562) +++ /usr/src/sys/amd64/amd64/pmap.c (working copy) @@ -1687,8 +1687,6 @@ pmap_pinit(pmap_t pmap) vm_page_t pml4pg; int i; - PMAP_LOCK_INIT(pmap); - /* * allocate the page directory page */ @@ -1959,9 +1957,6 @@ pmap_release(pmap_t pmap) KASSERT(vm_radix_is_empty(&pmap->pm_root), ("pmap_release: pmap has reserved page table page(s)")); - rw_wlock(&pvh_global_lock); - rw_wunlock(&pvh_global_lock); - m = PHYS_TO_VM_PAGE(pmap->pm_pml4[PML4PML4I] & PG_FRAME); for (i = 0; i < NKPML4E; i++) /* KVA */ @@ -1973,7 +1968,6 @@ pmap_release(pmap_t pmap) m->wire_count--; atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(m); - PMAP_LOCK_DESTROY(pmap); } static int @@ -4765,10 +4759,12 @@ pmap_remove_write(vm_page_t m) { struct md_page *pvh; pmap_t pmap; + struct rwlock *lock; pv_entry_t next_pv, pv; pd_entry_t *pde; pt_entry_t oldpte, *pte; vm_offset_t va; + int pvh_gen, md_gen; KASSERT((m->oflags & VPO_UNMANAGED) == 0, ("pmap_remove_write: page %p is not managed", m)); @@ -4781,13 +4777,26 @@ pmap_remove_write(vm_page_t m) VM_OBJECT_ASSERT_WLOCKED(m->object); if (!vm_page_xbusied(m) && (m->aflags & PGA_WRITEABLE) == 0) return; - rw_wlock(&pvh_global_lock); + rw_rlock(&pvh_global_lock); + lock = VM_PAGE_TO_PV_LIST_LOCK(m); + pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); +retry_pv_loop: + rw_wlock(lock); if ((m->flags & PG_FICTITIOUS) != 0) goto small_mappings; - pvh = pa_to_pvh(VM_PAGE_TO_PHYS(m)); TAILQ_FOREACH_SAFE(pv, &pvh->pv_list, pv_next, next_pv) { pmap = PV_PMAP(pv); - PMAP_LOCK(pmap); + if (!PMAP_TRYLOCK(pmap)) { + pvh_gen = pvh->pv_gen; + rw_wunlock(lock); + PMAP_LOCK(pmap); + rw_wlock(lock); + if (pvh_gen != pvh->pv_gen) { + PMAP_UNLOCK(pmap); + rw_wunlock(lock); + goto retry_pv_loop; + } + } va = pv->pv_va; pde = pmap_pde(pmap, va); if ((*pde & PG_RW) != 0) @@ -4797,7 +4806,19 @@ pmap_remove_write(vm_page_t m) small_mappings: TAILQ_FOREACH(pv, &m->md.pv_list, pv_next) { pmap = PV_PMAP(pv); - PMAP_LOCK(pmap); + if (!PMAP_TRYLOCK(pmap)) { + pvh_gen = pvh->pv_gen; + md_gen = m->md.pv_gen; + rw_wunlock(lock); + PMAP_LOCK(pmap); + rw_wlock(lock); + if (pvh_gen != pvh->pv_gen || + md_gen != m->md.pv_gen) { + PMAP_UNLOCK(pmap); + rw_wunlock(lock); + goto retry_pv_loop; + } + } pde = pmap_pde(pmap, pv->pv_va); KASSERT((*pde & PG_PS) == 0, ("pmap_remove_write: found a 2mpage in page %p's pv list", @@ -4815,8 +4836,9 @@ retry: } PMAP_UNLOCK(pmap); } + rw_wunlock(lock); vm_page_aflag_clear(m, PGA_WRITEABLE); - rw_wunlock(&pvh_global_lock); + rw_runlock(&pvh_global_lock); } /* Index: /usr/src/sys/arm/arm/pmap-v6.c =================================================================== --- /usr/src/sys/arm/arm/pmap-v6.c (revision 254562) +++ /usr/src/sys/arm/arm/pmap-v6.c (working copy) @@ -1814,7 +1814,6 @@ pmap_release(pmap_t pmap) } pmap_free_l1(pmap); - PMAP_LOCK_DESTROY(pmap); dprintf("pmap_release()\n"); } @@ -3225,7 +3224,6 @@ pmap_pinit(pmap_t pmap) { PDEBUG(1, printf("pmap_pinit: pmap = %08x\n", (uint32_t) pmap)); - PMAP_LOCK_INIT(pmap); pmap_alloc_l1(pmap); bzero(pmap->pm_l2, sizeof(pmap->pm_l2)); Index: /usr/src/sys/arm/arm/pmap.c =================================================================== --- /usr/src/sys/arm/arm/pmap.c (revision 254562) +++ /usr/src/sys/arm/arm/pmap.c (working copy) @@ -2479,7 +2479,6 @@ pmap_release(pmap_t pmap) } pmap_free_l1(pmap); - PMAP_LOCK_DESTROY(pmap); dprintf("pmap_release()\n"); } @@ -3819,7 +3818,6 @@ pmap_pinit(pmap_t pmap) { PDEBUG(1, printf("pmap_pinit: pmap = %08x\n", (uint32_t) pmap)); - PMAP_LOCK_INIT(pmap); pmap_alloc_l1(pmap); bzero(pmap->pm_l2, sizeof(pmap->pm_l2)); Index: /usr/src/sys/i386/i386/pmap.c =================================================================== --- /usr/src/sys/i386/i386/pmap.c (revision 254562) +++ /usr/src/sys/i386/i386/pmap.c (working copy) @@ -1738,8 +1738,6 @@ pmap_pinit(pmap_t pmap) vm_paddr_t pa; int i; - PMAP_LOCK_INIT(pmap); - /* * No need to allocate page table space yet but we do need a valid * page directory table. @@ -2051,7 +2049,6 @@ pmap_release(pmap_t pmap) atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(m); } - PMAP_LOCK_DESTROY(pmap); } static int Index: /usr/src/sys/i386/xen/pmap.c =================================================================== --- /usr/src/sys/i386/xen/pmap.c (revision 254562) +++ /usr/src/sys/i386/xen/pmap.c (working copy) @@ -1452,8 +1452,6 @@ pmap_pinit(pmap_t pmap) mtx_lock(&createdelete_lock); #endif - PMAP_LOCK_INIT(pmap); - /* * No need to allocate page table space yet but we do need a valid * page directory table. @@ -1821,7 +1819,6 @@ pmap_release(pmap_t pmap) #ifdef PAE pmap_qremove((vm_offset_t)pmap->pm_pdpt, 1); #endif - PMAP_LOCK_DESTROY(pmap); #ifdef HAMFISTED_LOCKING mtx_unlock(&createdelete_lock); Index: /usr/src/sys/ia64/ia64/pmap.c =================================================================== --- /usr/src/sys/ia64/ia64/pmap.c (revision 254562) +++ /usr/src/sys/ia64/ia64/pmap.c (working copy) @@ -622,6 +622,8 @@ pmap_free_rid(uint32_t rid) void pmap_pinit0(struct pmap *pmap) { + + PMAP_LOCK_INIT(pmap); /* kernel_pmap is the same as any other pmap. */ pmap_pinit(pmap); } @@ -635,7 +637,6 @@ pmap_pinit(struct pmap *pmap) { int i; - PMAP_LOCK_INIT(pmap); for (i = 0; i < IA64_VM_MINKERN_REGION; i++) pmap->pm_rid[i] = pmap_allocate_rid(); TAILQ_INIT(&pmap->pm_pvchunk); @@ -660,7 +661,6 @@ pmap_release(pmap_t pmap) for (i = 0; i < IA64_VM_MINKERN_REGION; i++) if (pmap->pm_rid[i]) pmap_free_rid(pmap->pm_rid[i]); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 254562) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -108,7 +108,6 @@ static void vm_hold_load_pages(struct buf *bp, vm_ static void vfs_page_set_valid(struct buf *bp, vm_ooffset_t off, vm_page_t m); static void vfs_page_set_validclean(struct buf *bp, vm_ooffset_t off, vm_page_t m); -static void vfs_drain_busy_pages(struct buf *bp); static void vfs_clean_pages_dirty_buf(struct buf *bp); static void vfs_setdirty_locked_object(struct buf *bp); static void vfs_vmio_release(struct buf *bp); @@ -3983,7 +3982,7 @@ vfs_page_set_validclean(struct buf *bp, vm_ooffset * Ensure that all buffer pages are not exclusive busied. If any page is * exclusive busy, drain it. */ -static void +void vfs_drain_busy_pages(struct buf *bp) { vm_page_t m; Index: /usr/src/sys/kern/vfs_cluster.c =================================================================== --- /usr/src/sys/kern/vfs_cluster.c (revision 254562) +++ /usr/src/sys/kern/vfs_cluster.c (working copy) @@ -315,7 +315,7 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize daddr_t bn; off_t off; long tinc, tsize; - int i, inc, j, toff; + int i, inc, j, k, toff; KASSERT(size == vp->v_mount->mnt_stat.f_iosize, ("cluster_rbuild: size %ld != f_iosize %jd\n", @@ -378,7 +378,15 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize inc = btodb(size); bo = &vp->v_bufobj; for (bn = blkno, i = 0; i < run; ++i, bn += inc) { - if (i != 0) { + if (i == 0) { + VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); + vfs_drain_busy_pages(tbp); + vm_object_pip_add(tbp->b_bufobj->bo_object, + tbp->b_npages); + for (k = 0; k < tbp->b_npages; k++) + vm_page_sbusy(tbp->b_pages[k]); + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); + } else { if ((bp->b_npages * PAGE_SIZE) + round_page(size) > vp->v_mount->mnt_iosize_max) { break; @@ -424,14 +432,23 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize if ((tbp->b_pages[j]->valid & vm_page_bits(toff, tinc)) != 0) break; + if (vm_page_xbusied(tbp->b_pages[j])) + break; + vm_object_pip_add(tbp->b_bufobj->bo_object, 1); + vm_page_sbusy(tbp->b_pages[j]); off += tinc; tsize -= tinc; } - VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); if (tsize > 0) { +clean_sbusy: + vm_object_pip_add(tbp->b_bufobj->bo_object, -j); + for (k = 0; k < j; k++) + vm_page_sunbusy(tbp->b_pages[k]); + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); bqrelse(tbp); break; } + VM_OBJECT_WUNLOCK(tbp->b_bufobj->bo_object); /* * Set a read-ahead mark as appropriate @@ -451,8 +468,8 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize if (tbp->b_blkno == tbp->b_lblkno) { tbp->b_blkno = bn; } else if (tbp->b_blkno != bn) { - brelse(tbp); - break; + VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); + goto clean_sbusy; } } /* @@ -466,10 +483,8 @@ cluster_rbuild(struct vnode *vp, u_quad_t filesize for (j = 0; j < tbp->b_npages; j += 1) { vm_page_t m; m = tbp->b_pages[j]; - vm_page_sbusy(m); - vm_object_pip_add(m->object, 1); if ((bp->b_npages == 0) || - (bp->b_pages[bp->b_npages-1] != m)) { + (bp->b_pages[bp->b_npages-1] != m)) { bp->b_pages[bp->b_npages] = m; bp->b_npages++; } @@ -944,7 +959,9 @@ cluster_wbuild(struct vnode *vp, long size, daddr_ vm_page_t m; VM_OBJECT_WLOCK(tbp->b_bufobj->bo_object); - if (i != 0) { /* if not first buffer */ + if (i == 0) { + vfs_drain_busy_pages(tbp); + } else { /* if not first buffer */ for (j = 0; j < tbp->b_npages; j += 1) { m = tbp->b_pages[j]; if (vm_page_xbusied(m)) { Index: /usr/src/sys/mips/mips/pmap.c =================================================================== --- /usr/src/sys/mips/mips/pmap.c (revision 254562) +++ /usr/src/sys/mips/mips/pmap.c (working copy) @@ -1070,8 +1070,6 @@ pmap_pinit(pmap_t pmap) vm_page_t ptdpg; int i; - PMAP_LOCK_INIT(pmap); - /* * allocate the page directory page */ @@ -1231,7 +1229,6 @@ pmap_release(pmap_t pmap) ptdpg->wire_count--; atomic_subtract_int(&cnt.v_wire_count, 1); vm_page_free_zero(ptdpg); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/aim/mmu_oea.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea.c (revision 254562) +++ /usr/src/sys/powerpc/aim/mmu_oea.c (working copy) @@ -1655,7 +1655,6 @@ moea_pinit(mmu_t mmu, pmap_t pmap) u_int entropy; KASSERT((int)pmap < VM_MIN_KERNEL_ADDRESS, ("moea_pinit: virt pmap")); - PMAP_LOCK_INIT(pmap); RB_INIT(&pmap->pmap_pvo); entropy = 0; @@ -1719,6 +1718,7 @@ void moea_pinit0(mmu_t mmu, pmap_t pm) { + PMAP_LOCK_INIT(pm); moea_pinit(mmu, pm); bzero(&pm->pm_stats, sizeof(pm->pm_stats)); } @@ -1824,7 +1824,6 @@ moea_release(mmu_t mmu, pmap_t pmap) idx /= VSID_NBPW; moea_vsid_bitmap[idx] &= ~mask; mtx_unlock(&moea_vsid_mutex); - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/aim/mmu_oea64.c =================================================================== --- /usr/src/sys/powerpc/aim/mmu_oea64.c (revision 254562) +++ /usr/src/sys/powerpc/aim/mmu_oea64.c (working copy) @@ -1879,7 +1879,7 @@ moea64_get_unique_vsid(void) { void moea64_pinit(mmu_t mmu, pmap_t pmap) { - PMAP_LOCK_INIT(pmap); + RB_INIT(&pmap->pmap_pvo); pmap->pm_slb_tree_root = slb_alloc_tree(); @@ -1893,7 +1893,6 @@ moea64_pinit(mmu_t mmu, pmap_t pmap) int i; uint32_t hash; - PMAP_LOCK_INIT(pmap); RB_INIT(&pmap->pmap_pvo); if (pmap_bootstrapped) @@ -1920,6 +1919,8 @@ moea64_pinit(mmu_t mmu, pmap_t pmap) void moea64_pinit0(mmu_t mmu, pmap_t pm) { + + PMAP_LOCK_INIT(pm); moea64_pinit(mmu, pm); bzero(&pm->pm_stats, sizeof(pm->pm_stats)); } @@ -2074,8 +2075,6 @@ moea64_release(mmu_t mmu, pmap_t pmap) moea64_release_vsid(VSID_TO_HASH(pmap->pm_sr[0])); #endif - - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/powerpc/booke/pmap.c =================================================================== --- /usr/src/sys/powerpc/booke/pmap.c (revision 254562) +++ /usr/src/sys/powerpc/booke/pmap.c (working copy) @@ -1477,6 +1477,7 @@ static void mmu_booke_pinit0(mmu_t mmu, pmap_t pmap) { + PMAP_LOCK_INIT(pmap); mmu_booke_pinit(mmu, pmap); PCPU_SET(curpmap, pmap); } @@ -1495,7 +1496,6 @@ mmu_booke_pinit(mmu_t mmu, pmap_t pmap) KASSERT((pmap != kernel_pmap), ("pmap_pinit: initializing kernel_pmap")); - PMAP_LOCK_INIT(pmap); for (i = 0; i < MAXCPU; i++) pmap->pm_tid[i] = TID_NONE; CPU_ZERO(&kernel_pmap->pm_active); @@ -1516,8 +1516,6 @@ mmu_booke_release(mmu_t mmu, pmap_t pmap) KASSERT(pmap->pm_stats.resident_count == 0, ("pmap_release: pmap resident count %ld != 0", pmap->pm_stats.resident_count)); - - PMAP_LOCK_DESTROY(pmap); } /* Index: /usr/src/sys/sparc64/sparc64/pmap.c =================================================================== --- /usr/src/sys/sparc64/sparc64/pmap.c (revision 254562) +++ /usr/src/sys/sparc64/sparc64/pmap.c (working copy) @@ -1204,8 +1204,6 @@ pmap_pinit(pmap_t pm) vm_page_t m; int i; - PMAP_LOCK_INIT(pm); - /* * Allocate KVA space for the TSB. */ @@ -1299,7 +1297,6 @@ pmap_release(pmap_t pm) vm_page_free_zero(m); } VM_OBJECT_WUNLOCK(obj); - PMAP_LOCK_DESTROY(pm); } /* Index: /usr/src/sys/sys/buf.h =================================================================== --- /usr/src/sys/sys/buf.h (revision 254562) +++ /usr/src/sys/sys/buf.h (working copy) @@ -501,6 +501,7 @@ void bufstrategy(struct bufobj *, struct buf *); void brelse(struct buf *); void bqrelse(struct buf *); int vfs_bio_awrite(struct buf *); +void vfs_drain_busy_pages(struct buf *bp); struct buf * getpbuf(int *); struct buf *incore(struct bufobj *, daddr_t); struct buf *gbincore(struct bufobj *, daddr_t); Index: /usr/src/sys/vm/vm_map.c =================================================================== --- /usr/src/sys/vm/vm_map.c (revision 254562) +++ /usr/src/sys/vm/vm_map.c (working copy) @@ -226,6 +226,7 @@ vmspace_zinit(void *mem, int size, int flags) vm->vm_map.pmap = NULL; (void)vm_map_zinit(&vm->vm_map, sizeof(vm->vm_map), flags); + PMAP_LOCK_INIT(vmspace_pmap(vm)); return (0); } Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 254562) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -2558,6 +2558,8 @@ vm_page_cache(vm_page_t m) vm_page_free(m); return; } + if (!cache_was_empty) + cache_was_empty = vm_radix_is_singleton(&object->cache); m->flags |= PG_CACHED; cnt.v_cache_count++; PCPU_INC(cnt.v_tcached); Index: /usr/src/sys/vm/vm_radix.c =================================================================== --- /usr/src/sys/vm/vm_radix.c (revision 254562) +++ /usr/src/sys/vm/vm_radix.c (working copy) @@ -432,6 +432,20 @@ restart: } /* + * XXX + */ +boolean_t +vm_radix_is_singleton(struct vm_radix *rtree) +{ + struct vm_radix_node *rnode; + + rnode = vm_radix_getroot(rtree); + if (rnode == NULL) + return (FALSE); + return (vm_radix_isleaf(rnode)); +} + +/* * Returns the value stored at the index. If the index is not present, * NULL is returned. */ Index: /usr/src/sys/vm/vm_radix.h =================================================================== --- /usr/src/sys/vm/vm_radix.h (revision 254562) +++ /usr/src/sys/vm/vm_radix.h (working copy) @@ -37,6 +37,7 @@ void vm_radix_init(void); int vm_radix_insert(struct vm_radix *rtree, vm_page_t page); +boolean_t vm_radix_is_singleton(struct vm_radix *rtree); vm_page_t vm_radix_lookup(struct vm_radix *rtree, vm_pindex_t index); vm_page_t vm_radix_lookup_ge(struct vm_radix *rtree, vm_pindex_t index); vm_page_t vm_radix_lookup_le(struct vm_radix *rtree, vm_pindex_t index); -- Test scenario: mountu.sh