GENERIC HEAD from 2013-11-21 09:19:14 UTC, r258425, vmcore.92 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r258425: Fri Nov 22 10:29:49 CET 2013 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x206d7 Family = 0x6 Model = 0x2d Stepping = 7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 32153251840 (30663 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 74718321 free (151905 frags, 9320802 blocks, 0.2% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 20602261 free (733 frags, 2575191 blocks, 0.0% fragmentation) Mounting local file systems:. lock order reversal: 1st 0xfffff8012103e068 ufs (ufs) @ kern/vfs_subr.c:2101 2nd 0xfffffe0785e32278 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xfffff80121647a28 ufs (ufs) @ kern/vfs_subr.c:2101 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081ded7c70 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081ded7d20 witness_checkorder() at witness_checkorder+0xd23/frame 0xfffffe081ded7db0 __lockmgr_args() at __lockmgr_args+0x86c/frame 0xfffffe081ded7ee0 ffs_lock() at ffs_lock+0x92/frame 0xfffffe081ded7f30 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xf5/frame 0xfffffe081ded7f60 _vn_lock() at _vn_lock+0xc6/frame 0xfffffe081ded7fd0 vget() at vget+0x70/frame 0xfffffe081ded8020 vfs_hash_get() at vfs_hash_get+0xf5/frame 0xfffffe081ded8070 ffs_vgetf() at ffs_vgetf+0x41/frame 0xfffffe081ded8100 softdep_sync_buf() at softdep_sync_buf+0x9d3/frame 0xfffffe081ded81d0 ffs_syncvnode() at ffs_syncvnode+0x258/frame 0xfffffe081ded8250 ffs_truncate() at ffs_truncate+0x5f4/frame 0xfffffe081ded8430 ufs_direnter() at ufs_direnter+0x891/frame 0xfffffe081ded84f0 ufs_makeinode() at ufs_makeinode+0x573/frame 0xfffffe081ded86b0 VOP_CREATE_APV() at VOP_CREATE_APV+0x108/frame 0xfffffe081ded86e0 vn_open_cred() at vn_open_cred+0x2f0/frame 0xfffffe081ded8830 kern_openat() at kern_openat+0x261/frame 0xfffffe081ded89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081ded8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081ded8ab0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x800dd926a, rsp = 0x7fffffffc4f8, rbp = 0x7fffffffc5e0 --- Writing entropy file:. Setting hostname: t1.osted.lan. Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 igb0: flags=8843 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring keyboard: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. Expensive timeout(9) function: 0xffffffff806fcaa0(0xfffff8001701f000) 0.007461200 s add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/nss /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. Starting watchdogd. No core dumps found. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xfffffe0785ee6cf8 bufwait (bufwait) @ kern/vfs_bio.c:3081 2nd 0xfffff80121c6f600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081dfc82d0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081dfc8380 witness_checkorder() at witness_checkorder+0xd23/frame 0xfffffe081dfc8410 _sx_xlock() at _sx_xlock+0x75/frame 0xfffffe081dfc8450 ufsdirhash_add() at ufsdirhash_add+0x4c/frame 0xfffffe081dfc8490 ufs_direnter() at ufs_direnter+0x688/frame 0xfffffe081dfc8550 ufs_mkdir() at ufs_mkdir+0x863/frame 0xfffffe081dfc8750 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x10e/frame 0xfffffe081dfc8780 kern_mkdirat() at kern_mkdirat+0x1f3/frame 0xfffffe081dfc89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dfc8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dfc8ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80093951a, rsp = 0x7fffffffd798, rbp = 0x7fffffffdc70 --- Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Configuring syscons: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Local package initialization: backup. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Fri Nov 22 10:34:28 CET 2013 FreeBSD/amd64 (t1.osted.lan) (console) login: panic: uma_zalloc_arg: Returning an empty bucket. cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e117280 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e117330 vpanic() at vpanic+0x126/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- KDB: enter: panic [ thread pid 1096 tid 100342 ] Stopped at kdb_enter+0x3e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 1096 tid 100342 td 0xfffff80239f31490 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x5c5d80 curthread = 0xfffff80239f31490: pid 1096 "swap" curpcb = 0xfffffe081e117b80 fpcurthread = none idlethread = 0xfffff8000b21c000: tid 100003 "idle: cpu0" curpmap = 0xfffff80121e1a9f8 tssp = 0xffffffff8172ee90 commontssp = 0xffffffff8172ee90 rsp0 = 0xfffffe081e117b80 gs32p = 0xffffffff817308e8 ldt = 0xffffffff81730928 tss = 0xffffffff81730918 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe087aee1d80 curthread = 0xfffff80239e36490: pid 1086 "swap" curpcb = 0xfffffe081e0eab80 fpcurthread = none idlethread = 0xfffff8000b21b920: tid 100004 "idle: cpu1" curpmap = 0xfffff80121e1bd78 tssp = 0xffffffff8172eef8 commontssp = 0xffffffff8172eef8 rsp0 = 0xfffffe081e0eab80 gs32p = 0xffffffff81730950 ldt = 0xffffffff81730990 tss = 0xffffffff81730980 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe087aee9d80 curthread = 0xfffff80121581920: pid 1080 "swap" curpcb = 0xfffffe081e0c2b80 fpcurthread = none idlethread = 0xfffff8000b21b490: tid 100005 "idle: cpu2" curpmap = 0xfffff801216a5d78 tssp = 0xffffffff8172ef60 commontssp = 0xffffffff8172ef60 rsp0 = 0xfffffe081e0c2b80 gs32p = 0xffffffff817309b8 ldt = 0xffffffff817309f8 tss = 0xffffffff817309e8 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe087aef1d80 curthread = 0xfffff800170d9920: pid 5 "pagedaemon" curpcb = 0xfffffe081dbd4b80 fpcurthread = none idlethread = 0xfffff8000b21b000: tid 100006 "idle: cpu3" curpmap = 0xffffffff817179a8 tssp = 0xffffffff8172efc8 commontssp = 0xffffffff8172efc8 rsp0 = 0xfffffe081dbd4b80 gs32p = 0xffffffff81730a20 ldt = 0xffffffff81730a60 tss = 0xffffffff81730a50 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe087aef9d80 curthread = 0xfffff80121ddb920: pid 1098 "swap" curpcb = 0xfffffe081e126b80 fpcurthread = none idlethread = 0xfffff8000b21a920: tid 100007 "idle: cpu4" curpmap = 0xfffff80121e1a678 tssp = 0xffffffff8172f030 commontssp = 0xffffffff8172f030 rsp0 = 0xfffffe081e126b80 gs32p = 0xffffffff81730a88 ldt = 0xffffffff81730ac8 tss = 0xffffffff81730ab8 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe087af01d80 curthread = 0xfffff8000b21a490: pid 11 "idle: cpu5" curpcb = 0xfffffe078aa54b80 fpcurthread = none idlethread = 0xfffff8000b21a490: tid 100008 "idle: cpu5" curpmap = 0xffffffff817179a8 tssp = 0xffffffff8172f098 commontssp = 0xffffffff8172f098 rsp0 = 0xfffffe078aa54b80 gs32p = 0xffffffff81730af0 ldt = 0xffffffff81730b30 tss = 0xffffffff81730b20 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe087af09d80 curthread = 0xfffff80239e31920: pid 1089 "swap" curpcb = 0xfffffe081e0efb80 fpcurthread = 0xfffff80239e31920: pid 1089 "swap" idlethread = 0xfffff8000b21a000: tid 100009 "idle: cpu6" curpmap = 0xfffff80121e1b838 tssp = 0xffffffff8172f100 commontssp = 0xffffffff8172f100 rsp0 = 0xfffffe081e0efb80 gs32p = 0xffffffff81730b58 ldt = 0xffffffff81730b98 tss = 0xffffffff81730b88 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe087af11d80 curthread = 0xfffff80239e2f490: pid 1092 "swap" curpcb = 0xfffffe081e108b80 fpcurthread = none idlethread = 0xfffff8000b22c920: tid 100010 "idle: cpu7" curpmap = 0xfffff80121e1b2f8 tssp = 0xffffffff8172f168 commontssp = 0xffffffff8172f168 rsp0 = 0xfffffe081e108b80 gs32p = 0xffffffff81730bc0 ldt = 0xffffffff81730c00 tss = 0xffffffff81730bf0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe087af19d80 curthread = 0xfffff80121a98490: pid 1083 "swap" curpcb = 0xfffffe081df2db80 fpcurthread = 0xfffff80121a98490: pid 1083 "swap" idlethread = 0xfffff8000b22c490: tid 100011 "idle: cpu8" curpmap = 0xfffff80121e1c4b8 tssp = 0xffffffff8172f1d0 commontssp = 0xffffffff8172f1d0 rsp0 = 0xfffffe081df2db80 gs32p = 0xffffffff81730c28 ldt = 0xffffffff81730c68 tss = 0xffffffff81730c58 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe087af21d80 curthread = 0xfffff80239e36000: pid 1088 "swap" curpcb = 0xfffffe081e0e5b80 fpcurthread = 0xfffff80239e36000: pid 1088 "swap" idlethread = 0xfffff8000b22c000: tid 100012 "idle: cpu9" curpmap = 0xfffff80121e1b9f8 tssp = 0xffffffff8172f238 commontssp = 0xffffffff8172f238 rsp0 = 0xfffffe081e0e5b80 gs32p = 0xffffffff81730c90 ldt = 0xffffffff81730cd0 tss = 0xffffffff81730cc0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe087af29d80 curthread = 0xfffff80239e2f000: pid 1095 "swap" curpcb = 0xfffffe081e0f9b80 fpcurthread = 0xfffff80239e2f000: pid 1095 "swap" idlethread = 0xfffff8000b22b920: tid 100013 "idle: cpu10" curpmap = 0xfffff80121e1abb8 tssp = 0xffffffff8172f2a0 commontssp = 0xffffffff8172f2a0 rsp0 = 0xfffffe081e0f9b80 gs32p = 0xffffffff81730cf8 ldt = 0xffffffff81730d38 tss = 0xffffffff81730d28 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe087af31d80 curthread = 0xfffff80121575920: pid 1081 "swap" curpcb = 0xfffffe081e0d1b80 fpcurthread = 0xfffff80121575920: pid 1081 "swap" idlethread = 0xfffff8000b22b490: tid 100014 "idle: cpu11" curpmap = 0xfffff80121bfd9f8 tssp = 0xffffffff8172f308 commontssp = 0xffffffff8172f308 rsp0 = 0xfffffe081e0d1b80 gs32p = 0xffffffff81730d60 ldt = 0xffffffff81730da0 tss = 0xffffffff81730d90 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe087af39d80 curthread = 0xfffff80121575490: pid 1087 "swap" curpcb = 0xfffffe081e0d6b80 fpcurthread = 0xfffff80121575490: pid 1087 "swap" idlethread = 0xfffff8000b22b000: tid 100015 "idle: cpu12" curpmap = 0xfffff80121e1bbb8 tssp = 0xffffffff8172f370 commontssp = 0xffffffff8172f370 rsp0 = 0xfffffe081e0d6b80 gs32p = 0xffffffff81730dc8 ldt = 0xffffffff81730e08 tss = 0xffffffff81730df8 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe087af41d80 curthread = 0xfffff80121581490: pid 1079 "swap" curpcb = 0xfffffe081e0c7b80 fpcurthread = none idlethread = 0xfffff8000b22a920: tid 100016 "idle: cpu13" curpmap = 0xfffff801215d0d78 tssp = 0xffffffff8172f3d8 commontssp = 0xffffffff8172f3d8 rsp0 = 0xfffffe081e0c7b80 gs32p = 0xffffffff81730e30 ldt = 0xffffffff81730e70 tss = 0xffffffff81730e60 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe087af49d80 curthread = 0xfffff80239e2f920: pid 1094 "swap" curpcb = 0xfffffe081e0feb80 fpcurthread = none idlethread = 0xfffff8000b22a490: tid 100017 "idle: cpu14" curpmap = 0xfffff80121e1ad78 tssp = 0xffffffff8172f440 commontssp = 0xffffffff8172f440 rsp0 = 0xfffffe081e0feb80 gs32p = 0xffffffff81730e98 ldt = 0xffffffff81730ed8 tss = 0xffffffff81730ec8 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe087af51d80 curthread = 0xfffff80239e31000: pid 1091 "swap" curpcb = 0xfffffe081e103b80 fpcurthread = 0xfffff80239e31000: pid 1091 "swap" idlethread = 0xfffff8000b22a000: tid 100018 "idle: cpu15" curpmap = 0xfffff80121e1b4b8 tssp = 0xffffffff8172f4a8 commontssp = 0xffffffff8172f4a8 rsp0 = 0xfffffe081e103b80 gs32p = 0xffffffff81730f00 ldt = 0xffffffff81730f40 tss = 0xffffffff81730f30 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe087af59d80 curthread = 0xfffff80239e31490: pid 1090 "swap" curpcb = 0xfffffe081e0f4b80 fpcurthread = 0xfffff80239e31490: pid 1090 "swap" idlethread = 0xfffff8000b231920: tid 100019 "idle: cpu16" curpmap = 0xfffff80121e1b678 tssp = 0xffffffff8172f510 commontssp = 0xffffffff8172f510 rsp0 = 0xfffffe081e0f4b80 gs32p = 0xffffffff81730f68 ldt = 0xffffffff81730fa8 tss = 0xffffffff81730f98 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe087af61d80 curthread = 0xfffff80121581000: pid 1082 "swap" curpcb = 0xfffffe081e0ccb80 fpcurthread = none idlethread = 0xfffff8000b231490: tid 100020 "idle: cpu17" curpmap = 0xfffff80121e1c678 tssp = 0xffffffff8172f578 commontssp = 0xffffffff8172f578 rsp0 = 0xfffffe081e0ccb80 gs32p = 0xffffffff81730fd0 ldt = 0xffffffff81731010 tss = 0xffffffff81731000 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe087af69d80 curthread = 0xfffff80239f31920: pid 1097 "swap" curpcb = 0xfffffe081e112b80 fpcurthread = none idlethread = 0xfffff8000b231000: tid 100021 "idle: cpu18" curpmap = 0xfffff80121e1a838 tssp = 0xffffffff8172f5e0 commontssp = 0xffffffff8172f5e0 rsp0 = 0xfffffe081e112b80 gs32p = 0xffffffff81731038 ldt = 0xffffffff81731078 tss = 0xffffffff81731068 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe087af71d80 curthread = 0xfffff80121d47000: pid 1093 "swap" curpcb = 0xfffffe081e10db80 fpcurthread = 0xfffff80121d47000: pid 1093 "swap" idlethread = 0xfffff8000b230920: tid 100022 "idle: cpu19" curpmap = 0xfffff80121e1b138 tssp = 0xffffffff8172f648 commontssp = 0xffffffff8172f648 rsp0 = 0xfffffe081e10db80 gs32p = 0xffffffff817310a0 ldt = 0xffffffff817310e0 tss = 0xffffffff817310d0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe087af79d80 curthread = 0xfffff80239e36920: pid 1085 "swap" curpcb = 0xfffffe081e0e0b80 fpcurthread = 0xfffff80239e36920: pid 1085 "swap" idlethread = 0xfffff8000b230490: tid 100023 "idle: cpu20" curpmap = 0xfffff80121e1c138 tssp = 0xffffffff8172f6b0 commontssp = 0xffffffff8172f6b0 rsp0 = 0xfffffe081e0e0b80 gs32p = 0xffffffff81731108 ldt = 0xffffffff81731148 tss = 0xffffffff81731138 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe087af81d80 curthread = 0xfffff80121575000: pid 1084 "swap" curpcb = 0xfffffe081e0dbb80 fpcurthread = none idlethread = 0xfffff8000b230000: tid 100024 "idle: cpu21" curpmap = 0xfffff80121e1c2f8 tssp = 0xffffffff8172f718 commontssp = 0xffffffff8172f718 rsp0 = 0xfffffe081e0dbb80 gs32p = 0xffffffff81731170 ldt = 0xffffffff817311b0 tss = 0xffffffff817311a0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe087af89d80 curthread = 0xfffff80239f2e920: pid 1117 "signal0" curpcb = 0xfffffe081e11cb80 fpcurthread = 0xfffff80239f2e920: pid 1117 "signal0" idlethread = 0xfffff8000b22f920: tid 100025 "idle: cpu22" curpmap = 0xfffff80121aa6678 tssp = 0xffffffff8172f780 commontssp = 0xffffffff8172f780 rsp0 = 0xfffffe081e11cb80 gs32p = 0xffffffff817311d8 ldt = 0xffffffff81731218 tss = 0xffffffff81731208 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe08095b9d80 curthread = 0xfffff8014874b000: pid 1117 "signal0" curpcb = 0xfffffe081e121b80 fpcurthread = none idlethread = 0xfffff8000b22f490: tid 100026 "idle: cpu23" curpmap = 0xfffff80121aa6678 tssp = 0xffffffff8172f7e8 commontssp = 0xffffffff8172f7e8 rsp0 = 0xfffffe081e121b80 gs32p = 0xffffffff81731240 ldt = 0xffffffff81731280 tss = 0xffffffff81731270 spin locks held: db:0:allpcpu> show alllocks Process 1117 (signal0) thread 0xfffff80239f2e920 (101121) exclusive sx vm map (user) (vm map (user)) r = 0 (0xfffff80121aa65c0) locked @ vm/vm_map.c:3358 Process 1098 (swap) thread 0xfffff80121ddb920 (100351) exclusive rw vm object (vm object) r = 0 (0xfffff802395cb000) locked @ vm/vm_fault.c:306 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1a5c0) locked @ vm/vm_map.c:3843 Process 1097 (swap) thread 0xfffff80239f31920 (100346) shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1a780) locked @ vm/vm_map.c:3843 Process 1096 (swap) thread 0xfffff80239f31490 (100342) exclusive sleep mutex RADIX NODE (UMA zone) r = 0 (0xfffff807fffdc600) locked @ vm/uma_core.c:2179 exclusive rw vm object (vm object) r = 0 (0xfffff804c7f05200) locked @ vm/vm_fault.c:306 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1a940) locked @ vm/vm_map.c:3843 Process 1092 (swap) thread 0xfffff80239e2f490 (100320) shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff816b1980) locked @ amd64/amd64/pmap.c:4172 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1b240) locked @ vm/vm_map.c:3843 Process 1086 (swap) thread 0xfffff80239e36490 (100292) exclusive rw vm object (vm object) r = 0 (0xfffff8024199d500) locked @ vm/vm_fault.c:306 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1bcc0) locked @ vm/vm_map.c:3843 Process 1084 (swap) thread 0xfffff80121575000 (100281) exclusive rw vm object (vm object) r = 0 (0xfffff80241ec3700) locked @ vm/vm_fault.c:306 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff80121e1c240) locked @ vm/vm_map.c:3843 Process 1080 (swap) thread 0xfffff80121581920 (100261) shared rw pmap pv global (pmap pv global) r = 0 (0xffffffff816b1980) locked @ amd64/amd64/pmap.c:4172 shared sx vm map (user) (vm map (user)) r = 0 (0xfffff801216a5cc0) locked @ vm/vm_map.c:3843 Process 1079 (swap) thread 0xfffff80121581490 (100256) shared sx vm map (user) (vm map (user)) r = 0 (0xfffff801215d0cc0) locked @ vm/vm_map.c:3843 Process 5 (pagedaemon) thread 0xfffff800170d9920 (100133) exclusive sleep mutex 2048 (UMA zone) r = 0 (0xfffff80005c61a80) locked @ vm/uma_core.c:708 exclusive sleep mutex UMA lock (UMA lock) r = 0 (0xffffffff816aa700) locked @ vm/uma_core.c:1736 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffff801213e6b58 /dev/da0p2 on / (ufs) 0xfffff801213e7000 devfs on /dev (devfs) 0xfffff80121d0b3c8 /dev/da0p3 on /tmp (ufs) 0xfffff80121d1d790 procfs on /proc (procfs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1117 1069 1069 1001 R+ (threaded) signal0 100673 Run CPU 23 signal0 101121 Run CPU 22 signal0 1110 1106 1110 1001 S+ select 0xfffff801486160c0 top 1106 1105 1106 1001 SWs+ wait 0xfffff8012149c000 bash 1105 1103 1103 1001 S select 0xfffff80121a3ca40 sshd 1103 955 1103 0 Ss select 0xfffff80121b1eb40 sshd 1098 1078 1069 1001 RL+ CPU 4 swap 1097 1078 1069 1001 RL+ CPU 18 swap 1096 1078 1069 1001 RL+ CPU 0 swap 1095 1078 1069 1001 R+ CPU 10 swap 1094 1078 1069 1001 RL+ CPU 14 swap 1093 1078 1069 1001 R+ CPU 19 swap 1092 1078 1069 1001 RL+ CPU 7 swap 1091 1078 1069 1001 R+ CPU 15 swap 1090 1078 1069 1001 R+ CPU 16 swap 1089 1078 1069 1001 R+ CPU 6 swap 1088 1078 1069 1001 R+ CPU 9 swap 1087 1078 1069 1001 R+ CPU 12 swap 1086 1078 1069 1001 RL+ CPU 1 swap 1085 1078 1069 1001 R+ CPU 20 swap 1084 1078 1069 1001 RL+ CPU 21 swap 1083 1078 1069 1001 R+ CPU 8 swap 1082 1078 1069 1001 R+ CPU 17 swap 1081 1078 1069 1001 R+ CPU 11 swap 1080 1078 1069 1001 RL+ CPU 2 swap 1079 1078 1069 1001 RL+ CPU 13 swap 1078 1075 1069 1001 SW+ wait 0xfffff8012166f000 swap 1075 1069 1069 1001 S+ nanslp 0xffffffff814b42d2 swap 1069 1055 1069 1001 S+ wait 0xfffff8012159d970 sh 1055 1054 1055 1001 SWs+ wait 0xfffff8012166f4b8 bash 1054 1052 1052 1001 S select 0xfffff80121be2840 sshd 1052 955 1052 0 Ss select 0xfffff801481fdac0 sshd 1051 1 1051 0 Ss+ ttyin 0xfffff8000b2424a8 getty 1050 1 1050 0 Ss+ ttyin 0xfffff8000b2428a8 getty 1049 1 1049 0 Ss+ ttyin 0xfffff8000b242ca8 getty 1048 1 1048 0 Ss+ ttyin 0xfffff8000b2430a8 getty 1047 1 1047 0 Ss+ ttyin 0xfffff8000b2434a8 getty 1046 1 1046 0 Ss+ ttyin 0xfffff8000b2438a8 getty 1045 1 1045 0 Ss+ ttyin 0xfffff8000b243ca8 getty 1044 1 1044 0 Ss+ ttyin 0xfffff8000b2440a8 getty 1043 1 1043 0 Ss+ ttyin 0xfffff8000b2448a8 getty 1026 1 1026 0 Ss select 0xfffff80121a3cb40 inetd 965 1 965 0 SWs nanslp 0xffffffff814b42e7 cron 961 1 961 25 SWs pause 0xfffff8012149ca18 sendmail 958 1 958 0 Ss select 0xfffff801212793c0 sendmail 955 1 955 0 Ss select 0xfffff80121be2940 sshd 926 1 926 0 Ss select 0xfffff801486f03c0 powerd 923 1 923 0 Ss select 0xfffff80121b1ebc0 ntpd 885 883 883 0 S (threaded) nfsd 100209 S rpcsvc 0xfffff80121c783a0 nfsd: service 100208 S rpcsvc 0xfffff80121491ca0 nfsd: service 100207 S rpcsvc 0xfffff801486ca7a0 nfsd: service 100206 S rpcsvc 0xfffff801486ce820 nfsd: master 883 1 883 0 Ss select 0xfffff80121cfd9c0 nfsd 877 1 877 0 Ss select 0xfffff80121cfde40 mountd 870 866 866 0 S select 0xfffff801481fdf40 nfsuserd 869 866 866 0 S select 0xfffff80121df2c40 nfsuserd 868 866 866 0 S select 0xfffff80121ba1c40 nfsuserd 867 866 866 0 S select 0xfffff80121cfda40 nfsuserd 866 1 866 0 SWs pause 0xfffff80121cc0560 nfsuserd 837 1 837 0 Ss select 0xfffff80121be2d40 rpcbind 823 1 823 0 Ss nanslp 0xffffffff814b42d0 watchdogd 820 1 820 0 Ss select 0xfffff801481fdd40 syslogd 687 1 687 0 Ss select 0xfffff801482aa0c0 devd 670 1 670 0 Ss select 0xfffff80121279540 moused 17 0 0 0 DL sdflush 0xffffffff816aa378 [softdepflush] 16 0 0 0 DL syncer 0xffffffff816a36b0 [syncer] 9 0 0 0 DL vlruwt 0xfffff801211d3000 [vnlru] 8 0 0 0 DL psleep 0xffffffff816a3084 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff816ab98c [pagezero] 6 0 0 0 DL psleep 0xffffffff816ab0c0 [vmdaemon] 5 0 0 0 RL CPU 3 [pagedaemon] 4 0 0 0 DL idle 0xfffff801211d4970 [enc_daemon0] 3 0 0 0 DL waiting_ 0xffffffff81722548 [sctp_iterator] 15 0 0 0 DL (threaded) [usb] 100123 D - 0xfffffe0001163e18 [usbus2] 100122 D - 0xfffffe0001163dc0 [usbus2] 100121 D - 0xfffffe0001163d68 [usbus2] 100120 D - 0xfffffe0001163d10 [usbus2] 100118 D - 0xfffffe000115c1b0 [usbus1] 100117 D - 0xfffffe000115c158 [usbus1] 100116 D - 0xfffffe000115c100 [usbus1] 100115 D - 0xfffffe000115c0a8 [usbus1] 100078 D - 0xfffffe0000ea9e18 [usbus0] 100077 D - 0xfffffe0000ea9dc0 [usbus0] 100076 D - 0xfffffe0000ea9d68 [usbus0] 100075 D - 0xfffffe0000ea9d10 [usbus0] 2 0 0 0 DL (threaded) [cam] 100131 D ccb_scan 0xffffffff81472440 [scanner] 100071 D - 0xffffffff81472a00 [doneq4] 100070 D - 0xffffffff81472900 [doneq3] 100069 D - 0xffffffff81472800 [doneq2] 100068 D - 0xffffffff81472700 [doneq1] 100067 D - 0xffffffff81472600 [doneq0] 14 0 0 0 DL - 0xffffffff8148f670 [rand_harvestq] 13 0 0 0 DL (threaded) [geom] 100056 D - 0xffffffff81716e40 [g_down] 100055 D - 0xffffffff81716e38 [g_up] 100054 D - 0xffffffff81716e30 [g_event] 12 0 0 0 WL (threaded) [intr] 100126 I [swi0: uart] 100125 I [irq287: hdac1] 100124 I [irq286: ahci0] 100119 I [irq20: ehci1] 100114 I [irq285: xhci0] 100113 I [irq284: igb1:link] 100111 I [irq283: igb1:que 7] 100109 I [irq282: igb1:que 6] 100107 I [irq281: igb1:que 5] 100105 I [irq280: igb1:que 4] 100103 I [irq279: igb1:que 3] 100101 I [irq278: igb1:que 2] 100099 I [irq277: igb1:que 1] 100097 I [irq276: igb1:que 0] 100096 I [irq275: igb0:link] 100094 I [irq274: igb0:que 7] 100092 I [irq273: igb0:que 6] 100090 I [irq272: igb0:que 5] 100088 I [irq271: igb0:que 4] 100086 I [irq270: igb0:que 3] 100084 I [irq269: igb0:que 2] 100082 I [irq268: igb0:que 1] 100080 I [irq267: igb0:que 0] 100079 I [irq266: hdac0] 100074 I [irq22: ehci0] 100073 I [irq265: isci0] 100072 I [irq264: isci0] 100065 I [swi5: fast taskq] 100063 I [swi6: Giant taskq] 100062 I [swi6: task queue] 100052 I [swi3: vm] 100051 I [swi1: netisr 0] 100050 I [swi4: clock] 100049 I [swi4: clock] 100048 I [swi4: clock] 100047 I [swi4: clock] 100046 I [swi4: clock] 100045 I [swi4: clock] 100044 I [swi4: clock] 100043 I [swi4: clock] 100042 I [swi4: clock] 100041 I [swi4: clock] 100040 I [swi4: clock] 100039 I [swi4: clock] 100038 I [swi4: clock] 100037 I [swi4: clock] 100036 I [swi4: clock] 100035 I [swi4: clock] 100034 I [swi4: clock] 100033 I [swi4: clock] 100032 I [swi4: clock] 100031 I [swi4: clock] 100030 I [swi4: clock] 100029 I [swi4: clock] 100028 I [swi4: clock] 100027 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100026 CanRun [idle: cpu23] 100025 CanRun [idle: cpu22] 100024 CanRun [idle: cpu21] 100023 CanRun [idle: cpu20] 100022 CanRun [idle: cpu19] 100021 CanRun [idle: cpu18] 100020 CanRun [idle: cpu17] 100019 CanRun [idle: cpu16] 100018 CanRun [idle: cpu15] 100017 CanRun [idle: cpu14] 100016 CanRun [idle: cpu13] 100015 CanRun [idle: cpu12] 100014 CanRun [idle: cpu11] 100013 CanRun [idle: cpu10] 100012 CanRun [idle: cpu9] 100011 CanRun [idle: cpu8] 100010 CanRun [idle: cpu7] 100009 CanRun [idle: cpu6] 100008 Run CPU 5 [idle: cpu5] 100007 CanRun [idle: cpu4] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xfffff8000b2194b8 [init] 10 0 0 0 DL audit_wo 0xffffffff81725cb8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100130 D - 0xfffff8000b26b900 [CAM taskq] 100128 D - 0xffffffff814b3147 [deadlkres] 100127 D - 0xfffff8000b269d00 [mca taskq] 100112 D - 0xfffff8000b26a600 [igb1 que] 100110 D - 0xfffff8000b26a700 [igb1 que] 100108 D - 0xfffff8000b26a800 [igb1 que] 100106 D - 0xfffff8000b26a900 [igb1 que] 100104 D - 0xfffff8000b26aa00 [igb1 que] 100102 D - 0xfffff8000b26ab00 [igb1 que] 100100 D - 0xfffff8000b26ac00 [igb1 que] 100098 D - 0xfffff8000b26ad00 [igb1 que] 100095 D - 0xfffff8000b26ae00 [igb0 que] 100093 D - 0xfffff8000b26b000 [igb0 que] 100091 D - 0xfffff8000b26b100 [igb0 que] 100089 D - 0xfffff8000b26b200 [igb0 que] 100087 D - 0xfffff8000b26b300 [igb0 que] 100085 D - 0xfffff8000b26b400 [igb0 que] 100083 D - 0xfffff8000b26b500 [igb0 que] 100081 D - 0xfffff8000b26b600 [igb0 que] 100066 D - 0xfffff8000b26ba00 [ffs_trim taskq] 100064 D - 0xfffff8000b26bc00 [thread taskq] 100061 D - 0xfffff8000b26c000 [kqueue taskq] 100060 D - 0xfffff8000b26c100 [acpi_task_2] 100059 D - 0xfffff8000b26c100 [acpi_task_1] 100058 D - 0xfffff8000b26c100 [acpi_task_0] 100053 D - 0xfffff8000b26d000 [firmware taskq] 100000 D swapin 0xffffffff81716f38 [swapper] db:0:ps> allt Tracing command signal0 pid 1117 tid 100673 td 0xfffff8014874b000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe078aa29ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe078aa29d00 trap() at trap+0x42/frame 0xfffffe078aa29f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe078aa29f20 --- trap 0x13, rip = 0xffffffff809172b3, rsp = 0xfffffe078aa29fe0, rbp = 0xfffffe081e121860 --- witness_warn() at witness_warn+0x4b3/frame 0xfffffe081e121860 userret() at userret+0x89/frame 0xfffffe081e121890 trap() at trap+0x52c/frame 0xfffffe081e121ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e121ab0 --- trap 0xc, rip = 0x800824370, rsp = 0x7ffcba5dfff8, rbp = 0 --- Tracing command signal0 pid 1117 tid 101121 td 0xfffff80239f2e920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3f9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3f9d00 trap() at trap+0x42/frame 0xfffffe07fc3f9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3f9f20 --- trap 0x13, rip = 0xffffffff80b3ffc2, rsp = 0xfffffe07fc3f9fe0, rbp = 0xfffffe081e11c6c0 --- vm_map_insert() at vm_map_insert+0xc2/frame 0xfffffe081e11c6c0 vm_map_stack() at vm_map_stack+0x307/frame 0xfffffe081e11c750 vm_mmap() at vm_mmap+0x528/frame 0xfffffe081e11c8e0 sys_mmap() at sys_mmap+0x310/frame 0xfffffe081e11c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e11cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e11cab0 --- syscall (477, FreeBSD ELF64, sys_mmap), rip = 0x800ad842a, rsp = 0x7fffffffd868, rbp = 0x7fffffffd8a0 --- Tracing command top pid 1110 tid 100318 td 0xfffff8039d5e5920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e12b580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e12b5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e12b600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e12b670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e12b6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081e12b720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e12b760 kern_select() at kern_select+0x8a2/frame 0xfffffe081e12b960 sys_select() at sys_select+0x54/frame 0xfffffe081e12b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e12bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e12bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800fcf9aa, rsp = 0x7fffffffd828, rbp = 0x7fffffffda10 --- Tracing command bash pid 1106 tid 101264 td 0xfffff8039d5d7920 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command sshd pid 1105 tid 100198 td 0xfffff80121ced000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e004590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0045d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e004610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e004680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0046b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e004720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e004760 kern_select() at kern_select+0x8a2/frame 0xfffffe081e004960 sys_select() at sys_select+0x54/frame 0xfffffe081e0049a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e004ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e004ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8032079aa, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1103 tid 100226 td 0xfffff801217ed490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e090630 mi_switch() at mi_switch+0x179/frame 0xfffffe081e090670 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0906b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e090720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e090750 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0907c0 seltdwait() at seltdwait+0x78/frame 0xfffffe081e090800 sys_poll() at sys_poll+0x3c9/frame 0xfffffe081e0909a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e090ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e090ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80319fe7a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command swap pid 1098 tid 100351 td 0xfffff80121ddb920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc369ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc369d00 trap() at trap+0x42/frame 0xfffffe07fc369f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc369f20 --- trap 0x13, rip = 0xffffffff809168cd, rsp = 0xfffffe07fc369fe0, rbp = 0xfffffe081e126520 --- witness_unlock() at witness_unlock+0x14d/frame 0xfffffe081e126520 _rw_wunlock_cookie() at _rw_wunlock_cookie+0x84/frame 0xfffffe081e126560 vm_fault_hold() at vm_fault_hold+0x16ee/frame 0xfffffe081e1267b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1267f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e126890 trap() at trap+0x502/frame 0xfffffe081e126ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e126ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1097 tid 100346 td 0xfffff80239f31920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3d9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3d9d00 trap() at trap+0x42/frame 0xfffffe07fc3d9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3d9f20 --- trap 0x13, rip = 0xffffffff808bf62a, rsp = 0xfffffe07fc3d9fe0, rbp = 0xfffffe081e112560 --- _rw_wunlock_cookie() at _rw_wunlock_cookie+0xda/frame 0xfffffe081e112560 vm_fault_hold() at vm_fault_hold+0x16ee/frame 0xfffffe081e1127b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1127f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e112890 trap() at trap+0x502/frame 0xfffffe081e112ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e112ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1096 tid 100342 td 0xfffff80239f31490 kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1095 tid 100336 td 0xfffff80239e2f000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc399ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc399d00 trap() at trap+0x42/frame 0xfffffe07fc399f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc399f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1094 tid 100330 td 0xfffff80239e2f920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3b9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3b9d00 trap() at trap+0x42/frame 0xfffffe07fc3b9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3b9f20 --- trap 0x13, rip = 0xffffffff8091525e, rsp = 0xfffffe07fc3b9fe0, rbp = 0xfffffe081e0fe7a0 --- witness_checkorder() at witness_checkorder+0x1e/frame 0xfffffe081e0fe7a0 __mtx_lock_flags() at __mtx_lock_flags+0xa6/frame 0xfffffe081e0fe7f0 trap_pfault() at trap_pfault+0x1db/frame 0xfffffe081e0fe890 trap() at trap+0x502/frame 0xfffffe081e0feab0 calltrap() at calltrap+0x8/frame 0xfffffe081e0feab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1093 tid 100325 td 0xfffff80121d47000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3e1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3e1d00 trap() at trap+0x42/frame 0xfffffe07fc3e1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3e1f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1092 tid 100320 td 0xfffff80239e2f490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc381ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc381d00 trap() at trap+0x42/frame 0xfffffe07fc381f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc381f20 --- trap 0x13, rip = 0xffffffff8091571b, rsp = 0xfffffe07fc381fe0, rbp = 0xfffffe081e108440 --- witness_checkorder() at witness_checkorder+0x4db/frame 0xfffffe081e108440 __mtx_lock_flags() at __mtx_lock_flags+0xa6/frame 0xfffffe081e108490 pmap_enter() at pmap_enter+0x2b4/frame 0xfffffe081e108560 vm_fault_hold() at vm_fault_hold+0x171a/frame 0xfffffe081e1087b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1087f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e108890 trap() at trap+0x502/frame 0xfffffe081e108ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e108ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1091 tid 100315 td 0xfffff80239e31000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3c1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3c1d00 trap() at trap+0x42/frame 0xfffffe07fc3c1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3c1f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1090 tid 100311 td 0xfffff80239e31490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3c9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3c9d00 trap() at trap+0x42/frame 0xfffffe07fc3c9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3c9f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1089 tid 100307 td 0xfffff80239e31920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc379ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc379d00 trap() at trap+0x42/frame 0xfffffe07fc379f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc379f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1088 tid 100302 td 0xfffff80239e36000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc391ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc391d00 trap() at trap+0x42/frame 0xfffffe07fc391f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc391f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1087 tid 100298 td 0xfffff80121575490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3a9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3a9d00 trap() at trap+0x42/frame 0xfffffe07fc3a9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3a9f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1086 tid 100292 td 0xfffff80239e36490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc351ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc351d00 trap() at trap+0x42/frame 0xfffffe07fc351f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc351f20 --- trap 0x13, rip = 0xffffffff808bf551, rsp = 0xfffffe07fc351fe0, rbp = 0xfffffe081e0ea7b0 --- _rw_wunlock_cookie() at _rw_wunlock_cookie+0x1/frame 0xfffffe081e0ea7b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e0ea7f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e0ea890 trap() at trap+0x502/frame 0xfffffe081e0eaab0 calltrap() at calltrap+0x8/frame 0xfffffe081e0eaab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1085 tid 100286 td 0xfffff80239e36920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3e9ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3e9d00 trap() at trap+0x42/frame 0xfffffe07fc3e9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3e9f20 --- trap 0x13, rip = 0x401b81, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1084 tid 100281 td 0xfffff80121575000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3f1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3f1d00 trap() at trap+0x42/frame 0xfffffe07fc3f1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3f1f20 --- trap 0x13, rip = 0xffffffff80cc5227, rsp = 0xfffffe07fc3f1fe0, rbp = 0xfffffe081e0db7b0 --- pagezero() at pagezero+0x17/frame 0xfffffe081e0db7b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e0db7f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e0db890 trap() at trap+0x502/frame 0xfffffe081e0dbab0 calltrap() at calltrap+0x8/frame 0xfffffe081e0dbab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1083 tid 100158 td 0xfffff80121a98490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc389ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc389d00 trap() at trap+0x42/frame 0xfffffe07fc389f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc389f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1082 tid 100272 td 0xfffff80121581000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3d1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3d1d00 trap() at trap+0x42/frame 0xfffffe07fc3d1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3d1f20 --- trap 0x13, rip = 0xffffffff80cac820, rsp = 0xfffffe07fc3d1fe0, rbp = 0x7fffffffd3d0 --- Xpage() at Xpage/frame 0x7fffffffd3d0 Tracing command swap pid 1081 tid 100267 td 0xfffff80121575920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3a1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3a1d00 trap() at trap+0x42/frame 0xfffffe07fc3a1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3a1f20 --- trap 0x13, rip = 0x401b7e, rsp = 0x7fffffffd8a0, rbp = 0x7fffffffd8c0 --- Tracing command swap pid 1080 tid 100261 td 0xfffff80121581920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc359ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc359d00 trap() at trap+0x42/frame 0xfffffe07fc359f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc359f20 --- trap 0x13, rip = 0xffffffff80916032, rsp = 0xfffffe07fc359fe0, rbp = 0xfffffe081e0c2440 --- witness_lock() at witness_lock+0xa2/frame 0xfffffe081e0c2440 __mtx_lock_flags() at __mtx_lock_flags+0x10a/frame 0xfffffe081e0c2490 pmap_enter() at pmap_enter+0x2b4/frame 0xfffffe081e0c2560 vm_fault_hold() at vm_fault_hold+0x171a/frame 0xfffffe081e0c27b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e0c27f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e0c2890 trap() at trap+0x502/frame 0xfffffe081e0c2ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e0c2ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1079 tid 100256 td 0xfffff80121581490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc3b1ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc3b1d00 trap() at trap+0x42/frame 0xfffffe07fc3b1f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc3b1f20 --- trap 0x13, rip = 0xffffffff8091571b, rsp = 0xfffffe07fc3b1fe0, rbp = 0xfffffe081e0c74c0 --- witness_checkorder() at witness_checkorder+0x4db/frame 0xfffffe081e0c74c0 __rw_rlock() at __rw_rlock+0xa5/frame 0xfffffe081e0c7560 vm_fault_hold() at vm_fault_hold+0x18a4/frame 0xfffffe081e0c77b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e0c77f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e0c7890 trap() at trap+0x502/frame 0xfffffe081e0c7ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e0c7ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1078 tid 100154 td 0xfffff8012167f000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command swap pid 1075 tid 100156 td 0xfffff80121ccf920 sched_switch() at sched_switch+0x482/frame 0xfffffe081df23740 mi_switch() at mi_switch+0x179/frame 0xfffffe081df23780 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df237c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df23830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df23860 _sleep() at _sleep+0x314/frame 0xfffffe081df23900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe081df23960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe081df239a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df23ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df23ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b3eada, rsp = 0x7fffffffd868, rbp = 0x7fffffffd8c0 --- Tracing command sh pid 1069 tid 100143 td 0xfffff801211e4000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dee2550 mi_switch() at mi_switch+0x179/frame 0xfffffe081dee2590 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dee25d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dee2640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dee2670 _sleep() at _sleep+0x334/frame 0xfffffe081dee2710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe081dee27b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe081dee29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dee2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dee2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800d39cca, rsp = 0x7fffffffd588, rbp = 0x7fffffffd630 --- Tracing command bash pid 1055 tid 100146 td 0xfffff8012167f490 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command sshd pid 1054 tid 100175 td 0xfffff80121ef7920 sched_switch() at sched_switch+0x482/frame 0xfffffe081df82590 mi_switch() at mi_switch+0x179/frame 0xfffffe081df825d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df82610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df82680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081df826b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081df82720 seltdwait() at seltdwait+0x78/frame 0xfffffe081df82760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df82960 sys_select() at sys_select+0x54/frame 0xfffffe081df829a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df82ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df82ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8032079aa, rsp = 0x7fffffffd168, rbp = 0x7fffffffd1d0 --- Tracing command sshd pid 1052 tid 100191 td 0xfffff8014833e920 sched_switch() at sched_switch+0x482/frame 0xfffffe081dfd2630 mi_switch() at mi_switch+0x179/frame 0xfffffe081dfd2670 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dfd26b0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dfd2720 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dfd2750 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081dfd27c0 seltdwait() at seltdwait+0x78/frame 0xfffffe081dfd2800 sys_poll() at sys_poll+0x3c9/frame 0xfffffe081dfd29a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dfd2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dfd2ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80319fe7a, rsp = 0x7fffffffd1f8, rbp = 0x7fffffffd250 --- Tracing command getty pid 1051 tid 100153 td 0xfffff80121872920 sched_switch() at sched_switch+0x482/frame 0xfffffe081df14610 mi_switch() at mi_switch+0x179/frame 0xfffffe081df14650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df14690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df14700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081df14730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081df147a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081df147d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081df14830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081df14860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081df148c0 dofileread() at dofileread+0x7b/frame 0xfffffe081df14900 kern_readv() at kern_readv+0x65/frame 0xfffffe081df14950 sys_read() at sys_read+0x63/frame 0xfffffe081df149a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df14ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df14ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1050 tid 100233 td 0xfffff801218d7000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0b3610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0b3650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0b3690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0b3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0b3730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0b37a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e0b37d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e0b3830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e0b3860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e0b38c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e0b3900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e0b3950 sys_read() at sys_read+0x63/frame 0xfffffe081e0b39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0b3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0b3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1049 tid 100232 td 0xfffff801218d7490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0ae610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0ae650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0ae690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0ae700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0ae730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0ae7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e0ae7d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e0ae830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e0ae860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e0ae8c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e0ae900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e0ae950 sys_read() at sys_read+0x63/frame 0xfffffe081e0ae9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0aeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0aeab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1048 tid 100231 td 0xfffff801218d7920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0a9610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0a9650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0a9690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0a9700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0a9730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0a97a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e0a97d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e0a9830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e0a9860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e0a98c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e0a9900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e0a9950 sys_read() at sys_read+0x63/frame 0xfffffe081e0a99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0a9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0a9ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1047 tid 100230 td 0xfffff80121aa9000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e0a4610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0a4650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0a4690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e0a4700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e0a4730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0a47a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e0a47d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e0a4830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e0a4860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e0a48c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e0a4900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e0a4950 sys_read() at sys_read+0x63/frame 0xfffffe081e0a49a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e0a4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e0a4ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1046 tid 100229 td 0xfffff80121aa9490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e09f610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e09f650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e09f690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e09f700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e09f730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e09f7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e09f7d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e09f830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e09f860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e09f8c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e09f900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e09f950 sys_read() at sys_read+0x63/frame 0xfffffe081e09f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e09fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e09fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1045 tid 100228 td 0xfffff80121aa9920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e09a610 mi_switch() at mi_switch+0x179/frame 0xfffffe081e09a650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e09a690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e09a700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e09a730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e09a7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081e09a7d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081e09a830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081e09a860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081e09a8c0 dofileread() at dofileread+0x7b/frame 0xfffffe081e09a900 kern_readv() at kern_readv+0x65/frame 0xfffffe081e09a950 sys_read() at sys_read+0x63/frame 0xfffffe081e09a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e09aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e09aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1044 tid 100177 td 0xfffff801211e3490 sched_switch() at sched_switch+0x482/frame 0xfffffe081df8c610 mi_switch() at mi_switch+0x179/frame 0xfffffe081df8c650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df8c690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df8c700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081df8c730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081df8c7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081df8c7d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081df8c830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081df8c860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081df8c8c0 dofileread() at dofileread+0x7b/frame 0xfffffe081df8c900 kern_readv() at kern_readv+0x65/frame 0xfffffe081df8c950 sys_read() at sys_read+0x63/frame 0xfffffe081df8c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df8cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df8cab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command getty pid 1043 tid 100140 td 0xfffff801214ae920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ded3610 mi_switch() at mi_switch+0x179/frame 0xfffffe081ded3650 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ded3690 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081ded3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081ded3730 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081ded37a0 tty_wait() at tty_wait+0x42/frame 0xfffffe081ded37d0 ttydisc_read() at ttydisc_read+0x353/frame 0xfffffe081ded3830 ttydev_read() at ttydev_read+0x6d/frame 0xfffffe081ded3860 devfs_read_f() at devfs_read_f+0xb4/frame 0xfffffe081ded38c0 dofileread() at dofileread+0x7b/frame 0xfffffe081ded3900 kern_readv() at kern_readv+0x65/frame 0xfffffe081ded3950 sys_read() at sys_read+0x63/frame 0xfffffe081ded39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081ded3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081ded3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b5fa2a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffdcd0 --- Tracing command inetd pid 1026 tid 100148 td 0xfffff8012188b920 sched_switch() at sched_switch+0x482/frame 0xfffffe081defb590 mi_switch() at mi_switch+0x179/frame 0xfffffe081defb5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081defb610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081defb680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081defb6b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081defb720 seltdwait() at seltdwait+0x78/frame 0xfffffe081defb760 kern_select() at kern_select+0x8a2/frame 0xfffffe081defb960 sys_select() at sys_select+0x54/frame 0xfffffe081defb9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081defbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081defbab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800f759aa, rsp = 0x7fffffffce08, rbp = 0x7fffffffdcf0 --- Tracing command cron pid 965 tid 100192 td 0xfffff80121d47920 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command sendmail pid 961 tid 100200 td 0xfffff801214ad920 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command sendmail pid 958 tid 100183 td 0xfffff801211e3000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dfaa580 mi_switch() at mi_switch+0x179/frame 0xfffffe081dfaa5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dfaa600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dfaa670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081dfaa6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081dfaa720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081dfaa760 kern_select() at kern_select+0x8a2/frame 0xfffffe081dfaa960 sys_select() at sys_select+0x54/frame 0xfffffe081dfaa9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dfaaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dfaaab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8014599aa, rsp = 0x7fffffffbd18, rbp = 0x7fffffffc810 --- Tracing command sshd pid 955 tid 100157 td 0xfffff80121ced920 sched_switch() at sched_switch+0x482/frame 0xfffffe081df28590 mi_switch() at mi_switch+0x179/frame 0xfffffe081df285d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df28610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df28680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081df286b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081df28720 seltdwait() at seltdwait+0x78/frame 0xfffffe081df28760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df28960 sys_select() at sys_select+0x54/frame 0xfffffe081df289a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df28ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df28ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8032079aa, rsp = 0x7fffffffd288, rbp = 0x7fffffffdd10 --- Tracing command powerd pid 926 tid 100213 td 0xfffff8014874c490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e04f580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e04f5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e04f600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e04f670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e04f6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081e04f720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e04f760 kern_select() at kern_select+0x8a2/frame 0xfffffe081e04f960 sys_select() at sys_select+0x54/frame 0xfffffe081e04f9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e04fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e04fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b5d9aa, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command ntpd pid 923 tid 100212 td 0xfffff8014874c920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e04a590 mi_switch() at mi_switch+0x179/frame 0xfffffe081e04a5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e04a610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e04a680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e04a6b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e04a720 seltdwait() at seltdwait+0x78/frame 0xfffffe081e04a760 kern_select() at kern_select+0x8a2/frame 0xfffffe081e04a960 sys_select() at sys_select+0x54/frame 0xfffffe081e04a9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e04aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e04aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013c89aa, rsp = 0x7fffffffdbc8, rbp = 0x7fffffffdc90 --- Tracing command nfsd pid 885 tid 100209 td 0xfffff80121770000 sched_switch() at sched_switch+0x482/frame 0xfffffe081e03b740 mi_switch() at mi_switch+0x179/frame 0xfffffe081e03b780 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e03b7c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e03b830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e03b860 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e03b8d0 svc_run_internal() at svc_run_internal+0x934/frame 0xfffffe081e03ba60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e03ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e03bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e03bab0 --- trap 0xc, rip = 0x80088bc7a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 885 tid 100208 td 0xfffff80121770490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e036740 mi_switch() at mi_switch+0x179/frame 0xfffffe081e036780 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0367c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e036830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e036860 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0368d0 svc_run_internal() at svc_run_internal+0x934/frame 0xfffffe081e036a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e036a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e036ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e036ab0 --- trap 0xc, rip = 0x80088bc7a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 885 tid 100207 td 0xfffff80121770920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e031740 mi_switch() at mi_switch+0x179/frame 0xfffffe081e031780 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0317c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e031830 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081e031860 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081e0318d0 svc_run_internal() at svc_run_internal+0x934/frame 0xfffffe081e031a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe081e031a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081e031ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081e031ab0 --- trap 0xc, rip = 0x80088bc7a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 885 tid 100206 td 0xfffff80121cec490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e02be80 mi_switch() at mi_switch+0x179/frame 0xfffffe081e02bec0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e02bf00 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e02bf70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e02bfa0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081e02c020 svc_run_internal() at svc_run_internal+0x905/frame 0xfffffe081e02c1b0 svc_run() at svc_run+0xd4/frame 0xfffffe081e02c1f0 nfsrvd_nfsd() at nfsrvd_nfsd+0x194/frame 0xfffffe081e02c350 nfssvc_nfsd() at nfssvc_nfsd+0x11a/frame 0xfffffe081e02c970 sys_nfssvc() at sys_nfssvc+0xd2/frame 0xfffffe081e02c9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e02cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e02cab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x80088bc7a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd880 --- Tracing command nfsd pid 883 tid 100195 td 0xfffff80121b55490 sched_switch() at sched_switch+0x482/frame 0xfffffe081dff3590 mi_switch() at mi_switch+0x179/frame 0xfffffe081dff35d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dff3610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dff3680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dff36b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081dff3720 seltdwait() at seltdwait+0x78/frame 0xfffffe081dff3760 kern_select() at kern_select+0x8a2/frame 0xfffffe081dff3960 sys_select() at sys_select+0x54/frame 0xfffffe081dff39a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dff3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dff3ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094c9aa, rsp = 0x7fffffffd888, rbp = 0x7fffffffdce0 --- Tracing command mountd pid 877 tid 100196 td 0xfffff80121ef7000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dff8590 mi_switch() at mi_switch+0x179/frame 0xfffffe081dff85d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dff8610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dff8680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dff86b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081dff8720 seltdwait() at seltdwait+0x78/frame 0xfffffe081dff8760 kern_select() at kern_select+0x8a2/frame 0xfffffe081dff8960 sys_select() at sys_select+0x54/frame 0xfffffe081dff89a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dff8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dff8ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b649aa, rsp = 0x7fffffffdb88, rbp = 0x7fffffffdd00 --- Tracing command nfsuserd pid 870 tid 100164 td 0xfffff80121e00920 sched_switch() at sched_switch+0x482/frame 0xfffffe081df4b580 mi_switch() at mi_switch+0x179/frame 0xfffffe081df4b5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df4b600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df4b670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df4b6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081df4b720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081df4b760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df4b960 sys_select() at sys_select+0x54/frame 0xfffffe081df4b9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df4bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df4bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094b9aa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 869 tid 100172 td 0xfffff80121ced490 sched_switch() at sched_switch+0x482/frame 0xfffffe081df73580 mi_switch() at mi_switch+0x179/frame 0xfffffe081df735c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df73600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df73670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df736a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081df73720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081df73760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df73960 sys_select() at sys_select+0x54/frame 0xfffffe081df739a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df73ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df73ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094b9aa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 868 tid 100176 td 0xfffff80121ccf000 sched_switch() at sched_switch+0x482/frame 0xfffffe081df87580 mi_switch() at mi_switch+0x179/frame 0xfffffe081df875c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df87600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df87670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df876a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081df87720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081df87760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df87960 sys_select() at sys_select+0x54/frame 0xfffffe081df879a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df87ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df87ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094b9aa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 867 tid 100199 td 0xfffff80121cce920 sched_switch() at sched_switch+0x482/frame 0xfffffe081e009580 mi_switch() at mi_switch+0x179/frame 0xfffffe081e0095c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e009600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e009670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e0096a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081e009720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e009760 kern_select() at kern_select+0x8a2/frame 0xfffffe081e009960 sys_select() at sys_select+0x54/frame 0xfffffe081e0099a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e009ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e009ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80094b9aa, rsp = 0x7fffffffd9f8, rbp = 0x7fffffffdb30 --- Tracing command nfsuserd pid 866 tid 100204 td 0xfffff80121cce490 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe081e116890 kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe081e116940 kdb_reenter() at kdb_reenter+0x33/frame 0xfffffe081e116950 trap() at trap+0x5c/frame 0xfffffe081e116b70 calltrap() at calltrap+0x8/frame 0xfffffe081e116b70 --- trap 0xc, rip = 0xffffffff80caba82, rsp = 0xfffffe081e116c30, rbp = 0xfffffe081e116c50 --- db_trace_thread() at db_trace_thread+0x12/frame 0xfffffe081e116c50 db_stack_trace_all() at db_stack_trace_all+0x8f/frame 0xfffffe081e116cf0 db_command() at db_command+0x26d/frame 0xfffffe081e116dc0 db_script_exec() at db_script_exec+0x18f/frame 0xfffffe081e116e60 db_command() at db_command+0x26d/frame 0xfffffe081e116f30 db_command_loop() at db_command_loop+0x64/frame 0xfffffe081e116f40 db_trap() at db_trap+0xe0/frame 0xfffffe081e116fd0 kdb_trap() at kdb_trap+0x133/frame 0xfffffe081e117030 trap() at trap+0x752/frame 0xfffffe081e117250 calltrap() at calltrap+0x8/frame 0xfffffe081e117250 --- trap 0x3, rip = 0xffffffff808fb07e, rsp = 0xfffffe081e117310, rbp = 0xfffffe081e117330 --- kdb_enter() at kdb_enter+0x3e/frame 0xfffffe081e117330 vpanic() at vpanic+0x146/frame 0xfffffe081e117370 kassert_panic() at kassert_panic+0x136/frame 0xfffffe081e1173e0 uma_zalloc_arg() at uma_zalloc_arg+0x42e/frame 0xfffffe081e117450 vm_radix_insert() at vm_radix_insert+0x23b/frame 0xfffffe081e1174b0 vm_page_insert_after() at vm_page_insert_after+0x1b9/frame 0xfffffe081e117500 vm_page_alloc() at vm_page_alloc+0x9a6/frame 0xfffffe081e117560 vm_fault_hold() at vm_fault_hold+0x366/frame 0xfffffe081e1177b0 vm_fault() at vm_fault+0x77/frame 0xfffffe081e1177f0 trap_pfault() at trap_pfault+0x1c2/frame 0xfffffe081e117890 trap() at trap+0x502/frame 0xfffffe081e117ab0 calltrap() at calltrap+0x8/frame 0xfffffe081e117ab0 --- trap 0xc, rip = 0x800b5f0d4, rsp = 0x7fffffffd398, rbp = 0x7fffffffd3d0 --- Tracing command rpcbind pid 837 tid 100202 td 0xfffff801214ad490 sched_switch() at sched_switch+0x482/frame 0xfffffe081e018620 mi_switch() at mi_switch+0x179/frame 0xfffffe081e018660 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081e0186a0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081e018710 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081e018740 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081e0187c0 seltdwait() at seltdwait+0x8b/frame 0xfffffe081e018800 sys_poll() at sys_poll+0x3c9/frame 0xfffffe081e0189a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081e018ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081e018ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800d04e7a, rsp = 0x7fffffffba68, rbp = 0x7fffffffdc80 --- Tracing command watchdogd pid 823 tid 100162 td 0xfffff801217fe490 sched_switch() at sched_switch+0x482/frame 0xfffffe081df41740 mi_switch() at mi_switch+0x179/frame 0xfffffe081df41780 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df417c0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df41830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df41860 _sleep() at _sleep+0x314/frame 0xfffffe081df41900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe081df41960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe081df419a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df41ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df41ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b3cada, rsp = 0x7fffffffdb08, rbp = 0x7fffffffdb60 --- Tracing command syslogd pid 820 tid 100186 td 0xfffff801214ae000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dfb9590 mi_switch() at mi_switch+0x179/frame 0xfffffe081dfb95d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dfb9610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dfb9680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dfb96b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081dfb9720 seltdwait() at seltdwait+0x78/frame 0xfffffe081dfb9760 kern_select() at kern_select+0x8a2/frame 0xfffffe081dfb9960 sys_select() at sys_select+0x54/frame 0xfffffe081dfb99a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dfb9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dfb9ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b629aa, rsp = 0x7fffffffcce8, rbp = 0x7fffffffdd00 --- Tracing command devd pid 687 tid 100174 td 0xfffff80121b56000 sched_switch() at sched_switch+0x482/frame 0xfffffe081df7d580 mi_switch() at mi_switch+0x179/frame 0xfffffe081df7d5c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081df7d600 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081df7d670 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe081df7d6a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1fd/frame 0xfffffe081df7d720 seltdwait() at seltdwait+0x8b/frame 0xfffffe081df7d760 kern_select() at kern_select+0x8a2/frame 0xfffffe081df7d960 sys_select() at sys_select+0x54/frame 0xfffffe081df7d9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081df7dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081df7dab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x49c2aa, rsp = 0x7fffffffbbb8, rbp = 0x7fffffffdd20 --- Tracing command moused pid 670 tid 100190 td 0xfffff80121e00000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dfcd590 mi_switch() at mi_switch+0x179/frame 0xfffffe081dfcd5d0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dfcd610 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe081dfcd680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe081dfcd6b0 _cv_wait_sig() at _cv_wait_sig+0x1e1/frame 0xfffffe081dfcd720 seltdwait() at seltdwait+0x78/frame 0xfffffe081dfcd760 kern_select() at kern_select+0x8a2/frame 0xfffffe081dfcd960 sys_select() at sys_select+0x54/frame 0xfffffe081dfcd9a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe081dfcdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe081dfcdab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800d889aa, rsp = 0x7fffffffd6f8, rbp = 0x7fffffffdca0 --- Tracing command softdepflush pid 17 tid 100139 td 0xfffff801211e4920 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbf28e0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbf2920 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbf2960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dbf2990 _sleep() at _sleep+0x326/frame 0xfffffe081dbf2a30 softdep_flush() at softdep_flush+0x1b3/frame 0xfffffe081dbf2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbf2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbf2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbf2b70, rbp = 0 --- Tracing command syncer pid 16 tid 100138 td 0xfffff801211e5000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbed8a0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbed8e0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbed920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dbed950 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1fd/frame 0xfffffe081dbed9d0 sched_sync() at sched_sync+0x5cb/frame 0xfffffe081dbeda70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbedab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbedab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbedb70, rbp = 0 --- Tracing command vnlru pid 9 tid 100137 td 0xfffff801211e5490 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbe88a0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbe88e0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbe8920 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dbe8950 _sleep() at _sleep+0x326/frame 0xfffffe081dbe89f0 vnlru_proc() at vnlru_proc+0x48/frame 0xfffffe081dbe8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbe8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbe8ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbe8b70, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100136 td 0xfffff801211e5920 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbe38f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbe3930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbe3970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dbe39a0 _sleep() at _sleep+0x326/frame 0xfffffe081dbe3a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe081dbe3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbe3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbe3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbe3b70, rbp = 0 --- Tracing command pagezero pid 7 tid 100135 td 0xfffff800170d9000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbde8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbde930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbde970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081dbde9a0 _sleep() at _sleep+0x326/frame 0xfffffe081dbdea40 vm_pagezero() at vm_pagezero+0x88/frame 0xfffffe081dbdea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbdeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbdeab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbdeb70, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100134 td 0xfffff800170d9490 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbd98b0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbd98f0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbd9930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dbd9960 _sleep() at _sleep+0x351/frame 0xfffffe081dbd9a00 vm_daemon() at vm_daemon+0x7e/frame 0xfffffe081dbd9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbd9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbd9ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbd9b70, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100133 td 0xfffff800170d9920 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc361ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc361d00 trap() at trap+0x42/frame 0xfffffe07fc361f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc361f20 --- trap 0x13, rip = 0xffffffff80916780, rsp = 0xfffffe07fc361fe0, rbp = 0xfffffe081dbd4950 --- witness_unlock() at witness_unlock/frame 0xfffffe081dbd4950 cache_drain_safe_cpu() at cache_drain_safe_cpu+0x26f/frame 0xfffffe081dbd4980 zone_foreach() at zone_foreach+0x67/frame 0xfffffe081dbd49b0 cache_drain_safe() at cache_drain_safe+0xf8/frame 0xfffffe081dbd49e0 uma_reclaim() at uma_reclaim+0x2c/frame 0xfffffe081dbd49f0 vm_pageout() at vm_pageout+0x3bc/frame 0xfffffe081dbd4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbd4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbd4ab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbd4b70, rbp = 0 --- Tracing command enc_daemon0 pid 4 tid 100132 td 0xfffff800170da000 sched_switch() at sched_switch+0x482/frame 0xfffffe081dbcf8b0 mi_switch() at mi_switch+0x179/frame 0xfffffe081dbcf8f0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081dbcf930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081dbcf960 _sleep() at _sleep+0x351/frame 0xfffffe081dbcfa00 enc_daemon() at enc_daemon+0x110/frame 0xfffffe081dbcfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081dbcfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081dbcfab0 --- trap 0, rip = 0, rsp = 0xfffffe081dbcfb70, rbp = 0 --- Tracing command sctp_iterator pid 3 tid 100129 td 0xfffff800170db000 sched_switch() at sched_switch+0x482/frame 0xfffffe081db40900 mi_switch() at mi_switch+0x179/frame 0xfffffe081db40940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081db40980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081db409b0 _sleep() at _sleep+0x351/frame 0xfffffe081db40a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe081db40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db40ab0 --- trap 0, rip = 0, rsp = 0xfffffe081db40b70, rbp = 0 --- Tracing command usb pid 15 tid 100123 td 0xfffff8000c8ba000 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba9d920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba9d960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba9d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba9d9d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081ba9da40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba9da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba9dab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba9db70, rbp = 0 --- Tracing command usb pid 15 tid 100122 td 0xfffff8000c8ba490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba98920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba98960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba989a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba989d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081ba98a40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba98ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba98b70, rbp = 0 --- Tracing command usb pid 15 tid 100121 td 0xfffff8000c8ba920 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba93920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba93960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba939a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba939d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081ba93a40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba93a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba93ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba93ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba93b70, rbp = 0 --- Tracing command usb pid 15 tid 100120 td 0xfffff8000c8be000 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba8e920 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba8e960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081ba8e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081ba8e9d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081ba8ea40 usb_process() at usb_process+0xd4/frame 0xfffffe081ba8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba8eab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba8eb70, rbp = 0 --- Tracing command usb pid 15 tid 100118 td 0xfffff8000c8be920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b901920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b901960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b9019a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b9019d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081b901a40 usb_process() at usb_process+0xd4/frame 0xfffffe081b901a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b901ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b901ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b901b70, rbp = 0 --- Tracing command usb pid 15 tid 100117 td 0xfffff8000c8b4000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8fc920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8fc960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8fc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8fc9d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081b8fca40 usb_process() at usb_process+0xd4/frame 0xfffffe081b8fca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8fcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8fcab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8fcb70, rbp = 0 --- Tracing command usb pid 15 tid 100116 td 0xfffff8000c8b4490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8f7920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8f7960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8f79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8f79d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081b8f7a40 usb_process() at usb_process+0xd4/frame 0xfffffe081b8f7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8f7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8f7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8f7b70, rbp = 0 --- Tracing command usb pid 15 tid 100115 td 0xfffff8000c8b4920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8f2920 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8f2960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8f29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8f29d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe081b8f2a40 usb_process() at usb_process+0xd4/frame 0xfffffe081b8f2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8f2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8f2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8f2b70, rbp = 0 --- Tracing command usb pid 15 tid 100078 td 0xfffff8000c84c000 sched_switch() at sched_switch+0x482/frame 0xfffffe000038d920 mi_switch() at mi_switch+0x179/frame 0xfffffe000038d960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe000038d9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000038d9d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe000038da40 usb_process() at usb_process+0xd4/frame 0xfffffe000038da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000038dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000038dab0 --- trap 0, rip = 0, rsp = 0xfffffe000038db70, rbp = 0 --- Tracing command usb pid 15 tid 100077 td 0xfffff8000c84c490 sched_switch() at sched_switch+0x482/frame 0xfffffe0000388920 mi_switch() at mi_switch+0x179/frame 0xfffffe0000388960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003889a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003889d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe0000388a40 usb_process() at usb_process+0xd4/frame 0xfffffe0000388a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000388ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000388ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000388b70, rbp = 0 --- Tracing command usb pid 15 tid 100076 td 0xfffff8000c84c920 sched_switch() at sched_switch+0x482/frame 0xfffffe0000383920 mi_switch() at mi_switch+0x179/frame 0xfffffe0000383960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003839a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003839d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe0000383a40 usb_process() at usb_process+0xd4/frame 0xfffffe0000383a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000383ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000383ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000383b70, rbp = 0 --- Tracing command usb pid 15 tid 100075 td 0xfffff8000c84d000 sched_switch() at sched_switch+0x482/frame 0xfffffe000037e920 mi_switch() at mi_switch+0x179/frame 0xfffffe000037e960 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe000037e9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000037e9d0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe000037ea40 usb_process() at usb_process+0xd4/frame 0xfffffe000037ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037eab0 --- trap 0, rip = 0, rsp = 0xfffffe000037eb70, rbp = 0 --- Tracing command cam pid 2 tid 100131 td 0xfffff800170da490 sched_switch() at sched_switch+0x482/frame 0xfffffe081db4a8c0 mi_switch() at mi_switch+0x179/frame 0xfffffe081db4a900 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081db4a940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081db4a970 _sleep() at _sleep+0x351/frame 0xfffffe081db4aa10 xpt_scanner_thread() at xpt_scanner_thread+0x5c/frame 0xfffffe081db4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db4aab0 --- trap 0, rip = 0, rsp = 0xfffffe081db4ab70, rbp = 0 --- Tracing command cam pid 2 tid 100071 td 0xfffff8000b41c490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab908d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab90910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab90950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab90980 _sleep() at _sleep+0x351/frame 0xfffffe078ab90a20 xpt_done_td() at xpt_done_td+0xa5/frame 0xfffffe078ab90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab90ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab90b70, rbp = 0 --- Tracing command cam pid 2 tid 100070 td 0xfffff8000b41c920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab8b8d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab8b910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab8b950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab8b980 _sleep() at _sleep+0x351/frame 0xfffffe078ab8ba20 xpt_done_td() at xpt_done_td+0xa5/frame 0xfffffe078ab8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab8bab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab8bb70, rbp = 0 --- Tracing command cam pid 2 tid 100069 td 0xfffff8000b41d000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab868d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab86910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab86950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab86980 _sleep() at _sleep+0x351/frame 0xfffffe078ab86a20 xpt_done_td() at xpt_done_td+0xa5/frame 0xfffffe078ab86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab86ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab86b70, rbp = 0 --- Tracing command cam pid 2 tid 100068 td 0xfffff8000b41d490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab818d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab81910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab81950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab81980 _sleep() at _sleep+0x351/frame 0xfffffe078ab81a20 xpt_done_td() at xpt_done_td+0xa5/frame 0xfffffe078ab81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab81ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab81b70, rbp = 0 --- Tracing command cam pid 2 tid 100067 td 0xfffff8000b41d920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab7c8d0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab7c910 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab7c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab7c980 _sleep() at _sleep+0x351/frame 0xfffffe078ab7ca20 xpt_done_td() at xpt_done_td+0xa5/frame 0xfffffe078ab7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab7cab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab7cb70, rbp = 0 --- Tracing command rand_harvestq pid 14 tid 100057 td 0xfffff8000b27e000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab498f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab49930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab49970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe078ab499a0 msleep_spin_sbt() at msleep_spin_sbt+0x1f0/frame 0xfffffe078ab49a30 random_kthread() at random_kthread+0x1d0/frame 0xfffffe078ab49a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab49ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab49ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab49b70, rbp = 0 --- Tracing command geom pid 13 tid 100056 td 0xfffff8000b27e490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab448e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab44920 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab44960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab44990 _sleep() at _sleep+0x351/frame 0xfffffe078ab44a30 g_io_schedule_down() at g_io_schedule_down+0x3c/frame 0xfffffe078ab44a60 g_down_procbody() at g_down_procbody+0x7d/frame 0xfffffe078ab44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab44ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab44b70, rbp = 0 --- Tracing command geom pid 13 tid 100055 td 0xfffff8000b27e920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab3f8e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab3f920 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab3f960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab3f990 _sleep() at _sleep+0x351/frame 0xfffffe078ab3fa30 g_io_schedule_up() at g_io_schedule_up+0xbc/frame 0xfffffe078ab3fa60 g_up_procbody() at g_up_procbody+0x7d/frame 0xfffffe078ab3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab3fab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab3fb70, rbp = 0 --- Tracing command geom pid 13 tid 100054 td 0xfffff8000b262000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab3a8e0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab3a920 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab3a960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab3a990 _sleep() at _sleep+0x351/frame 0xfffffe078ab3aa30 g_run_events() at g_run_events+0x4f4/frame 0xfffffe078ab3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab3aab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab3ab70, rbp = 0 --- Tracing command intr pid 12 tid 100126 td 0xfffff8000c8b9000 sched_switch() at sched_switch+0x482/frame 0xfffffe081db2c9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081db2ca30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081db2ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db2cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db2cab0 --- trap 0, rip = 0, rsp = 0xfffffe081db2cb70, rbp = 0 --- Tracing command intr pid 12 tid 100125 td 0xfffff8000c8b9490 sched_switch() at sched_switch+0x482/frame 0xfffffe081db249f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081db24a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081db24a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db24ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db24ab0 --- trap 0, rip = 0, rsp = 0xfffffe081db24b70, rbp = 0 --- Tracing command intr pid 12 tid 100124 td 0xfffff8000c8b9920 sched_switch() at sched_switch+0x482/frame 0xfffffe081baa29f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081baa2a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081baa2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081baa2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081baa2ab0 --- trap 0, rip = 0, rsp = 0xfffffe081baa2b70, rbp = 0 --- Tracing command intr pid 12 tid 100119 td 0xfffff8000c8be490 sched_switch() at sched_switch+0x482/frame 0xfffffe081ba899f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081ba89a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081ba89a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081ba89ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081ba89ab0 --- trap 0, rip = 0, rsp = 0xfffffe081ba89b70, rbp = 0 --- Tracing command intr pid 12 tid 100114 td 0xfffff8000c8b5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff8000c8b5490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff8000c8b6000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff8000c8b6920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff8000c8b1490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff8000c8b2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff8000c8b2920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff8000c8b3490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffff8000c893000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffff8000c893920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100096 td 0xfffff8000c894000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8319f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b831a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b831a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b831ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b831ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b831b70, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff8000c894920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8279f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b827a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b827a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b827ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b827ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b827b70, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffff8000c895490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b81d9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b81da30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b81da70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b81dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b81dab0 --- trap 0, rip = 0, rsp = 0xfffffe081b81db70, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff8000c88b000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8139f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b813a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b813a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b813ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b813ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b813b70, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff8000c88b920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8099f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b809a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe081b809a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b809ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b809ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b809b70, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff8000c88c490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003ff9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003ffa30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ffab0 --- trap 0, rip = 0, rsp = 0xfffffe00003ffb70, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff8000c88d000 sched_switch() at sched_switch+0x482/frame 0xfffffe00003f59f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003f5a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f5ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003f5b70, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff8000c88d920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003eb9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003eba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ebab0 --- trap 0, rip = 0, rsp = 0xfffffe00003ebb70, rbp = 0 --- Tracing command intr pid 12 tid 100080 td 0xfffff8000c84b490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003e19f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003e1a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe00003e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003e1ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003e1b70, rbp = 0 --- Tracing command intr pid 12 tid 100079 td 0xfffff8000c84b920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003929f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000392a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000392a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000392ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000392ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000392b70, rbp = 0 --- Tracing command intr pid 12 tid 100074 td 0xfffff8000c84d490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003799f0 mi_switch() at mi_switch+0x179/frame 0xfffffe0000379a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe0000379a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000379ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000379ab0 --- trap 0, rip = 0, rsp = 0xfffffe0000379b70, rbp = 0 --- Tracing command intr pid 12 tid 100073 td 0xfffff8000c84d920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100072 td 0xfffff8000b41c000 sched_switch() at sched_switch+0x482/frame 0xfffffe078abd89f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078abd8a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078abd8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078abd8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078abd8ab0 --- trap 0, rip = 0, rsp = 0xfffffe078abd8b70, rbp = 0 --- Tracing command intr pid 12 tid 100065 td 0xfffff8000b41e490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100063 td 0xfffff8000b27c000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab689f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab68a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ab68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab68ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab68b70, rbp = 0 --- Tracing command intr pid 12 tid 100062 td 0xfffff8000b27c490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab639f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab63a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ab63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab63ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab63b70, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff8000b262920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000b263000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab2b9f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab2ba30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078ab2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab2bab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab2bb70, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff8000b263490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000b263920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff8000b264000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000b264490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff8000b264920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff8000b25d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff8000b25d490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff8000b25d920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff8000b25e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff8000b25e490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff8000b25e920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff8000b25f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff8000b25f490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff8000b25f920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000b258000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000b258490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000b258920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000b259000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000b259490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff8000b259920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000b25a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff8000b25a490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100028 td 0xfffff8000b25a920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100027 td 0xfffff8000b22f000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aab39f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078aab3a30 ithread_loop() at ithread_loop+0x1d2/frame 0xfffffe078aab3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aab3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aab3ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aab3b70, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff8000b22f490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aaae960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aaae9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aaae9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aaaea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aaaeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aaaeab0 --- trap 0, rip = 0, rsp = 0xfffffe078aaaeb70, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff8000b22f920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aaa9960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aaa99a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aaa99c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aaa9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aaa9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aaa9ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aaa9b70, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000b230000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aaa4980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aaa49c0 sched_idletd() at sched_idletd+0x102/frame 0xfffffe078aaa4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aaa4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aaa4ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aaa4b70, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000b230490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa9f960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa9f9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa9f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa9fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa9fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa9fab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa9fb70, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000b230920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa9a980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa9a9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa9aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa9aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa9aab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa9ab70, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000b231000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa95960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa959a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa959c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa95a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa95ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa95ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa95b70, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000b231490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa90980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa909c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa90a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa90ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa90ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa90b70, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000b231920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa8b980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa8b9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa8ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa8bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa8bab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa8bb70, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000b22a000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa86980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa869c0 sched_idletd() at sched_idletd+0x102/frame 0xfffffe078aa86a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa86ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa86ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa86b70, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000b22a490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa81980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa819c0 sched_idletd() at sched_idletd+0x102/frame 0xfffffe078aa81a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa81ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa81ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa81b70, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000b22a920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa7c960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa7c9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa7c9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa7ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa7cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa7cab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa7cb70, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000b22b000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa77980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa779c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa77ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa77b70, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b22b490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa72960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa729a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa729c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa72a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa72ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa72ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa72b70, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b22b920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa6d960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa6d9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa6d9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa6dab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa6db70, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b22c000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa68980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa689c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa68a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa68ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa68ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa68b70, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000b22c490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa63980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa639c0 sched_idletd() at sched_idletd+0x102/frame 0xfffffe078aa63a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa63ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa63ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa63b70, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000b22c920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa5e980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa5e9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa5eab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa5eb70, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000b21a000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa59980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa599c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa59ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa59b70, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000b21a490 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe07fc371ce0 ipi_nmi_handler() at ipi_nmi_handler+0x3f/frame 0xfffffe07fc371d00 trap() at trap+0x42/frame 0xfffffe07fc371f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe07fc371f20 --- trap 0x13, rip = 0xffffffff80cb0c2e, rsp = 0xfffffe07fc371fe0, rbp = 0xfffffe078aa549c0 --- cpu_idle() at cpu_idle+0xbe/frame 0xfffffe078aa549c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa54ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa54b70, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b21a920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa4f960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa4f9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa4f9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa4fab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa4fb70, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b21b000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa4a960 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa4a9a0 critical_exit() at critical_exit+0x8b/frame 0xfffffe078aa4a9c0 sched_idletd() at sched_idletd+0x1e8/frame 0xfffffe078aa4aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa4aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa4aab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa4ab70, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000b21b490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa45980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa459c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa45ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa45b70, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b21b920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa40980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa409c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa40a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa40ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa40ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa40b70, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000b21c000 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa3b980 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa3b9c0 sched_idletd() at sched_idletd+0x3dd/frame 0xfffffe078aa3ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa3bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa3bab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa3bb70, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b21c490 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa36550 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa36590 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078aa365d0 sleepq_catch_signals() at sleepq_catch_signals+0x2f4/frame 0xfffffe078aa36640 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe078aa36670 _sleep() at _sleep+0x334/frame 0xfffffe078aa36710 kern_wait6() at kern_wait6+0x3e7/frame 0xfffffe078aa367b0 sys_wait4() at sys_wait4+0x76/frame 0xfffffe078aa369a0 amd64_syscall() at amd64_syscall+0x282/frame 0xfffffe078aa36ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe078aa36ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41323a, rsp = 0x7fffffffd758, rbp = 0x7fffffffd7c0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b21c920 sched_switch() at sched_switch+0x482/frame 0xfffffe078aa318f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078aa31930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078aa31970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078aa319a0 _cv_wait() at _cv_wait+0x1dc/frame 0xfffffe078aa31a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe078aa31a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078aa31ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078aa31ab0 --- trap 0, rip = 0, rsp = 0xfffffe078aa31b70, rbp = 0 --- Tracing command kernel pid 0 tid 100130 td 0xfffff800170da920 sched_switch() at sched_switch+0x482/frame 0xfffffe081db458f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081db45930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081db45970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081db459a0 _sleep() at _sleep+0x351/frame 0xfffffe081db45a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081db45a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db45ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db45ab0 --- trap 0, rip = 0, rsp = 0xfffffe081db45b70, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffff800170db490 sched_switch() at sched_switch+0x482/frame 0xfffffe081db3a880 mi_switch() at mi_switch+0x179/frame 0xfffffe081db3a8c0 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081db3a900 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe081db3a930 _sleep() at _sleep+0x326/frame 0xfffffe081db3a9d0 pause_sbt() at pause_sbt+0xe4/frame 0xfffffe081db3aa20 deadlkres() at deadlkres+0x66/frame 0xfffffe081db3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db3aab0 --- trap 0, rip = 0, rsp = 0xfffffe081db3ab70, rbp = 0 --- Tracing command kernel pid 0 tid 100127 td 0xfffff800170db920 sched_switch() at sched_switch+0x482/frame 0xfffffe081db35900 mi_switch() at mi_switch+0x179/frame 0xfffffe081db35940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081db35980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081db359b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe081db35a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe081db35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081db35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081db35ab0 --- trap 0, rip = 0, rsp = 0xfffffe081db35b70, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff8000c8b5920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8c18f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8c1930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8c1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8c19a0 _sleep() at _sleep+0x351/frame 0xfffffe081b8c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b8c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8c1ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8c1b70, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffff8000c8b6490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8b78f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8b7930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8b7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8b79a0 _sleep() at _sleep+0x351/frame 0xfffffe081b8b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b8b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8b7ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8b7b70, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff8000c8b1000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8ad8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8ad930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8ad970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8ad9a0 _sleep() at _sleep+0x351/frame 0xfffffe081b8ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b8ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8adab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8adb70, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff8000c8b1920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8a38f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b8a3930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b8a3970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8a39a0 _sleep() at _sleep+0x351/frame 0xfffffe081b8a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b8a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b8a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b8a3ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b8a3b70, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff8000c8b2490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8998f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b899930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b899970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8999a0 _sleep() at _sleep+0x351/frame 0xfffffe081b899a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b899a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b899ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b899ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b899b70, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff8000c8b3000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b88f8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b88f930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b88f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b88f9a0 _sleep() at _sleep+0x351/frame 0xfffffe081b88fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b88fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b88fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b88fab0 --- trap 0, rip = 0, rsp = 0xfffffe081b88fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff8000c8b3920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8858f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b885930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b885970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8859a0 _sleep() at _sleep+0x351/frame 0xfffffe081b885a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b885a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b885ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b885ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b885b70, rbp = 0 --- Tracing command kernel pid 0 tid 100098 td 0xfffff8000c893490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b87b8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b87b930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b87b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b87b9a0 _sleep() at _sleep+0x351/frame 0xfffffe081b87ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b87ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b87bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b87bab0 --- trap 0, rip = 0, rsp = 0xfffffe081b87bb70, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff8000c894490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b82c8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b82c930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b82c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b82c9a0 _sleep() at _sleep+0x351/frame 0xfffffe081b82ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b82ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b82cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b82cab0 --- trap 0, rip = 0, rsp = 0xfffffe081b82cb70, rbp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xfffff8000c895000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8228f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b822930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b822970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8229a0 _sleep() at _sleep+0x351/frame 0xfffffe081b822a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b822a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b822ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b822ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b822b70, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff8000c895920 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8188f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b818930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b818970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8189a0 _sleep() at _sleep+0x351/frame 0xfffffe081b818a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b818a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b818ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b818ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b818b70, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff8000c88b490 sched_switch() at sched_switch+0x482/frame 0xfffffe081b80e8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b80e930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b80e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b80e9a0 _sleep() at _sleep+0x351/frame 0xfffffe081b80ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b80ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b80eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b80eab0 --- trap 0, rip = 0, rsp = 0xfffffe081b80eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff8000c88c000 sched_switch() at sched_switch+0x482/frame 0xfffffe081b8048f0 mi_switch() at mi_switch+0x179/frame 0xfffffe081b804930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe081b804970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe081b8049a0 _sleep() at _sleep+0x351/frame 0xfffffe081b804a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe081b804a70 fork_exit() at fork_exit+0x84/frame 0xfffffe081b804ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe081b804ab0 --- trap 0, rip = 0, rsp = 0xfffffe081b804b70, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff8000c88c920 sched_switch() at sched_switch+0x482/frame 0xfffffe00003fa8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003fa930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003fa970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003fa9a0 _sleep() at _sleep+0x351/frame 0xfffffe00003faa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003faab0 --- trap 0, rip = 0, rsp = 0xfffffe00003fab70, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff8000c88d490 sched_switch() at sched_switch+0x482/frame 0xfffffe00003f08f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003f0930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003f0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003f09a0 _sleep() at _sleep+0x351/frame 0xfffffe00003f0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003f0ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003f0b70, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffff8000c84b000 sched_switch() at sched_switch+0x482/frame 0xfffffe00003e68f0 mi_switch() at mi_switch+0x179/frame 0xfffffe00003e6930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe00003e6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003e69a0 _sleep() at _sleep+0x351/frame 0xfffffe00003e6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe00003e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003e6ab0 --- trap 0, rip = 0, rsp = 0xfffffe00003e6b70, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff8000b41e000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab778f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab77930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab77970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab779a0 _sleep() at _sleep+0x351/frame 0xfffffe078ab77a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ab77a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab77ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab77ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab77b70, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff8000b41e920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab6d8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab6d930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab6d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab6d9a0 _sleep() at _sleep+0x351/frame 0xfffffe078ab6da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ab6da70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab6dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab6dab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab6db70, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff8000b27c920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab5e8f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab5e930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab5e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab5e9a0 _sleep() at _sleep+0x351/frame 0xfffffe078ab5ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ab5ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab5eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab5eab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab5eb70, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff8000b27d000 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab59900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab59940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab59980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab599b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ab59a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ab59a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab59ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab59ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab59b70, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff8000b27d490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab54900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab54940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab54980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab549b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ab54a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ab54a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab54ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab54ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab54b70, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff8000b27d920 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab4f900 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab4f940 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab4f980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab4f9b0 msleep_spin_sbt() at msleep_spin_sbt+0x200/frame 0xfffffe078ab4fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x8d/frame 0xfffffe078ab4fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab4fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab4fab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab4fb70, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff8000b262490 sched_switch() at sched_switch+0x482/frame 0xfffffe078ab358f0 mi_switch() at mi_switch+0x179/frame 0xfffffe078ab35930 sleepq_switch() at sleepq_switch+0x185/frame 0xfffffe078ab35970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe078ab359a0 _sleep() at _sleep+0x351/frame 0xfffffe078ab35a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xc8/frame 0xfffffe078ab35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe078ab35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe078ab35ab0 --- trap 0, rip = 0, rsp = 0xfffffe078ab35b70, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81717400 sched_switch() at sched_switch+0x482/frame 0xffffffff81a359d0 mi_switch() at mi_switch+0x179/frame 0xffffffff81a35a10 sleepq_switch() at sleepq_switch+0x185/frame 0xffffffff81a35a50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff81a35a80 _sleep() at _sleep+0x326/frame 0xffffffff81a35b20 swapper() at swapper+0x211/frame 0xffffffff81a35b70 btext() at btext+0x2c db:0:allt> call doadump Dumping 1333 out of 31643 MB:..2%..11%..21%..32%..41%..51%..62%..71%..81%..92% Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0xd) at pcpu.h:219 #1 0xffffffff80344b75 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff8034485d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #3 0xffffffff80348abf in db_script_exec (scriptname=0xffffffff8170bae0 "doadump", warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff8034485d in db_command (cmd_table=) at ../../../ddb/db_command.c:449 #5 0xffffffff803445d4 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff80346f80 in db_trap (type=, code=0x0) at ../../../ddb/db_main.c:231 #7 0xffffffff808fb8c3 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:656 #8 0xffffffff80cc7212 in trap (frame=0xfffffe081e117260) at ../../../amd64/amd64/trap.c:572 #9 0xffffffff80cac722 in calltrap () at ../../../amd64/amd64/exception.S:232 #10 0xffffffff808fb07e in kdb_enter (why=0xffffffff80f39b25 "panic", msg=) at cpufunc.h:63 #11 0xffffffff808c1a76 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:747 #12 0xffffffff808c1926 in kassert_panic (fmt=) at ../../../kern/kern_shutdown.c:642 #13 0xffffffff80b32b8e in uma_zalloc_arg (zone=0xfffff807fffd7000, udata=0x0, flags=0x101) at ../../../vm/uma_core.c:2206 #14 0xffffffff80b593db in vm_radix_insert (rtree=0xfffff804c7f05258, page=0xfffff807db26f730) at uma.h:336 #15 0xffffffff80b4da29 in vm_page_insert_after (m=0xfffff807db26f730, object=0xfffff804c7f05200, pindex=0x49a71, mpred=0xfffff807db26f590) at ../../../vm/vm_page.c:993 #16 0xffffffff80b4f786 in vm_page_alloc (object=0xfffff804c7f05200, pindex=0x49a71, req=0x40) at ../../../vm/vm_page.c:1611 #17 0xffffffff80b39f16 in vm_fault_hold (map=0xfffff80121e1a8c0, vaddr=0x84b271000, fault_type=0x2, fault_flags=0x0, m_hold=0x0) at ../../../vm/vm_fault.c:432 #18 0xffffffff80b39b67 in vm_fault (map=0xfffff80121e1a8c0, vaddr=, fault_type=0x2, fault_flags=0x0) at ../../../vm/vm_fault.c:224 #19 0xffffffff80cc7882 in trap_pfault (frame=0xfffffe081e117ac0, usermode=0x1) at ../../../amd64/amd64/trap.c:758 #20 0xffffffff80cc6fc2 in trap (frame=0xfffffe081e117ac0) at ../../../amd64/amd64/trap.c:356 #21 0xffffffff80cac722 in calltrap () at ../../../amd64/amd64/exception.S:232 #22 0x0000000800b5f0d4 in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 13 #13 0xffffffff80b32b8e in uma_zalloc_arg (zone=0xfffff807fffd7000, udata=0x0, flags=0x101) at ../../../vm/uma_core.c:2206 2206 KASSERT(bucket->ub_cnt != 0, (kgdb) l 2201 2202 /* 2203 * Check the zone's cache of buckets. 2204 */ 2205 if ((bucket = LIST_FIRST(&zone->uz_buckets)) != NULL) { 2206 KASSERT(bucket->ub_cnt != 0, 2207 ("uma_zalloc_arg: Returning an empty bucket.")); 2208 2209 LIST_REMOVE(bucket, ub_link); 2210 cache->uc_allocbucket = bucket; (kgdb) info loc item = (void *) 0xffffffff8091574a cache = 0xfffff807fffd7200 bucket = 0xfffff80148f9ba00 lockfail = 0x0 cpu = 0x0 (kgdb) p *bucket $1 = {ub_link = {le_next = 0xfffff8014888a000, le_prev = 0xfffff807fffd70a0}, ub_cnt = 0x0, ub_entries = 0x3d, ub_bucket = 0xfffff80148f9ba18} (kgdb) $ svn diff -x -p /usr/src/sys -- Test scenario: $ ./signal0.sh swap: run time 0+00:05:00, incarnations 20, load 100, verbose 1 bad signal, signum=0