GENERIC HEAD from 2013-05-27 06:32:07 UTC, r251023M, vmcore.10 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r251023M: Mon May 27 20:41:51 CEST 2013 pho@x4.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 gcc version 4.2.1 20070831 patched [FreeBSD] WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 7831875584 (7469 MB) : Trying to mount root from ufs:/dev/ufs/root [rw]... WARNING: / was not properly dismounted Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ufs/root: 4840 files, 579499 used, 433516 free (924 frags, 54074 blocks, 0.1% fragmentation) /dev/ufs/home: 16623 files, 298698 used, 714317 free (8349 frags, 88246 blocks, 0.8% fragmentation) /dev/ufs/var: 202363 files, 14818498 used, 9941695 free (55391 frags, 1235788 blocks, 0.2% fragmentation) /dev/label/tmp: 41731 files, 73682802 used, 44631179 free (7579 frags, 5577950 blocks, 0.0% fragmentation) /dev/ufs/usr: 671444 files, 5501710 used, 4652489 free (224145 frags, 553543 blocks, 2.2% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. lock order reversal: 1st 0xfffffe001acd0068 ufs (ufs) @ kern/vfs_lookup.c:517 2nd 0xffffff81e8e4a3e8 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:262 3rd 0xfffffe001aceb2d8 ufs (ufs) @ kern/vfs_subr.c:2109 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff82328decf0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff82328dedb0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff82328dedd0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff82328dee80 __lockmgr_args() at __lockmgr_args+0x11aa/frame 0xffffff82328def70 ffs_lock() at ffs_lock+0x9b/frame 0xffffff82328defc0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xab/frame 0xffffff82328deff0 _vn_lock() at _vn_lock+0x8e/frame 0xffffff82328df070 vget() at vget+0x63/frame 0xffffff82328df0c0 vfs_hash_get() at vfs_hash_get+0xd5/frame 0xffffff82328df110 ffs_vgetf() at ffs_vgetf+0x48/frame 0xffffff82328df1a0 softdep_sync_buf() at softdep_sync_buf+0x5ec/frame 0xffffff82328df290 ffs_syncvnode() at ffs_syncvnode+0x30e/frame 0xffffff82328df310 ffs_truncate() at ffs_truncate+0x10ef/frame 0xffffff82328df560 ufs_direnter() at ufs_direnter+0x538/frame 0xffffff82328df630 ufs_makeinode() at ufs_makeinode+0x359/frame 0xffffff82328df7f0 VOP_CREATE_APV() at VOP_CREATE_APV+0xc6/frame 0xffffff82328df820 vn_open_cred() at vn_open_cred+0x2e6/frame 0xffffff82328df970 kern_openat() at kern_openat+0x20d/frame 0xffffff82328dfad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff82328dfbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff82328dfbf0 --- syscall (5, FreeBSD ELF64, sys_open), rip = 0x8009306aa, rsp = 0x7fffffffdab8, rbp = 0x80101e280 --- re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (none) status: no carrier Starting devd. add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat/pkg /usr/local/lib/qt4 32-bit compatibility ldconfig path: /usr/lib32 Creating and/or trimming log files. Starting syslogd. savecore: unable to read from bounds, using 0 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device May 29 10:52:16 x4 savecore: couldn't find media and/or sector size of /var/crash: Inappropriate ioctl for device savecore: unable to read from bounds, using 0 savecore: reboot May 29 10:52:16 x4 savecore: reboot lock order reversal: 1st 0xffffff81e8e3d358 bufwait (bufwait) @ kern/vfs_bio.c:3071 2nd 0xfffffe001ace8400 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff823284e5f0 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff823284e6b0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff823284e6d0 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff823284e780 _sx_xlock() at _sx_xlock+0x74/frame 0xffffff823284e7b0 ufsdirhash_acquire() at ufsdirhash_acquire+0x44/frame 0xffffff823284e7d0 ufsdirhash_remove() at ufsdirhash_remove+0x16/frame 0xffffff823284e800 ufs_dirremove() at ufs_dirremove+0x1cb/frame 0xffffff823284e850 ufs_remove() at ufs_remove+0x92/frame 0xffffff823284e8c0 VOP_REMOVE_APV() at VOP_REMOVE_APV+0xeb/frame 0xffffff823284e8f0 kern_unlinkat() at kern_unlinkat+0x28b/frame 0xffffff823284ead0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff823284ebf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff823284ebf0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800b3a50a, rsp = 0x7fffffffd588, rbp = 0x7fffffffdf2c --- savecore: writing core to /var/crash/vmcore.9 Writing crash summary to /var/crash/core.txt.9. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting mountd. Starting nfsd. Recovering vi editor sessions:. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: watchdogd. Starting default moused. Starting inetd. Wed May 29 10:55:07 CEST 2013 FreeBSD/amd64 (x4.osted.lan) (console) login: Expensive timeout(9) function: 0xffffffff8074a020(0xffffffff815f6d40) 0.014126758 s Expensive timeout(9) function: 0xffffffff807971f0(0xffffff800093e320) 0.021766297 s May 29 11:07:45 x4 su: pho to root on /dev/pts/0 lock order reversal: 1st 0xfffffe001acd0548 pseudofs (pseudofs) @ kern/vfs_syscalls.c:4064 2nd 0xffffffff813bb4e0 allproc (allproc) @ fs/pseudofs/pseudofs_vnops.c:793 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a/frame 0xffffff8232c7c720 kdb_backtrace() at kdb_backtrace+0x37/frame 0xffffff8232c7c7e0 _witness_debugger() at _witness_debugger+0x2c/frame 0xffffff8232c7c800 witness_checkorder() at witness_checkorder+0x82d/frame 0xffffff8232c7c8b0 _sx_slock() at _sx_slock+0x72/frame 0xffffff8232c7c8e0 pfs_readdir() at pfs_readdir+0x11c/frame 0xffffff8232c7c970 VOP_READDIR_APV() at VOP_READDIR_APV+0xc9/frame 0xffffff8232c7c9a0 kern_getdirentries() at kern_getdirentries+0x199/frame 0xffffff8232c7ca90 sys_getdirentries() at sys_getdirentries+0x2d/frame 0xffffff8232c7cad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232c7cbf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232c7cbf0 --- syscall (196, FreeBSD ELF64, sys_getdirentries), rip = 0x800ac234a, rsp = 0x7fffffbfde58, rbp = 0x1 --- Stopping inetd. Waiting for PIDS: 1085. Stopping moused. Waiting for PIDS: 1052. Shutting down local packages:. Stopping cron. Waiting for PIDS: 1022. Stopping sshd. Waiting for PIDS: 1001. Stopping watchdogd. Waiting for PIDS: 1032. Stopping ntpd. Waiting for PIDS: 910. Stopping nfsd. Waiting for PIDS: 816 817. Stopping mountd. Waiting for PIDS: 807. Stopping rpcbind. Waiting for PIDS: 709. Stopping devd. Waiting for PIDS: 440. Writing entropy file:. . Terminated May 29 11:18:13 x4 syslogd: exiting on signal 15 May 29 11:18:33 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps auxww USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND root 11 183.1 0.0 0 64 - RL 10:45AM 80:23.91 [idle] nobody 64152 100.0 0.0 23040 3352 0- T 11:08AM 11:44.40 /tmp/syscall4 74 nobody 64236 100.0 0.0 23552 3400 0- TL 11:08AM 11:29.54 /tmp/syscall4 74 root 0 0.0 0.0 0 160 - DLs 10:45AM 0:00.10 [kernel] root 1 0.0 0.0 9308 1000 - ILs 10:45AM 0:27.98 /sbin/init -- root 2 0.0 0.0 0 16 - DL 10:45AM 0:00.01 [fdc0] root 3 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [sctp_iterator] root 4 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [xpt_thrd] root 5 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [pagedaemon] root 6 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [vmdaemon] root 7 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [pagezero] root 8 0.0 0.0 0 16 - DL 10:45AM 0:00.08 [bufdaemon] root 9 0.0 0.0 0 16 - DL 10:45AM 0:00.01 [vnlru] root 10 0.0 0.0 0 16 - DL 10:45AM 0:00.00 [audit] root 12 0.0 0.0 0 336 - WL 10:45AM 0:08.46 [intr] root 13 0.0 0.0 0 48 - DL 10:45AM 0:09.20 [geom] root 14 0.0 0.0 0 16 - DL 10:45AM 0:00.20 [yarrow] root 15 0.0 0.0 0 384 - DL 10:45AM 0:00.22 [usb] root 16 0.0 0.0 0 16 - DL 10:45AM 0:00.22 [syncer] root 17 0.0 0.0 0 16 - DL 10:45AM 0:00.16 [softdepflush] root 64097 0.0 0.0 0 16 - DL 11:08AM 0:00.00 [md5] root 66163 0.0 0.0 16836 3200 u0 Ss 11:18AM 0:00.01 -sh (sh) root 66164 0.0 0.0 16428 2160 u0 R+ 11:19AM 0:00.00 ps auxww # ~KDB: enter: Break to debugger [ thread pid 64152 tid 100470 ] Stopped at kdb_enter+0x3b: movq $0,0xac24e2(%rip) db> run pho db:0:pho> bt Tracing pid 64152 tid 100470 td 0xfffffe018b90c000 kdb_enter() at kdb_enter+0x3b/frame 0xffffff82330003c0 kdb_break() at kdb_break+0x27/frame 0xffffff82330003d0 uart_intr() at uart_intr+0x35a/frame 0xffffff8233000410 intr_event_handle() at intr_event_handle+0xb7/frame 0xffffff8233000460 intr_execute_handlers() at intr_execute_handlers+0x5f/frame 0xffffff8233000490 lapic_handle_intr() at lapic_handle_intr+0x32/frame 0xffffff82330004c0 Xapic_isr1() at Xapic_isr1+0xa0/frame 0xffffff82330004c0 --- interrupt, rip = 0xffffffff809632b6, rsp = 0xffffff8233000580, rbp = 0xffffff8233000630 --- witness_checkorder() at witness_checkorder+0x36/frame 0xffffff8233000630 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xffffff8233000660 trap_pfault() at trap_pfault+0x185/frame 0xffffff82330006f0 trap() at trap+0x40a/frame 0xffffff82330008f0 calltrap() at calltrap+0x8/frame 0xffffff82330008f0 --- trap 0xc, rip = 0xffffffff80cb7f79, rsp = 0xffffff82330009b0, rbp = 0xffffff8233000a80 --- casuword32() at casuword32+0x29/frame 0xffffff8233000a80 __umtx_op_rw_wrlock() at __umtx_op_rw_wrlock+0xa8/frame 0xffffff8233000ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8233000bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8233000bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80083074c, rsp = 0x7fffffffd2c8, rbp = 0x801406400 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x5eb800 curthread = 0xfffffe0015486490: pid 11 "idle: cpu0" curpcb = 0xffffff800025dcc0 fpcurthread = none idlethread = 0xfffffe0015486490: tid 100003 "idle: cpu0" curpmap = 0xffffffff813b5a30 tssp = 0xffffffff815c8900 commontssp = 0xffffffff815c8900 rsp0 = 0xffffff800025dcc0 gs32p = 0xffffffff815c6a38 ldt = 0xffffffff815c6a78 tss = 0xffffffff815c6a68 spin locks held: cpuid = 1 dynamic pcpu = 0xffffff807eec6800 curthread = 0xfffffe0015486000: pid 11 "idle: cpu1" curpcb = 0xffffff8000262cc0 fpcurthread = none idlethread = 0xfffffe0015486000: tid 100004 "idle: cpu1" curpmap = 0xffffffff813b5a30 tssp = 0xffffffff815c8968 commontssp = 0xffffffff815c8968 rsp0 = 0xffffff8000262cc0 gs32p = 0xffffffff815c6aa0 ldt = 0xffffffff815c6ae0 tss = 0xffffffff815c6ad0 spin locks held: cpuid = 2 dynamic pcpu = 0xffffff807eecd800 curthread = 0xfffffe018b90c000: pid 64152 "syscall4" curpcb = 0xffffff8233000cc0 fpcurthread = none idlethread = 0xfffffe0015492920: tid 100005 "idle: cpu2" curpmap = 0xfffffe018b71e130 tssp = 0xffffffff815c89d0 commontssp = 0xffffffff815c89d0 rsp0 = 0xffffff8233000cc0 gs32p = 0xffffffff815c6b08 ldt = 0xffffffff815c6b48 tss = 0xffffffff815c6b38 spin locks held: cpuid = 3 dynamic pcpu = 0xffffff807eed4800 curthread = 0xfffffe018b8af920: pid 64236 "syscall4" curpcb = 0xffffff8232a79cc0 fpcurthread = none idlethread = 0xfffffe0015492490: tid 100006 "idle: cpu3" curpmap = 0xfffffe018be92750 tssp = 0xffffffff815c8a38 commontssp = 0xffffffff815c8a38 rsp0 = 0xffffff8232a79cc0 gs32p = 0xffffffff815c6b70 ldt = 0xffffffff815c6bb0 tss = 0xffffffff815c6ba0 spin locks held: db:0:allpcpu> show alllocks db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffffe001aa09b58 /dev/ufs/root on / (ufs) 0xfffffe001aa0a000 devfs on /dev (devfs) 0xfffffe001abce790 /dev/ufs/home on /home (ufs) 0xfffffe001abce3c8 /dev/label/tmp on /tmp (ufs) 0xfffffe001abce000 /dev/ufs/usr on /usr (ufs) 0xfffffe001aa0ab58 /dev/ufs/var on /var (ufs) 0xfffffe001aa0a790 procfs on /proc (procfs) 0xfffffe001aa09790 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 66163 1 66163 0 Ss+ ttyin 0xfffffe00155638a8 sh 64236 1 64068 65534 T+ (threaded) syscall4 101156 s syscall4 101154 s syscall4 101151 s syscall4 101149 s syscall4 101148 s syscall4 101147 s syscall4 101146 s syscall4 101145 s syscall4 101144 s syscall4 101143 s syscall4 101142 s syscall4 101141 s syscall4 101140 s syscall4 101139 s syscall4 101138 s syscall4 101137 s syscall4 101136 s syscall4 101135 s syscall4 101134 s syscall4 101133 s syscall4 101132 s syscall4 101131 s syscall4 101130 s syscall4 101129 s syscall4 101127 s syscall4 101126 s syscall4 101124 s syscall4 101123 s syscall4 101122 s syscall4 101121 s syscall4 101120 s syscall4 101119 s syscall4 101118 s syscall4 101117 s syscall4 101116 s syscall4 101115 s syscall4 101114 s syscall4 100327 s syscall4 100160 s syscall4 100341 Run CPU 3 syscall4 64152 1 64068 65534 T+ (threaded) syscall4 101554 s syscall4 101553 s syscall4 101552 s syscall4 101551 s syscall4 101550 s syscall4 101549 s syscall4 101548 s syscall4 101547 s syscall4 101546 s syscall4 101545 s syscall4 101544 s syscall4 101543 s syscall4 101542 s syscall4 101541 s syscall4 101540 s syscall4 101539 s syscall4 101538 s syscall4 101537 s syscall4 101536 s syscall4 101535 s syscall4 101534 s syscall4 101533 s syscall4 101532 s syscall4 101531 s syscall4 101530 s syscall4 101529 s syscall4 101528 s syscall4 101527 s syscall4 101526 s syscall4 101525 s syscall4 101524 s syscall4 101523 s syscall4 101522 s syscall4 101521 s syscall4 101520 s syscall4 100470 Run CPU 2 syscall4 64097 0 0 0 DL mdwait 0xfffffe018bb40000 [md5] 17 0 0 0 DL sdflush 0xffffffff815bbb00 [softdepflush] 16 0 0 0 DL syncer 0xffffffff815b0100 [syncer] 9 0 0 0 DL vlruwt 0xfffffe001a761000 [vnlru] 8 0 0 0 DL psleep 0xffffffff815afb20 [bufdaemon] 7 0 0 0 DL pgzero 0xffffffff815c58b4 [pagezero] 6 0 0 0 DL psleep 0xffffffff815c4a70 [vmdaemon] 5 0 0 0 DL psleep 0xffffffff815c4a4c [pagedaemon] 4 0 0 0 DL ccb_scan 0xffffffff8137a660 [xpt_thrd] 3 0 0 0 DL waiting_ 0xffffffff815b5e40 [sctp_iterator] 2 0 0 0 DL - 0xfffffe00156da648 [fdc0] 15 0 0 0 DL (threaded) [usb] 100058 D - 0xffffff8000952e18 [usbus5] 100057 D - 0xffffff8000952dc0 [usbus5] 100056 D - 0xffffff8000952d68 [usbus5] 100055 D - 0xffffff8000952d10 [usbus5] 100053 D - 0xffffff800094a460 [usbus4] 100052 D - 0xffffff800094a408 [usbus4] 100051 D - 0xffffff800094a3b0 [usbus4] 100050 D - 0xffffff800094a358 [usbus4] 100049 D - 0xffffff8000947460 [usbus3] 100048 D - 0xffffff8000947408 [usbus3] 100047 D - 0xffffff80009473b0 [usbus3] 100046 D - 0xffffff8000947358 [usbus3] 100045 D - 0xffffff8000944460 [usbus2] 100044 D - 0xffffff8000944408 [usbus2] 100043 D - 0xffffff80009443b0 [usbus2] 100042 D - 0xffffff8000944358 [usbus2] 100040 D - 0xffffff8000941460 [usbus1] 100039 D - 0xffffff8000941408 [usbus1] 100038 D - 0xffffff80009413b0 [usbus1] 100037 D - 0xffffff8000941358 [usbus1] 100035 D - 0xffffff800093e460 [usbus0] 100034 D - 0xffffff800093e408 [usbus0] 100033 D - 0xffffff800093e3b0 [usbus0] 100032 D - 0xffffff800093e358 [usbus0] 14 0 0 0 DL - 0xffffffff81399f30 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xffffffff813b4c90 [g_down] 100014 D - 0xffffffff813b4c88 [g_up] 100013 D - 0xffffffff813b4c78 [g_event] 12 0 0 0 WL (threaded) [intr] 100063 I [irq12: psm0] 100062 I [irq1: atkbd0] 100060 I [swi0: uart] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: hdac1 ohci0] 100030 I [irq22: ahci0] 100029 I [irq257: re0] 100028 I [irq256: hdac0] 100023 I [swi6: task queue] 100022 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100018 I [swi2: cambio] 100012 I [swi3: vm] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi1: netisr 0] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xfffffe0015484970 [init] 10 0 0 0 DL audit_wo 0xffffffff815baa70 [audit] 0 0 0 0 DLs (threaded) [kernel] 100065 D - 0xffffffff813bbc80 [deadlkres] 100064 D - 0xfffffe0015925500 [mca taskq] 100027 D - 0xfffffe001558bc00 [kqueue taskq] 100026 D - 0xfffffe0015653100 [acpi_task_2] 100025 D - 0xfffffe0015653100 [acpi_task_1] 100024 D - 0xfffffe0015653100 [acpi_task_0] 100021 D - 0xfffffe00154ad500 [thread taskq] 100020 D - 0xfffffe00154ad700 [ffs_trim taskq] 100016 D - 0xfffffe001547ad00 [firmware taskq] 100000 D sched 0xffffffff813b4fc0 [swapper] db:0:ps> allt Tracing command sh pid 66163 tid 100329 td 0xfffffe018bb77000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a42710 mi_switch() at mi_switch+0x238/frame 0xffffff8232a42760 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232a427a0 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8232a42800 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8232a42820 _cv_wait_sig() at _cv_wait_sig+0x181/frame 0xffffff8232a42880 tty_wait() at tty_wait+0x4c/frame 0xffffff8232a428b0 ttydisc_read() at ttydisc_read+0x38e/frame 0xffffff8232a42950 ttydev_read() at ttydev_read+0x95/frame 0xffffff8232a42980 devfs_read_f() at devfs_read_f+0x90/frame 0xffffff8232a429f0 dofileread() at dofileread+0xa1/frame 0xffffff8232a42a40 kern_readv() at kern_readv+0x6c/frame 0xffffff8232a42a80 sys_read() at sys_read+0x64/frame 0xffffff8232a42ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232a42bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232a42bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800dcc44a, rsp = 0x7fffffffdbc8, rbp = 0x80180a100 --- Tracing command syscall4 pid 64236 tid 101156 td 0xfffffe018b975490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a55b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a55b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a55bb0 ast() at ast+0x3d0/frame 0xffffff8233a55bf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101154 td 0xfffffe018bc51000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a50b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a50b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a50bb0 ast() at ast+0x3d0/frame 0xffffff8233a50bf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101151 td 0xfffffe016d246920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a4bb20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a4bb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a4bbb0 ast() at ast+0x3d0/frame 0xffffff8233a4bbf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101149 td 0xfffffe016d246490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a46b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a46b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a46bb0 ast() at ast+0x3d0/frame 0xffffff8233a46bf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101148 td 0xfffffe016d246000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a41b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a41b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a41bb0 ast() at ast+0x3d0/frame 0xffffff8233a41bf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101147 td 0xfffffe018b2b7490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a3cb20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a3cb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a3cbb0 ast() at ast+0x3d0/frame 0xffffff8233a3cbf0 doreti_ast() at doreti_ast+0x1f Tracing command syscall4 pid 64236 tid 101146 td 0xfffffe0086be9490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a37b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a37b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a37bb0 ast() at ast+0x3d0/frame 0xffffff8233a37bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140f008 Tracing command syscall4 pid 64236 tid 101145 td 0xfffffe016d16c920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a32b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a32b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a32bb0 ast() at ast+0x3d0/frame 0xffffff8233a32bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140ec08 Tracing command syscall4 pid 64236 tid 101144 td 0xfffffe018b662000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a2db20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a2db70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a2dbb0 ast() at ast+0x3d0/frame 0xffffff8233a2dbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e808 Tracing command syscall4 pid 64236 tid 101143 td 0xfffffe018b662920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a28b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a28b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a28bb0 ast() at ast+0x3d0/frame 0xffffff8233a28bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e408 Tracing command syscall4 pid 64236 tid 101142 td 0xfffffe016da0b490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a23b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a23b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a23bb0 ast() at ast+0x3d0/frame 0xffffff8233a23bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e008 Tracing command syscall4 pid 64236 tid 101141 td 0xfffffe018bf8b490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a1eb20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a1eb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a1ebb0 ast() at ast+0x3d0/frame 0xffffff8233a1ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140dc08 Tracing command syscall4 pid 64236 tid 101140 td 0xfffffe018b7c7000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a19b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a19b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a19bb0 ast() at ast+0x3d0/frame 0xffffff8233a19bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d808 Tracing command syscall4 pid 64236 tid 101139 td 0xfffffe016d214920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a14b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a14b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a14bb0 ast() at ast+0x3d0/frame 0xffffff8233a14bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d408 Tracing command syscall4 pid 64236 tid 101138 td 0xfffffe018bcc2920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a0fb20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a0fb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a0fbb0 ast() at ast+0x3d0/frame 0xffffff8233a0fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d008 Tracing command syscall4 pid 64236 tid 101137 td 0xfffffe016d403490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a0ab20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a0ab70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a0abb0 ast() at ast+0x3d0/frame 0xffffff8233a0abf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140cc08 Tracing command syscall4 pid 64236 tid 101136 td 0xfffffe00860bd000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a05b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a05b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a05bb0 ast() at ast+0x3d0/frame 0xffffff8233a05bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c808 Tracing command syscall4 pid 64236 tid 101135 td 0xfffffe016d16c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233a00b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233a00b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233a00bb0 ast() at ast+0x3d0/frame 0xffffff8233a00bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c408 Tracing command syscall4 pid 64236 tid 101134 td 0xfffffe018b2c0000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339fbb20 mi_switch() at mi_switch+0x238/frame 0xffffff82339fbb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339fbbb0 ast() at ast+0x3d0/frame 0xffffff82339fbbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c008 Tracing command syscall4 pid 64236 tid 101133 td 0xfffffe016dafd490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339f6b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339f6b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339f6bb0 ast() at ast+0x3d0/frame 0xffffff82339f6bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140bc08 Tracing command syscall4 pid 64236 tid 101132 td 0xfffffe0086c85920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339f1b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339f1b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339f1bb0 ast() at ast+0x3d0/frame 0xffffff82339f1bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b808 Tracing command syscall4 pid 64236 tid 101131 td 0xfffffe018bf89000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339ecb20 mi_switch() at mi_switch+0x238/frame 0xffffff82339ecb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339ecbb0 ast() at ast+0x3d0/frame 0xffffff82339ecbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b408 Tracing command syscall4 pid 64236 tid 101130 td 0xfffffe016d7a4000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339e7b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339e7b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339e7bb0 ast() at ast+0x3d0/frame 0xffffff82339e7bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b008 Tracing command syscall4 pid 64236 tid 101129 td 0xfffffe016da0b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339e2b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339e2b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339e2bb0 ast() at ast+0x3d0/frame 0xffffff82339e2bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140ac08 Tracing command syscall4 pid 64236 tid 101127 td 0xfffffe018ba4a490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339ddb20 mi_switch() at mi_switch+0x238/frame 0xffffff82339ddb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339ddbb0 ast() at ast+0x3d0/frame 0xffffff82339ddbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a808 Tracing command syscall4 pid 64236 tid 101126 td 0xfffffe016d5f1490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339d8b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339d8b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339d8bb0 ast() at ast+0x3d0/frame 0xffffff82339d8bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a408 Tracing command syscall4 pid 64236 tid 101124 td 0xfffffe016da61490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339d3b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339d3b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339d3bb0 ast() at ast+0x3d0/frame 0xffffff82339d3bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a008 Tracing command syscall4 pid 64236 tid 101123 td 0xfffffe018bb21920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339ceb20 mi_switch() at mi_switch+0x238/frame 0xffffff82339ceb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339cebb0 ast() at ast+0x3d0/frame 0xffffff82339cebf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409c08 Tracing command syscall4 pid 64236 tid 101122 td 0xfffffe016dada490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339bfb20 mi_switch() at mi_switch+0x238/frame 0xffffff82339bfb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339bfbb0 ast() at ast+0x3d0/frame 0xffffff82339bfbf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409808 Tracing command syscall4 pid 64236 tid 101121 td 0xfffffe0086c4c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339b5b20 mi_switch() at mi_switch+0x238/frame 0xffffff82339b5b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339b5bb0 ast() at ast+0x3d0/frame 0xffffff82339b5bf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409408 Tracing command syscall4 pid 64236 tid 101120 td 0xfffffe0086f0e490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82339a6110 mi_switch() at mi_switch+0x238/frame 0xffffff82339a6160 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82339a61a0 exit1() at exit1+0x82/frame 0xffffff82339a6230 sigexit() at sigexit+0x8f/frame 0xffffff82339a64f0 sendsig() at sendsig+0x403/frame 0xffffff82339a6960 trapsignal() at trapsignal+0x1e0/frame 0xffffff82339a69f0 trap() at trap+0x1f5/frame 0xffffff82339a6bf0 calltrap() at calltrap+0x8/frame 0xffffff82339a6bf0 --- trap 0xc, rip = 0x401352, rsp = 0x7ffffebf5f70, rbp = 0x4a --- Tracing command syscall4 pid 64236 tid 101119 td 0xfffffe016d073000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233753b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233753b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233753bb0 ast() at ast+0x3d0/frame 0xffffff8233753bf0 doreti_ast() at doreti_ast+0x1f/frame 0x801408c08 Tracing command syscall4 pid 64236 tid 101118 td 0xfffffe018bb83000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233505110 mi_switch() at mi_switch+0x238/frame 0xffffff8233505160 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82335051a0 exit1() at exit1+0x82/frame 0xffffff8233505230 sigexit() at sigexit+0x8f/frame 0xffffff82335054f0 sendsig() at sendsig+0x403/frame 0xffffff8233505960 trapsignal() at trapsignal+0x1e0/frame 0xffffff82335059f0 trap() at trap+0x1f5/frame 0xffffff8233505bf0 calltrap() at calltrap+0x8/frame 0xffffff8233505bf0 --- trap 0xc, rip = 0x401352, rsp = 0x7ffffeff7f70, rbp = 0x4a --- Tracing command syscall4 pid 64236 tid 101117 td 0xfffffe018bbe1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233307b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233307b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233307bb0 ast() at ast+0x3d0/frame 0xffffff8233307bf0 doreti_ast() at doreti_ast+0x1f/frame 0x18afd Tracing command syscall4 pid 64236 tid 101116 td 0xfffffe0086f0f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823326c150 mi_switch() at mi_switch+0x238/frame 0xffffff823326c1a0 thread_suspend_switch() at thread_suspend_switch+0x103/frame 0xffffff823326c1f0 thread_single() at thread_single+0x222/frame 0xffffff823326c230 sigexit() at sigexit+0x97/frame 0xffffff823326c4f0 sendsig() at sendsig+0x403/frame 0xffffff823326c960 trapsignal() at trapsignal+0x1e0/frame 0xffffff823326c9f0 trap() at trap+0x1f5/frame 0xffffff823326cbf0 calltrap() at calltrap+0x8/frame 0xffffff823326cbf0 --- trap 0xc, rip = 0x401352, rsp = 0x7fffff3f9f70, rbp = 0x4a --- Tracing command syscall4 pid 64236 tid 101115 td 0xfffffe0086f0e920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82330a0b20 mi_switch() at mi_switch+0x238/frame 0xffffff82330a0b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82330a0bb0 ast() at ast+0x3d0/frame 0xffffff82330a0bf0 doreti_ast() at doreti_ast+0x1f/frame 0x18afb Tracing command syscall4 pid 64236 tid 101114 td 0xfffffe016d072920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232e2ab20 mi_switch() at mi_switch+0x238/frame 0xffffff8232e2ab70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8232e2abb0 ast() at ast+0x3d0/frame 0xffffff8232e2abf0 doreti_ast() at doreti_ast+0x1f/frame 0x18afa Tracing command syscall4 pid 64236 tid 100327 td 0xfffffe016d072490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232deeb20 mi_switch() at mi_switch+0x238/frame 0xffffff8232deeb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8232deebb0 ast() at ast+0x3d0/frame 0xffffff8232deebf0 doreti_ast() at doreti_ast+0x1f/frame 0x187e7 Tracing command syscall4 pid 64236 tid 100160 td 0xfffffe018bef6920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232d21b20 mi_switch() at mi_switch+0x238/frame 0xffffff8232d21b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8232d21bb0 ast() at ast+0x3d0/frame 0xffffff8232d21bf0 doreti_ast() at doreti_ast+0x1f/frame 0x18740 Tracing command syscall4 pid 64236 tid 100341 td 0xfffffe018b8af920 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff800024cd00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff800024cd20 trap() at trap+0x325/frame 0xffffff800024cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800024cf20 --- trap 0x13, rip = 0xffffffff808fb22e, rsp = 0xffffff800024cfe0, rbp = 0xffffff8232a799c0 --- __mtx_lock_flags() at __mtx_lock_flags+0x1e/frame 0xffffff8232a799c0 do_rw_wrlock() at do_rw_wrlock+0x135/frame 0xffffff8232a79a80 __umtx_op_rw_wrlock() at __umtx_op_rw_wrlock+0xa8/frame 0xffffff8232a79ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8232a79bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8232a79bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80083074c, rsp = 0x7fffffffd2c8, rbp = 0x801406400 --- Tracing command syscall4 pid 64152 tid 101554 td 0xfffffe018bb0f490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233992b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233992b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233992bb0 ast() at ast+0x3d0/frame 0xffffff8233992bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140f808 Tracing command syscall4 pid 64152 tid 101553 td 0xfffffe0086aa5490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823398db20 mi_switch() at mi_switch+0x238/frame 0xffffff823398db70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823398dbb0 ast() at ast+0x3d0/frame 0xffffff823398dbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140f408 Tracing command syscall4 pid 64152 tid 101552 td 0xfffffe016d881000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823397eb20 mi_switch() at mi_switch+0x238/frame 0xffffff823397eb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823397ebb0 ast() at ast+0x3d0/frame 0xffffff823397ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140f008 Tracing command syscall4 pid 64152 tid 101551 td 0xfffffe016d67a000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233979b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233979b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233979bb0 ast() at ast+0x3d0/frame 0xffffff8233979bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140ec08 Tracing command syscall4 pid 64152 tid 101550 td 0xfffffe0086ad2920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823396fb20 mi_switch() at mi_switch+0x238/frame 0xffffff823396fb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823396fbb0 ast() at ast+0x3d0/frame 0xffffff823396fbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e808 Tracing command syscall4 pid 64152 tid 101549 td 0xfffffe0086b9c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823396ab20 mi_switch() at mi_switch+0x238/frame 0xffffff823396ab70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823396abb0 ast() at ast+0x3d0/frame 0xffffff823396abf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e408 Tracing command syscall4 pid 64152 tid 101548 td 0xfffffe0086aa5000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233965b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233965b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233965bb0 ast() at ast+0x3d0/frame 0xffffff8233965bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140e008 Tracing command syscall4 pid 64152 tid 101547 td 0xfffffe016d67a490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233960b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233960b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233960bb0 ast() at ast+0x3d0/frame 0xffffff8233960bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140dc08 Tracing command syscall4 pid 64152 tid 101546 td 0xfffffe0086b9c000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823395bb20 mi_switch() at mi_switch+0x238/frame 0xffffff823395bb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823395bbb0 ast() at ast+0x3d0/frame 0xffffff823395bbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d808 Tracing command syscall4 pid 64152 tid 101545 td 0xfffffe016d67a920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233956b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233956b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233956bb0 ast() at ast+0x3d0/frame 0xffffff8233956bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d408 Tracing command syscall4 pid 64152 tid 101544 td 0xfffffe0086c51490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233951b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233951b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233951bb0 ast() at ast+0x3d0/frame 0xffffff8233951bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140d008 Tracing command syscall4 pid 64152 tid 101543 td 0xfffffe0086c51000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823394cb20 mi_switch() at mi_switch+0x238/frame 0xffffff823394cb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823394cbb0 ast() at ast+0x3d0/frame 0xffffff823394cbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140cc08 Tracing command syscall4 pid 64152 tid 101542 td 0xfffffe0086b9c920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233947b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233947b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233947bb0 ast() at ast+0x3d0/frame 0xffffff8233947bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c808 Tracing command syscall4 pid 64152 tid 101541 td 0xfffffe018b3f3920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233942b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233942b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233942bb0 ast() at ast+0x3d0/frame 0xffffff8233942bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c408 Tracing command syscall4 pid 64152 tid 101540 td 0xfffffe0086c51920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823393db20 mi_switch() at mi_switch+0x238/frame 0xffffff823393db70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823393dbb0 ast() at ast+0x3d0/frame 0xffffff823393dbf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140c008 Tracing command syscall4 pid 64152 tid 101539 td 0xfffffe018b3f3490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233938b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233938b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233938bb0 ast() at ast+0x3d0/frame 0xffffff8233938bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140bc08 Tracing command syscall4 pid 64152 tid 101538 td 0xfffffe016d26b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233933b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233933b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233933bb0 ast() at ast+0x3d0/frame 0xffffff8233933bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b808 Tracing command syscall4 pid 64152 tid 101537 td 0xfffffe016d26b490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823392eb20 mi_switch() at mi_switch+0x238/frame 0xffffff823392eb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823392ebb0 ast() at ast+0x3d0/frame 0xffffff823392ebf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b408 Tracing command syscall4 pid 64152 tid 101536 td 0xfffffe0086839920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233929b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233929b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233929bb0 ast() at ast+0x3d0/frame 0xffffff8233929bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140b008 Tracing command syscall4 pid 64152 tid 101535 td 0xfffffe018b941920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233924b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233924b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233924bb0 ast() at ast+0x3d0/frame 0xffffff8233924bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140ac08 Tracing command syscall4 pid 64152 tid 101534 td 0xfffffe008615f920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823391ab20 mi_switch() at mi_switch+0x238/frame 0xffffff823391ab70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823391abb0 ast() at ast+0x3d0/frame 0xffffff823391abf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a808 Tracing command syscall4 pid 64152 tid 101533 td 0xfffffe018b2d4490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233915b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233915b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233915bb0 ast() at ast+0x3d0/frame 0xffffff8233915bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a408 Tracing command syscall4 pid 64152 tid 101532 td 0xfffffe018bb21490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233910b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233910b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233910bb0 ast() at ast+0x3d0/frame 0xffffff8233910bf0 doreti_ast() at doreti_ast+0x1f/frame 0x80140a008 Tracing command syscall4 pid 64152 tid 101531 td 0xfffffe018b77f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823390bb20 mi_switch() at mi_switch+0x238/frame 0xffffff823390bb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823390bbb0 ast() at ast+0x3d0/frame 0xffffff823390bbf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409c08 Tracing command syscall4 pid 64152 tid 101530 td 0xfffffe016d8b9000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233906b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233906b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233906bb0 ast() at ast+0x3d0/frame 0xffffff8233906bf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409808 Tracing command syscall4 pid 64152 tid 101529 td 0xfffffe0086f02920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82338d9b20 mi_switch() at mi_switch+0x238/frame 0xffffff82338d9b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82338d9bb0 ast() at ast+0x3d0/frame 0xffffff82338d9bf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409408 Tracing command syscall4 pid 64152 tid 101528 td 0xfffffe018bf21920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233758b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233758b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233758bb0 ast() at ast+0x3d0/frame 0xffffff8233758bf0 doreti_ast() at doreti_ast+0x1f/frame 0x801409008 Tracing command syscall4 pid 64152 tid 101527 td 0xfffffe008615f490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823369ab20 mi_switch() at mi_switch+0x238/frame 0xffffff823369ab70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff823369abb0 ast() at ast+0x3d0/frame 0xffffff823369abf0 doreti_ast() at doreti_ast+0x1f/frame 0x801408c08 Tracing command syscall4 pid 64152 tid 101526 td 0xfffffe0086f02490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82334ceb20 mi_switch() at mi_switch+0x238/frame 0xffffff82334ceb70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82334cebb0 ast() at ast+0x3d0/frame 0xffffff82334cebf0 doreti_ast() at doreti_ast+0x1f/frame 0x801408808 Tracing command syscall4 pid 64152 tid 101525 td 0xfffffe0086e5c490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82333c06e0 mi_switch() at mi_switch+0x238/frame 0xffffff82333c0730 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff82333c0770 exit1() at exit1+0x82/frame 0xffffff82333c0800 sigexit() at sigexit+0x8f/frame 0xffffff82333c0ac0 postsig() at postsig+0x417/frame 0xffffff82333c0bb0 ast() at ast+0x247/frame 0xffffff82333c0bf0 doreti_ast() at doreti_ast+0x1f/frame 0x4a Tracing command syscall4 pid 64152 tid 101524 td 0xfffffe0086707920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233352720 mi_switch() at mi_switch+0x238/frame 0xffffff8233352770 thread_suspend_switch() at thread_suspend_switch+0x103/frame 0xffffff82333527c0 thread_single() at thread_single+0x222/frame 0xffffff8233352800 sigexit() at sigexit+0x97/frame 0xffffff8233352ac0 postsig() at postsig+0x417/frame 0xffffff8233352bb0 ast() at ast+0x247/frame 0xffffff8233352bf0 doreti_ast() at doreti_ast+0x1f/frame 0x4a Tracing command syscall4 pid 64152 tid 101523 td 0xfffffe018b2d4920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82332216e0 mi_switch() at mi_switch+0x238/frame 0xffffff8233221730 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233221770 exit1() at exit1+0x82/frame 0xffffff8233221800 sigexit() at sigexit+0x8f/frame 0xffffff8233221ac0 postsig() at postsig+0x417/frame 0xffffff8233221bb0 ast() at ast+0x247/frame 0xffffff8233221bf0 doreti_ast() at doreti_ast+0x1f/frame 0x4a Tracing command syscall4 pid 64152 tid 101522 td 0xfffffe018bdfe000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8233195b20 mi_switch() at mi_switch+0x238/frame 0xffffff8233195b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233195bb0 ast() at ast+0x3d0/frame 0xffffff8233195bf0 doreti_ast() at doreti_ast+0x1f/frame 0x18c92 Tracing command syscall4 pid 64152 tid 101521 td 0xfffffe016d30b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82330736e0 mi_switch() at mi_switch+0x238/frame 0xffffff8233073730 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8233073770 exit1() at exit1+0x82/frame 0xffffff8233073800 sigexit() at sigexit+0x8f/frame 0xffffff8233073ac0 postsig() at postsig+0x417/frame 0xffffff8233073bb0 ast() at ast+0x247/frame 0xffffff8233073bf0 doreti_ast() at doreti_ast+0x1f/frame 0x4a Tracing command syscall4 pid 64152 tid 101520 td 0xfffffe008615f000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232a29b20 mi_switch() at mi_switch+0x238/frame 0xffffff8232a29b70 thread_suspend_check() at thread_suspend_check+0x1ae/frame 0xffffff8232a29bb0 ast() at ast+0x3d0/frame 0xffffff8232a29bf0 doreti_ast() at doreti_ast+0x1f/frame 0x18c90 Tracing command syscall4 pid 64152 tid 100470 td 0xfffffe018b90c000 kdb_enter() at kdb_enter+0x3b/frame 0xffffff82330003c0 kdb_break() at kdb_break+0x27/frame 0xffffff82330003d0 uart_intr() at uart_intr+0x35a/frame 0xffffff8233000410 intr_event_handle() at intr_event_handle+0xb7/frame 0xffffff8233000460 intr_execute_handlers() at intr_execute_handlers+0x5f/frame 0xffffff8233000490 lapic_handle_intr() at lapic_handle_intr+0x32/frame 0xffffff82330004c0 Xapic_isr1() at Xapic_isr1+0xa0/frame 0xffffff82330004c0 --- interrupt, rip = 0xffffffff809632b6, rsp = 0xffffff8233000580, rbp = 0xffffff8233000630 --- witness_checkorder() at witness_checkorder+0x36/frame 0xffffff8233000630 __mtx_lock_flags() at __mtx_lock_flags+0x94/frame 0xffffff8233000660 trap_pfault() at trap_pfault+0x185/frame 0xffffff82330006f0 trap() at trap+0x40a/frame 0xffffff82330008f0 calltrap() at calltrap+0x8/frame 0xffffff82330008f0 --- trap 0xc, rip = 0xffffffff80cb7f79, rsp = 0xffffff82330009b0, rbp = 0xffffff8233000a80 --- casuword32() at casuword32+0x29/frame 0xffffff8233000a80 __umtx_op_rw_wrlock() at __umtx_op_rw_wrlock+0xa8/frame 0xffffff8233000ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8233000bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8233000bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80083074c, rsp = 0x7fffffffd2c8, rbp = 0x801406400 --- Tracing command md5 pid 64097 tid 100430 td 0xfffffe018bb4b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232f38a00 mi_switch() at mi_switch+0x238/frame 0xffffff8232f38a50 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232f38a90 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232f38ac0 _sleep() at _sleep+0x3fb/frame 0xffffff8232f38b50 md_kthread() at md_kthread+0x185/frame 0xffffff8232f38ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232f38bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232f38bf0 --- trap 0, rip = 0, rsp = 0xffffff8232f38cb0, rbp = 0 --- Tracing command softdepflush pid 17 tid 100074 td 0xfffffe001a930920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232844a10 mi_switch() at mi_switch+0x238/frame 0xffffff8232844a60 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232844aa0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232844ad0 _sleep() at _sleep+0x28d/frame 0xffffff8232844b60 softdep_flush() at softdep_flush+0x21f/frame 0xffffff8232844ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232844bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232844bf0 --- trap 0, rip = 0, rsp = 0xffffff8232844cb0, rbp = 0 --- Tracing command syncer pid 16 tid 100073 td 0xfffffe001a933000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823283f9e0 mi_switch() at mi_switch+0x238/frame 0xffffff823283fa30 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823283fa70 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823283faa0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1a4/frame 0xffffff823283fb10 sched_sync() at sched_sync+0x4ff/frame 0xffffff823283fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823283fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823283fbf0 --- trap 0, rip = 0, rsp = 0xffffff823283fcb0, rbp = 0 --- Tracing command vnlru pid 9 tid 100072 td 0xfffffe0015919000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823283a9c0 mi_switch() at mi_switch+0x238/frame 0xffffff823283aa10 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823283aa50 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823283aa80 _sleep() at _sleep+0x28d/frame 0xffffff823283ab10 vnlru_proc() at vnlru_proc+0x56a/frame 0xffffff823283aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823283abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823283abf0 --- trap 0, rip = 0, rsp = 0xffffff823283acb0, rbp = 0 --- Tracing command bufdaemon pid 8 tid 100071 td 0xfffffe0015919490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232835a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232835a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232835ac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232835af0 _sleep() at _sleep+0x28d/frame 0xffffff8232835b80 buf_daemon() at buf_daemon+0x1ba/frame 0xffffff8232835ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232835bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232835bf0 --- trap 0, rip = 0, rsp = 0xffffff8232835cb0, rbp = 0 --- Tracing command pagezero pid 7 tid 100070 td 0xfffffe0015919920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232830a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232830a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232830ac0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232830af0 _sleep() at _sleep+0x28d/frame 0xffffff8232830b80 vm_pagezero() at vm_pagezero+0x88/frame 0xffffff8232830ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232830bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232830bf0 --- trap 0, rip = 0, rsp = 0xffffff8232830cb0, rbp = 0 --- Tracing command vmdaemon pid 6 tid 100069 td 0xfffffe001591b000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823282b9d0 mi_switch() at mi_switch+0x238/frame 0xffffff823282ba20 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823282ba60 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823282ba90 _sleep() at _sleep+0x3fb/frame 0xffffff823282bb20 vm_daemon() at vm_daemon+0x57/frame 0xffffff823282bba0 fork_exit() at fork_exit+0x139/frame 0xffffff823282bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823282bbf0 --- trap 0, rip = 0, rsp = 0xffffff823282bcb0, rbp = 0 --- Tracing command pagedaemon pid 5 tid 100068 td 0xfffffe001591b490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232826940 mi_switch() at mi_switch+0x238/frame 0xffffff8232826990 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82328269d0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232826a00 _sleep() at _sleep+0x28d/frame 0xffffff8232826a90 vm_pageout() at vm_pageout+0xbab/frame 0xffffff8232826ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232826bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232826bf0 --- trap 0, rip = 0, rsp = 0xffffff8232826cb0, rbp = 0 --- Tracing command xpt_thrd pid 4 tid 100067 td 0xfffffe001591b920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82326a1a20 mi_switch() at mi_switch+0x238/frame 0xffffff82326a1a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82326a1ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82326a1ae0 _sleep() at _sleep+0x3fb/frame 0xffffff82326a1b70 xpt_scanner_thread() at xpt_scanner_thread+0xf2/frame 0xffffff82326a1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82326a1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82326a1bf0 --- trap 0, rip = 0, rsp = 0xffffff82326a1cb0, rbp = 0 --- Tracing command sctp_iterator pid 3 tid 100066 td 0xfffffe001591d000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823269ca30 mi_switch() at mi_switch+0x238/frame 0xffffff823269ca80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823269cac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823269caf0 _sleep() at _sleep+0x3fb/frame 0xffffff823269cb80 sctp_iterator_thread() at sctp_iterator_thread+0x4b/frame 0xffffff823269cba0 fork_exit() at fork_exit+0x139/frame 0xffffff823269cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823269cbf0 --- trap 0, rip = 0, rsp = 0xffffff823269ccb0, rbp = 0 --- Tracing command fdc0 pid 2 tid 100061 td 0xfffffe001591e920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823267e990 mi_switch() at mi_switch+0x238/frame 0xffffff823267e9e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823267ea20 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff823267ea50 _sleep() at _sleep+0x28d/frame 0xffffff823267eae0 fdc_thread() at fdc_thread+0x846/frame 0xffffff823267eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823267ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823267ebf0 --- trap 0, rip = 0, rsp = 0xffffff823267ecb0, rbp = 0 --- Tracing command usb pid 15 tid 100058 td 0xfffffe00158f8000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232638a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232638aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232638ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232638b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232638b70 usb_process() at usb_process+0x172/frame 0xffffff8232638ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232638bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232638bf0 --- trap 0, rip = 0, rsp = 0xffffff8232638cb0, rbp = 0 --- Tracing command usb pid 15 tid 100057 td 0xfffffe00158f8490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232633a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232633aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232633ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232633b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232633b70 usb_process() at usb_process+0x172/frame 0xffffff8232633ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232633bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232633bf0 --- trap 0, rip = 0, rsp = 0xffffff8232633cb0, rbp = 0 --- Tracing command usb pid 15 tid 100056 td 0xfffffe00158f8920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823262ea50 mi_switch() at mi_switch+0x238/frame 0xffffff823262eaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823262eae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823262eb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823262eb70 usb_process() at usb_process+0x172/frame 0xffffff823262eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823262ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823262ebf0 --- trap 0, rip = 0, rsp = 0xffffff823262ecb0, rbp = 0 --- Tracing command usb pid 15 tid 100055 td 0xfffffe00158f9000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232629a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232629aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232629ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232629b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232629b70 usb_process() at usb_process+0x172/frame 0xffffff8232629ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232629bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232629bf0 --- trap 0, rip = 0, rsp = 0xffffff8232629cb0, rbp = 0 --- Tracing command usb pid 15 tid 100053 td 0xfffffe00158f9920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823249ca50 mi_switch() at mi_switch+0x238/frame 0xffffff823249caa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823249cae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823249cb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823249cb70 usb_process() at usb_process+0x172/frame 0xffffff823249cba0 fork_exit() at fork_exit+0x139/frame 0xffffff823249cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823249cbf0 --- trap 0, rip = 0, rsp = 0xffffff823249ccb0, rbp = 0 --- Tracing command usb pid 15 tid 100052 td 0xfffffe00158fa000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232497a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232497aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232497ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232497b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232497b70 usb_process() at usb_process+0x172/frame 0xffffff8232497ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232497bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232497bf0 --- trap 0, rip = 0, rsp = 0xffffff8232497cb0, rbp = 0 --- Tracing command usb pid 15 tid 100051 td 0xfffffe00158fa490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232492a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232492aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232492ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232492b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232492b70 usb_process() at usb_process+0x172/frame 0xffffff8232492ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232492bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232492bf0 --- trap 0, rip = 0, rsp = 0xffffff8232492cb0, rbp = 0 --- Tracing command usb pid 15 tid 100050 td 0xfffffe00158fa920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823248da50 mi_switch() at mi_switch+0x238/frame 0xffffff823248daa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823248dae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823248db10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823248db70 usb_process() at usb_process+0x172/frame 0xffffff823248dba0 fork_exit() at fork_exit+0x139/frame 0xffffff823248dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823248dbf0 --- trap 0, rip = 0, rsp = 0xffffff823248dcb0, rbp = 0 --- Tracing command usb pid 15 tid 100049 td 0xfffffe00158ea000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232444a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232444aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232444ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232444b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232444b70 usb_process() at usb_process+0x172/frame 0xffffff8232444ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232444bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232444bf0 --- trap 0, rip = 0, rsp = 0xffffff8232444cb0, rbp = 0 --- Tracing command usb pid 15 tid 100048 td 0xfffffe00158ea490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823243fa50 mi_switch() at mi_switch+0x238/frame 0xffffff823243faa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823243fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823243fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823243fb70 usb_process() at usb_process+0x172/frame 0xffffff823243fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823243fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823243fbf0 --- trap 0, rip = 0, rsp = 0xffffff823243fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100047 td 0xfffffe00158ea920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823243aa50 mi_switch() at mi_switch+0x238/frame 0xffffff823243aaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823243aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823243ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823243ab70 usb_process() at usb_process+0x172/frame 0xffffff823243aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823243abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823243abf0 --- trap 0, rip = 0, rsp = 0xffffff823243acb0, rbp = 0 --- Tracing command usb pid 15 tid 100046 td 0xfffffe00158eb000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232435a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232435aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232435ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232435b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232435b70 usb_process() at usb_process+0x172/frame 0xffffff8232435ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232435bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232435bf0 --- trap 0, rip = 0, rsp = 0xffffff8232435cb0, rbp = 0 --- Tracing command usb pid 15 tid 100045 td 0xfffffe00158eb490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323eca50 mi_switch() at mi_switch+0x238/frame 0xffffff82323ecaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323ecae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323ecb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323ecb70 usb_process() at usb_process+0x172/frame 0xffffff82323ecba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323ecbf0 --- trap 0, rip = 0, rsp = 0xffffff82323eccb0, rbp = 0 --- Tracing command usb pid 15 tid 100044 td 0xfffffe00158eb920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323e7a50 mi_switch() at mi_switch+0x238/frame 0xffffff82323e7aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323e7ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323e7b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323e7b70 usb_process() at usb_process+0x172/frame 0xffffff82323e7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323e7bf0 --- trap 0, rip = 0, rsp = 0xffffff82323e7cb0, rbp = 0 --- Tracing command usb pid 15 tid 100043 td 0xfffffe00158ed000 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323e2a50 mi_switch() at mi_switch+0x238/frame 0xffffff82323e2aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323e2ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323e2b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323e2b70 usb_process() at usb_process+0x172/frame 0xffffff82323e2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323e2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323e2bf0 --- trap 0, rip = 0, rsp = 0xffffff82323e2cb0, rbp = 0 --- Tracing command usb pid 15 tid 100042 td 0xfffffe00158ed490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323dda50 mi_switch() at mi_switch+0x238/frame 0xffffff82323ddaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff82323ddae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff82323ddb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff82323ddb70 usb_process() at usb_process+0x172/frame 0xffffff82323ddba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323ddbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323ddbf0 --- trap 0, rip = 0, rsp = 0xffffff82323ddcb0, rbp = 0 --- Tracing command usb pid 15 tid 100040 td 0xfffffe00158f0000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823238fa50 mi_switch() at mi_switch+0x238/frame 0xffffff823238faa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823238fae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823238fb10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823238fb70 usb_process() at usb_process+0x172/frame 0xffffff823238fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823238fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823238fbf0 --- trap 0, rip = 0, rsp = 0xffffff823238fcb0, rbp = 0 --- Tracing command usb pid 15 tid 100039 td 0xfffffe00158e2000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823238aa50 mi_switch() at mi_switch+0x238/frame 0xffffff823238aaa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823238aae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823238ab10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823238ab70 usb_process() at usb_process+0x172/frame 0xffffff823238aba0 fork_exit() at fork_exit+0x139/frame 0xffffff823238abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823238abf0 --- trap 0, rip = 0, rsp = 0xffffff823238acb0, rbp = 0 --- Tracing command usb pid 15 tid 100038 td 0xfffffe00158e2490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232385a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232385aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232385ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232385b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232385b70 usb_process() at usb_process+0x172/frame 0xffffff8232385ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232385bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232385bf0 --- trap 0, rip = 0, rsp = 0xffffff8232385cb0, rbp = 0 --- Tracing command usb pid 15 tid 100037 td 0xfffffe00158e2920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232380a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232380aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232380ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232380b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232380b70 usb_process() at usb_process+0x172/frame 0xffffff8232380ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232380bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232380bf0 --- trap 0, rip = 0, rsp = 0xffffff8232380cb0, rbp = 0 --- Tracing command usb pid 15 tid 100035 td 0xfffffe00158e4490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232332a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232332aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232332ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232332b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232332b70 usb_process() at usb_process+0x172/frame 0xffffff8232332ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232332bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232332bf0 --- trap 0, rip = 0, rsp = 0xffffff8232332cb0, rbp = 0 --- Tracing command usb pid 15 tid 100034 td 0xfffffe00158e4920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823232da50 mi_switch() at mi_switch+0x238/frame 0xffffff823232daa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff823232dae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff823232db10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff823232db70 usb_process() at usb_process+0x172/frame 0xffffff823232dba0 fork_exit() at fork_exit+0x139/frame 0xffffff823232dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823232dbf0 --- trap 0, rip = 0, rsp = 0xffffff823232dcb0, rbp = 0 --- Tracing command usb pid 15 tid 100033 td 0xfffffe00158e5000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232328a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232328aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232328ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232328b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232328b70 usb_process() at usb_process+0x172/frame 0xffffff8232328ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232328bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232328bf0 --- trap 0, rip = 0, rsp = 0xffffff8232328cb0, rbp = 0 --- Tracing command usb pid 15 tid 100032 td 0xfffffe00158e5490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232323a50 mi_switch() at mi_switch+0x238/frame 0xffffff8232323aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232323ae0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232323b10 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8232323b70 usb_process() at usb_process+0x172/frame 0xffffff8232323ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232323bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232323bf0 --- trap 0, rip = 0, rsp = 0xffffff8232323cb0, rbp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xfffffe00154af920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a3a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002a3a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002a3ab0 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff80002a3ae0 msleep_spin_sbt() at msleep_spin_sbt+0x17f/frame 0xffffff80002a3b60 random_kthread() at random_kthread+0x190/frame 0xffffff80002a3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a3cb0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffffe00154a1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002999e0 mi_switch() at mi_switch+0x238/frame 0xffffff8000299a30 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000299a70 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000299aa0 _sleep() at _sleep+0x3fb/frame 0xffffff8000299b30 g_io_schedule_down() at g_io_schedule_down+0x296/frame 0xffffff8000299b90 g_down_procbody() at g_down_procbody+0x7c/frame 0xffffff8000299ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000299bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000299bf0 --- trap 0, rip = 0, rsp = 0xffffff8000299cb0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffffe00154a1490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000294a20 mi_switch() at mi_switch+0x238/frame 0xffffff8000294a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000294ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000294ae0 _sleep() at _sleep+0x3fb/frame 0xffffff8000294b70 g_io_schedule_up() at g_io_schedule_up+0xec/frame 0xffffff8000294b90 g_up_procbody() at g_up_procbody+0x7c/frame 0xffffff8000294ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000294bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000294bf0 --- trap 0, rip = 0, rsp = 0xffffff8000294cb0, rbp = 0 --- Tracing command geom pid 13 tid 100013 td 0xfffffe00154a1920 sched_switch() at sched_switch+0x1b4/frame 0xffffff800028fa10 mi_switch() at mi_switch+0x238/frame 0xffffff800028fa60 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff800028faa0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800028fad0 _sleep() at _sleep+0x3fb/frame 0xffffff800028fb60 g_run_events() at g_run_events+0x45f/frame 0xffffff800028fba0 fork_exit() at fork_exit+0x139/frame 0xffffff800028fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800028fbf0 --- trap 0, rip = 0, rsp = 0xffffff800028fcb0, rbp = 0 --- Tracing command intr pid 12 tid 100063 td 0xfffffe001591e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100062 td 0xfffffe001591e490 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232683b00 mi_switch() at mi_switch+0x238/frame 0xffffff8232683b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8232683ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232683bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232683bf0 --- trap 0, rip = 0, rsp = 0xffffff8232683cb0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe00158f0490 sched_switch() at sched_switch+0x1b4/frame 0xffffff823266fb00 mi_switch() at mi_switch+0x238/frame 0xffffff823266fb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823266fba0 fork_exit() at fork_exit+0x139/frame 0xffffff823266fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823266fbf0 --- trap 0, rip = 0, rsp = 0xffffff823266fcb0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe00158f0920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232660b00 mi_switch() at mi_switch+0x238/frame 0xffffff8232660b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8232660ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232660bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232660bf0 --- trap 0, rip = 0, rsp = 0xffffff8232660cb0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe00158f9490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffffe00158ed920 sched_switch() at sched_switch+0x1b4/frame 0xffffff82323d8b00 mi_switch() at mi_switch+0x238/frame 0xffffff82323d8b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff82323d8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff82323d8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff82323d8bf0 --- trap 0, rip = 0, rsp = 0xffffff82323d8cb0, rbp = 0 --- Tracing command intr pid 12 tid 100036 td 0xfffffe00158e4000 sched_switch() at sched_switch+0x1b4/frame 0xffffff823237bb00 mi_switch() at mi_switch+0x238/frame 0xffffff823237bb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823237bba0 fork_exit() at fork_exit+0x139/frame 0xffffff823237bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823237bbf0 --- trap 0, rip = 0, rsp = 0xffffff823237bcb0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffffe00158e5920 sched_switch() at sched_switch+0x1b4/frame 0xffffff823231eb00 mi_switch() at mi_switch+0x238/frame 0xffffff823231eb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff823231eba0 fork_exit() at fork_exit+0x139/frame 0xffffff823231ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff823231ebf0 --- trap 0, rip = 0, rsp = 0xffffff823231ecb0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffffe00154b1490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003ecb00 mi_switch() at mi_switch+0x238/frame 0xffffff80003ecb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80003ecba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003ecbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003ecbf0 --- trap 0, rip = 0, rsp = 0xffffff80003eccb0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffffe00154b1920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80003e7b00 mi_switch() at mi_switch+0x238/frame 0xffffff80003e7b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80003e7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80003e7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80003e7bf0 --- trap 0, rip = 0, rsp = 0xffffff80003e7cb0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffffe0015654000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002dbb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002dbb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002dbba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002dbbf0 --- trap 0, rip = 0, rsp = 0xffffff80002dbcb0, rbp = 0 --- Tracing command intr pid 12 tid 100023 td 0xfffffe0015655920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c2b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002c2b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002c2ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c2bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c2cb0, rbp = 0 --- Tracing command intr pid 12 tid 100022 td 0xfffffe00154ae000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002bdb00 mi_switch() at mi_switch+0x238/frame 0xffffff80002bdb50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002bdba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002bdbf0 --- trap 0, rip = 0, rsp = 0xffffff80002bdcb0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe00154af000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xfffffe00154af490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002a9b00 mi_switch() at mi_switch+0x238/frame 0xffffff80002a9b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff80002a9ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002a9bf0 --- trap 0, rip = 0, rsp = 0xffffff80002a9cb0, rbp = 0 --- Tracing command intr pid 12 tid 100012 td 0xfffffe00154a2000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffffe00154a2490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100010 td 0xfffffe00154a2920 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100009 td 0xfffffe0015487490 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xfffffe0015487920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000276b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000276b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8000276ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000276bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000276bf0 --- trap 0, rip = 0, rsp = 0xffffff8000276cb0, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffffe0015492000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000271b00 mi_switch() at mi_switch+0x238/frame 0xffffff8000271b50 ithread_loop() at ithread_loop+0x23e/frame 0xffffff8000271ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000271bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000271bf0 --- trap 0, rip = 0, rsp = 0xffffff8000271cb0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe0015492490 sched_switch() at sched_switch+0x1b4/frame 0xffffff800026cac0 mi_switch() at mi_switch+0x238/frame 0xffffff800026cb10 sched_idletd() at sched_idletd+0x323/frame 0xffffff800026cba0 fork_exit() at fork_exit+0x139/frame 0xffffff800026cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800026cbf0 --- trap 0, rip = 0, rsp = 0xffffff800026ccb0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe0015492920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000267ac0 mi_switch() at mi_switch+0x238/frame 0xffffff8000267b10 sched_idletd() at sched_idletd+0x323/frame 0xffffff8000267ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000267bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000267bf0 --- trap 0, rip = 0, rsp = 0xffffff8000267cb0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe0015486000 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffff800023ed00 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffff800023ed20 trap() at trap+0x325/frame 0xffffff800023ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffff800023ef20 --- trap 0x13, rip = 0xffffffff80c9ea06, rsp = 0xffffff800023efe0, rbp = 0xffffff8000262a90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff8000262a90 acpi_cpu_idle() at acpi_cpu_idle+0x2ba/frame 0xffffff8000262ad0 cpu_idle_acpi() at cpu_idle_acpi+0x57/frame 0xffffff8000262af0 cpu_idle() at cpu_idle+0x6b/frame 0xffffff8000262b10 sched_idletd() at sched_idletd+0x15e/frame 0xffffff8000262ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000262bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000262bf0 --- trap 0, rip = 0, rsp = 0xffffff8000262cb0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe0015486490 cpustop_handler() at cpustop_handler+0x2c/frame 0xffffffff815dc0e0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff815dc100 trap() at trap+0x325/frame 0xffffffff815dc300 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff815dc300 --- trap 0x13, rip = 0xffffffff80c9ea06, rsp = 0xffffffff815dc3c0, rbp = 0xffffff800025da90 --- acpi_cpu_c1() at acpi_cpu_c1+0x6/frame 0xffffff800025da90 acpi_cpu_idle() at acpi_cpu_idle+0x2ba/frame 0xffffff800025dad0 cpu_idle_acpi() at cpu_idle_acpi+0x57/frame 0xffffff800025daf0 cpu_idle() at cpu_idle+0x6b/frame 0xffffff800025db10 sched_idletd() at sched_idletd+0x15e/frame 0xffffff800025dba0 fork_exit() at fork_exit+0x139/frame 0xffffff800025dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800025dbf0 --- trap 0, rip = 0, rsp = 0xffffff800025dcb0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe0015486920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000258670 mi_switch() at mi_switch+0x238/frame 0xffffff80002586c0 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000258700 sleepq_catch_signals() at sleepq_catch_signals+0x157/frame 0xffffff8000258760 sleepq_wait_sig() at sleepq_wait_sig+0x16/frame 0xffffff8000258780 _sleep() at _sleep+0x385/frame 0xffffff8000258810 kern_wait6() at kern_wait6+0x5fb/frame 0xffffff80002588b0 kern_wait() at kern_wait+0x9c/frame 0xffffff8000258a10 sys_wait4() at sys_wait4+0x35/frame 0xffffff8000258ad0 amd64_syscall() at amd64_syscall+0x2d3/frame 0xffffff8000258bf0 Xfast_syscall() at Xfast_syscall+0xf7/frame 0xffffff8000258bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41242a, rsp = 0x7fffffffd6c8, rbp = 0x10273 --- Tracing command audit pid 10 tid 100001 td 0xfffffe0015487000 sched_switch() at sched_switch+0x1b4/frame 0xffffff8000253a00 mi_switch() at mi_switch+0x238/frame 0xffffff8000253a50 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8000253a90 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8000253ac0 _cv_wait() at _cv_wait+0x17d/frame 0xffffff8000253b20 audit_worker() at audit_worker+0x77/frame 0xffffff8000253ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8000253bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8000253bf0 --- trap 0, rip = 0, rsp = 0xffffff8000253cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffffe001591d490 sched_switch() at sched_switch+0x1b4/frame 0xffffff82326969c0 mi_switch() at mi_switch+0x238/frame 0xffffff8232696a10 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232696a50 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffff8232696a80 _sleep() at _sleep+0x28d/frame 0xffffff8232696b10 pause_sbt() at pause_sbt+0xc3/frame 0xffffff8232696b60 deadlkres() at deadlkres+0x2e5/frame 0xffffff8232696ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232696bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232696bf0 --- trap 0, rip = 0, rsp = 0xffffff8232696cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffffe001591d920 sched_switch() at sched_switch+0x1b4/frame 0xffffff8232691a30 mi_switch() at mi_switch+0x238/frame 0xffffff8232691a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff8232691ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff8232691af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff8232691b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff8232691ba0 fork_exit() at fork_exit+0x139/frame 0xffffff8232691bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff8232691bf0 --- trap 0, rip = 0, rsp = 0xffffff8232691cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe0015654490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d6a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002d6a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002d6ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d6ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002d6b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002d6ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d6bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d6cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe0015654920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002d1a30 mi_switch() at mi_switch+0x238/frame 0xffffff80002d1a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002d1ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002d1af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002d1b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002d1ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002d1bf0 --- trap 0, rip = 0, rsp = 0xffffff80002d1cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe0015655000 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002cca30 mi_switch() at mi_switch+0x238/frame 0xffffff80002cca80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002ccac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002ccaf0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002ccb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002ccba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002ccbf0 --- trap 0, rip = 0, rsp = 0xffffff80002cccb0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe0015655490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002c7a30 mi_switch() at mi_switch+0x238/frame 0xffffff80002c7a80 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002c7ac0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002c7af0 msleep_spin_sbt() at msleep_spin_sbt+0x22d/frame 0xffffff80002c7b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x9c/frame 0xffffff80002c7ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002c7bf0 --- trap 0, rip = 0, rsp = 0xffffff80002c7cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe00154ae490 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b8a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002b8a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002b8ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002b8ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002b8b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002b8ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b8bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b8cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe00154ae920 sched_switch() at sched_switch+0x1b4/frame 0xffffff80002b3a20 mi_switch() at mi_switch+0x238/frame 0xffffff80002b3a70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff80002b3ab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff80002b3ae0 _sleep() at _sleep+0x3fb/frame 0xffffff80002b3b70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff80002b3ba0 fork_exit() at fork_exit+0x139/frame 0xffffff80002b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff80002b3bf0 --- trap 0, rip = 0, rsp = 0xffffff80002b3cb0, rbp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xfffffe00154b1000 sched_switch() at sched_switch+0x1b4/frame 0xffffff800029ea20 mi_switch() at mi_switch+0x238/frame 0xffffff800029ea70 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffff800029eab0 sleepq_wait() at sleepq_wait+0x4d/frame 0xffffff800029eae0 _sleep() at _sleep+0x3fb/frame 0xffffff800029eb70 taskqueue_thread_loop() at taskqueue_thread_loop+0x166/frame 0xffffff800029eba0 fork_exit() at fork_exit+0x139/frame 0xffffff800029ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xffffff800029ebf0 --- trap 0, rip = 0, rsp = 0xffffff800029ecb0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff813b5480 sched_switch() at sched_switch+0x1b4/frame 0xffffffff81963af0 mi_switch() at mi_switch+0x238/frame 0xffffffff81963b40 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff81963b80 sleepq_timedwait() at sleepq_timedwait+0x4d/frame 0xffffffff81963bb0 _sleep() at _sleep+0x28d/frame 0xffffffff81963c40 scheduler() at scheduler+0x2c4/frame 0xffffffff81963c90 mi_startup() at mi_startup+0x77/frame 0xffffffff81963cb0 btext() at btext+0x2c db:0:allt> call doadump Dumping 738 out of 8039 MB:..3%..11%..22%..31%..42%..53%..61%..72%..81%..92% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0x15485000) at ../../../kern/kern_shutdown.c:264 #1 0xffffffff8033802c in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:578 #2 0xffffffff803382dd in db_command (last_cmdp=0xffffffff8137bda0, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xffffffff8033ce73 in db_script_exec (scriptname=0xffffffff8137c640 "doadump", warnifnotfound=0x1) at ../../../ddb/db_script.c:302 #4 0xffffffff80338361 in db_command (last_cmdp=0xffffffff8137bda0, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:449 #5 0xffffffff803385b0 in db_command_loop () at ../../../ddb/db_command.c:502 #6 0xffffffff8033a729 in db_trap (type=, code=) at ../../../ddb/db_main.c:231 #7 0xffffffff8094a618 in kdb_trap (type=0x3, code=0x0, tf=0xffffff82330002f0) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80cbaadd in trap (frame=0xffffff82330002f0) at ../../../amd64/amd64/trap.c:579 #9 0xffffffff80ca3753 in calltrap () at ../../../amd64/amd64/exception.S:228 #10 0xffffffff8094a09b in kdb_enter (why=0xffffffff80d6dc1c "break", msg=0x80
) at cpufunc.h:63 #11 0xffffffff8094a0d7 in kdb_break () at ../../../kern/subr_kdb.c:273 #12 0xffffffff80779a7a in uart_intr (arg=) at ../../../dev/uart/uart_core.c:125 #13 0xffffffff808e16e7 in intr_event_handle (ie=0xfffffe0015475b00, frame=0xffffff82330004d0) at ../../../kern/kern_intr.c:1436 #14 0xffffffff80d4992f in intr_execute_handlers (isrc=0xfffffe001549d168, frame=0xffffff82330004d0) at ../../../x86/x86/intr_machdep.c:269 #15 0xffffffff80d4d6c2 in lapic_handle_intr (vector=, frame=0xffffff82330004d0) at ../../../x86/x86/local_apic.c:774 #16 0xffffffff80ca3de0 in Xapic_isr1 () at apic_vector.S:86 #17 0xffffffff809632b6 in witness_checkorder (lock=0xfffffe0086868100, flags=0x9, file=0xffffffff80fa10ce "../../../amd64/amd64/trap.c", line=0x2ef, interlock=0x0) at ../../../kern/subr_witness.c:1053 #18 0xffffffff808fb2a4 in __mtx_lock_flags (c=, opts=0x0, file=0xffffffff80fa10ce "../../../amd64/amd64/trap.c", line=0x2ef) at ../../../kern/kern_mutex.c:221 #19 0xffffffff80cba555 in trap_pfault (frame=0xffffff8233000900, usermode=0x0) at ../../../amd64/amd64/trap.c:751 #20 0xffffffff80cbab8a in trap (frame=0xffffff8233000900) at ../../../amd64/amd64/trap.c:463 #21 0xffffffff80ca3753 in calltrap () at ../../../amd64/amd64/exception.S:228 #22 0xffffffff80cb7f79 in casuword32 () at ../../../amd64/amd64/support.S:326 #23 0xffffffff80929fb3 in do_rw_wrlock (td=, rwlock=0x800a3ee80, timeout=0x0) at ../../../kern/kern_umtx.c:2772 #24 0xffffffff8092b078 in __umtx_op_rw_wrlock (td=0xfffffe018b90c000, uap=0xffffff8233000b70) at ../../../kern/kern_umtx.c:3312 #25 0xffffffff80cb98b3 in amd64_syscall (td=0xfffffe018b90c000, traced=0x0) at subr_syscall.c:134 #26 0xffffffff80ca3a37 in Xfast_syscall () at ../../../amd64/amd64/exception.S:387 #27 0x000000080083074c in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 24 #24 0xffffffff8092b078 in __umtx_op_rw_wrlock (td=0xfffffe018b90c000, uap=0xffffff8233000b70) at ../../../kern/kern_umtx.c:3312 3312 error = do_rw_wrlock(td, uap->obj, 0); (kgdb) p *uap $1 = {obj_l_ = 0xffffff8233000b70 "\200î£", obj = 0x800a3ee80, obj_r_ = 0xffffff8233000b78 "\r", op_l_ = 0xffffff8233000b78 "\r", op = 0xd, op_r_ = "\000\000\000", val_l_ = 0xffffff8233000b80 "", val = 0x0, val_r_ = 0xffffff8233000b88 "", uaddr1_l_ = 0xffffff8233000b88 "", uaddr1 = 0x0, uaddr1_r_ = 0xffffff8233000b90 "", uaddr2_l_ = 0xffffff8233000b90 "", uaddr2 = 0x0, uaddr2_r_ = 0xffffff8233000b98 ""} (kgdb) f 23 #23 0xffffffff80929fb3 in do_rw_wrlock (td=, rwlock=0x800a3ee80, timeout=0x0) at ../../../kern/kern_umtx.c:2772 2772 oldstate = casuword32(&rwlock->rw_state, state, state | URWLOCK_WRITE_OWNER); (kgdb) p *rwlock Cannot access memory at address 0x800a3ee80 (kgdb) l 2767 2768 blocked_readers = 0; 2769 for (;;) { 2770 state = fuword32(__DEVOLATILE(int32_t *, &rwlock->rw_state)); 2771 while (!(state & URWLOCK_WRITE_OWNER) && URWLOCK_READER_COUNT(state) == 0) { 2772 oldstate = casuword32(&rwlock->rw_state, state, state | URWLOCK_WRITE_OWNER); 2773 if (oldstate == state) { 2774 umtx_key_release(&uq->uq_key); 2775 return (0); 2776 } (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 251023) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -1054,9 +1054,9 @@ vm_object_sync(vm_object_t object, vm_ooffset_t of */ flags = OBJPR_NOTMAPPED; else if (old_msync) - flags = 0; + flags = OBJPR_NOTWIRED; else - flags = OBJPR_CLEANONLY; + flags = OBJPR_CLEANONLY | OBJPR_NOTWIRED; vm_object_page_remove(object, OFF_TO_IDX(offset), OFF_TO_IDX(offset + size + PAGE_MASK), flags); } @@ -1911,7 +1911,8 @@ again: vm_page_lock(p); if ((wirings = p->wire_count) != 0 && (wirings = pmap_page_wired_mappings(p)) != p->wire_count) { - if ((options & OBJPR_NOTMAPPED) == 0) { + if ((options & (OBJPR_NOTWIRED | OBJPR_NOTMAPPED)) == + 0) { pmap_remove_all(p); /* Account for removal of wired mappings. */ if (wirings != 0) @@ -1921,8 +1922,7 @@ again: p->valid = 0; vm_page_undirty(p); } - vm_page_unlock(p); - continue; + goto next; } if (vm_page_sleep_if_busy(p, TRUE, "vmopar")) goto again; @@ -1931,12 +1931,12 @@ again: if ((options & OBJPR_CLEANONLY) != 0 && p->valid != 0) { if ((options & OBJPR_NOTMAPPED) == 0) pmap_remove_write(p); - if (p->dirty) { - vm_page_unlock(p); - continue; - } + if (p->dirty) + goto next; } if ((options & OBJPR_NOTMAPPED) == 0) { + if ((options & OBJPR_NOTWIRED) != 0 && wirings != 0) + goto next; pmap_remove_all(p); /* Account for removal of wired mappings. */ if (wirings != 0) { @@ -1948,6 +1948,7 @@ again: } } vm_page_free(p); +next: vm_page_unlock(p); } vm_object_pip_wakeup(object); Index: /usr/src/sys/vm/vm_object.h =================================================================== --- /usr/src/sys/vm/vm_object.h (revision 251023) +++ /usr/src/sys/vm/vm_object.h (working copy) @@ -205,6 +205,7 @@ struct vm_object { */ #define OBJPR_CLEANONLY 0x1 /* Don't remove dirty pages. */ #define OBJPR_NOTMAPPED 0x2 /* Don't unmap pages. */ +#define OBJPR_NOTWIRED 0x4 /* Don't remove wired pages. */ TAILQ_HEAD(object_q, vm_object); Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 251023) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -2619,8 +2619,6 @@ vm_page_set_invalid(vm_page_t m, int base, int siz vm_page_bits_t bits; VM_OBJECT_ASSERT_WLOCKED(m->object); - KASSERT((m->oflags & VPO_BUSY) == 0, - ("vm_page_set_invalid: page %p is busy", m)); bits = vm_page_bits(base, size); if (m->valid == VM_PAGE_BITS_ALL && bits != 0) pmap_remove_all(m); Index: /usr/src/sys/i386/i386/exception.s =================================================================== --- /usr/src/sys/i386/i386/exception.s (revision 251023) +++ /usr/src/sys/i386/i386/exception.s (working copy) @@ -422,6 +422,7 @@ doreti_popl_es_fault: pushl %fs .globl doreti_popl_fs_fault doreti_popl_fs_fault: + sti movl $0,TF_ERR(%esp) /* XXX should be the error code */ movl $T_PROTFLT,TF_TRAPNO(%esp) jmp alltraps_with_regs_pushed Index: /usr/src/sys/amd64/amd64/exception.S =================================================================== --- /usr/src/sys/amd64/amd64/exception.S (revision 251023) +++ /usr/src/sys/amd64/amd64/exception.S (working copy) @@ -818,6 +818,10 @@ doreti_iret_fault: .globl ds_load_fault ds_load_fault: movl $T_PROTFLT,TF_TRAPNO(%rsp) + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movq %rsp,%rdi call trap movw $KUDSEL,TF_DS(%rsp) @@ -827,6 +831,10 @@ ds_load_fault: .globl es_load_fault es_load_fault: movl $T_PROTFLT,TF_TRAPNO(%rsp) + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movq %rsp,%rdi call trap movw $KUDSEL,TF_ES(%rsp) @@ -835,6 +843,10 @@ es_load_fault: ALIGN_TEXT .globl fs_load_fault fs_load_fault: + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movl $T_PROTFLT,TF_TRAPNO(%rsp) movq %rsp,%rdi call trap @@ -846,6 +858,10 @@ fs_load_fault: gs_load_fault: popfq movl $T_PROTFLT,TF_TRAPNO(%rsp) + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movq %rsp,%rdi call trap movw $KUG32SEL,TF_GS(%rsp) @@ -855,6 +871,10 @@ gs_load_fault: .globl fsbase_load_fault fsbase_load_fault: movl $T_PROTFLT,TF_TRAPNO(%rsp) + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movq %rsp,%rdi call trap movq PCPU(CURTHREAD),%r8 @@ -866,6 +886,10 @@ fsbase_load_fault: .globl gsbase_load_fault gsbase_load_fault: movl $T_PROTFLT,TF_TRAPNO(%rsp) + testl $PSL_I,TF_RFLAGS(%rsp) + jz 1f + sti +1: movq %rsp,%rdi call trap movq PCPU(CURTHREAD),%r8 Index: /usr/src/sys/kern/vfs_bio.c =================================================================== --- /usr/src/sys/kern/vfs_bio.c (revision 251023) +++ /usr/src/sys/kern/vfs_bio.c (working copy) @@ -1576,7 +1576,8 @@ brelse(struct buf *bp) (PAGE_SIZE - poffset) : resid; KASSERT(presid >= 0, ("brelse: extra page")); - vm_page_set_invalid(m, poffset, presid); + if (pmap_page_wired_mappings(m) == 0) + vm_page_set_invalid(m, poffset, presid); if (had_bogus) printf("avoided corruption bug in bogus_page/brelse code\n"); } -- Test scenario: syscall4.sh (mprotect) $ ./syscall4.sh 74 umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy umount: unmount of /mnt failed: Device busy USER CMD PID FD MOUNT INUM MODE SZ|DV R/W NAME nobody syscall4 64236 wd /mnt 2 drwxrwxrwx 512 r /mnt nobody syscall4 64152 wd /mnt 2 drwxrwxrwx 512 r /mnt umount /mnt failed $