GENERIC HEAD from 2020-07-25 11:34:50 UTC, r363525, vmcore.865 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #0 r363525: Sat Jul 25 16:06:11 CEST 2020 pho@t2.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.0-97-g6f71678ecd2) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66705403904 (63615 MB) : Trying to mount root from ufs:/dev/da0p2 [rw]... WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff80a2e130(0xffffffff818e6758) 0.006701082 s uhub0: 4 ports with 4 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered Setting hostuuid: 2bde2bde-f4e2-e111-aab2-001e6756b69b. Setting hostid: 0x0035ff86. WARNING: reducing swap size to maximum of 65536MB per unit Starting file system checks: /dev/da0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p2: clean, 46863836 free (1206428 frags, 5707176 blocks, 1.2% fragmentation) /dev/da0p3: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/da0p3: clean, 23620516 free (6092 frags, 2951803 blocks, 0.0% fragmentation) Mounting local filesystems:. ugen0.2: at usbus0 uhub3 numa-domain 0 on uhub2 uhub3: on usbus0 ugen2.2: at usbus2 uhub4 numa-domain 0 on uhub1 uhub4: on usbus2 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc8 /usr/local/lib/gcc9 /usr/local/lib/mozjpeg /usr/local/lib/nss /usr/local/lib/perl5/5.30/mach/CORE /usr/local/lib/qt4 /usr/local/lib/qt5 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t2.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . lo0: link state changed to UP uhub3: 6 ports with 6 removable, self powered uhub4: 8 ports with 8 removable, self powered ugen2.3: at usbus2 uhub5 numa-domain 0 on uhub4 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd0 numa-domain 0 on uhub4 ukbd0: on usbus2 kbd2 at ukbd0 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=680003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21 igb0: flags=8863 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9b inet 192.168.1.109 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:b69b%igb0 prefixlen 64 scopeid 0x1 media: Ethernet autoselect (1000baseT ) status: active nd6 options=23 igb1: flags=8822 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9c media: Ethernet autoselect status: no carrier nd6 options=29 Starting devd. Autoloading module: ioat.ko ioat0: mem 0xd7fa0000-0xd7fa3fff irq 31 at device 4.0 numa-domain 0 on pci0 ioat0: Capabilities: 2f7 ioat1: mem 0xd7f90000-0xd7f93fff irq 39 at device 4.1 numa-domain 0 on pci0 ioat1: Capabilities: 2f7 ioat2: mem 0xd7f80000-0xd7f83fff irq 31 at device 4.2 numa-domain 0 on pci0 ioat2: Capabilities: f7 ioat3: mem 0xd7f70000-0xd7f73fff irq 39 at device 4.3 numa-domain 0 on pci0 ioat3: Capabilities: f7 ioat4: mem 0xd7f60000-0xd7f63fff irq 31 at device 4.4 numa-domain 0 on pci0 ioat4: Capabilities: f7 ioat5: mem 0xd7f50000-0xd7f53fff irq 39 at device 4.5 numa-domain 0 on pci0 ioat5: Capabilities: f7 ioat6: mem 0xd7f40000-0xd7f43fff irq 31 at device 4.6 numa-domain 0 on pci0 ioat6: Capabilities: f7 ioat7: mem 0xd7f30000-0xd7f33fff irq 39 at device 4.7 numa-domain 0 on pci0 ioat7: Capabilities: f7 ioat8: mem 0xfbf70000-0xfbf73fff irq 55 at device 4.0 numa-domain 1 on pci11 ioat8: Capabilities: 2f7 ioat9: mem 0xfbf60000-0xfbf63fff irq 63 at device 4.1 numa-domain 1 on pci11 ioat9: Capabilities: 2f7 ioat10: mem 0xfbf50000-0xfbf53fff irq 55 at device 4.2 numa-domain 1 on pci11 ioat10: Capabilities: f7 ioat11: mem 0xfbf40000-0xfbf43fff irq 63 at device 4.3 numa-domain 1 on pci11 ioat11: Capabilities: f7 ioat12: mem 0xfbf30000-0xfbf33fff irq 55 at device 4.4 numa-domain 1 on pci11 ioat12: Capabilities: f7 ioat13: mem 0xfbf20000-0xfbf23fff irq 63 at device 4.5 numa-domain 1 on pci11 ioat13: Capabilities: f7 ioat14: mem 0xfbf10000-0xfbf13fff irq 55 at device 4.6 numa-domain 1 on pci11 ioat14: Capabilities: f7 ioat15: mem 0xfbf00000-0xfbf03fff irq 63 at device 4.7 numa-domain 1 on pci11 ioat15: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e527bb ether 00:1e:67:56:b6:9c media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Configuring vt: keymap. Autoloading module: uhid.ko Autoloading module: ums.ko ums0 numa-domain 0 on uhub4 ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.254 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Updating CPU Microcode... CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 Structured Extended Features3=0x9c000400 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics Done. No core dumps found. Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Starting sendmail_submit. Starting sendmail_msp_queue. Performing sanity check on sshd configuration. Starting sshd. Configuring vt: keymap blanktime. Starting cron. Local package initialization:Jul 25 16:12:05 t2 su[2647]: pho to root on /dev/pts/0 backup. Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Sat Jul 25 16:12 FreeBSD/amd64 (t2.osted.lan) (ttyu1) login: 20200725 16:12:21 all (1/1): devfs3.sh lock order reversal: 1st 0xfffff8035ffd02f0 ufs (ufs) @ kern/vfs_mount.c:1008 2nd 0xfffff8035ffd0800 devfs (devfs) @ kern/vfs_mount.c:1019 stack backtrace: #0 0xffffffff80c3e3b1 at witness_debugger+0x71 #1 0xffffffff80ba1d32 at lockmgr_lock_flags+0x172 #2 0xffffffff810bf600 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc47e4 at _vn_lock+0x54 #4 0xffffffff80ca46df at vfs_domount+0xdcf #5 0xffffffff80ca2b71 at vfs_donmount+0x871 #6 0xffffffff80ca22c9 at sys_nmount+0x69 #7 0xffffffff8100e949 at amd64_syscall+0x159 #8 0xffffffff80fe4b8e at fast_syscall_common+0xf8 pts leak: 1/2 20200725 16:17:30 all (1/1): devfs3.sh lock order reversal: 1st 0xfffffe012a1d1cd0 filedesc structure (filedesc structure) @ kern/kern_descrip.c:3354 2nd 0xfffff8037759a2f0 devfs (devfs) @ kern/vfs_lookup.c:788 stack backtrace: #0 0xffffffff80c3e3b1 at witness_debugger+0x71 #1 0xffffffff80ba1c3c at lockmgr_lock_flags+0x7c #2 0xffffffff810bf600 at VOP_LOCK1_APV+0x40 #3 0xffffffff80cc47e4 at _vn_lock+0x54 #4 0xffffffff80ca010d at lookup+0xdd #5 0xffffffff80c9fb4c at namei+0x59c #6 0xffffffff80cbdaff at kern_statat+0x7f #7 0xffffffff80cbe2bf at sys_fstatat+0x2f #8 0xffffffff8100e949 at amd64_syscall+0x159 #9 0xffffffff80fe4b8e at fast_syscall_common+0xf8 userret: returning with the following locks held: shared sx filedesc structure (filedesc structure) r = 0 (0xfffffe012a1d1cd0) locked @ kern/kern_descrip.c:3354 panic: witness_warn cpuid = 22 time = 1595686826 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0138a11910 vpanic() at vpanic+0x182/frame 0xfffffe0138a11960 panic() at panic+0x43/frame 0xfffffe0138a119c0 witness_warn() at witness_warn+0x452/frame 0xfffffe0138a11a70 userret() at userret+0x235/frame 0xfffffe0138a11ad0 amd64_syscall() at amd64_syscall+0x213/frame 0xfffffe0138a11bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138a11bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x80043125a, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- KDB: enter: panic [ thread pid 35263 tid 100755 ] Stopped at kdb_enter+0x37: movq $0,0x10bace6(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 2376 out of 65426 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 35263 tid 100755 td 0xfffffe012a0ce100 kdb_enter() at kdb_enter+0x37/frame 0xfffffe0138a11910 vpanic() at vpanic+0x19e/frame 0xfffffe0138a11960 panic() at panic+0x43/frame 0xfffffe0138a119c0 witness_warn() at witness_warn+0x452/frame 0xfffffe0138a11a70 userret() at userret+0x235/frame 0xfffffe0138a11ad0 amd64_syscall() at amd64_syscall+0x213/frame 0xfffffe0138a11bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe0138a11bf0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x80043125a, rsp = 0x7fffffffe168, rbp = 0x7fffffffe220 --- db:1:pho1> show allpcpu Current CPU: 22 cpuid = 0 dynamic pcpu = 0x795ec0 curthread = 0xfffffe006a5c0300: pid 11 tid 100003 critnest 1 "idle: cpu0" curpcb = 0xfffffe006a5c0810 fpcurthread = none idlethread = 0xfffffe006a5c0300: tid 100003 "idle: cpu0" self = 0xffffffff82210000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82210384 rsp0 = 0xfffffe0069fe7cc0 kcr3 = 0x8000000002125003 ucr3 = 0xffffffffffffffff scr3 = 0x9d5458fb5 gs32p = 0xffffffff82210404 ldt = 0xffffffff82210444 tss = 0xffffffff82210434 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00eeff6ec0 curthread = 0xfffffe006a5bfc00: pid 11 tid 100004 critnest 1 "idle: cpu1" curpcb = 0xfffffe006a5c0110 fpcurthread = none idlethread = 0xfffffe006a5bfc00: tid 100004 "idle: cpu1" self = 0xffffffff82211000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82211384 rsp0 = 0xfffffe0069feccc0 kcr3 = 0x8000000002125005 ucr3 = 0xffffffffffffffff scr3 = 0x9d5e2dbb2 gs32p = 0xffffffff82211404 ldt = 0xffffffff82211444 tss = 0xffffffff82211434 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00eeffdec0 curthread = 0xfffffe006a5bf500: pid 11 tid 100005 critnest 1 "idle: cpu2" curpcb = 0xfffffe006a5bfa10 fpcurthread = none idlethread = 0xfffffe006a5bf500: tid 100005 "idle: cpu2" self = 0xffffffff82212000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82212384 rsp0 = 0xfffffe0069ff1cc0 kcr3 = 0x800000000212500e ucr3 = 0xffffffffffffffff scr3 = 0x9d55a2fe0 gs32p = 0xffffffff82212404 ldt = 0xffffffff82212444 tss = 0xffffffff82212434 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00ef008ec0 curthread = 0xfffffe006a5bee00: pid 11 tid 100006 critnest 1 "idle: cpu3" curpcb = 0xfffffe006a5bf310 fpcurthread = none idlethread = 0xfffffe006a5bee00: tid 100006 "idle: cpu3" self = 0xffffffff82213000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82213384 rsp0 = 0xfffffe0069ff6cc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x9d5e3080c gs32p = 0xffffffff82213404 ldt = 0xffffffff82213444 tss = 0xffffffff82213434 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00ef00fec0 curthread = 0xfffffe006a5be700: pid 11 tid 100007 critnest 1 "idle: cpu4" curpcb = 0xfffffe006a5bec10 fpcurthread = none idlethread = 0xfffffe006a5be700: tid 100007 "idle: cpu4" self = 0xffffffff82214000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82214384 rsp0 = 0xfffffe0069ffbcc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x37183ce4f gs32p = 0xffffffff82214404 ldt = 0xffffffff82214444 tss = 0xffffffff82214434 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00ef01aec0 curthread = 0xfffffe006a5be000: pid 11 tid 100008 critnest 1 "idle: cpu5" curpcb = 0xfffffe006a5be510 fpcurthread = none idlethread = 0xfffffe006a5be000: tid 100008 "idle: cpu5" self = 0xffffffff82215000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82215384 rsp0 = 0xfffffe00e0530cc0 kcr3 = 0x8000000002125003 ucr3 = 0xffffffffffffffff scr3 = 0x9d55a2a50 gs32p = 0xffffffff82215404 ldt = 0xffffffff82215444 tss = 0xffffffff82215434 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00ef021ec0 curthread = 0xfffffe006a5c8a00: pid 11 tid 100009 critnest 1 "idle: cpu6" curpcb = 0xfffffe006a5c8f10 fpcurthread = none idlethread = 0xfffffe006a5c8a00: tid 100009 "idle: cpu6" self = 0xffffffff82216000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82216384 rsp0 = 0xfffffe00e0535cc0 kcr3 = 0x8000000002125004 ucr3 = 0xffffffffffffffff scr3 = 0x95ed52cab gs32p = 0xffffffff82216404 ldt = 0xffffffff82216444 tss = 0xffffffff82216434 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00ef02cec0 curthread = 0xfffffe006a5c8300: pid 11 tid 100010 critnest 1 "idle: cpu7" curpcb = 0xfffffe006a5c8810 fpcurthread = none idlethread = 0xfffffe006a5c8300: tid 100010 "idle: cpu7" self = 0xffffffff82217000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82217384 rsp0 = 0xfffffe00e053acc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x6b449d7f gs32p = 0xffffffff82217404 ldt = 0xffffffff82217444 tss = 0xffffffff82217434 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00ef033ec0 curthread = 0xfffffe006a5c7c00: pid 11 tid 100011 critnest 1 "idle: cpu8" curpcb = 0xfffffe006a5c8110 fpcurthread = none idlethread = 0xfffffe006a5c7c00: tid 100011 "idle: cpu8" self = 0xffffffff82218000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82218384 rsp0 = 0xfffffe00e053fcc0 kcr3 = 0x8000000002125004 ucr3 = 0xffffffffffffffff scr3 = 0x3d3b78983 gs32p = 0xffffffff82218404 ldt = 0xffffffff82218444 tss = 0xffffffff82218434 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00ef03eec0 curthread = 0xfffffe006a5c7500: pid 11 tid 100012 critnest 1 "idle: cpu9" curpcb = 0xfffffe006a5c7a10 fpcurthread = none idlethread = 0xfffffe006a5c7500: tid 100012 "idle: cpu9" self = 0xffffffff82219000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82219384 rsp0 = 0xfffffe00e0544cc0 kcr3 = 0x8000000002125004 ucr3 = 0xffffffffffffffff scr3 = 0x3d38b980b gs32p = 0xffffffff82219404 ldt = 0xffffffff82219444 tss = 0xffffffff82219434 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00ef045ec0 curthread = 0xfffffe006a5c6e00: pid 11 tid 100013 critnest 1 "idle: cpu10" curpcb = 0xfffffe006a5c7310 fpcurthread = none idlethread = 0xfffffe006a5c6e00: tid 100013 "idle: cpu10" self = 0xffffffff8221a000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221a384 rsp0 = 0xfffffe00e0549cc0 kcr3 = 0x8000000002125005 ucr3 = 0xffffffffffffffff scr3 = 0x6b449a69 gs32p = 0xffffffff8221a404 ldt = 0xffffffff8221a444 tss = 0xffffffff8221a434 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00ef050ec0 curthread = 0xfffffe006a5c6700: pid 11 tid 100014 critnest 1 "idle: cpu11" curpcb = 0xfffffe006a5c6c10 fpcurthread = none idlethread = 0xfffffe006a5c6700: tid 100014 "idle: cpu11" self = 0xffffffff8221b000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221b384 rsp0 = 0xfffffe00e054ecc0 kcr3 = 0x8000000002125003 ucr3 = 0xffffffffffffffff scr3 = 0x3d36aaf8e gs32p = 0xffffffff8221b404 ldt = 0xffffffff8221b444 tss = 0xffffffff8221b434 curvnet = 0 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe00e86a4ec0 curthread = 0xfffffe006a5c6000: pid 11 tid 100015 critnest 1 "idle: cpu12" curpcb = 0xfffffe006a5c6510 fpcurthread = none idlethread = 0xfffffe006a5c6000: tid 100015 "idle: cpu12" self = 0xffffffff8221c000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221c384 rsp0 = 0xfffffe00e0553cc0 kcr3 = 0x8000000002125009 ucr3 = 0xffffffffffffffff scr3 = 0x9d5e9bd88 gs32p = 0xffffffff8221c404 ldt = 0xffffffff8221c444 tss = 0xffffffff8221c434 curvnet = 0 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe00e86abec0 curthread = 0xfffffe006a5c1800: pid 11 tid 100016 critnest 1 "idle: cpu13" curpcb = 0xfffffe006a5c1d10 fpcurthread = none idlethread = 0xfffffe006a5c1800: tid 100016 "idle: cpu13" self = 0xffffffff8221d000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221d384 rsp0 = 0xfffffe00e0558cc0 kcr3 = 0x8000000002125003 ucr3 = 0xffffffffffffffff scr3 = 0x9d599b875 gs32p = 0xffffffff8221d404 ldt = 0xffffffff8221d444 tss = 0xffffffff8221d434 curvnet = 0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe00e86b6ec0 curthread = 0xfffffe006a5cc300: pid 11 tid 100017 critnest 1 "idle: cpu14" curpcb = 0xfffffe006a5cc810 fpcurthread = none idlethread = 0xfffffe006a5cc300: tid 100017 "idle: cpu14" self = 0xffffffff8221e000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221e384 rsp0 = 0xfffffe00e055dcc0 kcr3 = 0x800000000212500e ucr3 = 0xffffffffffffffff scr3 = 0x8acb47e8c gs32p = 0xffffffff8221e404 ldt = 0xffffffff8221e444 tss = 0xffffffff8221e434 curvnet = 0 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe00e86bdec0 curthread = 0xfffffe006a5cbc00: pid 11 tid 100018 critnest 1 "idle: cpu15" curpcb = 0xfffffe006a5cc110 fpcurthread = none idlethread = 0xfffffe006a5cbc00: tid 100018 "idle: cpu15" self = 0xffffffff8221f000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff8221f384 rsp0 = 0xfffffe00e0562cc0 kcr3 = 0x800000000212500f ucr3 = 0xffffffffffffffff scr3 = 0x8acbe29f7 gs32p = 0xffffffff8221f404 ldt = 0xffffffff8221f444 tss = 0xffffffff8221f434 curvnet = 0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe00e86c8ec0 curthread = 0xfffffe006a5cb500: pid 11 tid 100019 critnest 1 "idle: cpu16" curpcb = 0xfffffe006a5cba10 fpcurthread = none idlethread = 0xfffffe006a5cb500: tid 100019 "idle: cpu16" self = 0xffffffff82220000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82220384 rsp0 = 0xfffffe00e0567cc0 kcr3 = 0x800000000212500d ucr3 = 0xffffffffffffffff scr3 = 0x8acb47f32 gs32p = 0xffffffff82220404 ldt = 0xffffffff82220444 tss = 0xffffffff82220434 curvnet = 0 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe00e86cfec0 curthread = 0xfffffe006a5cae00: pid 11 tid 100020 critnest 1 "idle: cpu17" curpcb = 0xfffffe006a5cb310 fpcurthread = none idlethread = 0xfffffe006a5cae00: tid 100020 "idle: cpu17" self = 0xffffffff82221000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82221384 rsp0 = 0xfffffe00e056ccc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x6b586d7d gs32p = 0xffffffff82221404 ldt = 0xffffffff82221444 tss = 0xffffffff82221434 curvnet = 0 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe00e86daec0 curthread = 0xfffffe006a5ca700: pid 11 tid 100021 critnest 1 "idle: cpu18" curpcb = 0xfffffe006a5cac10 fpcurthread = none idlethread = 0xfffffe006a5ca700: tid 100021 "idle: cpu18" self = 0xffffffff82222000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82222384 rsp0 = 0xfffffe00e0571cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x6b586941 gs32p = 0xffffffff82222404 ldt = 0xffffffff82222444 tss = 0xffffffff82222434 curvnet = 0 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe00e86e1ec0 curthread = 0xfffffe006a5ca000: pid 11 tid 100022 critnest 1 "idle: cpu19" curpcb = 0xfffffe006a5ca510 fpcurthread = none idlethread = 0xfffffe006a5ca000: tid 100022 "idle: cpu19" self = 0xffffffff82223000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82223384 rsp0 = 0xfffffe00e0576cc0 kcr3 = 0x8000000002125005 ucr3 = 0xffffffffffffffff scr3 = 0x9d5f95e74 gs32p = 0xffffffff82223404 ldt = 0xffffffff82223444 tss = 0xffffffff82223434 curvnet = 0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe00e86ecec0 curthread = 0xfffffe006a5c9800: pid 11 tid 100023 critnest 1 "idle: cpu20" curpcb = 0xfffffe006a5c9d10 fpcurthread = none idlethread = 0xfffffe006a5c9800: tid 100023 "idle: cpu20" self = 0xffffffff82224000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82224384 rsp0 = 0xfffffe00e057bcc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x3d3ffffb4 gs32p = 0xffffffff82224404 ldt = 0xffffffff82224444 tss = 0xffffffff82224434 curvnet = 0 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe00e86f3ec0 curthread = 0xfffffe006a5c9100: pid 11 tid 100024 critnest 1 "idle: cpu21" curpcb = 0xfffffe006a5c9610 fpcurthread = none idlethread = 0xfffffe006a5c9100: tid 100024 "idle: cpu21" self = 0xffffffff82225000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82225384 rsp0 = 0xfffffe00e0580cc0 kcr3 = 0x8000000002125002 ucr3 = 0xffffffffffffffff scr3 = 0x8acd2c86a gs32p = 0xffffffff82225404 ldt = 0xffffffff82225444 tss = 0xffffffff82225434 curvnet = 0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe00e86feec0 curthread = 0xfffffe012a0ce100: pid 35263 tid 100755 critnest 1 "find" curpcb = 0xfffffe012a0ce610 fpcurthread = 0xfffffe012a0ce100: pid 35263 "find" idlethread = 0xfffffe006a5cfc00: tid 100025 "idle: cpu22" self = 0xffffffff82226000 curpmap = 0xfffffe01299c2b08 tssp = 0xffffffff82226384 rsp0 = 0xfffffe0138a11cc0 kcr3 = 0x80000003d322c254 ucr3 = 0x80000003d33bea54 scr3 = 0x3d3488a4f gs32p = 0xffffffff82226404 ldt = 0xffffffff82226444 tss = 0xffffffff82226434 curvnet = 0 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe00e8705ec0 curthread = 0xfffffe006a5cf500: pid 11 tid 100026 critnest 1 "idle: cpu23" curpcb = 0xfffffe006a5cfa10 fpcurthread = none idlethread = 0xfffffe006a5cf500: tid 100026 "idle: cpu23" self = 0xffffffff82227000 curpmap = 0xffffffff81c8bc60 tssp = 0xffffffff82227384 rsp0 = 0xfffffe00e058acc0 kcr3 = 0x8000000002125006 ucr3 = 0xffffffffffffffff scr3 = 0x8acdced5a gs32p = 0xffffffff82227404 ldt = 0xffffffff82227444 tss = 0xffffffff82227434 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 35300 (mount) thread 0xfffffe012a0f3700 (100758) shared sx allproc (allproc) r = 0 (0xffffffff81802540) locked @ kern/kern_descrip.c:3526 Process 35263 (find) thread 0xfffffe012a0ce100 (100755) shared sx filedesc structure (filedesc structure) r = 0 (0xfffffe012a1d1cd0) locked @ kern/kern_descrip.c:3354 db:1:pho1> show lockedvnods Locked vnodes db:1:pho1> show allchains chain 1: thread 100276 (pid 35392, sh) is blocked on sx "allproc" SLOCK (count 1) chain 2: thread 101002 (pid 35391, find) is blocked on sx "allproc" SLOCK (count 1) chain 3: thread 100954 (pid 35390, grep) is blocked on sx "allproc" SLOCK (count 1) chain 4: thread 100851 (pid 35389, find) is blocked on sx "allproc" SLOCK (count 1) chain 5: thread 101113 (pid 35388, mount) is blocked on sx "allproc" SLOCK (count 1) chain 6: thread 100992 (pid 35387, grep) is blocked on sx "allproc" SLOCK (count 1) chain 7: thread 100855 (pid 35386, mount) is blocked on sx "allproc" SLOCK (count 1) chain 8: thread 100841 (pid 35385, grep) is blocked on sx "allproc" SLOCK (count 1) chain 9: thread 100853 (pid 35383, mount) is blocked on sx "allproc" SLOCK (count 1) chain 10: thread 100921 (pid 35382, find) is blocked on sx "allproc" SLOCK (count 1) chain 11: thread 100312 (pid 35380, grep) is blocked on sx "allproc" SLOCK (count 1) chain 12: thread 100399 (pid 35379, mount) is blocked on sx "allproc" SLOCK (count 1) chain 13: thread 100693 (pid 35378, egrep) is blocked on sx "allproc" SLOCK (count 1) chain 14: thread 100979 (pid 35376, umount) is blocked on sx "allproc" SLOCK (count 1) chain 15: thread 100241 (pid 35375, grep) is blocked on sx "allproc" SLOCK (count 1) chain 16: thread 100398 (pid 35374, find) is blocked on sx "allproc" SLOCK (count 1) chain 17: thread 100316 (pid 35373, find) is blocked on sx "allproc" SLOCK (count 1) chain 18: thread 100366 (pid 35372, find) is blocked on sx "allproc" SLOCK (count 1) chain 19: thread 101027 (pid 35371, mount) is blocked on sx "allproc" SLOCK (count 1) chain 20: thread 100912 (pid 35370, find) is blocked on sx "allproc" SLOCK (count 1) chain 21: thread 100762 (pid 35369, grep) is blocked on sx "allproc" SLOCK (count 1) chain 22: thread 101128 (pid 35368, sed) is blocked on sx "allproc" SLOCK (count 1) chain 23: thread 101199 (pid 35367, grep) is blocked on sx "allproc" SLOCK (count 1) chain 24: thread 101127 (pid 35366, find) is blocked on sx "allproc" SLOCK (count 1) chain 25: thread 101182 (pid 35364, grep) is blocked on sx "allproc" SLOCK (count 1) chain 26: thread 100923 (pid 35363, find) is blocked on sx "allproc" SLOCK (count 1) chain 27: thread 100287 (pid 35362, mount) is blocked on sx "allproc" SLOCK (count 1) chain 28: thread 101144 (pid 35361, mount) is blocked on sx "allproc" SLOCK (count 1) chain 29: thread 100309 (pid 35360, grep) is blocked on sx "allproc" SLOCK (count 1) chain 30: thread 100782 (pid 35359, mount) is blocked on sx "allproc" SLOCK (count 1) chain 31: thread 100348 (pid 35358, find) is blocked on sx "allproc" SLOCK (count 1) chain 32: thread 100850 (pid 35357, mount) is blocked on sx "allproc" SLOCK (count 1) chain 33: thread 100352 (pid 35356, find) is blocked on sx "allproc" SLOCK (count 1) chain 34: thread 101061 (pid 35354, find) is blocked on sx "allproc" SLOCK (count 1) chain 35: thread 100448 (pid 35353, find) is blocked on sx "allproc" SLOCK (count 1) chain 36: thread 100940 (pid 35352, grep) is blocked on sx "allproc" SLOCK (count 1) chain 37: thread 101021 (pid 35351, find) is blocked on sx "allproc" SLOCK (count 1) chain 38: thread 101044 (pid 35350, mount) is blocked on sx "allproc" SLOCK (count 1) chain 39: thread 100978 (pid 35349, find) is blocked on sx "allproc" SLOCK (count 1) chain 40: thread 101038 (pid 35348, grep) is blocked on sx "allproc" SLOCK (count 1) chain 41: thread 100955 (pid 35346, sh) is sleeping on 0xfffff803d323d520 "wait" chain 42: thread 100257 (pid 35345, mount) is blocked on sx "allproc" SLOCK (count 1) chain 43: thread 100280 (pid 35344, find) is blocked on sx "allproc" SLOCK (count 1) chain 44: thread 100780 (pid 35343, find) is blocked on sx "allproc" SLOCK (count 1) chain 45: thread 101147 (pid 35342, mount) is blocked on sx "allproc" SLOCK (count 1) chain 46: thread 101060 (pid 35341, find) is blocked on sx "allproc" SLOCK (count 1) chain 47: thread 100957 (pid 35340, find) is blocked on sx "allproc" SLOCK (count 1) chain 48: thread 101098 (pid 35339, find) is blocked on sx "allproc" SLOCK (count 1) chain 49: thread 100916 (pid 35338, find) is blocked on sx "allproc" SLOCK (count 1) chain 50: thread 100870 (pid 35334, find) is blocked on sx "allproc" SLOCK (count 1) chain 51: thread 100446 (pid 35337, find) is blocked on sx "allproc" SLOCK (count 1) chain 52: thread 101031 (pid 35336, umount) is blocked on sx "allproc" SLOCK (count 1) chain 53: thread 101088 (pid 35333, umount) is blocked on sx "allproc" SLOCK (count 1) chain 54: thread 100874 (pid 35332, mount) is blocked on sx "allproc" SLOCK (count 1) chain 55: thread 100909 (pid 35331, grep) is blocked on sx "allproc" SLOCK (count 1) chain 56: thread 100461 (pid 35330, mount) is blocked on sx "allproc" SLOCK (count 1) chain 57: thread 100784 (pid 35329, umount) is blocked on sx "allproc" SLOCK (count 1) chain 58: thread 100903 (pid 35328, mount) is blocked on sx "allproc" SLOCK (count 1) chain 59: thread 101028 (pid 35327, grep) is blocked on sx "allproc" SLOCK (count 1) chain 60: thread 101069 (pid 35320, grep) is blocked on sx "allproc" SLOCK (count 1) chain 61: thread 100722 (pid 35316, umount) is blocked on sx "allproc" SLOCK (count 1) chain 62: thread 101052 (pid 35315, date) is blocked on sx "allproc" SLOCK (count 1) chain 63: thread 100286 (pid 35310, umount) is blocked on sx "allproc" SLOCK (count 1) chain 64: thread 100355 (pid 35308, umount) is blocked on sx "allproc" SLOCK (count 1) chain 65: thread 100718 (pid 35306, grep) is blocked on sx "allproc" SLOCK (count 1) chain 66: thread 100858 (pid 35302, mount) is blocked on sx "allproc" SLOCK (count 1) chain 67: thread 100758 (pid 35300, mount) is blocked on sx "filedesc structure" SLOCK (count 1) chain 68: thread 100495 (pid 35299, find) is blocked on sx "allproc" SLOCK (count 1) chain 69: thread 101045 (pid 35297, find) is blocked on sx "allproc" SLOCK (count 1) chain 70: thread 100965 (pid 35292, find) is blocked on sx "allproc" SLOCK (count 1) chain 71: thread 100362 (pid 35265, find) is blocked on sx "allproc" SLOCK (count 1) chain 72: thread 100711 (pid 35261, find) is blocked on sx "allproc" SLOCK (count 1) chain 73: thread 100730 (pid 35245, grep) is blocked on sx "allproc" SLOCK (count 1) chain 74: thread 100901 (pid 35244, mount) is blocked on sx "allproc" SLOCK (count 1) chain 75: thread 100302 (pid 30277, sh) is sleeping on 0xfffff803785495f0 "piperd" chain 76: thread 100340 (pid 28851, sh) is sleeping on 0xfffff80008f70a40 "wait" chain 77: thread 100326 (pid 93085, sh) is sleeping on 0xfffff808466b1520 "wait" chain 78: thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL : : thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr EXCL thread 100915 (pid 93084, sh) is blocked on lockmgr E Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. Installed BIOS: SE5C600.86B.01.08.0003 Platform ID: W2600CR Copyright(c) 2009 - 2012 Intel Corporation.All rights reserved. Version 2.00.1201.Copyright(c) 2010 - 2012 American Megatrends,Inc. Installed BIOS: SE5C600.86B.01.08.0003 Platform ID: W2600CR Loading configured modules... GDB: no debug ports present (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:394 #2 0xffffffff8049c38a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049c14c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a1158 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049c14c in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a1158 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049c14c in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049bebd in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049f168 in db_trap (type=, code=) at ../../../ddb/db_main.c:270 #10 0xffffffff80c1bf24 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:699 #11 0xffffffff8100daf8 in trap (frame=0xfffffe0138a11840) at ../../../amd64/amd64/trap.c:576 #12 #13 kdb_enter (why=0xffffffff811d85b8 "panic", msg=) at ../../../kern/subr_kdb.c:486 #14 0xffffffff80bd0e1e in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:902 #15 0xffffffff80bd0bb3 in panic (fmt=0xffffffff81c8c848 "\234\260\031\201ÿÿÿÿ") at ../../../kern/kern_shutdown.c:839 #16 0xffffffff80c3f392 in witness_warn (flags=, lock=, fmt=0xffffffff811c8048 "userret: returning") at ../../../kern/subr_witness.c:1819 #17 0xffffffff80c32d35 in userret (td=0xfffffe012a0ce100, frame=0xfffffe0138a11c00) at ../../../kern/subr_trap.c:170 #18 0xffffffff8100ea03 in syscallret (td=0xfffffe012a0ce100) at ../../../amd64/amd64/../../kern/subr_syscall.c:210 #19 amd64_syscall (td=0xfffffe012a0ce100, traced=) at ../../../amd64/amd64/trap.c:1182 #20 #21 0x000000080043125a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffffffe168 (kgdb) f 17 #17 0xffffffff80c32d35 in userret (td=0xfffffe012a0ce100, frame=0xfffffe0138a11c00) at ../../../kern/subr_trap.c:170 170 WITNESS_WARN(WARN_PANIC, NULL, "userret: returning"); (kgdb) l 165 * In case there is a callchain tracing ongoing because of 166 * hwpmc(4), skip the scheduler pinning check. 167 * hwpmc(4) subsystem, infact, will collect callchain informations 168 * at ast() checkpoint, which is past userret(). 169 */ 170 WITNESS_WARN(WARN_PANIC, NULL, "userret: returning"); 171 KASSERT(td->td_critnest == 0, 172 ("userret: Returning in a critical section")); 173 KASSERT(td->td_locks == 0, 174 ("userret: Returning with %d locks held", td->td_locks)); (kgdb) p *td $1 = {td_lock = 0xfffffe006a088080, td_proc = 0xfffff80378788520, td_plist = {tqe_next = 0x0, tqe_prev = 0xfffff80378788530}, td_runq = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, td_slpq = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, td_lockq = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, td_hash = { le_next = 0x0, le_prev = 0xfffffe006a56ec98}, td_cpuset = 0xfffff800039ef000, td_domain = {dr_policy = 0xffffffff81c8c9b0 , dr_iter = 0x5}, td_sel = 0xfffff803d32de780, td_sleepqueue = 0xfffff80008ce7980, td_turnstile = 0xfffff8084612fd80, td_rlqe = 0xfffff80008d4e5c8, td_umtxq = 0xfffff80008083380, td_tid = 0x18993, td_sigqueue = {sq_signals = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_kill = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_ptrace = {__bits = {0x0, 0x0, 0x0, 0x0}}, sq_list = {tqh_first = 0x0, tqh_last = 0xfffffe012a0ce1d8}, sq_proc = 0xfffff80378788520, sq_flags = 0x1}, td_lend_user_pri = 0xff, td_flags = 0x4, td_inhibitors = 0x0, td_pflags = 0x100, td_pflags2 = 0x0, td_dupfd = 0x0, td_sqqueue = 0x1, td_wchan = 0x0, td_wmesg = 0x0, td_owepreempt = 0x0, td_tsqueue = 0xff, td_locks = 0x1, td_rw_rlocks = 0x0, td_sx_slocks = 0x1, td_lk_slocks = 0x0, td_stopsched = 0x1, td_blocked = 0x0, td_lockname = 0x0, td_contested = {lh_first = 0x0}, td_sleeplocks = 0xffffffff81d239e0 , td_intr_nesting_level = 0x0, td_pinned = 0x1, td_realucred = 0xfffff80841da4300, td_ucred = 0xfffff80841da4300, td_limit = 0xfffff8084692b400, td_slptick = 0x0, td_blktick = 0x0, td_swvoltick = 0x7fff4787, td_swinvoltick = 0x7fff47a4, td_cow = 0x26, td_ru = {ru_utime = { tv_sec = 0x0, tv_usec = 0x0}, ru_stime = {tv_sec = 0x0, tv_usec = 0x0}, ru_maxrss = 0x994, ru_ixrss = 0x16c, ru_idrss = 0x68, ru_isrss = 0x680, ru_minflt = 0x91, ru_majflt = 0x0, ru_nswap = 0x0, ru_inblock = 0x1, ru_oublock = 0x0, ru_msgsnd = 0x0, ru_msgrcv = 0x0, ru_nsignals = 0x0, ru_nvcsw = 0x10, ru_nivcsw = 0x2}, td_rux = {rux_runtime = 0x0, rux_uticks = 0x0, rux_sticks = 0x0, rux_iticks = 0x0, rux_uu = 0x0, rux_su = 0x0, rux_tu = 0x0}, td_incruntime = 0xbd9fb9c, td_runtime = 0xbd9fb9c, td_pticks = 0xa, td_sticks = 0xd, td_iticks = 0x0, td_uticks = 0x0, td_intrval = 0x0, td_oldsigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_generation = 0x12, td_sigstk = {ss_sp = 0x0, ss_size = 0x0, ss_flags = 0x4}, td_xsig = 0x0, td_profil_addr = 0x0, td_profil_ticks = 0x0, td_name = "find", '\000' , td_fpop = 0x0, td_dbgflags = 0x0, td_si = {si_signo = 0x0, si_errno = 0x0, si_code = 0x0, si_pid = 0x0, si_uid = 0x0, si_status = 0x0, si_addr = 0x0, si_value = {sival_int = 0x0, sival_ptr = 0x0, sigval_int = 0x0, sigval_ptr = 0x0}, _reason = {_fault = {_trapno = 0x0}, _timer = {_timerid = 0x0, _overrun = 0x0}, _mesgq = {_mqd = 0x0}, _poll = {_band = 0x0}, __spare__ = {__spare1__ = 0x0, __spare2__ = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}}}, td_ng_outbound = 0x0, td_osd = { osd_nslots = 0x0, osd_slots = 0x0, osd_next = {le_next = 0x0, le_prev = 0x0}}, td_map_def_user = 0x0, td_dbg_forked = 0x0, td_vp_reserved = 0x0, td_no_sleeping = 0x0, td_su = 0x0, td_sleeptimo = 0x0, td_rtcgen = 0x0, td_errno = 0x0, td_vslock_sz = 0x0, td_kcov_info = 0x0, td_ucredref = 0xfffffffb, td_sigmask = {__bits = {0x0, 0x0, 0x0, 0x0}}, td_rqindex = 0x20, td_base_pri = 0xac, td_priority = 0xac, td_pri_class = 0x3, td_user_pri = 0xad, td_base_user_pri = 0xad, td_pre_epoch_prio = 0x8d, td_rb_list = 0x0, td_rbp_list = 0x0, td_rb_inact = 0x0, td_sa = { code = 0x228, callp = 0xffffffff81900eb0 , args = {0xffffff9c, 0x800a37b78, 0x7fffffffe230, 0x200, 0x6465, 0x1, 0x0, 0x0}, narg = 0x4}, td_sigblock_ptr = 0x80022e280, td_sigblock_val = 0x0, td_pcb = 0xfffffe012a0ce610, td_state = TDS_RUNNING, td_uretoff = {tdu_retval = {0x0, 0x7fffffffe230}, tdu_off = 0x0}, td_cowgen = 0x0, td_slpcallout = {c_links = {le = { le_next = 0xffffffffffffffff, le_prev = 0xffffffffffffffff}, sle = {sle_next = 0xffffffffffffffff}, tqe = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}}, c_time = 0x17fc802b81f, c_precision = 0xffffef3, c_arg = 0xfffffe012a0ce100, c_func = 0xffffffff80c2b000 , c_lock = 0x0, c_flags = 0x2, c_iflags = 0x110, c_cpu = 0xd}, td_frame = 0xfffffe0138a11c00, td_kstack = 0xfffffe0138a0e000, td_kstack_pages = 0x4, td_critnest = 0x1, td_md = {md_spinlock_count = 0x1, md_saved_flags = 0x246, md_spurflt_addr = 0x0, md_invl_gen = {gen = 0x1ae08e9, {link = {le_next = 0x1, le_prev = 0xac}, {next = 0x1, saved_pri = 0xac}}}, md_efirt_tmp = 0x0, md_efirt_dis_pf = 0x0, md_pcb = {pcb_r15 = 0xfffffe006a088080, pcb_r14 = 0xfffffe006a088098, pcb_r13 = 0xfffffe012a0ce100, pcb_r12 = 0x1, pcb_rbp = 0xfffffe0138a10eb0, pcb_rsp = 0xfffffe0138a10df8, pcb_rbx = 0xfffffe0070c3c500, pcb_rip = 0xffffffff80c00642, pcb_fsbase = 0x800235920, pcb_gsbase = 0x0, pcb_kgsbase = 0x0, pcb_cr0 = 0x0, pcb_cr2 = 0x0, pcb_cr3 = 0x0, pcb_cr4 = 0x0, pcb_dr0 = 0x0, pcb_dr1 = 0x0, pcb_dr2 = 0x0, pcb_dr3 = 0x0, pcb_dr6 = 0x0, pcb_dr7 = 0x0, pcb_gdt = {rd_limit = 0x0, rd_base = 0x0}, pcb_idt = {rd_limit = 0x0, rd_base = 0x0}, pcb_ldt = {rd_limit = 0x0, rd_base = 0x0}, pcb_tr = 0x0, pcb_flags = 0x19, pcb_initial_fpucw = 0x37f, pcb_onfault = 0x0, pcb_saved_ucr3 = 0x3d33befc6, pcb_tssp = 0x0, pcb_efer = 0x0, pcb_star = 0x0, pcb_lstar = 0x0, pcb_cstar = 0x0, pcb_sfmask = 0x0, pcb_save = 0xfffffe0138a11cc0, pcb_pad = {0x0, 0x0, 0x0, 0x0, 0x0}}, md_stack_base = 0xfffffe0138a11cc0}, td_ar = 0x0, td_lprof = {{lh_first = 0x0}, {lh_first = 0x0}}, td_dtrace = 0xfffff80008fa1300, td_vnet = 0x0, td_vnet_lpush = 0x0, td_intr_frame = 0x0, td_rfppwait_p = 0xfffff80378825000, td_ma = 0x0, td_ma_cnt = 0x0, td_emuldata = 0x0, td_lastcpu = 0x16, td_oncpu = 0x16, td_lkpi_task = 0x0, td_pmcpend = 0x0} (kgdb) $ svnlite diff -x -p /usr/src/sys -- Test scenario: misc/devfs3.sh