GENERIC HEAD from 2016-07-16 08:11:43 UTC, r302933M, vmcore.546 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #1 r302933M: Mon Jul 18 06:01:00 CEST 2016 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.23-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66601603072 (63516 MB) : Trying to mount root from ufs:/dev/gpt/root [rw]... uhub1: 4 ports with 4 removable, self powered uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/gpt/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/root: clean, 45808894 free (781502 frags, 5628424 blocks, 0.8% fragmentation) /dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0p2: clean, 36227893 free (22549 frags, 4525668 blocks, 0.1% fragmentation) /dev/gpt/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/tmp: clean, 23167018 free (4570 frags, 2895306 blocks, 0.0% fragmentation) ugen2.2: at usbus2 uhub3: on usbus2 Mounting local file systems:ugen0.2: at usbus0 uhub4: on usbus0 . ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/llvm37/lib 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t1.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:uhub4: 6 ports with 6 removable, self powered uhub3: 8 ports with 8 removable, self powered ugen2.3: at usbus2 uhub5: on usbus2 uhub5: MTT enabled . uhub5: 4 ports with 4 removable, self powered Starting Network: lo0 igb0 igb1. lo0: flags=8049 at usbus2 UP,LOOPBACK,RUNNukbd0: on usbus2 ING,MULTICAST> mkbd2 at ukbd0 etric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 8192 options=6403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Starting casperd. lock order reversal: 1st 0xfffffe0f8f89b6e0 bufwait (bufwait) @ kern/vfs_bio.c:3512 2nd 0xfffff80121bae600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xffffffff80aae590 at witness_debugger+0x70 #1 0xffffffff80aae484 at witness_checkorder+0xe54 #2 0xffffffff80a56ea2 at _sx_xlock+0x72 #3 0xffffffff80d1af5d at ufsdirhash_add+0x4d #4 0xffffffff80d1fa0a at ufs_direnter+0x4da #5 0xffffffff80d281c9 at ufs_mkdir+0x8a9 #6 0xffffffff81022c74 at VOP_MKDIR_APV+0x104 #7 0xffffffff80b1dddc at kern_mkdirat+0x1fc #8 0xffffffff80ec6b46 at amd64_syscall+0x2f6 #9 0xffffffff80ea6d8b at Xfast_syscall+0xfb Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. sysctl: unknown oid 'debug.mnowait_failure.zalloc_whitelist' at line 13 sysctl: unknown oid 'debug.fail_point.uma_zalloc_arg' at line 14 Starting inetd. Mon Jul 18 09:16 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: root Password: Jul 18 09:16:33 t1 login: ROOT LOGIN (root) ON ttyu1 Last login: Fri Jul 15 19:59:11 on ttyu1 FreeBSD 12.0-CURRENT (PHO) #1 r302933M: Mon Jul 18 06:01:00 CEST 2016 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. You have new mail. root@t1:~ # bash $ cd ~pho/stress2/misc $ cat lockf5.sh #!/bin/sh # # Copyright (c) 2015 EMC Corp. # All rights reserved. # # Redistribution and use in source and binary forms, with or without # modification, are permitted provided that the following conditions # are met: # 1. Redistributions of source code must retain the above copyright # notice, this list of conditions and the following disclaimer. # 2. Redistributions in binary form must reproduce the above copyright # notice, this list of conditions and the following disclaimer in the # documentation and/or other materials provided with the distribution. # # THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS IS'' AND # ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE # IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE # ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE # FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL # DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS # OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) # HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT # LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY # OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF # SUCH DAMAGE. # # $FreeBSD$ # # "Fatal trap 9: general protection fault while in kernel mode" seen: # https://people.freebsd.org/~pho/stress/log/lockf5.txt # Test scenario by: ngie@FreeBSD.org. [ `id -u ` -ne 0 ] && echo "Must be root!" && exit 1 pgrep -q lockd || { echo "lockd not running."; exit 1; } . ../default.cfg [ -z "$nfs_export" ] && exit 0 ping -c 2 `echo $nfs_export | sed 's/:.*//'` > /dev/null 2>&1 || exit 0 mount | grep -q "on $mntpoint " && umount -f $mntpoint mount -t nfs $nfs_export $mntpoint || exit 1 rm -rf $mntpoint/$0 mkdir -p $mntpoint/$0 for i in `jot 100`; do (cd $mntpoint/$0; lockf -t 10 f$i sleep 5) > /dev/null 2>&1 & done sleep 3 umount -f $mntpoint wait mount -t nfs $nfs_export $mntpoint || exit 1 rm -rf $mntpoint/$0 umount $mntpoint $ sh -x ./lockf5.sh + id -u + [ 0 -ne 0 ] + pgrep -q lockd + . ../default.cfg + hostname + hostname=t1.osted.lan + [ -f ./t1.osted.lan ] + [ -f ../t1.osted.lan ] + . ../t1.osted.lan + export 'BLASTHOST=192.168.1.109' + export 'nfs_export=t2:/tmp' + testuser=stress + candidates='t2 x4 t1' + hostname + sed 's/\..*//' + me=t1 + echo t2 x4 t1 + sed s/t1// + candidates='t2 x4 ' + ping -c 2 -t 1 t2 + echo 'export BLASTHOST=t2' export BLASTHOST=t2 + export 'BLASTHOST=t2' + export 'nfs_export=t2:/tmp' + break + export 'RUNDIR=/tmp/stressX' + export 'RUNTIME=2m' + export 'VERBOSE=1' + export 'LOAD=20' + export 'INCARNATIONS=20' + export 'BLASTHOST=192.168.1.1' + export 'runRUNTIME=3d' + export 'runINCARNATIONS=1' + export 'runLOAD=100' + export 'swapINCARNATIONS=40' + export 'swapLOAD=80' + export 'syscallKILL=1' + export 'swapKILL=1' + export 'rwLOAD=70' + export 'mkdirLOAD=80' + export 'creatLOAD=80' + export 'symlinkLOAD=20}' + export 'tcpKILL=1' + export 'shmINCARNATIONS=5' + [ -z '' ] + export 'TESTPROGS= testcases/rw/rw testcases/swap/swap testcases/creat/creat testcases/mkdir/mkdir testcases/thr1/thr1 testcases/udp/udp testcases/tcp/tcp ' + export 'diskimage=/tmp/diskimage' + export 'mntpoint=/mnt' + export 'testuser=stress' + export 'mdstart=5' + export 'part=a' + export 'newfs_flags=-U' + pwd + export 'stress2origin=/home/pho/stress2/misc' + dirname /home/pho/stress2/misc + export 'stress2tools=/home/pho/stress2/tools' + CC=cc + pwd + dirname /home/pho/stress2/misc + top=/home/pho/stress2 + STRESS2BIN=/home/pho/stress2/bin + id stress + [ -z t2:/tmp ] + echo t2:/tmp + sed 's/:.*//' + ping -c 2 t2 + mount + grep -q 'on /mnt ' + mount -t nfs t2:/tmp /mnt + rm -rf /mnt/./lockf5.sh + mkdir -p /mnt/./lockf5.sh + jot 100 + sleep 3 + umount -f /mnt + wait Jul 18 09:17:24 t1 sshd[1118]: _secure_path: cannot stat /etc/login.conf: Not permitted in capability mode Jul 18 09:17:24 t1 last message repeated 2 times Jul 18 09:17:24 t1 sshd[1117]: _secure_path: cannot stat /etc/login.conf: Not permitted in capability mode Jul 18 09:17:24 t1 last message repeated 2 times Jul 18 09:17:24 t1 sshd[1116]: _secure_path: cannot stat /etc/login.conf: Not permitted in capability mode Jul 18 09:17:24 t1 last message repeated 2 times ^C $ ps PID TT STAT TIME COMMAND 971 u1 Is 0:00.03 login [pam] (login) 972 u1 I 0:00.03 -csh (csh) 974 u1 S 0:00.05 bash 1011 u1 R 10:45.05 lockf -t 10 f1 sleep 5 1012 u1 R 10:40.73 lockf -t 10 f2 sleep 5 1013 u1 R 10:39.83 lockf -t 10 f3 sleep 5 1014 u1 R 10:34.53 lockf -t 10 f4 sleep 5 1015 u1 R 10:34.74 lockf -t 10 f5 sleep 5 1016 u1 R 10:35.03 lockf -t 10 f6 sleep 5 1017 u1 R 10:35.67 lockf -t 10 f7 sleep 5 1018 u1 R 10:35.33 lockf -t 10 f8 sleep 5 1019 u1 R 10:36.24 lockf -t 10 f9 sleep 5 1020 u1 R 10:42.23 lockf -t 10 f10 sleep 5 1021 u1 R 10:39.84 lockf -t 10 f11 sleep 5 1022 u1 R 10:36.36 lockf -t 10 f12 sleep 5 1023 u1 R 10:38.87 lockf -t 10 f13 sleep 5 1024 u1 R 10:39.65 lockf -t 10 f14 sleep 5 1025 u1 R 10:36.44 lockf -t 10 f15 sleep 5 1026 u1 R 10:36.61 lockf -t 10 f16 sleep 5 1027 u1 R 10:34.02 lockf -t 10 f17 sleep 5 1028 u1 R 10:37.76 lockf -t 10 f18 sleep 5 1029 u1 R 10:38.18 lockf -t 10 f19 sleep 5 1030 u1 R 10:39.28 lockf -t 10 f20 sleep 5 1031 u1 R 10:35.68 lockf -t 10 f21 sleep 5 1032 u1 R 10:37.05 lockf -t 10 f22 sleep 5 1033 u1 R 10:38.44 lockf -t 10 f23 sleep 5 1034 u1 R 10:36.55 lockf -t 10 f24 sleep 5 1035 u1 R 10:37.13 lockf -t 10 f25 sleep 5 1036 u1 R 10:38.30 lockf -t 10 f26 sleep 5 1037 u1 R 10:36.35 lockf -t 10 f27 sleep 5 1038 u1 R 10:37.97 lockf -t 10 f28 sleep 5 1039 u1 R 10:38.16 lockf -t 10 f29 sleep 5 1040 u1 R 10:37.74 lockf -t 10 f30 sleep 5 1041 u1 R 10:38.05 lockf -t 10 f31 sleep 5 1042 u1 R 10:35.89 lockf -t 10 f32 sleep 5 1043 u1 R 10:37.79 lockf -t 10 f33 sleep 5 1044 u1 R 10:34.60 lockf -t 10 f34 sleep 5 1045 u1 R 10:35.42 lockf -t 10 f35 sleep 5 1046 u1 R 10:35.20 lockf -t 10 f36 sleep 5 1047 u1 R 10:35.42 lockf -t 10 f37 sleep 5 1048 u1 R 10:40.27 lockf -t 10 f38 sleep 5 1049 u1 R 10:33.32 lockf -t 10 f39 sleep 5 1050 u1 R 10:35.34 lockf -t 10 f40 sleep 5 1051 u1 R 10:37.97 lockf -t 10 f41 sleep 5 1052 u1 R 10:35.46 lockf -t 10 f42 sleep 5 1053 u1 R 10:40.09 lockf -t 10 f43 sleep 5 1054 u1 R 10:36.98 lockf -t 10 f44 sleep 5 1055 u1 R 10:35.39 lockf -t 10 f45 sleep 5 1056 u1 R 10:37.23 lockf -t 10 f46 sleep 5 1057 u1 R 10:41.51 lockf -t 10 f47 sleep 5 1058 u1 R 10:43.40 lockf -t 10 f48 sleep 5 1059 u1 R 10:35.81 lockf -t 10 f49 sleep 5 1060 u1 R 10:38.46 lockf -t 10 f50 sleep 5 1061 u1 R 10:37.68 lockf -t 10 f51 sleep 5 1062 u1 R 10:40.02 lockf -t 10 f52 sleep 5 1063 u1 R 10:40.84 lockf -t 10 f53 sleep 5 1064 u1 R 10:43.83 lockf -t 10 f54 sleep 5 1065 u1 R 10:37.79 lockf -t 10 f55 sleep 5 1066 u1 R 10:38.04 lockf -t 10 f56 sleep 5 1067 u1 R 10:32.73 lockf -t 10 f57 sleep 5 1068 u1 R 10:35.73 lockf -t 10 f58 sleep 5 1069 u1 R 10:37.48 lockf -t 10 f59 sleep 5 1070 u1 R 10:38.61 lockf -t 10 f60 sleep 5 1071 u1 R 10:38.76 lockf -t 10 f61 sleep 5 1072 u1 R 10:36.26 lockf -t 10 f62 sleep 5 1073 u1 R 10:40.32 lockf -t 10 f63 sleep 5 1074 u1 R 10:33.77 lockf -t 10 f64 sleep 5 1075 u1 R 10:36.90 lockf -t 10 f65 sleep 5 1076 u1 R 10:40.44 lockf -t 10 f66 sleep 5 1077 u1 R 10:40.70 lockf -t 10 f67 sleep 5 1078 u1 R 10:36.25 lockf -t 10 f68 sleep 5 1079 u1 R 10:37.91 lockf -t 10 f69 sleep 5 1080 u1 R 10:38.39 lockf -t 10 f70 sleep 5 1081 u1 R 10:37.66 lockf -t 10 f71 sleep 5 1082 u1 R 10:37.98 lockf -t 10 f72 sleep 5 1083 u1 R 10:37.96 lockf -t 10 f73 sleep 5 1084 u1 R 10:38.39 lockf -t 10 f74 sleep 5 1085 u1 R 10:37.73 lockf -t 10 f75 sleep 5 1086 u1 R 10:40.86 lockf -t 10 f76 sleep 5 1087 u1 R 10:42.09 lockf -t 10 f77 sleep 5 1088 u1 R 10:38.55 lockf -t 10 f78 sleep 5 1089 u1 R 10:35.90 lockf -t 10 f79 sleep 5 1090 u1 R 10:37.58 lockf -t 10 f80 sleep 5 1091 u1 R 10:37.33 lockf -t 10 f81 sleep 5 1092 u1 R 10:36.08 lockf -t 10 f82 sleep 5 1093 u1 R 10:37.49 lockf -t 10 f83 sleep 5 1094 u1 R 10:44.85 lockf -t 10 f84 sleep 5 1095 u1 R 10:34.14 lockf -t 10 f85 sleep 5 1096 u1 R 10:36.74 lockf -t 10 f86 sleep 5 1097 u1 R 10:36.06 lockf -t 10 f87 sleep 5 1098 u1 R 10:46.75 lockf -t 10 f88 sleep 5 1099 u1 R 10:43.98 lockf -t 10 f89 sleep 5 1100 u1 R 10:47.53 lockf -t 10 f90 sleep 5 1101 u1 R 10:36.94 lockf -t 10 f91 sleep 5 1102 u1 R 10:34.59 lockf -t 10 f92 sleep 5 1103 u1 R 10:39.38 lockf -t 10 f93 sleep 5 1104 u1 R 10:34.73 lockf -t 10 f94 sleep 5 1105 u1 R 10:36.09 lockf -t 10 f95 sleep 5 1106 u1 R 10:33.88 lockf -t 10 f96 sleep 5 1107 u1 R 10:33.85 lockf -t 10 f97 sleep 5 1108 u1 R 10:34.96 lockf -t 10 f98 sleep 5 1109 u1 R 10:34.71 lockf -t 10 f99 sleep 5 1110 u1 R 10:37.64 lockf -t 10 f100 sleep 5 55893 u1 R+ 0:00.00 ps 963 v0 Is+ 0:00.01 /usr/libexec/getty Pc ttyv0 964 v1 Is+ 0:00.00 /usr/libexec/getty Pc ttyv1 965 v2 Is+ 0:00.01 /usr/libexec/getty Pc ttyv2 966 v3 Is+ 0:00.01 /usr/libexec/getty Pc ttyv3 967 v4 Is+ 0:00.01 /usr/libexec/getty Pc ttyv4 968 v5 Is+ 0:00.01 /usr/libexec/getty Pc ttyv5 969 v6 Is+ 0:00.00 /usr/libexec/getty Pc ttyv6 970 v7 Is+ 0:00.00 /usr/libexec/getty Pc ttyv7 $ pkill -9 lockf $ pkill -9 lockf $ ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 971 1 0 22 0 43756 3376 wait Is u1 0:00.03 login [pam] (logi 0 972 971 0 22 0 19624 4460 pause I u1 0:00.03 -csh (csh) 0 974 972 0 20 0 15908 5732 wait S u1 0:00.07 bash 0 1011 1 0 20 0 6280 2040 - R u1 10:49.18 lockf -t 10 f1 sl 0 1012 1 0 20 0 6280 2040 - R u1 10:44.37 lockf -t 10 f2 sl 0 1013 1 0 20 0 6280 2040 - R u1 10:43.82 lockf -t 10 f3 sl 0 1014 1 0 52 0 6280 2040 - R u1 10:38.41 lockf -t 10 f4 sl 0 1015 1 0 20 0 6280 2040 - R u1 10:38.63 lockf -t 10 f5 sl 0 1016 1 0 20 0 6280 2040 - R u1 10:39.26 lockf -t 10 f6 sl 0 1017 1 0 20 0 6280 2040 - R u1 10:39.88 lockf -t 10 f7 sl 0 1018 1 0 20 0 6280 2040 - R u1 10:39.49 lockf -t 10 f8 sl 0 1019 1 0 20 0 6280 2040 - R u1 10:40.24 lockf -t 10 f9 sl 0 1020 1 0 20 0 6280 2040 - R u1 10:46.45 lockf -t 10 f10 s 0 1021 1 0 20 0 6280 2040 - R u1 10:44.05 lockf -t 10 f11 s 0 1022 1 0 20 0 6280 2040 - R u1 10:40.62 lockf -t 10 f12 s 0 1023 1 0 20 0 6280 2040 - R u1 10:43.05 lockf -t 10 f13 s 0 1024 1 0 20 0 6280 2040 - R u1 10:43.54 lockf -t 10 f14 s 0 1025 1 0 20 0 6280 2040 - R u1 10:40.62 lockf -t 10 f15 s 0 1026 1 0 20 0 6280 2040 - R u1 10:40.30 lockf -t 10 f16 s 0 1027 1 0 20 0 6280 2040 - R u1 10:38.30 lockf -t 10 f17 s 0 1028 1 0 20 0 6280 2040 - R u1 10:42.01 lockf -t 10 f18 s 0 1029 1 0 20 0 6280 2040 - R u1 10:41.80 lockf -t 10 f19 s 0 1030 1 0 20 0 6280 2040 - R u1 10:43.41 lockf -t 10 f20 s 0 1031 1 0 20 0 6280 2040 - R u1 10:39.80 lockf -t 10 f21 s 0 1032 1 0 20 0 6280 2040 - R u1 10:41.23 lockf -t 10 f22 s 0 1033 1 0 52 0 6280 2040 - R u1 10:42.17 lockf -t 10 f23 s 0 1034 1 0 52 0 6280 2040 - R u1 10:40.40 lockf -t 10 f24 s 0 1035 1 0 20 0 6280 2040 - R u1 10:41.26 lockf -t 10 f25 s 0 1036 1 0 20 0 6280 2040 - R u1 10:42.54 lockf -t 10 f26 s 0 1037 1 0 20 0 6280 2040 - R u1 10:40.47 lockf -t 10 f27 s 0 1038 1 0 20 0 6280 2040 - R u1 10:42.11 lockf -t 10 f28 s 0 1039 1 0 20 0 6280 2040 - R u1 10:42.23 lockf -t 10 f29 s 0 1040 1 0 20 0 6280 2040 - R u1 10:41.88 lockf -t 10 f30 s 0 1041 1 0 52 0 6280 2040 - R u1 10:41.93 lockf -t 10 f31 s 0 1042 1 0 20 0 6280 2040 - R u1 10:39.87 lockf -t 10 f32 s 0 1043 1 0 20 0 6280 2040 - R u1 10:41.88 lockf -t 10 f33 s 0 1044 1 0 20 0 6280 2040 - R u1 10:38.85 lockf -t 10 f34 s 0 1045 1 0 20 0 6280 2040 - R u1 10:39.62 lockf -t 10 f35 s 0 1046 1 0 20 0 6280 2040 - R u1 10:39.47 lockf -t 10 f36 s 0 1047 1 0 20 0 6280 2040 - R u1 10:39.51 lockf -t 10 f37 s 0 1048 1 0 20 0 6280 2040 - R u1 10:44.33 lockf -t 10 f38 s 0 1049 1 0 20 0 6280 2040 - R u1 10:37.63 lockf -t 10 f39 s 0 1050 1 0 20 0 6280 2040 - R u1 10:39.31 lockf -t 10 f40 s 0 1051 1 0 20 0 6280 2040 - R u1 10:42.16 lockf -t 10 f41 s 0 1052 1 0 20 0 6280 2040 - R u1 10:39.36 lockf -t 10 f42 s 0 1053 1 0 52 0 6280 2040 - R u1 10:43.67 lockf -t 10 f43 s 0 1054 1 0 20 0 6280 2040 - R u1 10:41.02 lockf -t 10 f44 s 0 1055 1 0 20 0 6280 2040 - R u1 10:39.65 lockf -t 10 f45 s 0 1056 1 0 52 0 6280 2040 - R u1 10:40.63 lockf -t 10 f46 s 0 1057 1 0 20 0 6280 2040 - R u1 10:45.76 lockf -t 10 f47 s 0 1058 1 0 20 0 6280 2040 - R u1 10:47.66 lockf -t 10 f48 s 0 1059 1 0 52 0 6280 2040 - R u1 10:39.64 lockf -t 10 f49 s 0 1060 1 0 20 0 6280 2040 - R u1 10:42.70 lockf -t 10 f50 s 0 1061 1 0 20 0 6280 2040 - R u1 10:41.95 lockf -t 10 f51 s 0 1062 1 0 20 0 6280 2040 - R u1 10:44.26 lockf -t 10 f52 s 0 1063 1 0 20 0 6280 2040 - R u1 10:45.09 lockf -t 10 f53 s 0 1064 1 0 52 0 6280 2040 - R u1 10:47.67 lockf -t 10 f54 s 0 1065 1 0 52 0 6280 2040 - R u1 10:41.46 lockf -t 10 f55 s 0 1066 1 0 52 0 6280 2040 - R u1 10:42.00 lockf -t 10 f56 s 0 1067 1 0 20 0 6280 2040 - R u1 10:36.82 lockf -t 10 f57 s 0 1068 1 0 52 0 6280 2040 - R u1 10:39.84 lockf -t 10 f58 s 0 1069 1 0 20 0 6280 2040 - R u1 10:41.66 lockf -t 10 f59 s 0 1070 1 0 20 0 6280 2040 - R u1 10:42.79 lockf -t 10 f60 s 0 1071 1 0 20 0 6280 2040 - R u1 10:42.99 lockf -t 10 f61 s 0 1072 1 0 20 0 6280 2040 - R u1 10:40.61 lockf -t 10 f62 s 0 1073 1 0 20 0 6280 2040 - R u1 10:44.50 lockf -t 10 f63 s 0 1074 1 0 20 0 6280 2040 - R u1 10:37.93 lockf -t 10 f64 s 0 1075 1 0 20 0 6280 2040 - R u1 10:41.04 lockf -t 10 f65 s 0 1076 1 0 20 0 6280 2040 - R u1 10:44.61 lockf -t 10 f66 s 0 1077 1 0 20 0 6280 2040 - R u1 10:44.69 lockf -t 10 f67 s 0 1078 1 0 20 0 6280 2040 - R u1 10:40.26 lockf -t 10 f68 s 0 1079 1 0 52 0 6280 2040 - R u1 10:41.67 lockf -t 10 f69 s 0 1080 1 0 20 0 6280 2040 - R u1 10:42.68 lockf -t 10 f70 s 0 1081 1 0 20 0 6280 2040 - R u1 10:41.71 lockf -t 10 f71 s 0 1082 1 0 20 0 6280 2040 - R u1 10:42.09 lockf -t 10 f72 s 0 1083 1 0 20 0 6280 2040 - R u1 10:42.19 lockf -t 10 f73 s 0 1084 1 0 52 0 6280 2040 - R u1 10:42.17 lockf -t 10 f74 s 0 1085 1 0 20 0 6280 2040 - R u1 10:41.84 lockf -t 10 f75 s 0 1086 1 0 20 0 6280 2040 - R u1 10:44.84 lockf -t 10 f76 s 0 1087 1 0 20 0 6280 2040 - R u1 10:46.13 lockf -t 10 f77 s 0 1088 1 0 20 0 6280 2040 - R u1 10:42.80 lockf -t 10 f78 s 0 1089 1 0 20 0 6280 2040 - R u1 10:40.18 lockf -t 10 f79 s 0 1090 1 0 20 0 6280 2040 - R u1 10:41.38 lockf -t 10 f80 s 0 1091 1 0 20 0 6280 2040 - R u1 10:41.58 lockf -t 10 f81 s 0 1092 1 0 20 0 6280 2040 - R u1 10:40.40 lockf -t 10 f82 s 0 1093 1 0 52 0 6280 2040 - R u1 10:41.18 lockf -t 10 f83 s 0 1094 1 0 20 0 6280 2040 - R u1 10:49.05 lockf -t 10 f84 s 0 1095 1 0 20 0 6280 2040 - R u1 10:38.35 lockf -t 10 f85 s 0 1096 1 0 20 0 6280 2040 - R u1 10:40.84 lockf -t 10 f86 s 0 1097 1 0 20 0 6280 2040 - R u1 10:40.12 lockf -t 10 f87 s 0 1098 1 0 52 0 6280 2040 - R u1 10:50.43 lockf -t 10 f88 s 0 1099 1 0 20 0 6280 2040 - R u1 10:48.13 lockf -t 10 f89 s 0 1100 1 0 20 0 6280 2040 - R u1 10:51.70 lockf -t 10 f90 s 0 1101 1 0 20 0 6280 2040 - R u1 10:41.06 lockf -t 10 f91 s 0 1102 1 0 20 0 6280 2040 - R u1 10:38.70 lockf -t 10 f92 s 0 1103 1 0 20 0 6280 2040 - R u1 10:43.58 lockf -t 10 f93 s 0 1104 1 0 20 0 6280 2040 - R u1 10:38.95 lockf -t 10 f94 s 0 1105 1 0 20 0 6280 2040 - R u1 10:40.33 lockf -t 10 f95 s 0 1106 1 0 20 0 6280 2040 - R u1 10:37.95 lockf -t 10 f96 s 0 1107 1 0 20 0 6280 2040 - R u1 10:38.14 lockf -t 10 f97 s 0 1108 1 0 52 0 6280 2040 - R u1 10:38.67 lockf -t 10 f98 s 0 1109 1 0 20 0 6280 2040 - R u1 10:38.87 lockf -t 10 f99 s 0 1110 1 0 20 0 6280 2040 - R u1 10:41.99 lockf -t 10 f100 0 55972 974 0 20 0 21180 3020 - R+ u1 0:00.00 ps -l 0 963 1 0 52 0 10484 2312 ttyin Is+ v0 0:00.01 /usr/libexec/gett 0 964 1 0 52 0 10484 2312 ttyin Is+ v1 0:00.00 /usr/libexec/gett 0 965 1 0 52 0 10484 2312 ttyin Is+ v2 0:00.01 /usr/libexec/gett 0 966 1 0 52 0 10484 2312 ttyin Is+ v3 0:00.01 /usr/libexec/gett 0 967 1 0 52 0 10484 2312 ttyin Is+ v4 0:00.01 /usr/libexec/gett 0 968 1 0 52 0 10484 2312 ttyin Is+ v5 0:00.01 /usr/libexec/gett 0 969 1 0 52 0 10484 2312 ttyin Is+ v6 0:00.00 /usr/libexec/gett 0 970 1 0 52 0 10484 2312 ttyin Is+ v7 0:00.00 /usr/libexec/gett $ init 1 $ Stopping inetd. Shutting down local packages:. Stopping cron. Stopping sshd. Stopping saslauthd. Stopping powerd. Waiting for PIDS: 748. Stopping ntpd. Stopping lockd. Stopping statd. Stopping nfsd. Waiting for PIDS: 707. Stopping mountd. Stopping nfsuserd. kill: 688: No such process kill: 689: No such process kill: 690: No such process kill: 692: No such process Stopping casperd. Stopping watchdogd. Waiting for PIDS: 648. Stopping rpcbind. Stopping rtsold. Stopping devd. Waiting for PIDS: 470. Writing entropy file:. Writing early boot entropy file:. Terminated . Jul 18 10:02:12 t1 syslogd: exiting on signal 15 Jul 18 10:02:32 init: some processes would not die; ps axl advised Enter full pathname of shell or RETURN for /bin/sh: # ps -l UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 1011 1 0 52 0 6280 2040 - R u1- 11:26.48 lockf -t 10 f1 s 0 1012 1 0 52 0 6280 2040 - R u1- 11:30.22 lockf -t 10 f2 s 0 1013 1 0 52 0 6280 2040 - R u1- 11:01.34 lockf -t 10 f3 s 0 1014 1 0 52 0 6280 2040 - R u1- 10:55.41 lockf -t 10 f4 s 0 1015 1 0 52 0 6280 2040 - R u1- 10:58.56 lockf -t 10 f5 s 0 1016 1 0 52 0 6280 2040 - R u1- 11:03.38 lockf -t 10 f6 s 0 1017 1 0 20 0 6280 2040 - R u1- 11:40.12 lockf -t 10 f7 s 0 1018 1 0 52 0 6280 2040 - R u1- 11:08.68 lockf -t 10 f8 s 0 1019 1 0 52 0 6280 2040 - R u1- 10:57.89 lockf -t 10 f9 s 0 1020 1 0 52 0 6280 2040 - R u1- 11:06.66 lockf -t 10 f10 0 1021 1 0 52 0 6280 2040 - R u1- 11:18.22 lockf -t 10 f11 0 1022 1 0 52 0 6280 2040 - R u1- 11:01.68 lockf -t 10 f12 0 1023 1 0 52 0 6280 2040 - R u1- 11:16.03 lockf -t 10 f13 0 1024 1 0 52 0 6280 2040 - R u1- 11:03.07 lockf -t 10 f14 0 1025 1 0 52 0 6280 2040 - R u1- 11:12.93 lockf -t 10 f15 0 1026 1 0 52 0 6280 2040 - R u1- 11:36.70 lockf -t 10 f16 0 1027 1 0 52 0 6280 2040 - R u1- 11:24.99 lockf -t 10 f17 0 1028 1 0 52 0 6280 2040 - R u1- 11:05.48 lockf -t 10 f18 0 1029 1 0 52 0 6280 2040 - R u1- 11:51.11 lockf -t 10 f19 0 1030 1 0 52 0 6280 2040 - R u1- 11:40.64 lockf -t 10 f20 0 1031 1 0 52 0 6280 2040 - R u1- 11:16.12 lockf -t 10 f21 0 1032 1 0 52 0 6280 2040 - R u1- 11:01.13 lockf -t 10 f22 0 1033 1 0 52 0 6280 2040 - R u1- 11:23.30 lockf -t 10 f23 0 1034 1 0 52 0 6280 2040 - R u1- 11:00.89 lockf -t 10 f24 0 1035 1 0 52 0 6280 2040 - R u1- 11:06.12 lockf -t 10 f25 0 1036 1 0 52 0 6280 2040 - R u1- 10:59.75 lockf -t 10 f26 0 1037 1 0 52 0 6280 2040 - R u1- 11:05.76 lockf -t 10 f27 0 1038 1 0 52 0 6280 2040 - R u1- 11:26.94 lockf -t 10 f28 0 1039 1 0 52 0 6280 2040 - R u1- 10:59.48 lockf -t 10 f29 0 1040 1 0 52 0 6280 2040 - R u1- 11:00.22 lockf -t 10 f30 0 1041 1 0 52 0 6280 2040 - R u1- 11:02.37 lockf -t 10 f31 0 1042 1 0 52 0 6280 2040 - R u1- 11:00.78 lockf -t 10 f32 0 1043 1 0 52 0 6280 2040 - R u1- 11:05.89 lockf -t 10 f33 0 1044 1 0 52 0 6280 2040 - R u1- 11:09.51 lockf -t 10 f34 0 1045 1 0 52 0 6280 2040 - R u1- 11:12.96 lockf -t 10 f35 0 1046 1 0 52 0 6280 2040 - R u1- 10:57.32 lockf -t 10 f36 0 1047 1 0 52 0 6280 2040 - R u1- 11:35.75 lockf -t 10 f37 0 1048 1 0 52 0 6280 2040 - R u1- 11:05.82 lockf -t 10 f38 0 1049 1 0 52 0 6280 2040 - R u1- 10:58.99 lockf -t 10 f39 0 1050 1 0 52 0 6280 2040 - R u1- 10:57.05 lockf -t 10 f40 0 1051 1 0 52 0 6280 2040 - R u1- 11:05.61 lockf -t 10 f41 0 1052 1 0 52 0 6280 2040 - R u1- 11:29.03 lockf -t 10 f42 0 1053 1 0 52 0 6280 2040 - R u1- 11:03.26 lockf -t 10 f43 0 1054 1 0 52 0 6280 2040 - R u1- 11:39.53 lockf -t 10 f44 0 1055 1 0 52 0 6280 2040 - R u1- 11:10.40 lockf -t 10 f45 0 1056 1 0 52 0 6280 2040 - R u1- 10:56.66 lockf -t 10 f46 0 1057 1 0 52 0 6280 2040 - R u1- 11:14.53 lockf -t 10 f47 0 1058 1 0 52 0 6280 2040 - R u1- 11:27.27 lockf -t 10 f48 0 1059 1 0 52 0 6280 2040 - R u1- 10:55.36 lockf -t 10 f49 0 1060 1 0 52 0 6280 2040 - R u1- 10:59.09 lockf -t 10 f50 0 1061 1 0 52 0 6280 2040 - R u1- 10:59.13 lockf -t 10 f51 0 1062 1 0 52 0 6280 2040 - R u1- 11:02.93 lockf -t 10 f52 0 1063 1 0 52 0 6280 2040 - R u1- 11:38.17 lockf -t 10 f53 0 1064 1 0 52 0 6280 2040 - R u1- 11:06.72 lockf -t 10 f54 0 1065 1 0 52 0 6280 2040 - R u1- 11:05.31 lockf -t 10 f55 0 1066 1 0 52 0 6280 2040 - R u1- 11:03.65 lockf -t 10 f56 0 1067 1 0 52 0 6280 2040 - R u1- 11:12.60 lockf -t 10 f57 0 1068 1 0 52 0 6280 2040 - R u1- 10:59.08 lockf -t 10 f58 0 1069 1 0 52 0 6280 2040 - R u1- 11:00.27 lockf -t 10 f59 0 1070 1 0 52 0 6280 2040 - R u1- 10:59.22 lockf -t 10 f60 0 1071 1 0 52 0 6280 2040 - R u1- 11:18.63 lockf -t 10 f61 0 1072 1 0 52 0 6280 2040 - R u1- 11:02.90 lockf -t 10 f62 0 1073 1 0 52 0 6280 2040 - R u1- 11:07.90 lockf -t 10 f63 0 1074 1 0 52 0 6280 2040 - R u1- 11:18.24 lockf -t 10 f64 0 1075 1 0 52 0 6280 2040 - R u1- 11:14.55 lockf -t 10 f65 0 1076 1 0 52 0 6280 2040 - R u1- 11:08.29 lockf -t 10 f66 0 1077 1 0 52 0 6280 2040 - R u1- 11:01.88 lockf -t 10 f67 0 1078 1 0 52 0 6280 2040 - R u1- 11:04.86 lockf -t 10 f68 0 1079 1 0 52 0 6280 2040 - R u1- 11:33.44 lockf -t 10 f69 0 1080 1 0 52 0 6280 2040 - R u1- 11:12.75 lockf -t 10 f70 0 1081 1 0 52 0 6280 2040 - R u1- 11:14.02 lockf -t 10 f71 0 1082 1 0 52 0 6280 2040 - R u1- 11:01.34 lockf -t 10 f72 0 1083 1 0 52 0 6280 2040 - R u1- 11:03.73 lockf -t 10 f73 0 1084 1 0 52 0 6280 2040 - R u1- 11:24.95 lockf -t 10 f74 0 1085 1 0 52 0 6280 2040 - R u1- 11:21.48 lockf -t 10 f75 0 1086 1 0 52 0 6280 2040 - R u1- 11:05.22 lockf -t 10 f76 0 1087 1 0 52 0 6280 2040 - R u1- 11:17.57 lockf -t 10 f77 0 1088 1 0 52 0 6280 2040 - R u1- 11:37.62 lockf -t 10 f78 0 1089 1 0 52 0 6280 2040 - R u1- 11:25.35 lockf -t 10 f79 0 1090 1 0 52 0 6280 2040 - R u1- 10:58.48 lockf -t 10 f80 0 1091 1 0 52 0 6280 2040 - R u1- 11:09.14 lockf -t 10 f81 0 1092 1 0 52 0 6280 2040 - R u1- 10:59.70 lockf -t 10 f82 0 1093 1 0 52 0 6280 2040 - R u1- 11:13.47 lockf -t 10 f83 0 1094 1 0 52 0 6280 2040 - R u1- 11:05.14 lockf -t 10 f84 0 1095 1 0 52 0 6280 2040 - R u1- 10:59.42 lockf -t 10 f85 0 1096 1 0 52 0 6280 2040 - R u1- 11:12.13 lockf -t 10 f86 0 1097 1 0 52 0 6280 2040 - R u1- 10:57.26 lockf -t 10 f87 0 1098 1 0 52 0 6280 2040 - R u1- 11:05.78 lockf -t 10 f88 0 1099 1 0 52 0 6280 2040 - R u1- 11:08.80 lockf -t 10 f89 0 1100 1 0 52 0 6280 2040 - R u1- 11:13.79 lockf -t 10 f90 0 1101 1 0 52 0 6280 2040 - R u1- 11:18.21 lockf -t 10 f91 0 1102 1 0 52 0 6280 2040 - R u1- 11:10.66 lockf -t 10 f92 0 1103 1 0 52 0 6280 2040 - R u1- 11:14.04 lockf -t 10 f93 0 1104 1 0 52 0 6280 2040 - R u1- 11:04.00 lockf -t 10 f94 0 1105 1 0 52 0 6280 2040 - R u1- 11:00.81 lockf -t 10 f95 0 1106 1 0 52 0 6280 2040 - R u1- 11:10.86 lockf -t 10 f96 0 1107 1 0 52 0 6280 2040 - R u1- 11:08.14 lockf -t 10 f97 0 1108 1 0 52 0 6280 2040 - R u1- 11:30.56 lockf -t 10 f98 0 1109 1 0 52 0 6280 2040 - R u1- 10:58.93 lockf -t 10 f99 0 1110 1 0 52 0 6280 2040 - R u1- 11:04.59 lockf -t 10 f100 0 56657 1 0 20 0 13168 3484 wait Ss u1 0:00.01 -sh (sh) 0 56658 56657 0 20 0 21180 2956 - R+ u1 0:00.00 ps -l # procstat -k 1110 PID TID COMM TDNAME KSTACK 1110 100570 lockf - mi_switch sleepq_switch sleepq_wait _sleep clnt_dg_call clnt_call_private nlm4_lock_4 nlm_lock_rpc nlm_setlock nlm_advlock_internal nlm_advlock nfs_advlock VOP_ADVLOCK_APV vn_open_vnode vn_open_cred kern_openat amd64_syscall Xfast_syscall # procstat -k 1110 PID TID COMM TDNAME KSTACK 1110 100570 lockf - mi_switch sleepq_switch sleepq_wait _sleep clnt_dg_call clnt_call_private nlm4_lock_4 nlm_lock_rpc nlm_setlock nlm_advlock_internal nlm_advlock nfs_advlock VOP_ADVLOCK_APV vn_open_vnode vn_open_cred kern_openat amd64_syscall Xfast_syscall # procstat -k 1110 PID TID COMM TDNAME KSTACK 1110 100570 lockf - mi_switch sleepq_switch sleepq_wait _sleep clnt_dg_call clnt_call_private nlm4_lock_4 nlm_lock_rpc nlm_setlock nlm_advlock_internal nlm_advlock nfs_advlock VOP_ADVLOCK_APV vn_open_vnode vn_open_cred kern_openat amd64_syscall Xfast_syscall # KDB: enter: Break to debugger [ thread pid 1102 tid 100207 ] Stopped at kdb_alt_break_internal+0x18e: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 1102 tid 100207 td 0xfffff8013204ba00 kdb_alt_break_internal() at kdb_alt_break_internal+0x18e/frame 0xfffffe104863a4e0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe104863a4f0 uart_intr_rxready() at uart_intr_rxready+0x98/frame 0xfffffe104863a520 uart_intr() at uart_intr+0x121/frame 0xfffffe104863a560 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe104863a5b0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe104863a5e0 lapic_handle_intr() at lapic_handle_intr+0x68/frame 0xfffffe104863a620 Xapic_isr1() at Xapic_isr1+0xb7/frame 0xfffffe104863a620 --- interrupt, rip = 0xffffffff80c79302, rsp = 0xfffffe104863a6f0, rbp = 0xfffffe104863a870 --- udp6_send() at udp6_send+0x232/frame 0xfffffe104863a870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104863a8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104863abe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104863ac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104863acc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104863adc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104863b0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104863b480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104863b4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104863b5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104863b600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104863b6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104863b820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104863b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104863bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104863bab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x7ca280 curthread = 0xfffff80121bc7000: pid 1098 "lockf" curpcb = 0xfffffe104ed7db80 fpcurthread = none idlethread = 0xfffff8000b6f0000: tid 100003 "idle: cpu0" curpmap = 0xfffff80235424138 tssp = 0xffffffff81d9d010 commontssp = 0xffffffff81d9d010 rsp0 = 0xfffffe104ed7db80 gs32p = 0xffffffff81da3868 ldt = 0xffffffff81da38a8 tss = 0xffffffff81da3898 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe100de65280 curthread = 0xfffff8022fe26500: pid 1083 "lockf" curpcb = 0xfffffe104efbfb80 fpcurthread = none idlethread = 0xfffff8000b6efa00: tid 100004 "idle: cpu1" curpmap = 0xfffff8022fc91138 tssp = 0xffffffff81d9d078 commontssp = 0xffffffff81d9d078 rsp0 = 0xfffffe104efbfb80 gs32p = 0xffffffff81da38d0 ldt = 0xffffffff81da3910 tss = 0xffffffff81da3900 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe100de6d280 curthread = 0xfffff8013204ba00: pid 1102 "lockf" curpcb = 0xfffffe104863bb80 fpcurthread = none idlethread = 0xfffff8000b6ef500: tid 100005 "idle: cpu2" curpmap = 0xfffff80235470138 tssp = 0xffffffff81d9d0e0 commontssp = 0xffffffff81d9d0e0 rsp0 = 0xfffffe104863bb80 gs32p = 0xffffffff81da3938 ldt = 0xffffffff81da3978 tss = 0xffffffff81da3968 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe100de75280 curthread = 0xfffff801211bd500: pid 1095 "lockf" curpcb = 0xfffffe104efe7b80 fpcurthread = none idlethread = 0xfffff8000b6ef000: tid 100006 "idle: cpu3" curpmap = 0xfffff8022fdbb138 tssp = 0xffffffff81d9d148 commontssp = 0xffffffff81d9d148 rsp0 = 0xfffffe104efe7b80 gs32p = 0xffffffff81da39a0 ldt = 0xffffffff81da39e0 tss = 0xffffffff81da39d0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe100de7d280 curthread = 0xfffff801439aa500: pid 1048 "lockf" curpcb = 0xfffffe104eed2b80 fpcurthread = none idlethread = 0xfffff8000b6eea00: tid 100007 "idle: cpu4" curpmap = 0xfffff801322d4138 tssp = 0xffffffff81d9d1b0 commontssp = 0xffffffff81d9d1b0 rsp0 = 0xfffffe104eed2b80 gs32p = 0xffffffff81da3a08 ldt = 0xffffffff81da3a48 tss = 0xffffffff81da3a38 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe100de85280 curthread = 0xfffff80235116a00: pid 1070 "lockf" curpcb = 0xfffffe104ef7eb80 fpcurthread = none idlethread = 0xfffff8000b6ee500: tid 100008 "idle: cpu5" curpmap = 0xfffff8023512f138 tssp = 0xffffffff81d9d218 commontssp = 0xffffffff81d9d218 rsp0 = 0xfffffe104ef7eb80 gs32p = 0xffffffff81da3a70 ldt = 0xffffffff81da3ab0 tss = 0xffffffff81da3aa0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe1083fba280 curthread = 0xfffff8022fe26000: pid 1084 "lockf" curpcb = 0xfffffe104efc4b80 fpcurthread = none idlethread = 0xfffff8000b6ee000: tid 100009 "idle: cpu6" curpmap = 0xfffff8022fc90138 tssp = 0xffffffff81d9d280 commontssp = 0xffffffff81d9d280 rsp0 = 0xfffffe104efc4b80 gs32p = 0xffffffff81da3ad8 ldt = 0xffffffff81da3b18 tss = 0xffffffff81da3b08 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe1083fc1280 curthread = 0xfffff80235090a00: pid 1076 "lockf" curpcb = 0xfffffe104ef9cb80 fpcurthread = none idlethread = 0xfffff8000b700a00: tid 100010 "idle: cpu7" curpmap = 0xfffff8022ffa6138 tssp = 0xffffffff81d9d2e8 commontssp = 0xffffffff81d9d2e8 rsp0 = 0xfffffe104ef9cb80 gs32p = 0xffffffff81da3b40 ldt = 0xffffffff81da3b80 tss = 0xffffffff81da3b70 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe1083fc9280 curthread = 0xfffff80121bbfa00: pid 1100 "lockf" curpcb = 0xfffffe104ed82b80 fpcurthread = none idlethread = 0xfffff8000b700500: tid 100011 "idle: cpu8" curpmap = 0xfffff80235422138 tssp = 0xffffffff81d9d350 commontssp = 0xffffffff81d9d350 rsp0 = 0xfffffe104ed82b80 gs32p = 0xffffffff81da3ba8 ldt = 0xffffffff81da3be8 tss = 0xffffffff81da3bd8 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe1083fd1280 curthread = 0xfffff8023501e500: pid 1062 "lockf" curpcb = 0xfffffe104ef26b80 fpcurthread = none idlethread = 0xfffff8000b700000: tid 100012 "idle: cpu9" curpmap = 0xfffff80235088138 tssp = 0xffffffff81d9d3b8 commontssp = 0xffffffff81d9d3b8 rsp0 = 0xfffffe104ef26b80 gs32p = 0xffffffff81da3c10 ldt = 0xffffffff81da3c50 tss = 0xffffffff81da3c40 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe1083fd9280 curthread = 0xfffff8013204b500: pid 1014 "lockf" curpcb = 0xfffffe104864fb80 fpcurthread = none idlethread = 0xfffff8000b6ffa00: tid 100013 "idle: cpu10" curpmap = 0xfffff80132094138 tssp = 0xffffffff81d9d420 commontssp = 0xffffffff81d9d420 rsp0 = 0xfffffe104864fb80 gs32p = 0xffffffff81da3c78 ldt = 0xffffffff81da3cb8 tss = 0xffffffff81da3ca8 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe1083fe1280 curthread = 0xfffff8000b6ff500: pid 11 "idle: cpu11" curpcb = 0xfffffe10059fbb80 fpcurthread = none idlethread = 0xfffff8000b6ff500: tid 100014 "idle: cpu11" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d488 commontssp = 0xffffffff81d9d488 rsp0 = 0xfffffe10059fbb80 gs32p = 0xffffffff81da3ce0 ldt = 0xffffffff81da3d20 tss = 0xffffffff81da3d10 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe1083fe9280 curthread = 0xfffff80121797000: pid 1023 "lockf" curpcb = 0xfffffe10486d6b80 fpcurthread = none idlethread = 0xfffff8000b6ff000: tid 100015 "idle: cpu12" curpmap = 0xfffff8022fbcd138 tssp = 0xffffffff81d9d4f0 commontssp = 0xffffffff81d9d4f0 rsp0 = 0xfffffe10486d6b80 gs32p = 0xffffffff81da3d48 ldt = 0xffffffff81da3d88 tss = 0xffffffff81da3d78 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe1083ff1280 curthread = 0xfffff8000b6fea00: pid 11 "idle: cpu13" curpcb = 0xfffffe0f94024b80 fpcurthread = none idlethread = 0xfffff8000b6fea00: tid 100016 "idle: cpu13" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d558 commontssp = 0xffffffff81d9d558 rsp0 = 0xfffffe0f94024b80 gs32p = 0xffffffff81da3db0 ldt = 0xffffffff81da3df0 tss = 0xffffffff81da3de0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe1083ff9280 curthread = 0xfffff80235308a00: pid 1088 "lockf" curpcb = 0xfffffe104efd8b80 fpcurthread = none idlethread = 0xfffff8000b6fe500: tid 100017 "idle: cpu14" curpmap = 0xfffff80235328138 tssp = 0xffffffff81d9d5c0 commontssp = 0xffffffff81d9d5c0 rsp0 = 0xfffffe104efd8b80 gs32p = 0xffffffff81da3e18 ldt = 0xffffffff81da3e58 tss = 0xffffffff81da3e48 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe1084001280 curthread = 0xfffff8022fbba500: pid 1041 "lockf" curpcb = 0xfffffe104ee87b80 fpcurthread = none idlethread = 0xfffff8000b6fe000: tid 100018 "idle: cpu15" curpmap = 0xfffff8022fdb0138 tssp = 0xffffffff81d9d628 commontssp = 0xffffffff81d9d628 rsp0 = 0xfffffe104ee87b80 gs32p = 0xffffffff81da3e80 ldt = 0xffffffff81da3ec0 tss = 0xffffffff81da3eb0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe1084009280 curthread = 0xfffff8000b703a00: pid 11 "idle: cpu16" curpcb = 0xfffffe0f94033b80 fpcurthread = none idlethread = 0xfffff8000b703a00: tid 100019 "idle: cpu16" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d690 commontssp = 0xffffffff81d9d690 rsp0 = 0xfffffe0f94033b80 gs32p = 0xffffffff81da3ee8 ldt = 0xffffffff81da3f28 tss = 0xffffffff81da3f18 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe1084011280 curthread = 0xfffff8022fc03a00: pid 1031 "lockf" curpcb = 0xfffffe104ee40b80 fpcurthread = none idlethread = 0xfffff8000b703500: tid 100020 "idle: cpu17" curpmap = 0xfffff8022faca138 tssp = 0xffffffff81d9d6f8 commontssp = 0xffffffff81d9d6f8 rsp0 = 0xfffffe104ee40b80 gs32p = 0xffffffff81da3f50 ldt = 0xffffffff81da3f90 tss = 0xffffffff81da3f80 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe1084019280 curthread = 0xfffff801216caa00: pid 1019 "lockf" curpcb = 0xfffffe104ebdab80 fpcurthread = none idlethread = 0xfffff8000b703000: tid 100021 "idle: cpu18" curpmap = 0xfffff8022fb38138 tssp = 0xffffffff81d9d760 commontssp = 0xffffffff81d9d760 rsp0 = 0xfffffe104ebdab80 gs32p = 0xffffffff81da3fb8 ldt = 0xffffffff81da3ff8 tss = 0xffffffff81da3fe8 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe1084021280 curthread = 0xfffff8000b702a00: pid 11 "idle: cpu19" curpcb = 0xfffffe0f94042b80 fpcurthread = none idlethread = 0xfffff8000b702a00: tid 100022 "idle: cpu19" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d7c8 commontssp = 0xffffffff81d9d7c8 rsp0 = 0xfffffe0f94042b80 gs32p = 0xffffffff81da4020 ldt = 0xffffffff81da4060 tss = 0xffffffff81da4050 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe1084029280 curthread = 0xfffff8000b702500: pid 11 "idle: cpu20" curpcb = 0xfffffe0f94047b80 fpcurthread = none idlethread = 0xfffff8000b702500: tid 100023 "idle: cpu20" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d830 commontssp = 0xffffffff81d9d830 rsp0 = 0xfffffe0f94047b80 gs32p = 0xffffffff81da4088 ldt = 0xffffffff81da40c8 tss = 0xffffffff81da40b8 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe1084031280 curthread = 0xfffff80235404a00: pid 1097 "lockf" curpcb = 0xfffffe104eff1b80 fpcurthread = none idlethread = 0xfffff8000b702000: tid 100024 "idle: cpu21" curpmap = 0xfffff8022fdbd138 tssp = 0xffffffff81d9d898 commontssp = 0xffffffff81d9d898 rsp0 = 0xfffffe104eff1b80 gs32p = 0xffffffff81da40f0 ldt = 0xffffffff81da4130 tss = 0xffffffff81da4120 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe1084039280 curthread = 0xfffff8000b701a00: pid 11 "idle: cpu22" curpcb = 0xfffffe0f94051b80 fpcurthread = none idlethread = 0xfffff8000b701a00: tid 100025 "idle: cpu22" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d900 commontssp = 0xffffffff81d9d900 rsp0 = 0xfffffe0f94051b80 gs32p = 0xffffffff81da4158 ldt = 0xffffffff81da4198 tss = 0xffffffff81da4188 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe1084041280 curthread = 0xfffff8000b701500: pid 11 "idle: cpu23" curpcb = 0xfffffe0f94056b80 fpcurthread = none idlethread = 0xfffff8000b701500: tid 100026 "idle: cpu23" curpmap = 0xffffffff81d66328 tssp = 0xffffffff81d9d968 commontssp = 0xffffffff81d9d968 rsp0 = 0xfffffe0f94056b80 gs32p = 0xffffffff81da41c0 ldt = 0xffffffff81da4200 tss = 0xffffffff81da41f0 spin locks held: db:0:allpcpu> show alllocks Process 1102 (lockf) thread 0xfffff8013204ba00 (100207) exclusive rw pcbinfohash (pcbinfohash) r = 0 (0xffffffff81d8e2d8) locked @ netinet6/udp6_usrreq.c:1273 exclusive rw udpinp (udpinp) r = 0 (0xfffff801438a5c48) locked @ netinet6/udp6_usrreq.c:1222 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xfffff801216413c8 /dev/gpt/root on / (ufs) 0xfffff80121552000 devfs on /dev (devfs) 0xfffff80121f20790 /dev/gpt/tmp on /tmp (ufs) 0xfffff80121f203c8 procfs on /proc (procfs) 0xfffff80121f20000 /dev/ada0p2 on /media (ufs) 0xfffff80121f47b58 fdescfs on /dev/fd (fdescfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 16106657 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 2798 vm_cnt.v_active_count: 7616 vm_cnt.v_wire_count: 198241 vm_cnt.v_free_reserved: 21293 vm_cnt.v_free_min: 102868 vm_cnt.v_free_target: 347593 vm_cnt.v_inactive_target: 521389 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 56657 1 56657 0 Ss+ ttyin 0xfffff80011d2aca8 sh 1110 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1109 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1108 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1107 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1106 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1105 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1104 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1103 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1102 1 980 0 R+ CPU 2 lockf 1101 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1100 1 980 0 R+ CPU 8 lockf 1099 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1098 1 980 0 R+ CPU 0 lockf 1097 1 980 0 R+ CPU 21 lockf 1096 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1095 1 980 0 R+ CPU 3 lockf 1094 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1093 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1092 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1091 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1090 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1089 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1088 1 980 0 R+ CPU 14 lockf 1087 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1086 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1085 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1084 1 980 0 R+ CPU 6 lockf 1083 1 980 0 R+ CPU 1 lockf 1082 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1081 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1080 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1079 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1078 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1077 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1076 1 980 0 R+ CPU 7 lockf 1075 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1074 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1073 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1072 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1071 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1070 1 980 0 R+ CPU 5 lockf 1069 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1068 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1067 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1066 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1065 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1064 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1063 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1062 1 980 0 R+ CPU 9 lockf 1061 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1060 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1059 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1058 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1057 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1056 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1055 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1054 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1053 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1052 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1051 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1050 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1049 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1048 1 980 0 R+ CPU 4 lockf 1047 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1046 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1045 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1044 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1043 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1042 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1041 1 980 0 R+ CPU 15 lockf 1040 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1039 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1038 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1037 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1036 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1035 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1034 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1033 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1032 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1031 1 980 0 R+ CPU 17 lockf 1030 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1029 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1028 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1027 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1026 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1025 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1024 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1023 1 980 0 R+ CPU 12 lockf 1022 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1021 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1020 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1019 1 980 0 R+ CPU 18 lockf 1018 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1017 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1016 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1015 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1014 1 980 0 R+ CPU 10 lockf 1013 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1012 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 1011 1 980 0 D+ rpccwnd 0xfffff80143a70d2c lockf 23 0 0 0 DL vlruwt 0xfffff80121151528 [vnlru] 22 0 0 0 DL syncer 0xffffffff81ce85d0 [syncer] 21 0 0 0 DL - 0xffffffff81ce7b04 [bufspacedaemon] 20 0 0 0 DL (threaded) [bufdaemon] 100144 D psleep 0xffffffff81ce6e04 [bufdaemon] 100188 D sdflush 0xfffff80121e8b8e8 [/ worker] 100194 D sdflush 0xfffff8012169e8e8 [/tmp worker] 100196 D sdflush 0xfffff8012169e4e8 [/media worker] 19 0 0 0 DL pgzero 0xffffffff81cf4c64 [pagezero] 18 0 0 0 DL psleep 0xffffffff81cf110c [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100141 D psleep 0xffffffff81d9c405 [pagedaemon] 100172 D umarcl 0xffffffff81cf0a38 [uma] 16 0 0 0 DL idle 0xfffff8011df81a50 [enc_daemon0] 15 0 0 0 DL - 0xffffffff81ce666c [soaiod4] 9 0 0 0 DL - 0xffffffff81ce666c [soaiod3] 8 0 0 0 DL - 0xffffffff81ce666c [soaiod2] 7 0 0 0 DL - 0xffffffff81ce666c [soaiod1] 6 0 0 0 DL - 0xffffffff81aa0fd0 [rand_harvestq] 5 0 0 0 DL waiting_ 0xffffffff81d8d520 [sctp_iterator] 14 0 0 0 DL (threaded) [usb] 100076 D - 0xfffffe0001466d10 [usbus0] 100077 D - 0xfffffe0001466d68 [usbus0] 100078 D - 0xfffffe0001466dc0 [usbus0] 100079 D - 0xfffffe0001466e18 [usbus0] 100080 D - 0xfffffe0001466e70 [usbus0] 100117 D - 0xfffffe000186b460 [usbus1] 100118 D - 0xfffffe000186b4b8 [usbus1] 100119 D - 0xfffffe000186b510 [usbus1] 100120 D - 0xfffffe000186b568 [usbus1] 100121 D - 0xfffffe000186b5c0 [usbus1] 100123 D - 0xfffffe00016ddd10 [usbus2] 100124 D - 0xfffffe00016ddd68 [usbus2] 100125 D - 0xfffffe00016dddc0 [usbus2] 100126 D - 0xfffffe00016dde18 [usbus2] 100127 D - 0xfffffe00016dde70 [usbus2] 4 0 0 0 DL (threaded) [cam] 100065 D - 0xffffffff81974100 [doneq0] 100066 D - 0xffffffff81974200 [doneq1] 100067 D - 0xffffffff81974300 [doneq2] 100068 D - 0xffffffff81974400 [doneq3] 100069 D - 0xffffffff81974500 [doneq4] 100135 D - 0xffffffff81973f48 [scanner] 3 0 0 0 DL crypto_r 0xffffffff81cef558 [crypto returns] 2 0 0 0 DL crypto_w 0xffffffff81cef410 [crypto] 13 0 0 0 DL (threaded) [geom] 100059 D - 0xffffffff81d65760 [g_event] 100060 D - 0xffffffff81d65768 [g_up] 100061 D - 0xffffffff81d65770 [g_down] 12 0 0 0 WL (threaded) [intr] 100027 I [swi4: clock (0)] 100028 I [swi4: clock (1)] 100029 I [swi4: clock (2)] 100030 I [swi4: clock (3)] 100031 I [swi4: clock (4)] 100032 I [swi4: clock (5)] 100033 I [swi4: clock (6)] 100034 I [swi4: clock (7)] 100035 I [swi4: clock (8)] 100036 I [swi4: clock (9)] 100037 I [swi4: clock (10)] 100038 I [swi4: clock (11)] 100039 I [swi4: clock (12)] 100040 I [swi4: clock (13)] 100041 I [swi4: clock (14)] 100042 I [swi4: clock (15)] 100043 I [swi4: clock (16)] 100044 I [swi4: clock (17)] 100045 I [swi4: clock (18)] 100046 I [swi4: clock (19)] 100047 I [swi4: clock (20)] 100048 I [swi4: clock (21)] 100049 I [swi4: clock (22)] 100050 I [swi4: clock (23)] 100051 I [swi1: netisr 0] 100052 I [swi3: vm] 100053 I [swi6: task queue] 100054 I [swi6: Giant taskq] 100057 I [swi5: fast taskq] 100073 I [irq264: isci0] 100074 I [irq265: isci0] 100075 I [irq22: ehci0] 100081 I [irq266: hdac0] 100082 I [irq267: igb0:que 0] 100084 I [irq268: igb0:que 1] 100086 I [irq269: igb0:que 2] 100088 I [irq270: igb0:que 3] 100090 I [irq271: igb0:que 4] 100092 I [irq272: igb0:que 5] 100094 I [irq273: igb0:que 6] 100096 I [irq274: igb0:que 7] 100098 I [irq275: igb0:link] 100099 I [irq276: igb1:que 0] 100101 I [irq277: igb1:que 1] 100103 I [irq278: igb1:que 2] 100105 I [irq279: igb1:que 3] 100107 I [irq280: igb1:que 4] 100109 I [irq281: igb1:que 5] 100111 I [irq282: igb1:que 6] 100113 I [irq283: igb1:que 7] 100115 I [irq284: igb1:link] 100116 I [irq285: xhci0] 100122 I [irq20: ehci1] 100128 I [irq286: ahci0] 100129 I [irq287: hdac1] 100130 I [swi0: uart] 11 0 0 0 RL (threaded) [idle] 100003 CanRun [idle: cpu0] 100004 CanRun [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 CanRun [idle: cpu6] 100010 CanRun [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 CanRun [idle: cpu9] 100013 CanRun [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 CanRun [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 CanRun [idle: cpu14] 100018 CanRun [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 CanRun [idle: cpu17] 100021 CanRun [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 CanRun [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 SLs wait 0xfffff8000b6ed528 [init] 10 0 0 0 DL audit_wo 0xffffffff81d92ba0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d65798 [swapper] 100055 D - 0xfffff8000b725600 [thread taskq] 100056 D - 0xfffff8000b725500 [aiod_kick taskq] 100058 D - 0xfffff8000b725200 [kqueue_ctx taskq] 100062 D - 0xfffff8000b725100 [firmware taskq] 100070 D - 0xfffff8000b724c00 [acpi_task_0] 100071 D - 0xfffff8000b724c00 [acpi_task_1] 100072 D - 0xfffff8000b724c00 [acpi_task_2] 100083 D - 0xfffff80011d25700 [igb0 que (qid 0)] 100085 D - 0xfffff80011d25600 [igb0 que (qid 1)] 100087 D - 0xfffff80011d25500 [igb0 que (qid 2)] 100089 D - 0xfffff80011d25400 [igb0 que (qid 3)] 100091 D - 0xfffff80011d25300 [igb0 que (qid 4)] 100093 D - 0xfffff80011d25200 [igb0 que (qid 5)] 100095 D - 0xfffff80011d25100 [igb0 que (qid 6)] 100097 D - 0xfffff80011d25000 [igb0 que (qid 7)] 100100 D - 0xfffff80011d24500 [igb1 que (qid 8)] 100102 D - 0xfffff80011d24400 [igb1 que (qid 9)] 100104 D - 0xfffff80011d24300 [igb1 que (qid 10)] 100106 D - 0xfffff80011d24200 [igb1 que (qid 11)] 100108 D - 0xfffff80011d24100 [igb1 que (qid 12)] 100110 D - 0xfffff80011d24000 [igb1 que (qid 13)] 100112 D - 0xfffff80011d23e00 [igb1 que (qid 14)] 100114 D - 0xfffff80011d23d00 [igb1 que (qid 15)] 100131 D - 0xfffff80011d23100 [mca taskq] 100134 D - 0xfffff8000b725000 [CAM taskq] 100148 D - 0xfffff8000b728700 [if_io_tqg_0] 100149 D - 0xfffff8000b728600 [if_io_tqg_1] 100150 D - 0xfffff8000b728500 [if_io_tqg_2] 100151 D - 0xfffff8000b728400 [if_io_tqg_3] 100152 D - 0xfffff8000b728300 [if_io_tqg_4] 100153 D - 0xfffff8000b728200 [if_io_tqg_5] 100154 D - 0xfffff801211ae300 [if_io_tqg_6] 100155 D - 0xfffff801211ae200 [if_io_tqg_7] 100156 D - 0xfffff801211ae100 [if_io_tqg_8] 100157 D - 0xfffff801211ae000 [if_io_tqg_9] 100158 D - 0xfffff801211ade00 [if_io_tqg_10] 100159 D - 0xfffff801211add00 [if_io_tqg_11] 100160 D - 0xfffff801211adc00 [if_io_tqg_12] 100161 D - 0xfffff801211adb00 [if_io_tqg_13] 100162 D - 0xfffff801211ada00 [if_io_tqg_14] 100163 D - 0xfffff801211ad900 [if_io_tqg_15] 100164 D - 0xfffff801211ad800 [if_io_tqg_16] 100165 D - 0xfffff801211ad700 [if_io_tqg_17] 100166 D - 0xfffff801211ad600 [if_io_tqg_18] 100167 D - 0xfffff801211ad500 [if_io_tqg_19] 100168 D - 0xfffff801211ad400 [if_io_tqg_20] 100169 D - 0xfffff801211ad300 [if_io_tqg_21] 100170 D - 0xfffff801211ad200 [if_io_tqg_22] 100171 D - 0xfffff801211ad100 [if_io_tqg_23] 100173 D - 0xfffff80121508400 [if_config_tqg_0] 100195 D - 0xfffff80121ff2600 [/media trim] db:0:ps> allt Tracing command sh pid 56657 tid 100450 td 0xfffff80121ce5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ebdf630 mi_switch() at mi_switch+0x167/frame 0xfffffe104ebdf660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ebdf6a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104ebdf700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104ebdf730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe104ebdf7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe104ebdf7d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe104ebdf830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe104ebdf860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe104ebdf8c0 dofileread() at dofileread+0xcf/frame 0xfffffe104ebdf900 kern_readv() at kern_readv+0x68/frame 0xfffffe104ebdf950 sys_read() at sys_read+0x84/frame 0xfffffe104ebdf9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ebdfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ebdfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800bd7e3a, rsp = 0x7fffffffea68, rbp = 0x7fffffffeac0 --- Tracing command lockf pid 1110 tid 100570 td 0xfffff80235402000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f01c7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f01c7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f01c820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f01c850 _sleep() at _sleep+0x338/frame 0xfffffe104f01c8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f01cbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f01cc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f01ccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f01cdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f01d0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f01d480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f01d4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f01d5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f01d600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f01d6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f01d820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f01d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f01dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f01dab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1109 tid 100569 td 0xfffff80235402500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f0177b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f0177e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f017820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f017850 _sleep() at _sleep+0x338/frame 0xfffffe104f0178f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f017be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f017c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f017cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f017dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f0180a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f018480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f0184b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f0185d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f018600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f0186b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f018820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f0189a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f018ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f018ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1108 tid 100568 td 0xfffff80235402a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f0127b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f0127e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f012820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f012850 _sleep() at _sleep+0x338/frame 0xfffffe104f0128f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f012be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f012c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f012cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f012dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f0130a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f013480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f0134b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f0135d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f013600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f0136b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f013820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f0139a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f013ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f013ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1107 tid 100567 td 0xfffff80235403000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f00d7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f00d7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f00d820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f00d850 _sleep() at _sleep+0x338/frame 0xfffffe104f00d8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f00dbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f00dc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f00dcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f00ddc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f00e0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f00e480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f00e4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f00e5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f00e600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f00e6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f00e820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f00e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f00eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f00eab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1106 tid 100566 td 0xfffff80235403500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f0087b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f0087e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f008820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f008850 _sleep() at _sleep+0x338/frame 0xfffffe104f0088f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f008be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f008c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f008cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f008dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f0090a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f009480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f0094b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f0095d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f009600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f0096b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f009820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f0099a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f009ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f009ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1105 tid 100565 td 0xfffff80235403a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104f0037b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104f0037e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104f003820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104f003850 _sleep() at _sleep+0x338/frame 0xfffffe104f0038f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104f003be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104f003c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104f003cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104f003dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104f0040a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104f004480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104f0044b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104f0045d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104f004600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104f0046b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104f004820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104f0049a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104f004ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104f004ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1104 tid 100564 td 0xfffff80235404000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104effa7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104effa7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104effa820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104effa850 _sleep() at _sleep+0x338/frame 0xfffffe104effa8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104effabe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104effac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104effacc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104effadc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104effb0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104effb480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104effb4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104effb5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104effb600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104effb6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104effb820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104effb9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104effbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104effbab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1103 tid 100563 td 0xfffff80235404500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eff57b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eff57e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eff5820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eff5850 _sleep() at _sleep+0x338/frame 0xfffffe104eff58f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eff5be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eff5c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eff5cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eff5dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eff60a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eff6480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eff64b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eff65d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eff6600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eff66b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eff6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eff69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eff6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eff6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1102 tid 100207 td 0xfffff8013204ba00 kdb_alt_break_internal() at kdb_alt_break_internal+0x18e/frame 0xfffffe104863a4e0 kdb_alt_break() at kdb_alt_break+0xb/frame 0xfffffe104863a4f0 uart_intr_rxready() at uart_intr_rxready+0x98/frame 0xfffffe104863a520 uart_intr() at uart_intr+0x121/frame 0xfffffe104863a560 intr_event_handle() at intr_event_handle+0x9c/frame 0xfffffe104863a5b0 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe104863a5e0 lapic_handle_intr() at lapic_handle_intr+0x68/frame 0xfffffe104863a620 Xapic_isr1() at Xapic_isr1+0xb7/frame 0xfffffe104863a620 --- interrupt, rip = 0xffffffff80c79302, rsp = 0xfffffe104863a6f0, rbp = 0xfffffe104863a870 --- udp6_send() at udp6_send+0x232/frame 0xfffffe104863a870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104863a8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104863abe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104863ac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104863acc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104863adc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104863b0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104863b480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104863b4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104863b5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104863b600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104863b6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104863b820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104863b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104863bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104863bab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1101 tid 100216 td 0xfffff80132058a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10486d07b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10486d07e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10486d0820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10486d0850 _sleep() at _sleep+0x338/frame 0xfffffe10486d08f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe10486d0be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe10486d0c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe10486d0cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe10486d0dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10486d10a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe10486d1480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10486d14b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10486d15d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe10486d1600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10486d16b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe10486d1820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10486d19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10486d1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10486d1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1100 tid 100465 td 0xfffff80121bbfa00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100593acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100593ad10 trap() at trap+0x3a/frame 0xfffffe100593af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100593af20 --- trap 0x13, rip = 0xffffffff80a4a7c2, rsp = 0xfffffe104ed81630, rbp = 0xfffffe104ed816a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x122/frame 0xfffffe104ed816a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ed816e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ed81870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ed818f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ed81be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ed81c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ed81cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ed81dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ed820a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ed82480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ed824b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ed825d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ed82600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ed826b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ed82820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ed829a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ed82ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ed82ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1099 tid 100466 td 0xfffff80121bbf500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ed867b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ed867e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ed86820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ed86850 _sleep() at _sleep+0x338/frame 0xfffffe104ed868f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ed86be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ed86c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ed86cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ed86dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ed870a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ed87480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ed874b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ed875d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ed87600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ed876b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ed87820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ed879a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ed87ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ed87ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1098 tid 100464 td 0xfffff80121bc7000 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81cf8eb0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff81cf8ed0 trap() at trap+0x3a/frame 0xffffffff81cf90e0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81cf90e0 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104ed7c630, rbp = 0xfffffe104ed7c6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104ed7c6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ed7c6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ed7c870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ed7c8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ed7cbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ed7cc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ed7ccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ed7cdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ed7d0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ed7d480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ed7d4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ed7d5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ed7d600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ed7d6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ed7d820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ed7d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ed7dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ed7dab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1097 tid 100562 td 0xfffff80235404a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe10059a2cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe10059a2d10 trap() at trap+0x3a/frame 0xfffffe10059a2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe10059a2f20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104eff0630, rbp = 0xfffffe104eff06a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104eff06a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104eff06e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104eff0870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104eff08f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104eff0be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eff0c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eff0cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eff0dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eff10a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eff1480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eff14b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eff15d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eff1600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eff16b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eff1820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eff19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eff1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eff1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1096 tid 100561 td 0xfffff801211bd000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efeb7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efeb7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efeb820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efeb850 _sleep() at _sleep+0x338/frame 0xfffffe104efeb8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efebbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efebc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efebcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efebdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efec0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efec480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efec4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efec5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efec600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efec6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efec820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efec9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efecab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efecab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1095 tid 100560 td 0xfffff801211bd500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0f8f7e6cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0f8f7e6d10 trap() at trap+0x3a/frame 0xfffffe0f8f7e6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f8f7e6f20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104efe6630, rbp = 0xfffffe104efe66a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104efe66a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104efe66e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104efe6870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104efe68f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104efe6be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efe6c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efe6cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efe6dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efe70a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efe7480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efe74b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efe75d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efe7600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efe76b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efe7820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efe79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efe7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efe7ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1094 tid 100202 td 0xfffff80121c6a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10486217b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10486217e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048621820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048621850 _sleep() at _sleep+0x338/frame 0xfffffe10486218f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048621be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048621c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048621cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048621dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10486220a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe1048622480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10486224b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10486225d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048622600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10486226b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe1048622820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10486229a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048622ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048622ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1093 tid 100236 td 0xfffff8012147b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104e7937b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104e7937e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104e793820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104e793850 _sleep() at _sleep+0x338/frame 0xfffffe104e7938f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104e793be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104e793c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104e793cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104e793dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104e7940a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104e794480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104e7944b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104e7945d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104e794600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104e7946b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104e794820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104e7949a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104e794ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104e794ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1092 tid 100240 td 0xfffff80121473a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104e7b67b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104e7b67e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104e7b6820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104e7b6850 _sleep() at _sleep+0x338/frame 0xfffffe104e7b68f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104e7b6be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104e7b6c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104e7b6cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104e7b6dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104e7b70a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104e7b7480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104e7b74b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104e7b75d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104e7b7600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104e7b76b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104e7b7820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104e7b79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104e7b7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104e7b7ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1091 tid 100479 td 0xfffff80121473500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104edc77b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104edc77e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104edc7820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104edc7850 _sleep() at _sleep+0x338/frame 0xfffffe104edc78f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104edc7be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104edc7c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104edc7cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104edc7dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104edc80a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104edc8480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104edc84b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104edc85d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104edc8600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104edc86b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104edc8820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104edc89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104edc8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104edc8ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1090 tid 100559 td 0xfffff80235308000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efe17b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efe17e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efe1820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efe1850 _sleep() at _sleep+0x338/frame 0xfffffe104efe18f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efe1be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efe1c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efe1cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efe1dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efe20a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efe2480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efe24b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efe25d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efe2600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efe26b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efe2820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efe29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efe2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efe2ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1089 tid 100558 td 0xfffff80235308500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efdc7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efdc7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efdc820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efdc850 _sleep() at _sleep+0x338/frame 0xfffffe104efdc8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efdcbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efdcc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efdccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efdcdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efdd0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efdd480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efdd4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efdd5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efdd600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efdd6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efdd820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efdd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efddab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efddab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1088 tid 100557 td 0xfffff80235308a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100596acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100596ad10 trap() at trap+0x3a/frame 0xfffffe100596af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100596af20 --- trap 0x13, rip = 0xffffffff80a4a7c0, rsp = 0xfffffe104efd7630, rbp = 0xfffffe104efd76a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x120/frame 0xfffffe104efd76a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104efd76e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104efd7870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104efd78f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104efd7be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efd7c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efd7cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efd7dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efd80a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efd8480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efd84b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efd85d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efd8600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efd86b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efd8820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efd89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efd8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efd8ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1087 tid 100556 td 0xfffff8023530a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efd27b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efd27e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efd2820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efd2850 _sleep() at _sleep+0x338/frame 0xfffffe104efd28f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efd2be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efd2c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efd2cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efd2dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efd30a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efd3480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efd34b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efd35d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efd3600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efd36b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efd3820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efd39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efd3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efd3ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1086 tid 100555 td 0xfffff8023530a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efcd7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efcd7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efcd820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efcd850 _sleep() at _sleep+0x338/frame 0xfffffe104efcd8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efcdbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efcdc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efcdcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efcddc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efce0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efce480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efce4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efce5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efce600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efce6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efce820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efce9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efceab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efceab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1085 tid 100554 td 0xfffff8023530aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efc87b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efc87e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efc8820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efc8850 _sleep() at _sleep+0x338/frame 0xfffffe104efc88f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efc8be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efc8c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efc8cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efc8dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efc90a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efc9480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efc94b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efc95d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efc9600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efc96b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efc9820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efc99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efc9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efc9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1084 tid 100553 td 0xfffff8022fe26000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0f8f7fecf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0f8f7fed10 trap() at trap+0x3a/frame 0xfffffe0f8f7fef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f8f7fef20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104efc3630, rbp = 0xfffffe104efc36a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104efc36a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104efc36e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104efc3870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104efc38f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104efc3be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efc3c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efc3cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efc3dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efc40a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efc4480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efc44b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efc45d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efc4600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efc46b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efc4820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efc49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efc4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efc4ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1083 tid 100552 td 0xfffff8022fe26500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0f8f7d6cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0f8f7d6d10 trap() at trap+0x3a/frame 0xfffffe0f8f7d6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f8f7d6f20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104efbe630, rbp = 0xfffffe104efbe6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104efbe6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104efbe6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104efbe870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104efbe8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104efbebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efbec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efbecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efbedc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efbf0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efbf480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efbf4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efbf5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efbf600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efbf6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efbf820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efbf9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efbfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efbfab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1082 tid 100551 td 0xfffff8022fe26a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efb97b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efb97e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efb9820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efb9850 _sleep() at _sleep+0x338/frame 0xfffffe104efb98f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efb9be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efb9c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efb9cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efb9dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efba0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efba480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efba4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efba5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efba600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efba6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efba820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efba9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efbaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efbaab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1081 tid 100550 td 0xfffff8022fe27000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efb47b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efb47e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efb4820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efb4850 _sleep() at _sleep+0x338/frame 0xfffffe104efb48f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efb4be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efb4c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efb4cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efb4dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efb50a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efb5480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efb54b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efb55d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efb5600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efb56b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efb5820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efb59a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efb5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efb5ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1080 tid 100549 td 0xfffff8022fe27500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efaf7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efaf7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efaf820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efaf850 _sleep() at _sleep+0x338/frame 0xfffffe104efaf8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efafbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efafc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efafcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efafdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efb00a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efb0480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efb04b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efb05d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efb0600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efb06b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efb0820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efb09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efb0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efb0ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1079 tid 100548 td 0xfffff8022fe27a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efaa7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efaa7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efaa820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efaa850 _sleep() at _sleep+0x338/frame 0xfffffe104efaa8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efaabe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efaac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efaacc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efaadc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efab0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efab480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efab4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efab5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efab600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efab6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efab820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efab9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efabab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efabab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1078 tid 100547 td 0xfffff80235090000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efa57b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efa57e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efa5820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efa5850 _sleep() at _sleep+0x338/frame 0xfffffe104efa58f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efa5be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efa5c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efa5cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efa5dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efa60a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efa6480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efa64b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efa65d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efa6600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efa66b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efa6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efa69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efa6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efa6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1077 tid 100546 td 0xfffff80235090500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104efa07b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104efa07e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104efa0820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104efa0850 _sleep() at _sleep+0x338/frame 0xfffffe104efa08f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104efa0be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104efa0c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104efa0cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104efa0dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104efa10a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104efa1480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104efa14b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104efa15d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104efa1600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104efa16b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104efa1820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104efa19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104efa1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104efa1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1076 tid 100545 td 0xfffff80235090a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005932cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005932d10 trap() at trap+0x3a/frame 0xfffffe1005932f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005932f20 --- trap 0x13, rip = 0xffffffff80a4a7c8, rsp = 0xfffffe104ef9b630, rbp = 0xfffffe104ef9b6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x128/frame 0xfffffe104ef9b6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ef9b6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ef9b870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ef9b8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ef9bbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef9bc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef9bcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef9bdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef9c0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef9c480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef9c4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef9c5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef9c600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef9c6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef9c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef9c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef9cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef9cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1075 tid 100544 td 0xfffff80235115000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef967b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef967e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef96820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef96850 _sleep() at _sleep+0x338/frame 0xfffffe104ef968f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef96be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef96c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef96cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef96dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef970a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef97480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef974b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef975d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef97600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef976b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef97820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef979a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef97ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef97ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1074 tid 100543 td 0xfffff80235115500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef917b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef917e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef91820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef91850 _sleep() at _sleep+0x338/frame 0xfffffe104ef918f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef91be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef91c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef91cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef91dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef920a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef92480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef924b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef925d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef92600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef926b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef92820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef929a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef92ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef92ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1073 tid 100542 td 0xfffff80235115a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef8c7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef8c7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef8c820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef8c850 _sleep() at _sleep+0x338/frame 0xfffffe104ef8c8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef8cbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef8cc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef8ccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef8cdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef8d0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef8d480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef8d4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef8d5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef8d600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef8d6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef8d820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef8d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef8dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef8dab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1072 tid 100541 td 0xfffff80235116000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef877b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef877e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef87820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef87850 _sleep() at _sleep+0x338/frame 0xfffffe104ef878f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef87be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef87c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef87cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef87dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef880a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef88480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef884b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef885d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef88600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef886b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef88820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef889a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef88ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef88ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1071 tid 100540 td 0xfffff80235116500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef827b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef827e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef82820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef82850 _sleep() at _sleep+0x338/frame 0xfffffe104ef828f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef82be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef82c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef82cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef82dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef830a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef83480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef834b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef835d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef83600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef836b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef83820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef839a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef83ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef83ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1070 tid 100539 td 0xfffff80235116a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0f8f7f6cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0f8f7f6d10 trap() at trap+0x3a/frame 0xfffffe0f8f7f6f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f8f7f6f20 --- trap 0x13, rip = 0xffffffff80a4a7d1, rsp = 0xfffffe104ef7d630, rbp = 0xfffffe104ef7d6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x131/frame 0xfffffe104ef7d6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ef7d6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ef7d870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ef7d8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ef7dbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef7dc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef7dcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef7ddc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef7e0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef7e480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef7e4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef7e5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef7e600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef7e6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef7e820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef7e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef7eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef7eab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1069 tid 100538 td 0xfffff80235117000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef607b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef607e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef60820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef60850 _sleep() at _sleep+0x338/frame 0xfffffe104ef608f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef60be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef60c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef60cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef60dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef610a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef61480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef614b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef615d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef61600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef616b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef61820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef619a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef61ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef61ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1068 tid 100537 td 0xfffff80235117500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef5b7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef5b7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef5b820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef5b850 _sleep() at _sleep+0x338/frame 0xfffffe104ef5b8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef5bbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef5bc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef5bcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef5bdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef5c0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef5c480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef5c4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef5c5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef5c600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef5c6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef5c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef5c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef5cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef5cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1067 tid 100536 td 0xfffff80235117a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef567b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef567e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef56820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef56850 _sleep() at _sleep+0x338/frame 0xfffffe104ef568f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef56be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef56c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef56cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef56dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef570a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef57480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef574b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef575d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef57600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef576b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef57820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef579a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef57ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef57ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1066 tid 100535 td 0xfffff8023501d000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef4e7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef4e7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef4e820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef4e850 _sleep() at _sleep+0x338/frame 0xfffffe104ef4e8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef4ebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef4ec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef4ecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef4edc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef4f0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef4f480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef4f4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef4f5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef4f600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef4f6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef4f820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef4f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef4fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef4fab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1065 tid 100534 td 0xfffff8023501d500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef347b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef347e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef34820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef34850 _sleep() at _sleep+0x338/frame 0xfffffe104ef348f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef34be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef34c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef34cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef34dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef350a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef35480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef354b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef355d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef35600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef356b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef35820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef359a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef35ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef35ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1064 tid 100533 td 0xfffff8023501da00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef2f7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef2f7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef2f820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef2f850 _sleep() at _sleep+0x338/frame 0xfffffe104ef2f8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef2fbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef2fc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef2fcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef2fdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef300a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef30480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef304b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef305d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef30600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef306b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef30820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef309a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef30ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef30ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1063 tid 100532 td 0xfffff8023501e000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef2a7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef2a7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef2a820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef2a850 _sleep() at _sleep+0x338/frame 0xfffffe104ef2a8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef2abe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef2ac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef2acc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef2adc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef2b0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef2b480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef2b4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef2b5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef2b600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef2b6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef2b820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef2b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef2bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef2bab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1062 tid 100531 td 0xfffff8023501e500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005942cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005942d10 trap() at trap+0x3a/frame 0xfffffe1005942f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005942f20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104ef25630, rbp = 0xfffffe104ef256a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104ef256a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ef256e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ef25870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ef258f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ef25be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef25c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef25cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef25dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef260a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef26480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef264b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef265d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef26600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef266b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef26820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef269a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef26ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef26ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1061 tid 100530 td 0xfffff8023501ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef207b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef207e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef20820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef20850 _sleep() at _sleep+0x338/frame 0xfffffe104ef208f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef20be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef20c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef20cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef20dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef210a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef21480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef214b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef215d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef21600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef216b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef21820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef219a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef21ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef21ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1060 tid 100529 td 0xfffff8023501f000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ef1b7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ef1b7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ef1b820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ef1b850 _sleep() at _sleep+0x338/frame 0xfffffe104ef1b8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ef1bbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ef1bc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ef1bcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ef1bdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ef1c0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ef1c480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ef1c4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ef1c5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ef1c600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ef1c6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ef1c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ef1c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ef1cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ef1cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1059 tid 100528 td 0xfffff8023501f500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eefe7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eefe7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eefe820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eefe850 _sleep() at _sleep+0x338/frame 0xfffffe104eefe8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eefebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eefec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eefecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eefedc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eeff0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eeff480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eeff4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eeff5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eeff600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eeff6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eeff820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eeff9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eeffab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eeffab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1058 tid 100527 td 0xfffff8023501fa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eef97b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eef97e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eef9820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eef9850 _sleep() at _sleep+0x338/frame 0xfffffe104eef98f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eef9be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eef9c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eef9cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eef9dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eefa0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eefa480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eefa4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eefa5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eefa600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eefa6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eefa820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eefa9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eefaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eefaab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1057 tid 100191 td 0xfffff80121f12500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10485507b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10485507e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048550820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048550850 _sleep() at _sleep+0x338/frame 0xfffffe10485508f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048550be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048550c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048550cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048550dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10485510a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe1048551480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10485514b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10485515d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048551600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10485516b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe1048551820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10485519a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048551ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048551ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1056 tid 100461 td 0xfffff80143fe3000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ec177b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ec177e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ec17820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ec17850 _sleep() at _sleep+0x338/frame 0xfffffe104ec178f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ec17be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ec17c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ec17cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ec17dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ec180a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ec18480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ec184b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ec185d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ec18600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ec186b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ec18820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ec189a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ec18ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ec18ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1055 tid 100526 td 0xfffff801439a1000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eef47b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eef47e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eef4820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eef4850 _sleep() at _sleep+0x338/frame 0xfffffe104eef48f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eef4be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eef4c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eef4cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eef4dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eef50a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eef5480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eef54b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eef55d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eef5600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eef56b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eef5820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eef59a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eef5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eef5ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1054 tid 100525 td 0xfffff801439a1500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eeef7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eeef7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eeef820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eeef850 _sleep() at _sleep+0x338/frame 0xfffffe104eeef8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eeefbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eeefc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eeefcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eeefdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eef00a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eef0480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eef04b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eef05d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eef0600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eef06b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eef0820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eef09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eef0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eef0ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1053 tid 100524 td 0xfffff801439a1a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eeea7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eeea7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eeea820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eeea850 _sleep() at _sleep+0x338/frame 0xfffffe104eeea8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eeeabe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eeeac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eeeacc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eeeadc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eeeb0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eeeb480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eeeb4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eeeb5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eeeb600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eeeb6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eeeb820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eeeb9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eeebab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eeebab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1052 tid 100523 td 0xfffff801439a9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eee57b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eee57e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eee5820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eee5850 _sleep() at _sleep+0x338/frame 0xfffffe104eee58f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eee5be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eee5c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eee5cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eee5dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eee60a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eee6480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eee64b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eee65d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eee6600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eee66b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eee6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eee69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eee6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eee6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1051 tid 100522 td 0xfffff801439a9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eee07b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eee07e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eee0820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eee0850 _sleep() at _sleep+0x338/frame 0xfffffe104eee08f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eee0be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eee0c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eee0cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eee0dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eee10a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eee1480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eee14b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eee15d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eee1600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eee16b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eee1820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eee19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eee1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eee1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1050 tid 100521 td 0xfffff801439a9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eedb7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eedb7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eedb820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eedb850 _sleep() at _sleep+0x338/frame 0xfffffe104eedb8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eedbbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eedbc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eedbcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eedbdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eedc0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eedc480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eedc4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eedc5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eedc600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eedc6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eedc820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eedc9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eedcab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eedcab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1049 tid 100520 td 0xfffff801439aa000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eed67b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eed67e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eed6820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eed6850 _sleep() at _sleep+0x338/frame 0xfffffe104eed68f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eed6be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eed6c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eed6cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eed6dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eed70a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eed7480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eed74b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eed75d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eed7600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eed76b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eed7820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eed79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eed7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eed7ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1048 tid 100519 td 0xfffff801439aa500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0f8f7eecf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0f8f7eed10 trap() at trap+0x3a/frame 0xfffffe0f8f7eef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0f8f7eef20 --- trap 0x13, rip = 0xffffffff80a4a7c0, rsp = 0xfffffe104eed1630, rbp = 0xfffffe104eed16a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x120/frame 0xfffffe104eed16a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104eed16e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104eed1870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104eed18f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104eed1be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eed1c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eed1cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eed1dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eed20a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eed2480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eed24b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eed25d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eed2600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eed26b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eed2820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eed29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eed2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eed2ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1047 tid 100455 td 0xfffff8013219ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ebf77b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ebf77e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ebf7820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ebf7850 _sleep() at _sleep+0x338/frame 0xfffffe104ebf78f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ebf7be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ebf7c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ebf7cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ebf7dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ebf80a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ebf8480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ebf84b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ebf85d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ebf8600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ebf86b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ebf8820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ebf89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ebf8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ebf8ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1046 tid 100518 td 0xfffff8022fdf6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eecc7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eecc7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eecc820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eecc850 _sleep() at _sleep+0x338/frame 0xfffffe104eecc8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eeccbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eeccc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eecccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eeccdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eecd0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eecd480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eecd4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eecd5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eecd600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eecd6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eecd820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eecd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eecdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eecdab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1045 tid 100517 td 0xfffff8022fdf9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eec77b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eec77e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eec7820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eec7850 _sleep() at _sleep+0x338/frame 0xfffffe104eec78f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eec7be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eec7c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eec7cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eec7dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eec80a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eec8480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eec84b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eec85d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eec8600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eec86b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eec8820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eec89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eec8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eec8ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1044 tid 100516 td 0xfffff8022fdf9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eeaa7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eeaa7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eeaa820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eeaa850 _sleep() at _sleep+0x338/frame 0xfffffe104eeaa8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eeaabe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eeaac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eeaacc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eeaadc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eeab0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eeab480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eeab4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eeab5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eeab600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eeab6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eeab820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eeab9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eeabab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eeabab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1043 tid 100515 td 0xfffff8022fdf9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eea57b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eea57e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eea5820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eea5850 _sleep() at _sleep+0x338/frame 0xfffffe104eea58f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eea5be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eea5c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eea5cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eea5dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eea60a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eea6480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eea64b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eea65d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eea6600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eea66b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eea6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eea69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eea6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eea6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1042 tid 100514 td 0xfffff8022fbba000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104eea07b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104eea07e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104eea0820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104eea0850 _sleep() at _sleep+0x338/frame 0xfffffe104eea08f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104eea0be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104eea0c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104eea0cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104eea0dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104eea10a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104eea1480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104eea14b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104eea15d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104eea1600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104eea16b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104eea1820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104eea19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104eea1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104eea1ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1041 tid 100513 td 0xfffff8022fbba500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005972cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005972d10 trap() at trap+0x3a/frame 0xfffffe1005972f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005972f20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104ee86630, rbp = 0xfffffe104ee866a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104ee866a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ee866e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ee86870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ee868f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ee86be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee86c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee86cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee86dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee870a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee87480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee874b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee875d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee87600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee876b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee87820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee879a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee87ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee87ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1040 tid 100512 td 0xfffff8022fbbaa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee817b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee817e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee81820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee81850 _sleep() at _sleep+0x338/frame 0xfffffe104ee818f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee81be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee81c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee81cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee81dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee820a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee82480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee824b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee825d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee82600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee826b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee82820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee829a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee82ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee82ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1039 tid 100511 td 0xfffff8022fbbb000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee7c7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee7c7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee7c820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee7c850 _sleep() at _sleep+0x338/frame 0xfffffe104ee7c8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee7cbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee7cc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee7ccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee7cdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee7d0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee7d480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee7d4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee7d5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee7d600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee7d6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee7d820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee7d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee7dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee7dab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1038 tid 100510 td 0xfffff8022fbbb500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee777b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee777e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee77820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee77850 _sleep() at _sleep+0x338/frame 0xfffffe104ee778f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee77be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee77c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee77cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee77dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee780a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee78480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee784b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee785d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee78600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee786b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee78820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee789a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee78ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee78ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1037 tid 100509 td 0xfffff8022fbbba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee727b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee727e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee72820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee72850 _sleep() at _sleep+0x338/frame 0xfffffe104ee728f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee72be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee72c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee72cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee72dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee730a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee73480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee734b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee735d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee73600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee736b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee73820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee739a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee73ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee73ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1036 tid 100508 td 0xfffff8022fbbc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee6d7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee6d7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee6d820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee6d850 _sleep() at _sleep+0x338/frame 0xfffffe104ee6d8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee6dbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee6dc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee6dcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee6ddc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee6e0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee6e480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee6e4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee6e5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee6e600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee6e6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee6e820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee6e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee6eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee6eab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1035 tid 100507 td 0xfffff8022fbbc500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee597b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee597e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee59820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee59850 _sleep() at _sleep+0x338/frame 0xfffffe104ee598f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee59be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee59c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee59cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee59dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee5a0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee5a480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee5a4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee5a5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee5a600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee5a6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee5a820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee5a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee5aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee5aab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1034 tid 100506 td 0xfffff8022fbbca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee4e7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee4e7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee4e820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee4e850 _sleep() at _sleep+0x338/frame 0xfffffe104ee4e8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee4ebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee4ec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee4ecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee4edc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee4f0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee4f480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee4f4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee4f5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee4f600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee4f6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee4f820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee4f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee4fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee4fab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1033 tid 100505 td 0xfffff8022fc03000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee497b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee497e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee49820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee49850 _sleep() at _sleep+0x338/frame 0xfffffe104ee498f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee49be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee49c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee49cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee49dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee4a0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee4a480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee4a4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee4a5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee4a600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee4a6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee4a820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee4a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee4aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee4aab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1032 tid 100504 td 0xfffff8022fc03500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee447b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee447e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee44820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee44850 _sleep() at _sleep+0x338/frame 0xfffffe104ee448f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee44be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee44c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee44cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee44dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee450a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee45480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee454b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee455d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee45600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee456b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee45820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee459a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee45ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee45ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1031 tid 100503 td 0xfffff8022fc03a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005982cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005982d10 trap() at trap+0x3a/frame 0xfffffe1005982f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005982f20 --- trap 0x13, rip = 0xffffffff80a4a7c2, rsp = 0xfffffe104ee3f630, rbp = 0xfffffe104ee3f6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x122/frame 0xfffffe104ee3f6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ee3f6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ee3f870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ee3f8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ee3fbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee3fc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee3fcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee3fdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee400a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee40480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee404b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee405d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee40600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee406b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee40820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee409a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee40ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee40ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1030 tid 100502 td 0xfffff8022fc04000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee3a7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee3a7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee3a820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee3a850 _sleep() at _sleep+0x338/frame 0xfffffe104ee3a8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee3abe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee3ac80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee3acc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee3adc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee3b0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee3b480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee3b4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee3b5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee3b600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee3b6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee3b820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee3b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee3bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee3bab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1029 tid 100501 td 0xfffff8022fc04500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee357b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee357e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee35820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee35850 _sleep() at _sleep+0x338/frame 0xfffffe104ee358f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee35be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee35c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee35cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee35dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee360a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee36480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee364b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee365d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee36600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee366b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee36820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee369a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee36ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee36ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1028 tid 100500 td 0xfffff8022fc04a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee307b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee307e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee30820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee30850 _sleep() at _sleep+0x338/frame 0xfffffe104ee308f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee30be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee30c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee30cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee30dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee310a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee31480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee314b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee315d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee31600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee316b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee31820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee319a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee31ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee31ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1027 tid 100499 td 0xfffff8022fc05000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee2b7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee2b7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee2b820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee2b850 _sleep() at _sleep+0x338/frame 0xfffffe104ee2b8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee2bbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee2bc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee2bcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee2bdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee2c0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee2c480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee2c4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee2c5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee2c600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee2c6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee2c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee2c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee2cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee2cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1026 tid 100498 td 0xfffff8022fc05500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee267b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee267e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee26820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee26850 _sleep() at _sleep+0x338/frame 0xfffffe104ee268f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee26be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee26c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee26cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee26dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee270a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee27480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee274b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee275d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee27600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee276b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee27820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee279a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee27ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee27ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1025 tid 100497 td 0xfffff8022fc05a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee217b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee217e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee21820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee21850 _sleep() at _sleep+0x338/frame 0xfffffe104ee218f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee21be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee21c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee21cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee21dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee220a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee22480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee224b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee225d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee22600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee226b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee22820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee229a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee22ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee22ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1024 tid 100184 td 0xfffff80121c6aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484f77b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10484f77e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484f7820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484f7850 _sleep() at _sleep+0x338/frame 0xfffffe10484f78f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe10484f7be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe10484f7c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe10484f7cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe10484f7dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10484f80a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe10484f8480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10484f84b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10484f85d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe10484f8600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10484f86b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe10484f8820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10484f89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10484f8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10484f8ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1023 tid 100217 td 0xfffff80121797000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100595acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100595ad10 trap() at trap+0x3a/frame 0xfffffe100595af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100595af20 --- trap 0x13, rip = 0xffffffff80a4a7c8, rsp = 0xfffffe10486d5630, rbp = 0xfffffe10486d56a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x128/frame 0xfffffe10486d56a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe10486d56e0 udp6_send() at udp6_send+0x78/frame 0xfffffe10486d5870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe10486d58f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe10486d5be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe10486d5c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe10486d5cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe10486d5dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10486d60a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe10486d6480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10486d64b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10486d65d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe10486d6600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10486d66b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe10486d6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10486d69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10486d6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10486d6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1022 tid 100183 td 0xfffff8012147b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484f27b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10484f27e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484f2820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484f2850 _sleep() at _sleep+0x338/frame 0xfffffe10484f28f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe10484f2be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe10484f2c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe10484f2cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe10484f2dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10484f30a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe10484f3480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10484f34b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10484f35d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe10484f3600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10484f36b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe10484f3820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10484f39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10484f3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10484f3ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1021 tid 100219 td 0xfffff801322a6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10486df7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10486df7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10486df820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10486df850 _sleep() at _sleep+0x338/frame 0xfffffe10486df8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe10486dfbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe10486dfc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe10486dfcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe10486dfdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10486e00a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe10486e0480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10486e04b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10486e05d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe10486e0600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10486e06b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe10486e0820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10486e09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10486e0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10486e0ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1020 tid 100226 td 0xfffff80121d15a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10487027b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10487027e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048702820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048702850 _sleep() at _sleep+0x338/frame 0xfffffe10487028f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048702be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048702c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048702cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048702dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10487030a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe1048703480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10487034b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10487035d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048703600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10487036b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe1048703820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10487039a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048703ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048703ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1019 tid 100449 td 0xfffff801216caa00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100598acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100598ad10 trap() at trap+0x3a/frame 0xfffffe100598af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100598af20 --- trap 0x13, rip = 0xffffffff80a4a7cc, rsp = 0xfffffe104ebd9630, rbp = 0xfffffe104ebd96a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x12c/frame 0xfffffe104ebd96a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104ebd96e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104ebd9870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104ebd98f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104ebd9be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ebd9c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ebd9cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ebd9dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ebda0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ebda480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ebda4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ebda5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ebda600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ebda6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ebda820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ebda9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ebdaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ebdaab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1018 tid 100459 td 0xfffff80143fe3500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ec0d7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ec0d7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ec0d820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ec0d850 _sleep() at _sleep+0x338/frame 0xfffffe104ec0d8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ec0dbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ec0dc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ec0dcc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ec0ddc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ec0e0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ec0e480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ec0e4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ec0e5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ec0e600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ec0e6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ec0e820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ec0e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ec0eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ec0eab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1017 tid 100474 td 0xfffff80121796000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104edae7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104edae7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104edae820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104edae850 _sleep() at _sleep+0x338/frame 0xfffffe104edae8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104edaebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104edaec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104edaecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104edaedc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104edaf0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104edaf480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104edaf4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104edaf5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104edaf600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104edaf6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104edaf820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104edaf9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104edafab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104edafab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1016 tid 100469 td 0xfffff8012151a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ed957b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ed957e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ed95820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ed95850 _sleep() at _sleep+0x338/frame 0xfffffe104ed958f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ed95be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ed95c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ed95cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ed95dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ed960a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ed96480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ed964b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ed965d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ed96600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ed966b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ed96820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ed969a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ed96ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ed96ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1015 tid 100189 td 0xfffff80121797500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10485107b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10485107e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048510820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048510850 _sleep() at _sleep+0x338/frame 0xfffffe10485108f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048510be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048510c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048510cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048510dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10485110a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe1048511480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10485114b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10485115d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048511600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10485116b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe1048511820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10485119a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048511ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048511ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1014 tid 100211 td 0xfffff8013204b500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100594acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100594ad10 trap() at trap+0x3a/frame 0xfffffe100594af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100594af20 --- trap 0x13, rip = 0xffffffff80a4a7c5, rsp = 0xfffffe104864e630, rbp = 0xfffffe104864e6a0 --- __rw_wlock_hard() at __rw_wlock_hard+0x125/frame 0xfffffe104864e6a0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104864e6e0 udp6_send() at udp6_send+0x78/frame 0xfffffe104864e870 sosend_dgram() at sosend_dgram+0x368/frame 0xfffffe104864e8f0 clnt_dg_call() at clnt_dg_call+0x963/frame 0xfffffe104864ebe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104864ec80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104864ecc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104864edc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104864f0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104864f480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104864f4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104864f5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104864f600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104864f6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104864f820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104864f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104864fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104864fab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1013 tid 100212 td 0xfffff80132248a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10486537b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10486537e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048653820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048653850 _sleep() at _sleep+0x338/frame 0xfffffe10486538f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048653be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048653c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048653cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048653dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe10486540a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe1048654480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe10486544b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe10486545d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048654600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe10486546b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe1048654820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10486549a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048654ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048654ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1012 tid 100496 td 0xfffff80121ce5000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104ee1c7b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104ee1c7e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104ee1c820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104ee1c850 _sleep() at _sleep+0x338/frame 0xfffffe104ee1c8f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe104ee1cbe0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe104ee1cc80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe104ee1ccc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe104ee1cdc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104ee1d0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104ee1d480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104ee1d4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104ee1d5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104ee1d600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104ee1d6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104ee1d820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104ee1d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104ee1dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104ee1dab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command lockf pid 1011 tid 100210 td 0xfffff80121f3a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10486497b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10486497e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048649820 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048649850 _sleep() at _sleep+0x338/frame 0xfffffe10486498f0 clnt_dg_call() at clnt_dg_call+0x7c8/frame 0xfffffe1048649be0 clnt_call_private() at clnt_call_private+0xbe/frame 0xfffffe1048649c80 nlm4_lock_4() at nlm4_lock_4+0x50/frame 0xfffffe1048649cc0 nlm_lock_rpc() at nlm_lock_rpc+0x5c/frame 0xfffffe1048649dc0 nlm_setlock() at nlm_setlock+0x32d/frame 0xfffffe104864a0a0 nlm_advlock_internal() at nlm_advlock_internal+0x83c/frame 0xfffffe104864a480 nlm_advlock() at nlm_advlock+0x58/frame 0xfffffe104864a4b0 nfs_advlock() at nfs_advlock+0x8b/frame 0xfffffe104864a5d0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104864a600 vn_open_vnode() at vn_open_vnode+0x2e5/frame 0xfffffe104864a6b0 vn_open_cred() at vn_open_cred+0x36b/frame 0xfffffe104864a820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104864a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104864aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104864aab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800908b4a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe6d0 --- Tracing command vnlru pid 23 tid 100147 td 0xfffff8012115b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483fd8a0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483fd8d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483fd910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483fd940 _sleep() at _sleep+0x318/frame 0xfffffe10483fd9e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe10483fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 22 tid 100146 td 0xfffff8012115b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483f88c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483f88f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483f8930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483f8960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21f/frame 0xfffffe10483f89e0 sched_sync() at sched_sync+0x5fc/frame 0xfffffe10483f8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 21 tid 100145 td 0xfffff8012115ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483f3910 mi_switch() at mi_switch+0x167/frame 0xfffffe10483f3940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483f3980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483f39b0 _sleep() at _sleep+0x318/frame 0xfffffe10483f3a50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe10483f3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100144 td 0xfffff8012109a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483ee900 mi_switch() at mi_switch+0x167/frame 0xfffffe10483ee930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483ee970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483ee9a0 _sleep() at _sleep+0x318/frame 0xfffffe10483eea40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe10483eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100188 td 0xfffff801219dd500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104850c900 mi_switch() at mi_switch+0x167/frame 0xfffffe104850c930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104850c970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe104850c9a0 _sleep() at _sleep+0x318/frame 0xfffffe104850ca40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe104850ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe104850cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104850cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100194 td 0xfffff801216d7500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10485fa900 mi_switch() at mi_switch+0x167/frame 0xfffffe10485fa930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10485fa970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10485fa9a0 _sleep() at _sleep+0x318/frame 0xfffffe10485faa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe10485faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10485faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10485faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100196 td 0xfffff801216d6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048604900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048604930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048604970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10486049a0 _sleep() at _sleep+0x318/frame 0xfffffe1048604a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe1048604a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048604ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048604ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagezero pid 19 tid 100143 td 0xfffff8012109a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483e9900 mi_switch() at mi_switch+0x167/frame 0xfffffe10483e9930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483e9970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483e99a0 _sleep() at _sleep+0x318/frame 0xfffffe10483e9a40 vm_pagezero() at vm_pagezero+0x85/frame 0xfffffe10483e9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 18 tid 100142 td 0xfffff8012109aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483e48c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483e48f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483e4930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10483e4960 _sleep() at _sleep+0x338/frame 0xfffffe10483e4a00 vm_daemon() at vm_daemon+0x96/frame 0xfffffe10483e4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483e4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483e4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100141 td 0xfffff8012109b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483df820 mi_switch() at mi_switch+0x167/frame 0xfffffe10483df850 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483df890 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483df8c0 _sleep() at _sleep+0x318/frame 0xfffffe10483df960 vm_pageout() at vm_pageout+0x2b2/frame 0xfffffe10483dfa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483dfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483dfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100172 td 0xfffff8012147ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484bc910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484bc940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484bc980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484bc9b0 _sleep() at _sleep+0x338/frame 0xfffffe10484bca50 uma_reclaim_worker() at uma_reclaim_worker+0x71/frame 0xfffffe10484bca70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484bcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484bcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 16 tid 100140 td 0xfffff8012109b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483da8c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483da8f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483da930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10483da960 _sleep() at _sleep+0x338/frame 0xfffffe10483daa00 enc_daemon() at enc_daemon+0x26f/frame 0xfffffe10483daa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483daab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483daab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 15 tid 100139 td 0xfffff8012109ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483d58f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483d5920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483d5960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483d5990 _sleep() at _sleep+0x318/frame 0xfffffe10483d5a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe10483d5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483d5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483d5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 9 tid 100138 td 0xfffff8012109c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483d08f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483d0920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483d0960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483d0990 _sleep() at _sleep+0x318/frame 0xfffffe10483d0a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe10483d0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483d0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483d0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 8 tid 100137 td 0xfffff8012109c500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483cb8f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483cb920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483cb960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483cb990 _sleep() at _sleep+0x318/frame 0xfffffe10483cba30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe10483cba70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483cbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483cbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 7 tid 100136 td 0xfffff8012109ca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10483c68f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10483c6920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10483c6960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10483c6990 _sleep() at _sleep+0x318/frame 0xfffffe10483c6a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe10483c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10483c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10483c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100133 td 0xfffff80011da5a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10482378d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048237900 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048237940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1048237970 _sleep() at _sleep+0x318/frame 0xfffffe1048237a10 random_kthread() at random_kthread+0x230/frame 0xfffffe1048237a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048237ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048237ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 5 tid 100132 td 0xfffff80011da6000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048232910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048232940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048232980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10482329b0 _sleep() at _sleep+0x338/frame 0xfffffe1048232a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe1048232a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048232ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048232ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100076 td 0xfffff80011d0ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045e8c940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045e8c970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045e8c9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045e8c9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045e8ca40 usb_process() at usb_process+0x13b/frame 0xfffffe1045e8ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045e8cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045e8cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100077 td 0xfffff80011d0b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045e91940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045e91970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045e919b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045e919e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045e91a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045e91a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045e91ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045e91ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100078 td 0xfffff80011d0b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045e96940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045e96970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045e969b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045e969e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045e96a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045e96a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045e96ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045e96ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100079 td 0xfffff80011d0aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045e9b940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045e9b970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045e9b9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045e9b9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045e9ba40 usb_process() at usb_process+0x13b/frame 0xfffffe1045e9ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045e9bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045e9bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100080 td 0xfffff80011d0a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ea0940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ea0970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045ea09b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045ea09e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045ea0a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045ea0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ea0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ea0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100117 td 0xfffff80011d76000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fe5940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fe5970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fe59b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fe59e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045fe5a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045fe5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fe5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fe5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100118 td 0xfffff80011d93a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fea940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fea970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fea9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fea9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045feaa40 usb_process() at usb_process+0x13b/frame 0xfffffe1045feaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045feaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045feaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100119 td 0xfffff80011d93500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fef940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fef970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fef9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fef9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045fefa40 usb_process() at usb_process+0x13b/frame 0xfffffe1045fefa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fefab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fefab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100120 td 0xfffff80011d93000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ff4940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ff4970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045ff49b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045ff49e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045ff4a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045ff4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ff4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ff4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100121 td 0xfffff80011d8fa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ff9940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ff9970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045ff99b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045ff99e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045ff9a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045ff9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ff9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ff9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100123 td 0xfffff80011d8f000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1046186940 mi_switch() at mi_switch+0x167/frame 0xfffffe1046186970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10461869b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10461869e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1046186a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046186a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046186ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046186ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100124 td 0xfffff80011d8ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104618b940 mi_switch() at mi_switch+0x167/frame 0xfffffe104618b970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104618b9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104618b9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe104618ba40 usb_process() at usb_process+0x13b/frame 0xfffffe104618ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe104618bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104618bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100125 td 0xfffff80011d8e500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1046190940 mi_switch() at mi_switch+0x167/frame 0xfffffe1046190970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10461909b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10461909e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1046190a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046190a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046190ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046190ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100126 td 0xfffff80011d8e000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1046195940 mi_switch() at mi_switch+0x167/frame 0xfffffe1046195970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10461959b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10461959e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1046195a40 usb_process() at usb_process+0x13b/frame 0xfffffe1046195a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046195ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046195ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100127 td 0xfffff80011da7a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104619a940 mi_switch() at mi_switch+0x167/frame 0xfffffe104619a970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104619a9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104619a9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe104619aa40 usb_process() at usb_process+0x13b/frame 0xfffffe104619aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104619aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104619aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100065 td 0xfffff8000b808500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941198e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94119910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94119950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94119980 _sleep() at _sleep+0x338/frame 0xfffffe0f94119a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94119a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94119ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94119ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100066 td 0xfffff8000b808000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9411e8e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9411e910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f9411e950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9411e980 _sleep() at _sleep+0x338/frame 0xfffffe0f9411ea20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f9411ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9411eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9411eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100067 td 0xfffff8000b807a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941238e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94123910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94123950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94123980 _sleep() at _sleep+0x338/frame 0xfffffe0f94123a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94123a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94123ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94123ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100068 td 0xfffff8000b807500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941288e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94128910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94128950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94128980 _sleep() at _sleep+0x338/frame 0xfffffe0f94128a20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f94128a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94128ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94128ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100069 td 0xfffff8000b807000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9412d8e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9412d910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f9412d950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9412d980 _sleep() at _sleep+0x338/frame 0xfffffe0f9412da20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe0f9412da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9412dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9412dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100135 td 0xfffff80011da5000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10482418e0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048241910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048241950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048241980 _sleep() at _sleep+0x338/frame 0xfffffe1048241a20 xpt_scanner_thread() at xpt_scanner_thread+0xa4/frame 0xfffffe1048241a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048241ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048241ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 3 tid 100064 td 0xfffff8000b808a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941148f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94114920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94114960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94114990 _sleep() at _sleep+0x338/frame 0xfffffe0f94114a30 crypto_ret_proc() at crypto_ret_proc+0x1da/frame 0xfffffe0f94114a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94114ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94114ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100063 td 0xfffff8000b748000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9410f8f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9410f920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f9410f960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9410f990 _sleep() at _sleep+0x338/frame 0xfffffe0f9410fa30 crypto_proc() at crypto_proc+0x394/frame 0xfffffe0f9410fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9410fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9410fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100059 td 0xfffff8000b749500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940fb8f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940fb920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f940fb960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f940fb990 _sleep() at _sleep+0x338/frame 0xfffffe0f940fba30 g_run_events() at g_run_events+0x50/frame 0xfffffe0f940fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100060 td 0xfffff8000b749000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941008f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94100920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94100960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94100990 _sleep() at _sleep+0x338/frame 0xfffffe0f94100a30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe0f94100a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe0f94100a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94100ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94100ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100061 td 0xfffff8000b748a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f941058e0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94105910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94105950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f94105980 _sleep() at _sleep+0x338/frame 0xfffffe0f94105a20 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe0f94105a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0f94105a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94105ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94105ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffff8000b701000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9405b9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9405ba20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0f9405ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9405bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9405bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff8000b731a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100029 td 0xfffff8000b731500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000b731000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff8000b730a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100032 td 0xfffff8000b730500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100033 td 0xfffff8000b730000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100034 td 0xfffff8000b72fa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff8000b72f500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff8000b72f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff8000b73ca00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff8000b73c500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100039 td 0xfffff8000b73c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100040 td 0xfffff8000b73ba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xfffff8000b73b500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xfffff8000b73b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100043 td 0xfffff8000b73aa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff8000b73a500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100045 td 0xfffff8000b73a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100046 td 0xfffff8000b741a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffff8000b741500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100048 td 0xfffff8000b741000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100049 td 0xfffff8000b740a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100050 td 0xfffff8000b740500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xfffff8000b740000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940d39f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940d3a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0f940d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff8000b73fa00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100053 td 0xfffff8000b73f500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940dd9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940dda20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0f940dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffff8000b73f000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940e29f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940e2a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0f940e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffff8000b74a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100073 td 0xfffff80011d0ca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe000037f9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe000037fa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe000037fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100074 td 0xfffff80011d0c500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100075 td 0xfffff80011d0c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045e879f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045e87a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045e87a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045e87ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045e87ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100081 td 0xfffff80011d0a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ea59f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ea5a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045ea5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ea5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ea5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100082 td 0xfffff80011d56a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ef49f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ef4a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045ef4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ef4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ef4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100084 td 0xfffff80011d56000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045efe9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045efea20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045efea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045efeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045efeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100086 td 0xfffff80011d55500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f089f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f08a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f08a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f08ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f08ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100088 td 0xfffff80011d54a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f129f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f12a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f12a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f12ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f12ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100090 td 0xfffff80011d54000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f1c9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f1ca20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f1ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f1cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f1cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100092 td 0xfffff80011d5b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f269f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f26a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f26a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f26ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f26ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100094 td 0xfffff80011d5aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f309f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f30a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f30a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f30ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f30ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100096 td 0xfffff80011d5a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f3a9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f3aa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f3aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f3aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f3aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100098 td 0xfffff80011d59500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f449f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f44a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045f44a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f44ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f44ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100099 td 0xfffff80011d59000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff80011d71500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff80011d70a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff80011d70000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff80011d6f500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100109 td 0xfffff80011d78a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100111 td 0xfffff80011d78000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffff80011d77500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100115 td 0xfffff80011d76a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100116 td 0xfffff80011d76500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100122 td 0xfffff80011d8f500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10461819f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1046181a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1046181a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1046181ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1046181ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100128 td 0xfffff80011da7500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104619f9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe104619fa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe104619fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104619fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104619fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100129 td 0xfffff80011da7000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10481f59f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10481f5a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe10481f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10481f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10481f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100130 td 0xfffff80011da6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10481fd9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10481fda20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe10481fda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10481fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10481fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000b6f0000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059c4950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059c4980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059c4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000b6efa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059c9950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059c9980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000b6ef500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059ce950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059ce980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000b6ef000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059d3950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059d3980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000b6eea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059d8950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059d8980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff8000b6ee500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059dd950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059dd980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff8000b6ee000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059e2950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059e2980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059e2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059e2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059e2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff8000b700a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059e7950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059e7980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff8000b700500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059ec950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059ec980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000b700000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059f1950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059f1980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059f1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000b6ffa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059f6950 mi_switch() at mi_switch+0x167/frame 0xfffffe10059f6980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe10059f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000b6ff500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005952cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005952d10 trap() at trap+0x3a/frame 0xfffffe1005952f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005952f20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe10059fb8e0, rbp = 0xfffffe10059fb8f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe10059fb8f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe10059fb940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe10059fb960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe10059fb980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe10059fba70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000b6ff000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9401f950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9401f980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f9401fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9401fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9401fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000b6fea00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005962cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005962d10 trap() at trap+0x3a/frame 0xfffffe1005962f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005962f20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940248e0, rbp = 0xfffffe0f940248f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940248f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94024940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94024960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94024980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94024a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94024ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94024ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000b6fe500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f94029950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94029980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f94029a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94029ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94029ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000b6fe000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9402e950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9402e980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f9402ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9402eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9402eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff8000b703a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100597acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100597ad10 trap() at trap+0x3a/frame 0xfffffe100597af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100597af20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940338e0, rbp = 0xfffffe0f940338f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940338f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94033940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94033960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94033980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94033a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94033ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94033ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff8000b703500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f94038950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94038980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f94038a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94038ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94038ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff8000b703000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9403d950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9403d980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f9403da70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9403dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9403dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff8000b702a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe1005992cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe1005992d10 trap() at trap+0x3a/frame 0xfffffe1005992f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe1005992f20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940428e0, rbp = 0xfffffe0f940428f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940428f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94042940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94042960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94042980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94042a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94042ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94042ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff8000b702500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe100599acf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe100599ad10 trap() at trap+0x3a/frame 0xfffffe100599af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe100599af20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940478e0, rbp = 0xfffffe0f940478f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940478f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94047940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94047960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94047980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94047a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94047ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94047ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff8000b702000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9404c950 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9404c980 sched_idletd() at sched_idletd+0x391/frame 0xfffffe0f9404ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9404cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9404cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff8000b701a00 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe10059aacf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe10059aad10 trap() at trap+0x3a/frame 0xfffffe10059aaf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe10059aaf20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940518e0, rbp = 0xfffffe0f940518f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940518f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94051940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94051960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94051980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94051a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94051ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94051ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff8000b701500 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe10059b2cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe10059b2d10 trap() at trap+0x3a/frame 0xfffffe10059b2f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe10059b2f20 --- trap 0x13, rip = 0xffffffff8100be0f, rsp = 0xfffffe0f940568e0, rbp = 0xfffffe0f940568f0 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x3f/frame 0xfffffe0f940568f0 acpi_cpu_idle() at acpi_cpu_idle+0x2e7/frame 0xfffffe0f94056940 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0f94056960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe0f94056980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe0f94056a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94056ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94056ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b6f0500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059bf560 mi_switch() at mi_switch+0x167/frame 0xfffffe10059bf590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10059bf5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10059bf630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10059bf660 _sleep() at _sleep+0x32b/frame 0xfffffe10059bf700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10059bf7b0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe10059bf9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10059bfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10059bfab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41d3da, rsp = 0x7fffffffe728, rbp = 0x7fffffffe810 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b6f0a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10059ba910 mi_switch() at mi_switch+0x167/frame 0xfffffe10059ba940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10059ba980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10059ba9b0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe10059baa10 audit_worker() at audit_worker+0xa3/frame 0xfffffe10059baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10059baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10059baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d65cc0 sched_switch() at sched_switch+0x48a/frame 0xffffffff8213b9e0 mi_switch() at mi_switch+0x167/frame 0xffffffff8213ba10 sleepq_switch() at sleepq_switch+0xe7/frame 0xffffffff8213ba50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff8213ba80 _sleep() at _sleep+0x318/frame 0xffffffff8213bb20 swapper() at swapper+0x248/frame 0xffffffff8213bb70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100055 td 0xfffff8000b74aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940e7900 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940e7930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f940e7970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f940e79a0 _sleep() at _sleep+0x338/frame 0xfffffe0f940e7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f940e7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940e7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940e7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff8000b74a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940ec900 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940ec930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f940ec970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f940ec9a0 _sleep() at _sleep+0x338/frame 0xfffffe0f940eca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f940eca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940ecab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940ecab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff8000b749a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f940f6900 mi_switch() at mi_switch+0x167/frame 0xfffffe0f940f6930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f940f6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f940f69a0 _sleep() at _sleep+0x338/frame 0xfffffe0f940f6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f940f6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f940f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f940f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff8000b748500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9410a900 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9410a930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f9410a970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9410a9a0 _sleep() at _sleep+0x338/frame 0xfffffe0f9410aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0f9410aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9410aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9410aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000b802a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f94132910 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94132940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94132980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f941329b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0f94132a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f94132a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94132ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94132ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000b802500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f94137910 mi_switch() at mi_switch+0x167/frame 0xfffffe0f94137940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f94137980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f941379b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0f94137a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f94137a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f94137ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f94137ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000b802000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f9413c910 mi_switch() at mi_switch+0x167/frame 0xfffffe0f9413c940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe0f9413c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0f9413c9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe0f9413ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0f9413ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f9413cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f9413cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100083 td 0xfffff80011d56500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045ef9900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045ef9930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045ef9970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045ef99a0 _sleep() at _sleep+0x338/frame 0xfffffe1045ef9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045ef9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045ef9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045ef9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100085 td 0xfffff80011d55a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f03900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f03930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f03970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f039a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f03a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f03a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f03ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f03ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100087 td 0xfffff80011d55000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f0d900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f0d930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f0d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f0d9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f0da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f0da70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f0dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f0dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100089 td 0xfffff80011d54500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f17900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f17930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f17970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f179a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f17a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f17a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f17ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f17ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100091 td 0xfffff80011d5ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f21900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f21930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f21970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f219a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f21a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f21a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f21ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f21ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100093 td 0xfffff80011d5b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f2b900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f2b930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f2b970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f2b9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f2ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f2ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f2bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f2bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100095 td 0xfffff80011d5a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f35900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f35930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f35970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f359a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f35a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f35a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f35ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f35ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100097 td 0xfffff80011d59a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f3f900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f3f930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f3f970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f3f9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f3fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f3fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f3fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f3fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100100 td 0xfffff80011d71a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f8e900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f8e930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f8e970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f8e9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f8ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f8ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f8eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f8eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100102 td 0xfffff80011d71000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045f98900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045f98930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045f98970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045f989a0 _sleep() at _sleep+0x338/frame 0xfffffe1045f98a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045f98a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045f98ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045f98ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100104 td 0xfffff80011d70500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fa2900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fa2930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fa2970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fa29a0 _sleep() at _sleep+0x338/frame 0xfffffe1045fa2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045fa2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fa2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fa2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100106 td 0xfffff80011d6fa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fac900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fac930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fac970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fac9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045faca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045faca70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045facab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045facab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100108 td 0xfffff80011d6f000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fb6900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fb6930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fb6970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fb69a0 _sleep() at _sleep+0x338/frame 0xfffffe1045fb6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045fb6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fb6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fb6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100110 td 0xfffff80011d78500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fc0900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fc0930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fc0970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fc09a0 _sleep() at _sleep+0x338/frame 0xfffffe1045fc0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045fc0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fc0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fc0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff80011d77a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fca900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fca930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fca970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fca9a0 _sleep() at _sleep+0x338/frame 0xfffffe1045fcaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045fcaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fcaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fcaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff80011d77000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045fd4900 mi_switch() at mi_switch+0x167/frame 0xfffffe1045fd4930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045fd4970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045fd49a0 _sleep() at _sleep+0x338/frame 0xfffffe1045fd4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1045fd4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045fd4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045fd4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100131 td 0xfffff80011da6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104822c910 mi_switch() at mi_switch+0x167/frame 0xfffffe104822c940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104822c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104822c9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104822ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104822ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe104822cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104822cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100134 td 0xfffff80011da5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104823c900 mi_switch() at mi_switch+0x167/frame 0xfffffe104823c930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104823c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104823c9a0 _sleep() at _sleep+0x338/frame 0xfffffe104823ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe104823ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe104823cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104823cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100148 td 0xfffff8012115aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048444910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048444940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048444980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484449b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048444a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048444a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048444ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048444ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100149 td 0xfffff8012115a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048449910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048449940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048449980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484499b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048449a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048449a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048449ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048449ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100150 td 0xfffff8012115a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104844e910 mi_switch() at mi_switch+0x167/frame 0xfffffe104844e940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104844e980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104844e9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104844ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104844ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe104844eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104844eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100151 td 0xfffff80121159a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048453910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048453940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048453980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484539b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048453a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048453a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048453ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048453ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100152 td 0xfffff80121159500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048458910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048458940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048458980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484589b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048458a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048458a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048458ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048458ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100153 td 0xfffff80121159000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104845d910 mi_switch() at mi_switch+0x167/frame 0xfffffe104845d940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104845d980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104845d9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104845da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104845da70 fork_exit() at fork_exit+0x84/frame 0xfffffe104845dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104845dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100154 td 0xfffff801211b1a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048462910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048462940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048462980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484629b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048462a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048462a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048462ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048462ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100155 td 0xfffff801211b1500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048467910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048467940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048467980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484679b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048467a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048467a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048467ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048467ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100156 td 0xfffff801211b1000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104846c910 mi_switch() at mi_switch+0x167/frame 0xfffffe104846c940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104846c980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104846c9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104846ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104846ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe104846cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104846cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100157 td 0xfffff801211b0a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048471910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048471940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048471980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484719b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048471a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048471a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048471ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048471ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100158 td 0xfffff801211b0500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048476910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048476940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048476980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484769b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048476a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048476a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048476ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048476ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100159 td 0xfffff801211b0000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104847b910 mi_switch() at mi_switch+0x167/frame 0xfffffe104847b940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104847b980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104847b9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104847ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104847ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe104847bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104847bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100160 td 0xfffff801211afa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048480910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048480940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048480980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484809b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048480a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048480a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048480ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048480ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100161 td 0xfffff801211af500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048485910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048485940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048485980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484859b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048485a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048485a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048485ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048485ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100162 td 0xfffff801211af000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104848a910 mi_switch() at mi_switch+0x167/frame 0xfffffe104848a940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104848a980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104848a9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104848aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104848aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104848aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104848aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100163 td 0xfffff801211b6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104848f910 mi_switch() at mi_switch+0x167/frame 0xfffffe104848f940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104848f980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104848f9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104848fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104848fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104848fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104848fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100164 td 0xfffff801211b6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048494910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048494940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048494980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484949b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048494a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048494a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048494ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048494ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100165 td 0xfffff801211b6000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048499910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048499940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048499980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484999b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1048499a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1048499a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048499ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048499ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100166 td 0xfffff801211b5a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104849e910 mi_switch() at mi_switch+0x167/frame 0xfffffe104849e940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104849e980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104849e9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe104849ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe104849ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe104849eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104849eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100167 td 0xfffff801211b5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484a3910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484a3940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484a3980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484a39b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484a3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484a3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484a3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484a3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100168 td 0xfffff801211b5000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484a8910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484a8940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484a8980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484a89b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484a8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484a8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484a8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484a8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100169 td 0xfffff801211b4a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484ad910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484ad940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484ad980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484ad9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484ada40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484ada70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484adab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484adab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100170 td 0xfffff801211b4500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484b2910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484b2940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484b2980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484b29b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484b2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484b2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484b2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484b2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100171 td 0xfffff801211b4000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484b7910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484b7940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484b7980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484b79b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484b7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484b7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484b7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484b7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100173 td 0xfffff8012151aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10484c1910 mi_switch() at mi_switch+0x167/frame 0xfffffe10484c1940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10484c1980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10484c19b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10484c1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10484c1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10484c1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10484c1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100195 td 0xfffff801216d7000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10485ff900 mi_switch() at mi_switch+0x167/frame 0xfffffe10485ff930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10485ff970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10485ff9a0 _sleep() at _sleep+0x338/frame 0xfffffe10485ffa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe10485ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10485ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10485ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> call doadump Dumping 2465 out of 65428 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) proc 1110 [Switching to thread 278 (Thread 100570)]#0 cpustop_handler () at ../../../x86/x86/mp_x86.c:1232 1232 CPU_SET_ATOMIC(cpu, &stopped_cpus); Current language: auto; currently minimal (kgdb) bt #0 cpustop_handler () at ../../../x86/x86/mp_x86.c:1232 #1 0xffffffff81017b4a in ipi_nmi_handler () at ../../../x86/x86/mp_x86.c:1214 #2 0xffffffff80ec581a in trap (frame=0xffffffff81cf90f0) at ../../../amd64/amd64/trap.c:190 #3 0xffffffff80ea6ee3 in nmi_calltrap () at ../../../amd64/amd64/exception.S:510 #4 0xffffffff80a4a7c5 in __rw_wlock_hard (c=, tid=, file=, line=) at ../../../kern/kern_rwlock.c:804 Previous frame inner to this frame (corrupt stack?) (kgdb) f 4 #4 0xffffffff80a4a7c5 in __rw_wlock_hard (c=, tid=, file=, line=) at ../../../kern/kern_rwlock.c:804 804 spin_cnt++; (kgdb) l 799 rw->lock_object.lo_name); 800 while ((struct thread*)RW_OWNER(rw->rw_lock) == owner && 801 TD_IS_RUNNING(owner)) { 802 cpu_spinwait(); 803 #ifdef KDTRACE_HOOKS 804 spin_cnt++; 805 #endif 806 } 807 KTR_STATE0(KTR_SCHED, "thread", sched_tdname(curthread), 808 "running"); (kgdb) info loc sleep_time = 0x0 spin_cnt = spintries = Cannot access memory at address 0x0 (kgdb) $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/ddb/db_ps.c =================================================================== --- /usr/src/sys/ddb/db_ps.c (revision 302933) +++ /usr/src/sys/ddb/db_ps.c (working copy) @@ -375,8 +375,13 @@ DB_SHOW_COMMAND(thread, db_show_thread) db_printf(" lock: %s turnstile: %p\n", td->td_lockname, td->td_blocked); if (TD_ON_SLEEPQ(td)) - db_printf(" wmesg: %s wchan: %p\n", td->td_wmesg, - td->td_wchan); + db_printf( + " wmesg: %s wchan: %p sleeptimo %lx. %jx (curr %lx. %jx)\n", + td->td_wmesg, td->td_wchan, + (long)sbttobt(td->td_sleeptimo).sec, + (uintmax_t)sbttobt(td->td_sleeptimo).frac, + (long)sbttobt(sbinuptime()).sec, + (uintmax_t)sbttobt(sbinuptime()).frac); db_printf(" priority: %d\n", td->td_priority); db_printf(" container lock: %s (%p)\n", lock->lo_name, lock); if (td->td_swvoltick != 0) { Index: /usr/src/sys/kern/kern_exec.c =================================================================== --- /usr/src/sys/kern/kern_exec.c (revision 302933) +++ /usr/src/sys/kern/kern_exec.c (working copy) @@ -760,6 +760,8 @@ interpret: if (p->p_flag & P_PPWAIT) { p->p_flag &= ~(P_PPWAIT | P_PPTRACE); cv_broadcast(&p->p_pwait); + /* STOPs are no longer ignored, arrange for AST */ + signotify(td); } /* Index: /usr/src/sys/kern/kern_sig.c =================================================================== --- /usr/src/sys/kern/kern_sig.c (revision 302933) +++ /usr/src/sys/kern/kern_sig.c (working copy) @@ -2726,7 +2726,20 @@ issignal(struct thread *td) SIG_STOPSIGMASK(sigpending); if (SIGISEMPTY(sigpending)) /* no signal to send */ return (0); - sig = sig_ffs(&sigpending); + if ((p->p_flag & (P_TRACED | P_PPTRACE)) == P_TRACED && + (p->p_flag2 & P2_PTRACE_FSTP) != 0 && + SIGISMEMBER(sigpending, SIGSTOP)) { + /* + * If debugger just attached, always consume + * SIGSTOP from ptrace(PT_ATTACH) first, to + * execute the debugger attach ritual in + * order. + */ + sig = SIGSTOP; + p->p_flag2 &= ~P2_PTRACE_FSTP; + } else { + sig = sig_ffs(&sigpending); + } if (p->p_stops & S_SIG) { mtx_unlock(&ps->ps_mtx); @@ -2743,7 +2756,7 @@ issignal(struct thread *td) sigqueue_delete(&p->p_sigqueue, sig); continue; } - if (p->p_flag & P_TRACED && (p->p_flag & P_PPTRACE) == 0) { + if ((p->p_flag & (P_TRACED | P_PPTRACE)) == P_TRACED) { /* * If traced, always stop. * Remove old signal from queue before the stop. @@ -2846,6 +2859,8 @@ issignal(struct thread *td) mtx_unlock(&ps->ps_mtx); WITNESS_WARN(WARN_GIANTOK | WARN_SLEEPOK, &p->p_mtx.lock_object, "Catching SIGSTOP"); + sigqueue_delete(&td->td_sigqueue, sig); + sigqueue_delete(&p->p_sigqueue, sig); p->p_flag |= P_STOPPED_SIG; p->p_xsig = sig; PROC_SLOCK(p); @@ -2853,7 +2868,7 @@ issignal(struct thread *td) thread_suspend_switch(td, p); PROC_SUNLOCK(p); mtx_lock(&ps->ps_mtx); - break; + goto next; } else if (prop & SA_IGNORE) { /* * Except for SIGCONT, shouldn't get here. @@ -2884,6 +2899,7 @@ issignal(struct thread *td) } sigqueue_delete(&td->td_sigqueue, sig); /* take the signal! */ sigqueue_delete(&p->p_sigqueue, sig); +next:; } /* NOTREACHED */ } Index: /usr/src/sys/kern/kern_thread.c =================================================================== --- /usr/src/sys/kern/kern_thread.c (revision 302933) +++ /usr/src/sys/kern/kern_thread.c (working copy) @@ -318,7 +318,7 @@ thread_reap(void) /* * Don't even bother to lock if none at this instant, - * we really don't care about the next instant.. + * we really don't care about the next instant. */ if (!TAILQ_EMPTY(&zombie_threads)) { mtx_lock_spin(&zombie_lock); @@ -383,6 +383,7 @@ thread_free(struct thread *td) if (td->td_kstack != 0) vm_thread_dispose(td); vm_domain_policy_cleanup(&td->td_vm_dom_policy); + callout_drain(&td->td_slpcallout); uma_zfree(thread_zone, td); } @@ -580,6 +581,7 @@ thread_wait(struct proc *p) td->td_cpuset = NULL; cpu_thread_clean(td); thread_cow_free(td); + callout_drain(&td->td_slpcallout); thread_reap(); /* check for zombie threads etc. */ } Index: /usr/src/sys/kern/kern_timeout.c =================================================================== --- /usr/src/sys/kern/kern_timeout.c (revision 302933) +++ /usr/src/sys/kern/kern_timeout.c (working copy) @@ -945,6 +945,49 @@ callout_handle_init(struct callout_handle *handle) handle->callout = NULL; } +sbintime_t +callout_when(sbintime_t sbt, int flags) +{ + sbintime_t to_sbt; + + if ((flags & (C_ABSOLUTE | C_PRECALC)) != 0) + return (sbt); + if ((flags & C_HARDCLOCK) != 0 && sbt < tick_sbt) + sbt = tick_sbt; + if ((flags & C_HARDCLOCK) != 0 || +#ifdef NO_EVENTTIMERS + sbt >= sbt_timethreshold) { + to_sbt = getsbinuptime(); + + /* Add safety belt for the case of hz > 1000. */ + to_sbt += tc_tick_sbt - tick_sbt; +#else + sbt >= sbt_tickthreshold) { + /* + * Obtain the time of the last hardclock() call on + * this CPU directly from the kern_clocksource.c. + * This value is per-CPU, but it is equal for all + * active ones. + */ +#ifdef __LP64__ + to_sbt = DPCPU_GET(hardclocktime); +#else + spinlock_enter(); + to_sbt = DPCPU_GET(hardclocktime); + spinlock_exit(); +#endif +#endif + if ((flags & C_HARDCLOCK) == 0) + to_sbt += tick_sbt; + } else + to_sbt = sbinuptime(); + if (SBT_MAX - to_sbt < sbt) + to_sbt = SBT_MAX; + else + to_sbt += sbt; + return (to_sbt); +} + /* * New interface; clients allocate their own callout structures. * @@ -978,42 +1021,8 @@ callout_reset_sbt_on(struct callout *c, sbintime_t /* Invalid CPU spec */ panic("Invalid CPU in callout %d", cpu); } - if (flags & C_ABSOLUTE) { - to_sbt = sbt; - } else { - if ((flags & C_HARDCLOCK) && (sbt < tick_sbt)) - sbt = tick_sbt; - if ((flags & C_HARDCLOCK) || -#ifdef NO_EVENTTIMERS - sbt >= sbt_timethreshold) { - to_sbt = getsbinuptime(); - - /* Add safety belt for the case of hz > 1000. */ - to_sbt += tc_tick_sbt - tick_sbt; -#else - sbt >= sbt_tickthreshold) { - /* - * Obtain the time of the last hardclock() call on - * this CPU directly from the kern_clocksource.c. - * This value is per-CPU, but it is equal for all - * active ones. - */ -#ifdef __LP64__ - to_sbt = DPCPU_GET(hardclocktime); -#else - spinlock_enter(); - to_sbt = DPCPU_GET(hardclocktime); - spinlock_exit(); -#endif -#endif - if ((flags & C_HARDCLOCK) == 0) - to_sbt += tick_sbt; - } else - to_sbt = sbinuptime(); - if (SBT_MAX - to_sbt < sbt) - to_sbt = SBT_MAX; - else - to_sbt += sbt; + to_sbt = callout_when(sbt, flags); + if ((flags & C_ABSOLUTE) == 0) { pr = ((C_PRELGET(flags) < 0) ? sbt >> tc_precexp : sbt >> C_PRELGET(flags)); if (pr > precision) Index: /usr/src/sys/kern/subr_sleepqueue.c =================================================================== --- /usr/src/sys/kern/subr_sleepqueue.c (revision 302933) +++ /usr/src/sys/kern/subr_sleepqueue.c (working copy) @@ -387,8 +387,14 @@ sleepq_set_timeout_sbt(void *wchan, sbintime_t sbt MPASS(wchan != NULL); if (cold) panic("timed sleep before timers are working"); - callout_reset_sbt_on(&td->td_slpcallout, sbt, pr, - sleepq_timeout, td, PCPU_GET(cpuid), flags | C_DIRECT_EXEC); + KASSERT(td->td_sleeptimo == 0, ("td %d %p td_sleeptimo %jx", + td->td_tid, td, (uintmax_t)td->td_sleeptimo)); + thread_lock(td); + td->td_sleeptimo = callout_when(sbt, flags); + thread_unlock(td); + callout_reset_sbt_on(&td->td_slpcallout, td->td_sleeptimo, pr, + sleepq_timeout, td, PCPU_GET(cpuid), flags | C_PRECALC | + C_DIRECT_EXEC); } /* @@ -576,37 +582,26 @@ static int sleepq_check_timeout(void) { struct thread *td; + int res; td = curthread; THREAD_LOCK_ASSERT(td, MA_OWNED); /* - * If TDF_TIMEOUT is set, we timed out. + * If TDF_TIMEOUT is set, we timed out. But recheck + * td_sleeptimo anyway. */ - if (td->td_flags & TDF_TIMEOUT) { + res = 0; + if (td->td_sleeptimo != 0) { + if (td->td_sleeptimo <= sbinuptime()) + res = EWOULDBLOCK; + td->td_sleeptimo = 0; + } + if (td->td_flags & TDF_TIMEOUT) td->td_flags &= ~TDF_TIMEOUT; - return (EWOULDBLOCK); - } - - /* - * If TDF_TIMOFAIL is set, the timeout ran after we had - * already been woken up. - */ - if (td->td_flags & TDF_TIMOFAIL) - td->td_flags &= ~TDF_TIMOFAIL; - - /* - * If callout_stop() fails, then the timeout is running on - * another CPU, so synchronize with it to avoid having it - * accidentally wake up a subsequent sleep. - */ - else if (_callout_stop_safe(&td->td_slpcallout, CS_EXECUTING, NULL) - == 0) { - td->td_flags |= TDF_TIMEOUT; - TD_SET_SLEEPING(td); - mi_switch(SW_INVOL | SWT_SLEEPQTIMO, NULL); - } - return (0); + else + _callout_stop_safe(&td->td_slpcallout, 0, NULL); + return (res); } /* @@ -914,12 +909,17 @@ sleepq_timeout(void *arg) CTR3(KTR_PROC, "sleepq_timeout: thread %p (pid %ld, %s)", (void *)td, (long)td->td_proc->p_pid, (void *)td->td_name); - /* - * First, see if the thread is asleep and get the wait channel if - * it is. - */ thread_lock(td); - if (TD_IS_SLEEPING(td) && TD_ON_SLEEPQ(td)) { + + if (td->td_sleeptimo > sbinuptime() || td->td_sleeptimo == 0) { + /* + * The thread does not want a timeout (yet). + */ + } else if (TD_IS_SLEEPING(td) && TD_ON_SLEEPQ(td)) { + /* + * See if the thread is asleep and get the wait + * channel if it is. + */ wchan = td->td_wchan; sc = SC_LOOKUP(wchan); THREAD_LOCKPTR_ASSERT(td, &sc->sc_lock); @@ -927,40 +927,16 @@ sleepq_timeout(void *arg) MPASS(sq != NULL); td->td_flags |= TDF_TIMEOUT; wakeup_swapper = sleepq_resume_thread(sq, td, 0); - thread_unlock(td); - if (wakeup_swapper) - kick_proc0(); - return; - } - - /* - * If the thread is on the SLEEPQ but isn't sleeping yet, it - * can either be on another CPU in between sleepq_add() and - * one of the sleepq_*wait*() routines or it can be in - * sleepq_catch_signals(). - */ - if (TD_ON_SLEEPQ(td)) { + } else if (TD_ON_SLEEPQ(td)) { + /* + * If the thread is on the SLEEPQ but isn't sleeping + * yet, it can either be on another CPU in between + * sleepq_add() and one of the sleepq_*wait*() + * routines or it can be in sleepq_catch_signals(). + */ td->td_flags |= TDF_TIMEOUT; - thread_unlock(td); - return; } - /* - * Now check for the edge cases. First, if TDF_TIMEOUT is set, - * then the other thread has already yielded to us, so clear - * the flag and resume it. If TDF_TIMEOUT is not set, then the - * we know that the other thread is not on a sleep queue, but it - * hasn't resumed execution yet. In that case, set TDF_TIMOFAIL - * to let it know that the timeout has already run and doesn't - * need to be canceled. - */ - if (td->td_flags & TDF_TIMEOUT) { - MPASS(TD_IS_SLEEPING(td)); - td->td_flags &= ~TDF_TIMEOUT; - TD_CLR_SLEEPING(td); - wakeup_swapper = setrunnable(td); - } else - td->td_flags |= TDF_TIMOFAIL; thread_unlock(td); if (wakeup_swapper) kick_proc0(); Index: /usr/src/sys/kern/subr_trap.c =================================================================== --- /usr/src/sys/kern/subr_trap.c (revision 302933) +++ /usr/src/sys/kern/subr_trap.c (working copy) @@ -107,15 +107,20 @@ userret(struct thread *td, struct trapframe *frame * multi-threaded processes, where signal distribution might * change due to other threads changing sigmask, the check is * racy and cannot be performed reliably. + * If current process is vfork child, indicated by P_PPWAIT, then + * issignal() ignores stops, so we block the check to avoid + * classifying pending signals. */ if (p->p_numthreads == 1) { PROC_LOCK(p); thread_lock(td); - KASSERT(!SIGPENDING(td) || - (td->td_flags & (TDF_NEEDSIGCHK | TDF_ASTPENDING)) == - (TDF_NEEDSIGCHK | TDF_ASTPENDING), - ("failed to set signal flags for ast p %p td %p fl %x", - p, td, td->td_flags)); + if ((p->p_flag & P_PPWAIT) == 0) { + KASSERT(!SIGPENDING(td) || (td->td_flags & + (TDF_NEEDSIGCHK | TDF_ASTPENDING)) == + (TDF_NEEDSIGCHK | TDF_ASTPENDING), + ("failed to set signal flags for ast p %p " + "td %p fl %x", p, td, td->td_flags)); + } thread_unlock(td); PROC_UNLOCK(p); } @@ -281,12 +286,15 @@ ast(struct trapframe *framep) * td_flags, since signal might have been delivered * after we cleared td_flags above. This is one of * the reason for looping check for AST condition. + * See comment in userret() about P_PPWAIT. */ - KASSERT(!SIGPENDING(td) || - (td->td_flags & (TDF_NEEDSIGCHK | TDF_ASTPENDING)) == - (TDF_NEEDSIGCHK | TDF_ASTPENDING), - ("failed2 to set signal flags for ast p %p td %p fl %x %x", - p, td, flags, td->td_flags)); + if ((p->p_flag & P_PPWAIT) == 0) { + KASSERT(!SIGPENDING(td) || (td->td_flags & + (TDF_NEEDSIGCHK | TDF_ASTPENDING)) == + (TDF_NEEDSIGCHK | TDF_ASTPENDING), + ("failed2 to set signal flags for ast p %p td %p " + "fl %x %x", p, td, flags, td->td_flags)); + } thread_unlock(td); PROC_UNLOCK(p); } Index: /usr/src/sys/kern/sys_process.c =================================================================== --- /usr/src/sys/kern/sys_process.c (revision 302933) +++ /usr/src/sys/kern/sys_process.c (working copy) @@ -900,6 +900,7 @@ kern_ptrace(struct thread *td, int req, pid_t pid, case PT_TRACE_ME: /* set my trace flag and "owner" so it can read/write me */ p->p_flag |= P_TRACED; + p->p_flag2 |= P2_PTRACE_FSTP; p->p_ptevents = PTRACE_DEFAULT; if (p->p_flag & P_PPWAIT) p->p_flag |= P_PPTRACE; @@ -919,6 +920,7 @@ kern_ptrace(struct thread *td, int req, pid_t pid, * on a "detach". */ p->p_flag |= P_TRACED; + p->p_flag2 |= P2_PTRACE_FSTP; p->p_ptevents = PTRACE_DEFAULT; p->p_oppid = p->p_pptr->p_pid; if (p->p_pptr != td->td_proc) { @@ -1088,6 +1090,17 @@ kern_ptrace(struct thread *td, int req, pid_t pid, p->p_pid, data); p->p_oppid = 0; p->p_ptevents = 0; + FOREACH_THREAD_IN_PROC(p, td3) { + td3->td_dbgflags &= ~TDB_XSIG; + if ((p->p_flag2 & P2_PTRACE_FSTP) != 0) { + sigqueue_delete(&td3->td_sigqueue, + SIGSTOP); + } + } + if ((p->p_flag2 & P2_PTRACE_FSTP) != 0) { + sigqueue_delete(&p->p_sigqueue, SIGSTOP); + p->p_flag2 &= ~P2_PTRACE_FSTP; + } /* should we send SIGCHLD? */ /* childproc_continued(p); */ @@ -1108,7 +1121,7 @@ kern_ptrace(struct thread *td, int req, pid_t pid, if (req == PT_DETACH) { FOREACH_THREAD_IN_PROC(p, td3) - td3->td_dbgflags &= ~TDB_SUSPEND; + td3->td_dbgflags &= ~TDB_SUSPEND; } /* * unsuspend all threads, to not let a thread run, Index: /usr/src/sys/sys/callout.h =================================================================== --- /usr/src/sys/sys/callout.h (revision 302933) +++ /usr/src/sys/sys/callout.h (working copy) @@ -57,6 +57,7 @@ #define C_PRELGET(x) (int)((((x) >> 1) & C_PRELRANGE) - 1) #define C_HARDCLOCK 0x0100 /* align to hardclock() calls */ #define C_ABSOLUTE 0x0200 /* event time is absolute. */ +#define C_PRECALC 0x0400 /* event time is pre-calculated. */ struct callout_handle { struct callout *callout; @@ -129,6 +130,7 @@ int _callout_stop_safe(struct callout *, int, void void callout_process(sbintime_t now); #define callout_async_drain(c, d) \ _callout_stop_safe(c, 0, d) +sbintime_t callout_when(sbintime_t sbt, int flags); #endif #endif /* _SYS_CALLOUT_H_ */ Index: /usr/src/sys/sys/proc.h =================================================================== --- /usr/src/sys/sys/proc.h (revision 302933) +++ /usr/src/sys/sys/proc.h (working copy) @@ -282,6 +282,7 @@ struct thread { int td_no_sleeping; /* (k) Sleeping disabled count. */ int td_dom_rr_idx; /* (k) RR Numa domain selection. */ void *td_su; /* (k) FFS SU private */ + sbintime_t td_sleeptimo; /* (t) Sleep timeout. */ #define td_endzero td_sigmask /* Copied during fork1() or create_thread(). */ @@ -388,7 +389,7 @@ do { \ #define TDF_ALLPROCSUSP 0x00000200 /* suspended by SINGLE_ALLPROC */ #define TDF_BOUNDARY 0x00000400 /* Thread suspended at user boundary */ #define TDF_ASTPENDING 0x00000800 /* Thread has some asynchronous events. */ -#define TDF_TIMOFAIL 0x00001000 /* Timeout from sleep after we were awake. */ +#define TDF_UNUSED12 0x00001000 /* Timeout from sleep after we were awake. */ #define TDF_SBDRY 0x00002000 /* Stop only on usermode boundary. */ #define TDF_UPIBLOCKED 0x00004000 /* Thread blocked on user PI mutex. */ #define TDF_NEEDSUSPCHK 0x00008000 /* Thread may need to suspend. */ @@ -712,6 +713,7 @@ struct proc { #define P2_NOTRACE 0x00000002 /* No ptrace(2) attach or coredumps. */ #define P2_NOTRACE_EXEC 0x00000004 /* Keep P2_NOPTRACE on exec(2). */ #define P2_AST_SU 0x00000008 /* Handles SU ast for kthreads. */ +#define P2_PTRACE_FSTP 0x00000010 /* First issignal() after PT_ATTACH. */ /* Flags protected by proctree_lock, kept in p_treeflags. */ #define P_TREE_ORPHANED 0x00000001 /* Reparented, on orphan list */ -- Test scenario: misc/lockf5.sh