GENERIC HEAD from 2016-09-14 17:43:32 UTC, r305815M, vmcore.593 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #1 r305815M: Thu Sep 15 01:17:48 CEST 2016 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66601750528 (63516 MB) : Trying to mount root from ufs:/dev/gpt/root [rw]... uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. ugen2.2: at usbus2 uhub3 numa-domain 0 on uhub0 uhub3: on usbus2 ugen0.2: at usbus0 uhub4 numa-domain 0 on uhub2 uhub4: on usbus0 Starting ddb. Starting file system checks: /dev/gpt/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/root: clean, 41517828 free (866556 frags, 5081409 blocks, 0.9% fragmentation) /dev/ada0p2: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0p2: clean, 34084431 free (7199 frags, 4259654 blocks, 0.0% fragmentation) /dev/gpt/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/tmp: clean, 22428655 free (4775 frags, 2802985 blocks, 0.0% fragmentation) Mounting local filesystems:. uhub4: 6 ports with 6 removable, self powered ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc48 /usr/local/lib/gcc49 /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/llvm37/lib 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat uhub3: 8 ports with 8 removable, self powered Setting hostname: t1.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . ugen2.3: at usbus2 uhub5 numa-domain 0 on uhub3 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd0 numa-domain 0 on uhub3 ukbd0: on usbus2 kbd2 at ukbd0 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 8192 options=6403bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::21e:67ff:fe56:c168%igb0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: igb1. igb1: flags=8c02 metric 0 mtu 1500 options=6403bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Configuring vt: keymap. ums0 numa-domain 0 on uhub3 ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. lock order reversal: 1st 0xfffffe0f8f87bc70 bufwait (bufwait) @ kern/vfs_bio.c:3505 2nd 0xfffff8000b6c2800 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xffffffff80ab2b35 at witness_debugger+0xe5 #1 0xffffffff80ab2419 at witness_checkorder+0xf19 #2 0xffffffff80a59f62 at _sx_xlock+0x72 #3 0xffffffff80d2720d at ufsdirhash_add+0x4d #4 0xffffffff80d2bc5d at ufs_direnter+0x51d #5 0xffffffff80d34446 at ufs_mkdir+0x896 #6 0xffffffff810367b4 at VOP_MKDIR_APV+0x104 #7 0xffffffff80b2724c at kern_mkdirat+0x1fc #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting saslauthd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization:Sep 15 01:20:51 t1 su: pho to root on /dev/pts/1 20160915 01:21:17 all (1/1): marcus.sh lock order reversal: 1st 0xfffff8011ab85c98 ufs (ufs) @ kern/vfs_lookup.c:522 2nd 0xfffffe0f90022cf0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:276 3rd 0xfffff8020715fc98 ufs (ufs) @ kern/vfs_subr.c:2523 stack backtrace: #0 0xffffffff80ab2b35 at witness_debugger+0xe5 #1 0xffffffff80ab2419 at witness_checkorder+0xf19 #2 0xffffffff80a29db2 at __lockmgr_args+0x4c2 #3 0xffffffff80d2243f at _lockmgr_args+0x8f #4 0xffffffff80d207c2 at ffs_lock+0x112 #5 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #6 0xffffffff80b29e82 at _vn_lock+0xc2 #7 0xffffffff80b19bdd at vget+0x8d #8 0xffffffff80b0c02c at vfs_hash_get+0xcc #9 0xffffffff80d1bc30 at ffs_vgetf+0x40 #10 0xffffffff80d1233e at softdep_sync_buf+0xd5e #11 0xffffffff80d21d5c at ffs_syncvnode+0x38c #12 0xffffffff80cf7591 at ffs_truncate+0x8a1 #13 0xffffffff80d2bdff at ufs_direnter+0x6bf #14 0xffffffff80d352f3 at ufs_makeinode+0x5e3 #15 0xffffffff80d347e2 at ufs_symlink+0x32 #16 0xffffffff81036b94 at VOP_SYMLINK_APV+0x104 #17 0xffffffff80b23a8f at kern_symlinkat+0x22f Sep 15 01:40:53 t1 kernel: pid 8497 (rw), uid 1002 inumber 110966 on /mnt: filesystem full Sep 15 01:41:18 t1 kernel: pid 8493 (rw), uid 1002 inumber 67469 on /mnt: filesystem full backup. sysctl: unknown oid 'debug.mnowait_failure.zalloc_whitelist' at line 13 sysctl: unknown oid 'debug.fail_point.uma_zalloc_arg' at line 14 Starting inetd. Thu Sep 15 01:42 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: lock order reversal: 1st 0xfffff8001d5f1a28 ufs (ufs) @ kern/vfs_mount.c:1244 2nd 0xfffff800711e5068 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1908 stack backtrace: #0 0xffffffff80ab2b35 at witness_debugger+0xe5 #1 0xffffffff80ab2419 at witness_checkorder+0xf19 #2 0xffffffff80a29db2 at __lockmgr_args+0x4c2 #3 0xffffffff80b0845c at vop_stdlock+0x3c #4 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #5 0xffffffff80b29e82 at _vn_lock+0xc2 #6 0xffffffff80cff620 at softdep_flushworklist+0x70 #7 0xffffffff80d1e777 at ffs_sync+0x257 #8 0xffffffff80b12020 at dounmount+0x6b0 #9 0xffffffff80b118dd at sys_unmount+0x35d #10 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #11 0xffffffff80eb2f0b at Xfast_syscall+0xfb *** Excessive run time: marcus.sh, 99 min 20160915 03:01:13 all (1/1): marcus.sh 20160915 03:33:18 all (1/1): marcus.sh interrupt total irq3: uart1 300 irq9: acpi0 2 irq20: ehci1 30634 irq22: ehci0 15263 cpu0:timer 11394743 irq264: isci0 148542 irq266: hdac0 101 irq267: igb0:que 0 169757 irq268: igb0:link 1 irq272: ahci0 433 irq273: hdac1 4 Total 11759780 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe1048fdded0 watchdog_fire() at watchdog_fire+0x88/frame 0xfffffe1048fddf00 hardclock_cnt() at hardclock_cnt+0x28e/frame 0xfffffe1048fddf60 handleevents() at handleevents+0xb5/frame 0xfffffe1048fddfa0 timercb() at timercb+0x227/frame 0xfffffe1048fddff0 lapic_handle_timer() at lapic_handle_timer+0x9f/frame 0xfffffe1048fde030 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe1048fde030 --- interrupt, rip = 0xffffffff80b054c4, rsp = 0xfffffe1048fde100, rbp = 0xfffffe1048fde100 --- fnv_32_buf() at fnv_32_buf+0x4/frame 0xfffffe1048fde100 cache_get_hash() at cache_get_hash+0x5c/frame 0xfffffe1048fde140 NCP2BUCKETLOCK() at NCP2BUCKETLOCK+0x25/frame 0xfffffe1048fde160 cache_zap_locked_vnode_kl() at cache_zap_locked_vnode_kl+0x9f/frame 0xfffffe1048fde1e0 cache_purge() at cache_purge+0x1bc/frame 0xfffffe1048fde250 vgonel() at vgonel+0x444/frame 0xfffffe1048fde2c0 vnlru_free_locked() at vnlru_free_locked+0x2c2/frame 0xfffffe1048fde330 getnewvnode() at getnewvnode+0xc9/frame 0xfffffe1048fde370 ffs_vgetf() at ffs_vgetf+0xe2/frame 0xfffffe1048fde400 ffs_valloc() at ffs_valloc+0x4e1/frame 0xfffffe1048fde4a0 ufs_makeinode() at ufs_makeinode+0x84/frame 0xfffffe1048fde660 ufs_create() at ufs_create+0x33/frame 0xfffffe1048fde680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe1048fde6b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe1048fde820 kern_openat() at kern_openat+0x25c/frame 0xfffffe1048fde9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fdeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fdeab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- KDB: enter: watchdog timeout [ thread pid 20716 tid 100167 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> bt Tracing pid 20716 tid 100167 td 0xfffff8011ae4e500 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe1048fddf00 hardclock_cnt() at hardclock_cnt+0x28e/frame 0xfffffe1048fddf60 handleevents() at handleevents+0xb5/frame 0xfffffe1048fddfa0 timercb() at timercb+0x227/frame 0xfffffe1048fddff0 lapic_handle_timer() at lapic_handle_timer+0x9f/frame 0xfffffe1048fde030 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe1048fde030 --- interrupt, rip = 0xffffffff80b054c4, rsp = 0xfffffe1048fde100, rbp = 0xfffffe1048fde100 --- fnv_32_buf() at fnv_32_buf+0x4/frame 0xfffffe1048fde100 cache_get_hash() at cache_get_hash+0x5c/frame 0xfffffe1048fde140 NCP2BUCKETLOCK() at NCP2BUCKETLOCK+0x25/frame 0xfffffe1048fde160 cache_zap_locked_vnode_kl() at cache_zap_locked_vnode_kl+0x9f/frame 0xfffffe1048fde1e0 cache_purge() at cache_purge+0x1bc/frame 0xfffffe1048fde250 vgonel() at vgonel+0x444/frame 0xfffffe1048fde2c0 vnlru_free_locked() at vnlru_free_locked+0x2c2/frame 0xfffffe1048fde330 getnewvnode() at getnewvnode+0xc9/frame 0xfffffe1048fde370 ffs_vgetf() at ffs_vgetf+0xe2/frame 0xfffffe1048fde400 ffs_valloc() at ffs_valloc+0x4e1/frame 0xfffffe1048fde4a0 ufs_makeinode() at ufs_makeinode+0x84/frame 0xfffffe1048fde660 ufs_create() at ufs_create+0x33/frame 0xfffffe1048fde680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe1048fde6b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe1048fde820 kern_openat() at kern_openat+0x25c/frame 0xfffffe1048fde9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fdeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fdeab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x84f600 curthread = 0xfffff8011ae4e500: pid 20716 tid 100167 "creat" curpcb = 0xfffffe1048fdeb80 fpcurthread = none idlethread = 0xfffff8000b6d8000: tid 100003 "idle: cpu0" curpmap = 0xfffff801e2211138 tssp = 0xffffffff81e34f10 commontssp = 0xffffffff81e34f10 rsp0 = 0xfffffe1048fdeb80 gs32p = 0xffffffff81e3b768 ldt = 0xffffffff81e3b7a8 tss = 0xffffffff81e3b798 spin locks held: db:0:allpcpu> show alllocks Process 20750 (sh) thread 0xfffff8011aefba00 (100172) exclusive rw ncbuc (ncbuc) r = 0 (0xfffffe0000f61380) locked @ kern/vfs_cache.c:1273 exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffff800180cd480) locked @ kern/vfs_cache.c:1212 shared lockmgr ufs (ufs) r = 0 (0xfffff8001d1d2548) locked @ kern/vfs_lookup.c:522 Process 20727 (ls) thread 0xfffff8011aefb000 (100174) shared lockmgr ufs (ufs) r = 0 (0xfffff800709b2068) locked @ kern/vfs_lookup.c:522 Process 20716 (creat) thread 0xfffff8011ae4e500 (100167) exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffff800180cdae0) locked @ kern/vfs_cache.c:1707 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8042532d7b8) locked @ kern/vfs_subr.c:1188 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80325b77c98) locked @ kern/vfs_lookup.c:522 Process 20715 (creat) thread 0xfffff804553e0000 (100310) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8025b014c98) locked @ ufs/ffs/ffs_vfsops.c:1694 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8032592b7b8) locked @ kern/vfs_lookup.c:522 Process 20700 (swap) thread 0xfffff802cd4cc500 (100300) exclusive rw vm object (vm object) r = 0 (0xfffff802c530cd68) locked @ vm/vm_object.c:529 Process 20698 (swap) thread 0xfffff801e2626a00 (100335) exclusive rw vm object (vm object) r = 0 (0xfffff80eb573c738) locked @ vm/vm_object.c:529 Process 20695 (creat) thread 0xfffff8011afca500 (100182) exclusive lockmgr ufs (ufs) r = 0 (0xfffff802d0ef9c98) locked @ kern/vfs_lookup.c:522 Process 20694 (creat) thread 0xfffff801e27c6a00 (100271) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80dac67c2d8) locked @ ufs/ffs/ffs_vfsops.c:1694 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80325930068) locked @ kern/vfs_lookup.c:522 Process 20689 (rename) thread 0xfffff801e23b4500 (100227) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80325b3c7b8) locked @ kern/vfs_subr.c:2523 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0f917e2070) locked @ ufs/ffs/ffs_vnops.c:276 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80227970c98) locked @ ufs/ufs/ufs_vnops.c:1157 Process 20662 (link) thread 0xfffff8021ac05a00 (100338) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80babaea2d8) locked @ kern/vfs_syscalls.c:1478 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80325b837b8) locked @ kern/vfs_lookup.c:522 Process 20647 (openat) thread 0xfffff801e26fc000 (100264) exclusive lockmgr ufs (ufs) r = 0 (0xfffff803257c72d8) locked @ kern/vfs_lookup.c:522 Process 20618 (symlink) thread 0xfffff801e213c000 (100204) exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffff800180cdb20) locked @ kern/vfs_cache.c:875 exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffff800180cd880) locked @ kern/vfs_cache.c:1707 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8047639c548) locked @ kern/vfs_subr.c:1188 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8025bb532d8) locked @ kern/vfs_lookup.c:522 Process 20617 (symlink) thread 0xfffff8011ae4d500 (100170) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8025bd5a068) locked @ ufs/ffs/ffs_vfsops.c:1694 exclusive lockmgr ufs (ufs) r = 0 (0xfffff803257ec068) locked @ kern/vfs_lookup.c:522 Process 20616 (symlink) thread 0xfffff804760ec000 (100313) exclusive sleep mutex ncvn (ncvn) r = 0 (0xfffff800180cdce0) locked @ kern/vfs_cache.c:1707 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8080881e7b8) locked @ kern/vfs_subr.c:1188 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802d06872d8) locked @ kern/vfs_lookup.c:522 Process 20615 (symlink) thread 0xfffff801e23b2000 (100234) exclusive lockmgr ufs (ufs) r = 0 (0xfffff800704817b8) locked @ ufs/ffs/ffs_vfsops.c:1694 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8025bbc8c98) locked @ kern/vfs_lookup.c:522 Process 20601 (link) thread 0xfffff8011ad22000 (100159) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80476f3d068) locked @ kern/vfs_subr.c:2523 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80325a21c98) locked @ kern/vfs_lookup.c:522 Process 20599 (link) thread 0xfffff8001d178a00 (100073) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80baba117b8) locked @ kern/vfs_subr.c:2523 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802d07bfc98) locked @ kern/vfs_lookup.c:522 db:0:alllocks> show lockedvnods Locked vnodes vnode 0xfffff8001d1d24e0: tag ufs, type VDIR usecount 6, writecount 0, refcount 9 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8001d1c9420 ref 0 pages 1 cleanbuf 0 dirtybuf 1 lock type ufs: SHARED (count 1) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b24648 at kern_statat+0xa8 #8 0xffffffff80b2457d at sys_stat+0x2d #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 33065534, on dev gpt/root vnode 0xfffff800709b2000: tag ufs, type VDIR usecount 3, writecount 0, refcount 6 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff802c532f630 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 1) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b24648 at kern_statat+0xa8 #8 0xffffffff80b247dc at sys_fstatat+0x2c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 2, on dev md5a vnode 0xfffff80227970c30: tag ufs, type VDIR usecount 90, writecount 0, refcount 94 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff802c53a0e70 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801e23b4500 (pid 20689, rename, tid 100227) with shared waiters pending #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80d32776 at ufs_rename+0x136 #6 0xffffffff81036618 at VOP_RENAME_APV+0xe8 #7 0xffffffff80b26fd8 at kern_renameat+0x4a8 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32768, on dev md5a vnode 0xfffff802d07bfc30: tag ufs, type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801ac13ac60 ref 0 pages 25 cleanbuf 0 dirtybuf 5 lock type ufs: EXCL by thread 0xfffff8001d178a00 (pid 20599, link, tid 100073) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23da1 at kern_unlinkat+0xa1 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32773, on dev md5a vnode 0xfffff8025bbc8c30: tag ufs, type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80821c6ae70 ref 0 pages 25 cleanbuf 0 dirtybuf 5 lock type ufs: EXCL by thread 0xfffff801e23b2000 (pid 20615, symlink, tid 100234) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23961 at kern_symlinkat+0x101 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32774, on dev md5a vnode 0xfffff80325a21c30: tag ufs, type VDIR usecount 2, writecount 0, refcount 9 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801797b5d68 ref 0 pages 25 cleanbuf 0 dirtybuf 5 lock type ufs: EXCL by thread 0xfffff8011ad22000 (pid 20601, link, tid 100159) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23da1 at kern_unlinkat+0xa1 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32777, on dev md5a vnode 0xfffff802d0687270: tag ufs, type VDIR usecount 2, writecount 0, refcount 8 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801797b5c60 ref 0 pages 30 cleanbuf 0 dirtybuf 5 lock type ufs: EXCL by thread 0xfffff804760ec000 (pid 20616, symlink, tid 100313) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23961 at kern_symlinkat+0x101 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32785, on dev md5a vnode 0xfffff803257ec000: tag ufs, type VDIR usecount 2, writecount 0, refcount 7 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801797b5b58 ref 0 pages 23 cleanbuf 0 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff8011ae4d500 (pid 20617, symlink, tid 100170) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23961 at kern_symlinkat+0x101 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32786, on dev md5a vnode 0xfffff8025bb53270: tag ufs, type VDIR usecount 2, writecount 0, refcount 7 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801797b5a50 ref 0 pages 17 cleanbuf 0 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff801e213c000 (pid 20618, symlink, tid 100204) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b23961 at kern_symlinkat+0x101 #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32787, on dev md5a vnode 0xfffff803257c7270: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80179704840 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801e26fc000 (pid 20647, openat, tid 100264) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b29492 at vn_open_cred+0x102 #8 0xffffffff80b2297c at kern_openat+0x25c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32796, on dev md5a vnode 0xfffff80325b83750: tag ufs, type VDIR usecount 2, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801797b5948 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8021ac05a00 (pid 20662, link, tid 100338) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b234e6 at kern_linkat+0x176 #8 0xffffffff80b23368 at sys_link+0x28 #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32801, on dev md5a vnode 0xfffff802d0ef9c30: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8017918b948 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8011afca500 (pid 20695, creat, tid 100182) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b29492 at vn_open_cred+0x102 #8 0xffffffff80b2297c at kern_openat+0x25c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32812, on dev md5a vnode 0xfffff80325930000: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80179967420 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801e27c6a00 (pid 20694, creat, tid 100271) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b29492 at vn_open_cred+0x102 #8 0xffffffff80b2297c at kern_openat+0x25c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32814, on dev md5a vnode 0xfffff8032592b750: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8082108bd68 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff804553e0000 (pid 20715, creat, tid 100310) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b29492 at vn_open_cred+0x102 #8 0xffffffff80b2297c at kern_openat+0x25c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32816, on dev md5a vnode 0xfffff80325b77c30: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80eb52f3948 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8011ae4e500 (pid 20716, creat, tid 100167) #0 0xffffffff80a2a4fd at __lockmgr_args+0xc0d #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b0d929 at lookup+0x109 #6 0xffffffff80b0d462 at namei+0x592 #7 0xffffffff80b29492 at vn_open_cred+0x102 #8 0xffffffff80b2297c at kern_openat+0x25c #9 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #10 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32820, on dev md5a vnode 0xfffff80325b3c750: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80eb5b54e70 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801e23b4500 (pid 20689, rename, tid 100227) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b19bdd at vget+0x8d #6 0xffffffff80b0c02c at vfs_hash_get+0xcc #7 0xffffffff80d1bc30 at ffs_vgetf+0x40 #8 0xffffffff80d11ca6 at softdep_sync_buf+0x6c6 #9 0xffffffff80d21d5c at ffs_syncvnode+0x38c #10 0xffffffff80cf7591 at ffs_truncate+0x8a1 #11 0xffffffff80d3373d at ufs_rename+0x10fd #12 0xffffffff81036618 at VOP_RENAME_APV+0xe8 #13 0xffffffff80b26fd8 at kern_renameat+0x4a8 #14 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #15 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 32852, on dev md5a vnode 0xfffff80476f3d000: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80eb5fe9a50 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8011ad22000 (pid 20601, link, tid 100159) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b19bdd at vget+0x8d #6 0xffffffff80b0c02c at vfs_hash_get+0xcc #7 0xffffffff80d1bc30 at ffs_vgetf+0x40 #8 0xffffffff80d2af18 at ufs_lookup_ino+0x938 #9 0xffffffff810342ae at VOP_CACHEDLOOKUP_APV+0xfe #10 0xffffffff80b0340d at VOP_CACHEDLOOKUP+0x4d #11 0xffffffff80b03328 at vfs_cache_lookup+0x148 #12 0xffffffff810340de at VOP_LOOKUP_APV+0xfe #13 0xffffffff80b0ddd2 at lookup+0x5b2 #14 0xffffffff80b0d462 at namei+0x592 #15 0xffffffff80b23da1 at kern_unlinkat+0xa1 #16 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #17 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 45173, on dev md5a vnode 0xfffff80baba11750: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80821074108 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001d178a00 (pid 20599, link, tid 100073) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b19bdd at vget+0x8d #6 0xffffffff80b0c02c at vfs_hash_get+0xcc #7 0xffffffff80d1bc30 at ffs_vgetf+0x40 #8 0xffffffff80d2af18 at ufs_lookup_ino+0x938 #9 0xffffffff810342ae at VOP_CACHEDLOOKUP_APV+0xfe #10 0xffffffff80b0340d at VOP_CACHEDLOOKUP+0x4d #11 0xffffffff80b03328 at vfs_cache_lookup+0x148 #12 0xffffffff810340de at VOP_LOOKUP_APV+0xfe #13 0xffffffff80b0ddd2 at lookup+0x5b2 #14 0xffffffff80b0d462 at namei+0x592 #15 0xffffffff80b23da1 at kern_unlinkat+0xa1 #16 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #17 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 57605, on dev md5a vnode 0xfffff80babaea270: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80eb551b420 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8021ac05a00 (pid 20662, link, tid 100338) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d2243f at _lockmgr_args+0x8f #2 0xffffffff80d207c2 at ffs_lock+0x112 #3 0xffffffff81037418 at VOP_LOCK1_APV+0xe8 #4 0xffffffff80b29e82 at _vn_lock+0xc2 #5 0xffffffff80b2352e at kern_linkat+0x1be #6 0xffffffff80b23368 at sys_link+0x28 #7 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #8 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 67212, on dev md5a vnode 0xfffff80070481750: tag ufs, type VLNK usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff801e23b2000 (pid 20615, symlink, tid 100234) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d1bd2e at ffs_vgetf+0x13e #2 0xffffffff80cef6d1 at ffs_valloc+0x4e1 #3 0xffffffff80d34d94 at ufs_makeinode+0x84 #4 0xffffffff80d347e2 at ufs_symlink+0x32 #5 0xffffffff81036b94 at VOP_SYMLINK_APV+0x104 #6 0xffffffff80b23a8f at kern_symlinkat+0x22f #7 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #8 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 67304, on dev md5a vnode 0xfffff80dac67c270: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff801e27c6a00 (pid 20694, creat, tid 100271) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d1bd2e at ffs_vgetf+0x13e #2 0xffffffff80cef6d1 at ffs_valloc+0x4e1 #3 0xffffffff80d34d94 at ufs_makeinode+0x84 #4 0xffffffff80d30e03 at ufs_create+0x33 #5 0xffffffff8103447e at VOP_CREATE_APV+0xfe #6 0xffffffff80b29672 at vn_open_cred+0x2e2 #7 0xffffffff80b2297c at kern_openat+0x25c #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 67324, on dev md5a vnode 0xfffff8025bd5a000: tag ufs, type VLNK usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8011ae4d500 (pid 20617, symlink, tid 100170) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d1bd2e at ffs_vgetf+0x13e #2 0xffffffff80cef6d1 at ffs_valloc+0x4e1 #3 0xffffffff80d34d94 at ufs_makeinode+0x84 #4 0xffffffff80d347e2 at ufs_symlink+0x32 #5 0xffffffff81036b94 at VOP_SYMLINK_APV+0x104 #6 0xffffffff80b23a8f at kern_symlinkat+0x22f #7 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #8 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 67329, on dev md5a vnode 0xfffff8025b014c30: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff804553e0000 (pid 20715, creat, tid 100310) #0 0xffffffff80a2a44a at __lockmgr_args+0xb5a #1 0xffffffff80d1bd2e at ffs_vgetf+0x13e #2 0xffffffff80cef6d1 at ffs_valloc+0x4e1 #3 0xffffffff80d34d94 at ufs_makeinode+0x84 #4 0xffffffff80d30e03 at ufs_create+0x33 #5 0xffffffff8103447e at VOP_CREATE_APV+0xfe #6 0xffffffff80b29672 at vn_open_cred+0x2e2 #7 0xffffffff80b2297c at kern_openat+0x25c #8 0xffffffff80ed3ca6 at amd64_syscall+0x2f6 #9 0xffffffff80eb2f0b at Xfast_syscall+0xfb ino 67349, on dev md5a db:0:lockedvnods> show mount 0xfffff8001d05cb58 /dev/gpt/root on / (ufs) 0xfffff8001d05d000 devfs on /dev (devfs) 0xfffff8001d05c790 /dev/gpt/tmp on /tmp (ufs) 0xfffff8001d05c3c8 procfs on /proc (procfs) 0xfffff8001d05c000 /dev/ada0p2 on /media (ufs) 0xfffff8001d05bb58 fdescfs on /dev/fd (fdescfs) 0xfffff8001d05b790 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 15284726 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 177578 vm_cnt.v_active_count: 17143 vm_cnt.v_wire_count: 835708 vm_cnt.v_free_reserved: 21293 vm_cnt.v_free_min: 102867 vm_cnt.v_free_target: 347589 vm_cnt.v_inactive_target: 521383 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 20750 20747 20750 2 Rs sh 20747 828 828 0 S piperd 0xfffff801054625f0 cron 20745 20741 20741 2 RV sh 20741 20739 20741 2 Rs sh 20739 828 828 0 S piperd 0xfffff80455fe92f8 cron 20734 20731 20731 2 RV sh 20731 20730 20731 2 Rs sh 20730 828 828 0 S piperd 0xfffff80105462000 cron 20727 20726 637 0 D ufs 0xfffff80227970c98 ls 20726 637 637 0 S wait 0xfffff802cda63a50 sh 20725 20692 19823 1002 R+ creat 20724 20692 19823 1002 R+ creat 20723 20692 19823 1002 R+ creat 20722 20692 19823 1002 R+ creat 20721 20692 19823 1002 R+ creat 20720 20692 19823 1002 R+ creat 20719 20692 19823 1002 R+ creat 20718 20692 19823 1002 R+ creat 20717 20692 19823 1002 R+ creat 20716 20692 19823 1002 R+ CPU 0 creat 20715 20692 19823 1002 R+ creat 20700 20696 19823 1002 RE+ swap 20698 20696 19823 1002 RE+ swap 20696 20593 19823 1002 R+ swap 20695 20692 19823 1002 R+ creat 20694 20692 19823 1002 R+ creat 20693 20692 19823 1002 R+ creat 20692 20590 19823 1002 S+ wait 0xfffff8011add3a50 creat 20691 20687 19823 1002 R+ rename 20690 20687 19823 1002 D+ ufs 0xfffff80227970c98 rename 20689 20687 19823 1002 R+ rename 20688 20687 19823 1002 D+ ufs 0xfffff80227970c98 rename 20687 20592 19823 1002 S+ wait 0xfffff80117ddda50 rename 20686 20672 19823 1002 R+ mkdir 20685 20672 19823 1002 R+ mkdir 20684 20672 19823 1002 R+ mkdir 20683 20672 19823 1002 R+ mkdir 20682 20672 19823 1002 R+ mkdir 20681 20672 19823 1002 R+ mkdir 20680 20672 19823 1002 R+ mkdir 20679 20672 19823 1002 R+ mkdir 20678 20672 19823 1002 R+ mkdir 20677 20672 19823 1002 R+ mkdir 20676 20672 19823 1002 D+ ufs 0xfffff80227970c98 mkdir 20675 20672 19823 1002 D+ ufs 0xfffff80227970c98 mkdir 20674 20672 19823 1002 R+ mkdir 20673 20672 19823 1002 R+ mkdir 20672 20591 19823 1002 S+ wait 0xfffff802cda62528 mkdir 20671 20598 19823 1002 R+ link 20670 20598 19823 1002 R+ link 20669 20598 19823 1002 R+ link 20668 20598 19823 1002 R+ link 20667 20598 19823 1002 R+ link 20666 20598 19823 1002 R+ link 20665 20598 19823 1002 R+ link 20664 20598 19823 1002 R+ link 20663 20598 19823 1002 R+ link 20662 20598 19823 1002 R+ link 20661 20596 19823 1002 R+ openat 20660 20596 19823 1002 R+ openat 20659 20596 19823 1002 R+ openat 20658 20596 19823 1002 R+ openat 20657 20596 19823 1002 R+ openat 20656 20596 19823 1002 R+ openat 20655 20596 19823 1002 R+ openat 20654 20596 19823 1002 R+ openat 20653 20596 19823 1002 R+ openat 20652 20596 19823 1002 R+ openat 20651 20596 19823 1002 R+ openat 20650 20596 19823 1002 R+ openat 20649 20596 19823 1002 R+ openat 20648 20596 19823 1002 R+ openat 20647 20596 19823 1002 R+ openat 20646 20596 19823 1002 R+ openat 20645 20596 19823 1002 R+ openat 20644 20596 19823 1002 R+ openat 20643 20596 19823 1002 R+ openat 20642 20595 19823 1002 R+ fts 20641 20595 19823 1002 D+ ufs 0xfffff80227970c98 fts 20640 20595 19823 1002 D+ ufs 0xfffff80227970c98 fts 20639 20595 19823 1002 D+ ufs 0xfffff80227970c98 fts 20638 20620 19823 1002 R+ lockf 20637 20620 19823 1002 R+ lockf 20636 20620 19823 1002 R+ lockf 20635 20620 19823 1002 R+ lockf 20634 20620 19823 1002 R+ lockf 20633 20620 19823 1002 R+ lockf 20632 20620 19823 1002 R+ lockf 20631 20620 19823 1002 R+ lockf 20630 20620 19823 1002 R+ lockf 20629 20620 19823 1002 R+ lockf 20628 20620 19823 1002 R+ lockf 20627 20620 19823 1002 R+ lockf 20626 20620 19823 1002 D+ ufs 0xfffff80227970c98 lockf 20625 20620 19823 1002 D+ ufs 0xfffff80227970c98 lockf 20624 20620 19823 1002 R+ lockf 20623 20620 19823 1002 R+ lockf 20622 20620 19823 1002 D+ ufs 0xfffff80227970c98 lockf 20621 20620 19823 1002 D+ ufs 0xfffff80227970c98 lockf 20620 20589 19823 1002 S+ wait 0xfffff8011ace8528 lockf 20619 20603 19823 1002 R+ symlink 20618 20603 19823 1002 L+ *ncbuc 0xfffff801e2555c00 symlink 20617 20603 19823 1002 R+ symlink 20616 20603 19823 1002 R+ symlink 20615 20603 19823 1002 R+ symlink 20614 20602 19823 1002 R+ lockf2 20613 20602 19823 1002 R+ lockf2 20612 20602 19823 1002 R+ lockf2 20611 20602 19823 1002 R+ lockf2 20610 20602 19823 1002 D+ ufs 0xfffff80227970c98 lockf2 20609 20602 19823 1002 R+ lockf2 20608 20602 19823 1002 R+ lockf2 20607 20602 19823 1002 R+ lockf2 20606 20602 19823 1002 R+ lockf2 20605 20602 19823 1002 D+ ufs 0xfffff80227970c98 lockf2 20604 20602 19823 1002 R+ lockf2 20603 20584 19823 1002 S+ wait 0xfffff801e250e528 symlink 20602 20583 19823 1002 S+ wait 0xfffff801e26b4a50 lockf2 20601 20598 19823 1002 R+ link 20600 20598 19823 1002 R+ link 20599 20598 19823 1002 R+ link 20598 20588 19823 1002 S+ wait 0xfffff8011af82528 link 20597 20596 19823 1002 R+ openat 20596 20585 19823 1002 S+ wait 0xfffff80071888528 openat 20595 20587 19823 1002 S+ wait 0xfffff80117ddca50 fts 20593 19846 19823 1002 S+ wait 0xfffff80476565a50 swap 20592 19846 19823 1002 S+ wait 0xfffff8011ae26000 rename 20591 19846 19823 1002 S+ wait 0xfffff801e226b528 mkdir 20590 19846 19823 1002 S+ wait 0xfffff8047642da50 creat 20589 19846 19823 1002 S+ wait 0xfffff8011ad2f528 lockf 20588 19846 19823 1002 S+ wait 0xfffff801e2783528 link 20587 19846 19823 1002 S+ wait 0xfffff801e25e4000 fts 20585 19846 19823 1002 S+ wait 0xfffff801e2783000 openat 20584 19846 19823 1002 S+ wait 0xfffff8011add3000 symlink 20583 19846 19823 1002 S+ wait 0xfffff802129ff528 lockf2 20581 863 858 1001 R sleep 19846 19845 19823 1002 S+ wait 0xfffff8011adee000 run 19845 19844 19823 1002 S+ wait 0xfffff8047642b000 run 19844 19823 19823 1002 S+ wait 0xfffff801e226ba50 run 19823 19822 19823 1002 S+ wait 0xfffff8011adeea50 sh 19822 19791 18932 0 S+ wait 0xfffff8011add1a50 su 19817 0 0 0 DL mdwait 0xfffff8011abee800 [md5] 19791 19789 18932 0 S+ wait 0xfffff80071889528 sh 19790 18932 18932 0 S+ piperd 0xfffff80105462be0 tee 19789 18932 18932 0 S+ wait 0xfffff801e2852000 sh 18932 1448 18932 0 S+ wait 0xfffff80117ddd000 sh 11809 11804 11429 0 S piperd 0xfffff80105463be0 cat 11804 11793 11429 0 S wait 0xfffff8011ace8000 sh 11803 11793 11429 0 R find 11793 11791 11429 0 S wait 0xfffff8011ae09528 sh 11792 11772 11429 0 S piperd 0xfffff8001d0ff5f0 mail 11791 11772 11429 0 S wait 0xfffff802129fe528 sh 11772 11768 11429 0 S wait 0xfffff80476360000 sh 11768 11763 11429 0 S wait 0xfffff802cdd27528 lockf 11763 11762 11429 0 S wait 0xfffff801e243f000 sh 11762 11442 11429 0 S wait 0xfffff801e25e5000 sh 11443 11432 11429 0 S piperd 0xfffff80455fe95f0 mail 11442 11432 11429 0 S wait 0xfffff801e21a9a50 sh 11432 11431 11429 0 S wait 0xfffff8011ace9a50 sh 11431 11429 11429 0 S wait 0xfffff801e2372a50 lockf 11429 11427 11429 0 Ss wait 0xfffff801e2784000 sh 11427 828 828 0 S piperd 0xfffff8001d0ff000 cron 9216 1 9216 0 Ss+ ttyin 0xfffff800181128a8 getty 9215 1 9215 0 Ss+ ttyin 0xfffff800181100a8 getty 9214 1 9214 0 Ss+ ttyin 0xfffff800181104a8 getty 9213 1 9213 0 Ss+ ttyin 0xfffff800181108a8 getty 9212 1 9212 0 Ss+ ttyin 0xfffff80018110ca8 getty 9211 1 9211 0 Ss+ ttyin 0xfffff800181110a8 getty 9210 1 9210 0 Ss+ ttyin 0xfffff800181114a8 getty 9209 1 9209 0 Ss+ ttyin 0xfffff800181118a8 getty 9208 1 9208 0 Ss+ ttyin 0xfffff80018111ca8 getty 9188 1 9188 0 Ss select 0xfffff800180c54c0 inetd 1448 1446 1448 0 S+ wait 0xfffff80105411528 bash 1446 1445 1446 0 S+ pause 0xfffff80105411af8 csh 1445 1438 1445 1001 S+ wait 0xfffff80105412a50 su 1438 1437 1438 1001 Ss+ wait 0xfffff80105412528 bash 1437 1435 1435 1001 S select 0xfffff800180af840 sshd 1435 818 1435 0 Ss select 0xfffff8001d085140 sshd 866 858 858 1001 S piperd 0xfffff8001d0ff2f8 sh 864 858 858 1001 S piperd 0xfffff8001d0ff8e8 awk 863 858 858 1001 S wait 0xfffff801050a6528 sh 860 855 860 1001 Ss+ select 0xfffff8001d0849c0 top 859 856 859 1001 Ss kqread 0xfffff800715a7b00 tail 858 857 858 1001 Ss wait 0xfffff801050ab528 sh 857 849 849 1001 S select 0xfffff800180c53c0 sshd 856 853 853 1001 S select 0xfffff800180afcc0 sshd 855 848 848 1001 S select 0xfffff800180c2dc0 sshd 853 818 853 0 Ss select 0xfffff800180c5340 sshd 849 818 849 0 Ss select 0xfffff800180c2040 sshd 848 818 848 0 Ss select 0xfffff800180afe40 sshd 828 1 828 0 Ss nanslp 0xffffffff81be6120 cron 824 1 824 25 Ss pause 0xfffff800717270a8 sendmail 821 1 821 0 Ss select 0xfffff8001d1a6040 sendmail 818 1 818 0 Ss select 0xfffff8001d1a5e40 sshd 765 760 760 0 S lockf 0xfffff80018125600 saslauthd 764 760 760 0 S lockf 0xfffff80018125680 saslauthd 763 760 760 0 S lockf 0xfffff80018125700 saslauthd 762 760 760 0 S lockf 0xfffff80018126800 saslauthd 760 1 760 0 Ss accept 0xfffff800710463cc saslauthd 736 1 736 0 Rs powerd 733 1 733 0 Ss (threaded) ntpd 100101 S select 0xfffff800180c25c0 ntpd 696 1 696 0 Rs NLM: master 693 1 693 0 Ss select 0xfffff8001d1a5cc0 rpc.statd 692 689 689 0 R (threaded) nfsd 100091 RunQ nfsd: master 100092 S rpcsvc 0xfffff80010c80ba0 nfsd: service 100093 S rpcsvc 0xfffff80010c80aa0 nfsd: service 100094 S rpcsvc 0xfffff80010c809a0 nfsd: service 100095 S rpcsvc 0xfffff80010c808a0 nfsd: service 100096 S rpcsvc 0xfffff80010c807a0 nfsd: service 100097 S rpcsvc 0xfffff80010c806a0 nfsd: service 100098 S rpcsvc 0xfffff80010c805a0 nfsd: service 689 1 689 0 Ss select 0xfffff8001d1a5b40 nfsd 683 1 683 0 Ss select 0xfffff8001d1a5ac0 mountd 677 672 672 0 S select 0xfffff8001d1a5a40 nfsuserd 676 672 672 0 S select 0xfffff8001d1a59c0 nfsuserd 675 672 672 0 S select 0xfffff8001d1a5940 nfsuserd 674 672 672 0 S select 0xfffff8001d084bc0 nfsuserd 672 1 672 0 Ss pause 0xfffff8001d1e75d0 nfsuserd 637 1 637 0 Ss wait 0xfffff8001d1e7000 watchdogd 559 1 559 0 Ss select 0xfffff8001d1a6340 rpcbind 551 1 551 0 Ss select 0xfffff8001d084d40 syslogd 519 1 519 0 Ss select 0xfffff8001d085ac0 rtsold 467 1 467 0 Ss select 0xfffff8001d1a58c0 moused 454 1 454 0 Ss select 0xfffff8001d1a5ec0 devd 22 0 0 0 DL vlruwt 0xfffff8001d050a50 [vnlru] 21 0 0 0 DL syncer 0xffffffff81d7f640 [syncer] 20 0 0 0 RL (threaded) [bufdaemon] 100066 D psleep 0xffffffff81d7dd04 [bufdaemon] 100075 RunQ [/ worker] 100078 RunQ [/tmp worker] 100080 D sdflush 0xfffff8001af1cae8 [/media worker] 100341 RunQ [/mnt worker] 19 0 0 0 DL - 0xffffffff81d7ea04 [bufspacedaemon] 18 0 0 0 DL psleep 0xffffffff81d8818c [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100063 D psleep 0xffffffff81e34305 [pagedaemon] 100069 D umarcl 0xffffffff81d87ab8 [uma] 16 0 0 0 DL idle 0xfffff8001af11a50 [enc_daemon0] 15 0 0 0 DL - 0xffffffff81d7d564 [soaiod4] 9 0 0 0 DL - 0xffffffff81d7d564 [soaiod3] 8 0 0 0 DL - 0xffffffff81d7d564 [soaiod2] 7 0 0 0 DL - 0xffffffff81d7d564 [soaiod1] 6 0 0 0 DL - 0xffffffff81ab9c88 [rand_harvestq] 5 0 0 0 DL waiting 0xffffffff81e25420 [sctp_iterator] 14 0 0 0 DL (threaded) [usb] 100026 D - 0xfffffe0000ebad10 [usbus0] 100027 D - 0xfffffe0000ebad68 [usbus0] 100028 D - 0xfffffe0000ebadc0 [usbus0] 100029 D - 0xfffffe0000ebae18 [usbus0] 100030 D - 0xfffffe0000ebae70 [usbus0] 100039 D - 0xfffffe00010ff460 [usbus1] 100040 D - 0xfffffe00010ff4b8 [usbus1] 100041 D - 0xfffffe00010ff510 [usbus1] 100042 D - 0xfffffe00010ff568 [usbus1] 100043 D - 0xfffffe00010ff5c0 [usbus1] 100045 D - 0xfffffe0000f69d10 [usbus2] 100046 D - 0xfffffe0000f69d68 [usbus2] 100047 D - 0xfffffe0000f69dc0 [usbus2] 100048 D - 0xfffffe0000f69e18 [usbus2] 100049 D - 0xfffffe0000f69e70 [usbus2] 4 0 0 0 DL (threaded) [cam] 100019 D - 0xffffffff8198cd80 [doneq0] 100057 D - 0xffffffff8198cbc8 [scanner] 3 0 0 0 DL crypto_ 0xffffffff81d865d8 [crypto returns] 2 0 0 0 DL crypto_ 0xffffffff81d86490 [crypto] 13 0 0 0 DL (threaded) [geom] 100014 D - 0xffffffff81dfd6b0 [g_event] 100015 D - 0xffffffff81dfd6b8 [g_up] 100016 D - 0xffffffff81dfd6c0 [g_down] 12 0 0 0 WL (threaded) [intr] 100004 I [swi1: netisr 0] 100005 I [swi3: vm] 100006 I [swi4: clock (0)] 100007 I [swi6: Giant taskq] 100010 I [swi5: fast taskq] 100012 I [swi6: task queue] 100023 I [irq264: isci0] 100024 I [irq265: isci0] 100025 I [irq22: ehci0] 100031 I [irq266: hdac0] 100032 I [irq267: igb0:que 0] 100034 I [irq268: igb0:link] 100035 I [irq269: igb1:que 0] 100037 I [irq270: igb1:link] 100038 I [irq271: xhci0] 100044 I [irq20: ehci1] 100050 I [irq272: ahci0] 100051 I [irq273: hdac1] 100052 I [swi0: uart] 11 0 0 0 RL [idle: cpu0] 1 0 1 0 SLs wait 0xfffff8000b6d0528 [init] 10 0 0 0 DL audit_w 0xffffffff81e2aaa0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81dfd6e8 [swapper] 100008 D - 0xfffff8000b6c6600 [thread taskq] 100009 D - 0xfffff8000b6c6400 [aiod_kick taskq] 100011 D - 0xfffff8000b6c6000 [kqueue_ctx taskq] 100013 D - 0xfffff8000b6c5b00 [firmware taskq] 100020 D - 0xfffff8000b6c5100 [acpi_task_0] 100021 D - 0xfffff8000b6c5100 [acpi_task_1] 100022 D - 0xfffff8000b6c5100 [acpi_task_2] 100033 D - 0xfffff8000b6c4200 [igb0 que] 100036 D - 0xfffff8000b6c3d00 [igb1 que] 100053 D - 0xfffff80010d8ac00 [mca taskq] 100056 D - 0xfffff8000b6c5400 [CAM taskq] 100079 D - 0xfffff80010d88600 [/media trim] 20711 20696 19823 1002 Z+ swap 20699 20696 19823 1002 Z+ swap 20709 20696 19823 1002 Z+ swap 20703 20696 19823 1002 Z+ swap 20702 20696 19823 1002 Z+ swap 20710 20696 19823 1002 Z+ swap 20708 20696 19823 1002 Z+ swap 20713 20696 19823 1002 Z+ swap 20705 20696 19823 1002 Z+ swap 20712 20696 19823 1002 Z+ swap 20706 20696 19823 1002 Z+ swap 20701 20696 19823 1002 Z+ swap 20714 20696 19823 1002 Z+ swap 20707 20696 19823 1002 Z+ swap 20704 20696 19823 1002 Z+ swap 20594 19846 19823 1002 Z+ mkfifo 20586 19846 19823 1002 Z+ rw db:0:ps> allt Tracing command sh pid 20750 tid 100172 td 0xfffff8011aefba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ff70b0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ff70e0 critical_exit() at critical_exit+0x8b/frame 0xfffffe1048ff7100 intr_event_handle() at intr_event_handle+0x147/frame 0xfffffe1048ff7150 intr_execute_handlers() at intr_execute_handlers+0x48/frame 0xfffffe1048ff7180 lapic_handle_intr() at lapic_handle_intr+0x68/frame 0xfffffe1048ff71c0 Xapic_isr2() at Xapic_isr2+0xb7/frame 0xfffffe1048ff71c0 --- interrupt, rip = 0xffffffff80b00f8e, rsp = 0xfffffe1048ff7290, rbp = 0xfffffe1048ff73c0 --- cache_enter_time() at cache_enter_time+0x98e/frame 0xfffffe1048ff73c0 ufs_lookup_ino() at ufs_lookup_ino+0xd51/frame 0xfffffe1048ff74e0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xfe/frame 0xfffffe1048ff7510 VOP_CACHEDLOOKUP() at VOP_CACHEDLOOKUP+0x4d/frame 0xfffffe1048ff7560 vfs_cache_lookup() at vfs_cache_lookup+0x148/frame 0xfffffe1048ff75d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xfe/frame 0xfffffe1048ff7600 lookup() at lookup+0x5b2/frame 0xfffffe1048ff7690 namei() at namei+0x592/frame 0xfffffe1048ff7750 kern_statat() at kern_statat+0xa8/frame 0xfffffe1048ff7900 sys_stat() at sys_stat+0x2d/frame 0xfffffe1048ff79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ff7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ff7ab0 --- syscall (188, FreeBSD ELF64, sys_stat), rip = 0x800bd333a, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe7d0 --- Tracing command cron pid 20747 tid 100262 td 0xfffff801e26fca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491bc6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491bc6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491bc730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491bc790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491bc7c0 _sleep() at _sleep+0x32b/frame 0xfffffe10491bc860 pipe_read() at pipe_read+0x286/frame 0xfffffe10491bc8c0 dofileread() at dofileread+0xcf/frame 0xfffffe10491bc900 kern_readv() at kern_readv+0x68/frame 0xfffffe10491bc950 sys_read() at sys_read+0x84/frame 0xfffffe10491bc9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491bcab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491bcab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800da3afa, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe4e0 --- Tracing command sh pid 20745 tid 100106 td 0xfffff8007162ba00 fork_trampoline() at fork_trampoline Tracing command sh pid 20741 tid 100250 td 0xfffff801e2554a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049180880 mi_switch() at mi_switch+0x167/frame 0xfffffe10491808b0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491808f0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1049180920 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21f/frame 0xfffffe10491809a0 amd64_syscall() at amd64_syscall+0x6c1/frame 0xfffffe1049180ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049180ab0 --- syscall (20745), rip = 0x800b4582d, rsp = 0x7fffffffe830, rbp = 0x7fffffffe8d0 --- Tracing command cron pid 20739 tid 100243 td 0xfffff801e2484000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104915d6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe104915d6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104915d730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104915d790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104915d7c0 _sleep() at _sleep+0x32b/frame 0xfffffe104915d860 pipe_read() at pipe_read+0x286/frame 0xfffffe104915d8c0 dofileread() at dofileread+0xcf/frame 0xfffffe104915d900 kern_readv() at kern_readv+0x68/frame 0xfffffe104915d950 sys_read() at sys_read+0x84/frame 0xfffffe104915d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104915dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104915dab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800da3afa, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe4e0 --- Tracing command sh pid 20734 tid 100333 td 0xfffff80476488500 fork_trampoline() at fork_trampoline Tracing command sh pid 20731 tid 100278 td 0xfffff801e27c4500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104920e880 mi_switch() at mi_switch+0x167/frame 0xfffffe104920e8b0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104920e8f0 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe104920e920 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21f/frame 0xfffffe104920e9a0 amd64_syscall() at amd64_syscall+0x6c1/frame 0xfffffe104920eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104920eab0 --- syscall (20734), rip = 0x800b4582d, rsp = 0x7fffffffe830, rbp = 0x7fffffffe8d0 --- Tracing command cron pid 20730 tid 100302 td 0xfffff802cd4cba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492816c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10492816f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049281730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049281790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492817c0 _sleep() at _sleep+0x32b/frame 0xfffffe1049281860 pipe_read() at pipe_read+0x286/frame 0xfffffe10492818c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049281900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049281950 sys_read() at sys_read+0x84/frame 0xfffffe10492819a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049281ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049281ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800da3afa, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe4e0 --- Tracing command ls pid 20727 tid 100174 td 0xfffff8011aefb000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049004030 mi_switch() at mi_switch+0x167/frame 0xfffffe1049004060 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490040a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10490040d0 sleeplk() at sleeplk+0x151/frame 0xfffffe1049004130 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe10490041f0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1049004260 ffs_lock() at ffs_lock+0x112/frame 0xfffffe10490042f0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1049004320 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1049004390 vget() at vget+0x8d/frame 0xfffffe10490043e0 cache_lookup() at cache_lookup+0xa79/frame 0xfffffe1049004560 vfs_cache_lookup() at vfs_cache_lookup+0x12a/frame 0xfffffe10490045d0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xfe/frame 0xfffffe1049004600 lookup() at lookup+0x5b2/frame 0xfffffe1049004690 namei() at namei+0x592/frame 0xfffffe1049004750 kern_statat() at kern_statat+0xa8/frame 0xfffffe1049004900 sys_fstatat() at sys_fstatat+0x2c/frame 0xfffffe10490049a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049004ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049004ab0 --- syscall (493, FreeBSD ELF64, sys_fstatat), rip = 0x800f48e4a, rsp = 0x7fffffffe488, rbp = 0x7fffffffe540 --- Tracing command sh pid 20726 tid 100295 td 0xfffff800719d0a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ed7560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ed7590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ed75d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ed7630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ed7660 _sleep() at _sleep+0x32b/frame 0xfffffe1048ed7700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048ed77b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048ed79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ed7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ed7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe878, rbp = 0x7fffffffe930 --- Tracing command creat pid 20725 tid 100187 td 0xfffff8011afc5a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049045760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049045790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490457d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049045830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049045860 _sleep() at _sleep+0x306/frame 0xfffffe1049045900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049045960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490459a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049045ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049045ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20724 tid 100232 td 0xfffff801e23b2a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049126760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049126790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491267d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049126830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049126860 _sleep() at _sleep+0x306/frame 0xfffffe1049126900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049126960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491269a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049126ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049126ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20723 tid 100168 td 0xfffff8011ae4e000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fe3760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fe3790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fe37d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fe3830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048fe3860 _sleep() at _sleep+0x306/frame 0xfffffe1048fe3900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048fe3960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048fe39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fe3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fe3ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20722 tid 100184 td 0xfffff8011afc9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049036760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049036790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490367d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049036830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049036860 _sleep() at _sleep+0x306/frame 0xfffffe1049036900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049036960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490369a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049036ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049036ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20721 tid 100222 td 0xfffff801e22b5000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490f4760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490f4790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490f47d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490f4830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490f4860 _sleep() at _sleep+0x306/frame 0xfffffe10490f4900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490f4960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490f49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490f4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490f4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20720 tid 100275 td 0xfffff801e27c5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491fd760 mi_switch() at mi_switch+0x167/frame 0xfffffe10491fd790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491fd7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491fd830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10491fd860 _sleep() at _sleep+0x306/frame 0xfffffe10491fd900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10491fd960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491fd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491fdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491fdab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20719 tid 100163 td 0xfffff8011ae4fa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fca760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fca790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fca7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fca830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048fca860 _sleep() at _sleep+0x306/frame 0xfffffe1048fca900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048fca960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048fca9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fcaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fcaab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20718 tid 100111 td 0xfffff800717cf000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048eb4760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048eb4790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048eb47d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048eb4830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048eb4860 _sleep() at _sleep+0x306/frame 0xfffffe1048eb4900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048eb4960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048eb49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048eb4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048eb4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20717 tid 100301 td 0xfffff802cd4cc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104927c760 mi_switch() at mi_switch+0x167/frame 0xfffffe104927c790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104927c7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104927c830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104927c860 _sleep() at _sleep+0x306/frame 0xfffffe104927c900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104927c960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104927c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104927cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104927cab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20716 tid 100167 td 0xfffff8011ae4e500 (CPU 0) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe1048fddf00 hardclock_cnt() at hardclock_cnt+0x28e/frame 0xfffffe1048fddf60 handleevents() at handleevents+0xb5/frame 0xfffffe1048fddfa0 timercb() at timercb+0x227/frame 0xfffffe1048fddff0 lapic_handle_timer() at lapic_handle_timer+0x9f/frame 0xfffffe1048fde030 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe1048fde030 --- interrupt, rip = 0xffffffff80b054c4, rsp = 0xfffffe1048fde100, rbp = 0xfffffe1048fde100 --- fnv_32_buf() at fnv_32_buf+0x4/frame 0xfffffe1048fde100 cache_get_hash() at cache_get_hash+0x5c/frame 0xfffffe1048fde140 NCP2BUCKETLOCK() at NCP2BUCKETLOCK+0x25/frame 0xfffffe1048fde160 cache_zap_locked_vnode_kl() at cache_zap_locked_vnode_kl+0x9f/frame 0xfffffe1048fde1e0 cache_purge() at cache_purge+0x1bc/frame 0xfffffe1048fde250 vgonel() at vgonel+0x444/frame 0xfffffe1048fde2c0 vnlru_free_locked() at vnlru_free_locked+0x2c2/frame 0xfffffe1048fde330 getnewvnode() at getnewvnode+0xc9/frame 0xfffffe1048fde370 ffs_vgetf() at ffs_vgetf+0xe2/frame 0xfffffe1048fde400 ffs_valloc() at ffs_valloc+0x4e1/frame 0xfffffe1048fde4a0 ufs_makeinode() at ufs_makeinode+0x84/frame 0xfffffe1048fde660 ufs_create() at ufs_create+0x33/frame 0xfffffe1048fde680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe1048fde6b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe1048fde820 kern_openat() at kern_openat+0x25c/frame 0xfffffe1048fde9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fdeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fdeab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20715 tid 100310 td 0xfffff804553e0000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492a90b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10492a90e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492a9120 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10492a9150 sleeplk() at sleeplk+0x151/frame 0xfffffe10492a91b0 __lockmgr_args() at __lockmgr_args+0x9bf/frame 0xfffffe10492a9270 getblk() at getblk+0x11d/frame 0xfffffe10492a9310 breadn_flags() at breadn_flags+0x30/frame 0xfffffe10492a9360 ffs_update() at ffs_update+0x1c6/frame 0xfffffe10492a93e0 ufs_direnter() at ufs_direnter+0x881/frame 0xfffffe10492a94a0 ufs_makeinode() at ufs_makeinode+0x5e3/frame 0xfffffe10492a9660 ufs_create() at ufs_create+0x33/frame 0xfffffe10492a9680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe10492a96b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe10492a9820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10492a99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492a9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492a9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command swap pid 20700 tid 100300 td 0xfffff802cd4cc500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049277000 mi_switch() at mi_switch+0x167/frame 0xfffffe1049277030 critical_exit() at critical_exit+0x8b/frame 0xfffffe1049277050 lapic_handle_timer() at lapic_handle_timer+0xb1/frame 0xfffffe1049277090 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe1049277090 --- interrupt, rip = 0xffffffff80ab26fe, rsp = 0xfffffe1049277160, rbp = 0xfffffe1049277180 --- witness_lock_order_check() at witness_lock_order_check+0x1e/frame 0xfffffe1049277180 witness_checkorder() at witness_checkorder+0x54a/frame 0xfffffe10492773a0 __mtx_lock_flags() at __mtx_lock_flags+0xa4/frame 0xfffffe10492773f0 uma_dbg_getslab() at uma_dbg_getslab+0x42/frame 0xfffffe1049277420 uma_dbg_free() at uma_dbg_free+0x3a/frame 0xfffffe1049277450 uma_zfree_arg() at uma_zfree_arg+0x64/frame 0xfffffe10492774a0 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x38/frame 0xfffffe10492774d0 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x38/frame 0xfffffe1049277500 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x38/frame 0xfffffe1049277530 vm_radix_reclaim_allnodes_int() at vm_radix_reclaim_allnodes_int+0x38/frame 0xfffffe1049277560 vm_object_terminate() at vm_object_terminate+0x1f7/frame 0xfffffe10492775a0 vm_object_deallocate() at vm_object_deallocate+0x4ac/frame 0xfffffe1049277610 vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xfffffe1049277640 vm_map_remove() at vm_map_remove+0xc8/frame 0xfffffe1049277670 vmspace_exit() at vmspace_exit+0xc9/frame 0xfffffe10492776b0 exit1() at exit1+0x58b/frame 0xfffffe1049277710 sigexit() at sigexit+0xb93/frame 0xfffffe10492779a0 postsig() at postsig+0x2ae/frame 0xfffffe1049277a70 ast() at ast+0x4b8/frame 0xfffffe1049277ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe410 Tracing command swap pid 20698 tid 100335 td 0xfffff801e2626a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049326410 mi_switch() at mi_switch+0x167/frame 0xfffffe1049326440 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe1049326490 __mtx_lock_sleep() at __mtx_lock_sleep+0x18c/frame 0xfffffe1049326510 __mtx_lock_flags() at __mtx_lock_flags+0x10d/frame 0xfffffe1049326560 vm_object_terminate() at vm_object_terminate+0x193/frame 0xfffffe10493265a0 vm_object_deallocate() at vm_object_deallocate+0x4ac/frame 0xfffffe1049326610 vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xfffffe1049326640 vm_map_remove() at vm_map_remove+0xc8/frame 0xfffffe1049326670 vmspace_exit() at vmspace_exit+0xc9/frame 0xfffffe10493266b0 exit1() at exit1+0x58b/frame 0xfffffe1049326710 sigexit() at sigexit+0xb93/frame 0xfffffe10493269a0 postsig() at postsig+0x2ae/frame 0xfffffe1049326a70 ast() at ast+0x4b8/frame 0xfffffe1049326ab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe410 Tracing command swap pid 20696 tid 100241 td 0xfffff801e2484a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049153560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049153590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491535d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049153630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049153660 _sleep() at _sleep+0x32b/frame 0xfffffe1049153700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491537b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491539a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049153ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049153ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command creat pid 20695 tid 100182 td 0xfffff8011afca500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104902bda0 mi_switch() at mi_switch+0x167/frame 0xfffffe104902bdd0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104902be10 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104902be40 sleeplk() at sleeplk+0x151/frame 0xfffffe104902bea0 __lockmgr_args() at __lockmgr_args+0x9bf/frame 0xfffffe104902bf60 getblk() at getblk+0x11d/frame 0xfffffe104902c000 breadn_flags() at breadn_flags+0x30/frame 0xfffffe104902c050 ffs_update() at ffs_update+0x1c6/frame 0xfffffe104902c0d0 ffs_syncvnode() at ffs_syncvnode+0x860/frame 0xfffffe104902c1e0 ffs_truncate() at ffs_truncate+0x8a1/frame 0xfffffe104902c3e0 ufs_direnter() at ufs_direnter+0x6bf/frame 0xfffffe104902c4a0 ufs_makeinode() at ufs_makeinode+0x5e3/frame 0xfffffe104902c660 ufs_create() at ufs_create+0x33/frame 0xfffffe104902c680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe104902c6b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe104902c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104902c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104902cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104902cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20694 tid 100271 td 0xfffff801e27c6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491e90b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491e90e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491e9120 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10491e9150 sleeplk() at sleeplk+0x151/frame 0xfffffe10491e91b0 __lockmgr_args() at __lockmgr_args+0x9bf/frame 0xfffffe10491e9270 getblk() at getblk+0x11d/frame 0xfffffe10491e9310 breadn_flags() at breadn_flags+0x30/frame 0xfffffe10491e9360 ffs_update() at ffs_update+0x1c6/frame 0xfffffe10491e93e0 ufs_direnter() at ufs_direnter+0x881/frame 0xfffffe10491e94a0 ufs_makeinode() at ufs_makeinode+0x5e3/frame 0xfffffe10491e9660 ufs_create() at ufs_create+0x33/frame 0xfffffe10491e9680 VOP_CREATE_APV() at VOP_CREATE_APV+0xfe/frame 0xfffffe10491e96b0 vn_open_cred() at vn_open_cred+0x2e2/frame 0xfffffe10491e9820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10491e99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491e9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491e9ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20693 tid 100193 td 0xfffff801e2072a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049063760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049063790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490637d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049063830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049063860 _sleep() at _sleep+0x306/frame 0xfffffe1049063900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049063960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490639a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049063ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049063ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command creat pid 20692 tid 100169 td 0xfffff8011ae4da00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fe8560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fe8590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fe85d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fe8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048fe8660 _sleep() at _sleep+0x32b/frame 0xfffffe1048fe8700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048fe87b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048fe89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fe8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fe8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command rename pid 20691 tid 100214 td 0xfffff801e21e1a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490c7760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490c7790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490c77d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490c7830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490c7860 _sleep() at _sleep+0x306/frame 0xfffffe10490c7900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490c7960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490c79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490c7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490c7ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command rename pid 20690 tid 100145 td 0xfffff8011896ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f70200 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f70230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f70270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048f702a0 sleeplk() at sleeplk+0x151/frame 0xfffffe1048f70300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1048f703c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1048f70430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1048f704c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1048f704f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1048f70560 lookup() at lookup+0x109/frame 0xfffffe1048f705f0 namei() at namei+0x592/frame 0xfffffe1048f706b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe1048f70820 kern_openat() at kern_openat+0x25c/frame 0xfffffe1048f709a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f70ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f70ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe3b0 --- Tracing command rename pid 20689 tid 100227 td 0xfffff801e23b4500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104910cfd0 mi_switch() at mi_switch+0x167/frame 0xfffffe104910d000 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe104910d050 __rw_wlock_hard() at __rw_wlock_hard+0xb5/frame 0xfffffe104910d0e0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe104910d120 softdep_sync_buf() at softdep_sync_buf+0x9db/frame 0xfffffe104910d200 ffs_syncvnode() at ffs_syncvnode+0x38c/frame 0xfffffe104910d310 ffs_truncate() at ffs_truncate+0x8a1/frame 0xfffffe104910d510 ufs_rename() at ufs_rename+0x10fd/frame 0xfffffe104910d710 VOP_RENAME_APV() at VOP_RENAME_APV+0xe8/frame 0xfffffe104910d740 kern_renameat() at kern_renameat+0x4a8/frame 0xfffffe104910d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104910dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104910dab0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x800a83f5a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command rename pid 20688 tid 100206 td 0xfffff801e213b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104909f200 mi_switch() at mi_switch+0x167/frame 0xfffffe104909f230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104909f270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104909f2a0 sleeplk() at sleeplk+0x151/frame 0xfffffe104909f300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe104909f3c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe104909f430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe104909f4c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe104909f4f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe104909f560 lookup() at lookup+0x109/frame 0xfffffe104909f5f0 namei() at namei+0x592/frame 0xfffffe104909f6b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe104909f820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104909f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104909fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104909fab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe3b0 --- Tracing command rename pid 20687 tid 100141 td 0xfffff8010542f000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f5c560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f5c590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f5c5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f5c630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f5c660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f5c700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f5c7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f5c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f5cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f5cab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command mkdir pid 20686 tid 100198 td 0xfffff801e2071000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104907c760 mi_switch() at mi_switch+0x167/frame 0xfffffe104907c790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104907c7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104907c830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104907c860 _sleep() at _sleep+0x306/frame 0xfffffe104907c900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104907c960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104907c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104907cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104907cab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20685 tid 100153 td 0xfffff801189d2000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f98760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f98790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f987d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f98830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f98860 _sleep() at _sleep+0x306/frame 0xfffffe1048f98900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048f98960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048f989a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f98ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f98ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20684 tid 100221 td 0xfffff801e22b5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490ef760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490ef790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490ef7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490ef830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490ef860 _sleep() at _sleep+0x306/frame 0xfffffe10490ef900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490ef960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490ef9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490efab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490efab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20683 tid 100332 td 0xfffff80476488a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049317760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049317790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10493177d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049317830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049317860 _sleep() at _sleep+0x306/frame 0xfffffe1049317900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049317960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10493179a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049317ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049317ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20682 tid 100228 td 0xfffff801e23b4000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049112760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049112790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491127d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049112830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049112860 _sleep() at _sleep+0x306/frame 0xfffffe1049112900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049112960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491129a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049112ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049112ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20681 tid 100318 td 0xfffff804763bd500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492d1760 mi_switch() at mi_switch+0x167/frame 0xfffffe10492d1790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492d17d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492d1830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10492d1860 _sleep() at _sleep+0x306/frame 0xfffffe10492d1900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10492d1960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492d19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492d1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492d1ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20680 tid 100281 td 0xfffff801e2899500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104921d760 mi_switch() at mi_switch+0x167/frame 0xfffffe104921d790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104921d7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104921d830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104921d860 _sleep() at _sleep+0x306/frame 0xfffffe104921d900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104921d960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104921d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104921dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104921dab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20679 tid 100326 td 0xfffff8047648aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492f9760 mi_switch() at mi_switch+0x167/frame 0xfffffe10492f9790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492f97d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492f9830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10492f9860 _sleep() at _sleep+0x306/frame 0xfffffe10492f9900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10492f9960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492f99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492f9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492f9ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20678 tid 100160 td 0xfffff8011aceba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fbb760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fbb790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fbb7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fbb830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048fbb860 _sleep() at _sleep+0x306/frame 0xfffffe1048fbb900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048fbb960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048fbb9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fbbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fbbab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20677 tid 100306 td 0xfffff802cd4ca500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049295760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049295790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492957d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049295830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049295860 _sleep() at _sleep+0x306/frame 0xfffffe1049295900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049295960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492959a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049295ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049295ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20676 tid 100244 td 0xfffff801e2559a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491622d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1049162300 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049162340 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1049162370 sleeplk() at sleeplk+0x151/frame 0xfffffe10491623d0 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1049162490 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1049162500 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1049162590 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe10491625c0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1049162630 lookup() at lookup+0x109/frame 0xfffffe10491626c0 namei() at namei+0x592/frame 0xfffffe1049162780 kern_mkdirat() at kern_mkdirat+0xcb/frame 0xfffffe10491629a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049162ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049162ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800b8c35a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffe0c0 --- Tracing command mkdir pid 20675 tid 100173 td 0xfffff8011aefb500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ffc2d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ffc300 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ffc340 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048ffc370 sleeplk() at sleeplk+0x151/frame 0xfffffe1048ffc3d0 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1048ffc490 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1048ffc500 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1048ffc590 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1048ffc5c0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1048ffc630 lookup() at lookup+0x109/frame 0xfffffe1048ffc6c0 namei() at namei+0x592/frame 0xfffffe1048ffc780 kern_mkdirat() at kern_mkdirat+0xcb/frame 0xfffffe1048ffc9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ffcab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ffcab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800b8c35a, rsp = 0x7fffffffdc98, rbp = 0x7fffffffe0c0 --- Tracing command mkdir pid 20674 tid 100215 td 0xfffff801e21e1500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490cc760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490cc790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490cc7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490cc830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490cc860 _sleep() at _sleep+0x306/frame 0xfffffe10490cc900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490cc960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490cc9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490ccab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490ccab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20673 tid 100327 td 0xfffff8047648a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492fe760 mi_switch() at mi_switch+0x167/frame 0xfffffe10492fe790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492fe7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492fe830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10492fe860 _sleep() at _sleep+0x306/frame 0xfffffe10492fe900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10492fe960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492fe9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492feab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492feab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command mkdir pid 20672 tid 100299 td 0xfffff802cd4cca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049272560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049272590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492725d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049272630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049272660 _sleep() at _sleep+0x32b/frame 0xfffffe1049272700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10492727b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10492729a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049272ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049272ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command link pid 20671 tid 100279 td 0xfffff801e27c4000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049213760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049213790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492137d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049213830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049213860 _sleep() at _sleep+0x306/frame 0xfffffe1049213900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049213960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492139a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049213ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049213ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20670 tid 100181 td 0xfffff8011afcaa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049027760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049027790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490277d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049027830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049027860 _sleep() at _sleep+0x306/frame 0xfffffe1049027900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049027960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490279a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049027ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049027ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20669 tid 100304 td 0xfffff802cd4cb000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104928b760 mi_switch() at mi_switch+0x167/frame 0xfffffe104928b790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104928b7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104928b830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104928b860 _sleep() at _sleep+0x306/frame 0xfffffe104928b900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104928b960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104928b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104928bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104928bab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20668 tid 100115 td 0xfffff800717b9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ec8760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ec8790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ec87d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ec8830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048ec8860 _sleep() at _sleep+0x306/frame 0xfffffe1048ec8900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048ec8960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048ec89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ec8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ec8ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20667 tid 100113 td 0xfffff800717ce500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ebe760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ebe790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ebe7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ebe830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048ebe860 _sleep() at _sleep+0x306/frame 0xfffffe1048ebe900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048ebe960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048ebe9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ebeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ebeab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20666 tid 100239 td 0xfffff801e2485500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049149760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049149790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491497d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049149830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049149860 _sleep() at _sleep+0x306/frame 0xfffffe1049149900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049149960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491499a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049149ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049149ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20665 tid 100280 td 0xfffff801e2899a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049218760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049218790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492187d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049218830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049218860 _sleep() at _sleep+0x306/frame 0xfffffe1049218900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049218960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492189a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049218ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049218ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20664 tid 100289 td 0xfffff801e2313a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049245760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049245790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492457d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049245830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049245860 _sleep() at _sleep+0x306/frame 0xfffffe1049245900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049245960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492459a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049245ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049245ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20663 tid 100311 td 0xfffff804760eca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492aea40 mi_switch() at mi_switch+0x167/frame 0xfffffe10492aea70 ast() at ast+0x273/frame 0xfffffe10492aeab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe10492aeab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800b892ca, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20662 tid 100338 td 0xfffff8021ac05a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049335420 mi_switch() at mi_switch+0x167/frame 0xfffffe1049335450 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe10493354a0 __rw_wlock_hard() at __rw_wlock_hard+0xb5/frame 0xfffffe1049335530 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe1049335570 softdep_setup_link() at softdep_setup_link+0x13a/frame 0xfffffe10493355d0 ufs_link() at ufs_link+0xd7/frame 0xfffffe1049335720 VOP_LINK_APV() at VOP_LINK_APV+0x124/frame 0xfffffe1049335750 kern_linkat() at kern_linkat+0x417/frame 0xfffffe1049335980 sys_link() at sys_link+0x28/frame 0xfffffe10493359a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049335ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049335ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x800a8429a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20661 tid 100231 td 0xfffff801e23b3000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049121760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049121790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491217d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049121830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049121860 _sleep() at _sleep+0x306/frame 0xfffffe1049121900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049121960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491219a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049121ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049121ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20660 tid 100209 td 0xfffff801e21e3500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490ae760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490ae790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490ae7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490ae830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490ae860 _sleep() at _sleep+0x306/frame 0xfffffe10490ae900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490ae960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490ae9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490aeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490aeab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20659 tid 100140 td 0xfffff8010542f500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f57760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f57790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f577d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f57830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f57860 _sleep() at _sleep+0x306/frame 0xfffffe1048f57900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048f57960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048f579a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f57ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f57ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20658 tid 100305 td 0xfffff802cd4caa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049290760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049290790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492907d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049290830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049290860 _sleep() at _sleep+0x306/frame 0xfffffe1049290900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049290960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492909a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049290ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049290ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20657 tid 100112 td 0xfffff800717cea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048eb9760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048eb9790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048eb97d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048eb9830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048eb9860 _sleep() at _sleep+0x306/frame 0xfffffe1048eb9900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048eb9960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048eb99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048eb9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048eb9ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20656 tid 100296 td 0xfffff801e210ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049263760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049263790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492637d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049263830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049263860 _sleep() at _sleep+0x306/frame 0xfffffe1049263900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049263960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492639a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049263ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049263ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20655 tid 100284 td 0xfffff801e2898500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104922c760 mi_switch() at mi_switch+0x167/frame 0xfffffe104922c790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104922c7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104922c830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104922c860 _sleep() at _sleep+0x306/frame 0xfffffe104922c900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104922c960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104922c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104922cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104922cab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20654 tid 100207 td 0xfffff801e213b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490a4760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490a4790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490a47d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490a4830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490a4860 _sleep() at _sleep+0x306/frame 0xfffffe10490a4900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490a4960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490a49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490a4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490a4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20653 tid 100261 td 0xfffff801e262b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491b7760 mi_switch() at mi_switch+0x167/frame 0xfffffe10491b7790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491b77d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491b7830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10491b7860 _sleep() at _sleep+0x306/frame 0xfffffe10491b7900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10491b7960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491b79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491b7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491b7ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20652 tid 100339 td 0xfffff8021ac05500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104933a760 mi_switch() at mi_switch+0x167/frame 0xfffffe104933a790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104933a7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104933a830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104933a860 _sleep() at _sleep+0x306/frame 0xfffffe104933a900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104933a960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104933a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104933aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104933aab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20651 tid 100240 td 0xfffff801e2485000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104914e760 mi_switch() at mi_switch+0x167/frame 0xfffffe104914e790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104914e7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104914e830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104914e860 _sleep() at _sleep+0x306/frame 0xfffffe104914e900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104914e960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104914e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104914eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104914eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20650 tid 100225 td 0xfffff801e22b0000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049103760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049103790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491037d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049103830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049103860 _sleep() at _sleep+0x306/frame 0xfffffe1049103900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049103960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491039a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049103ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049103ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20649 tid 100328 td 0xfffff8047648a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049303760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049303790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10493037d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049303830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049303860 _sleep() at _sleep+0x306/frame 0xfffffe1049303900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049303960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10493039a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049303ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049303ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20648 tid 100288 td 0xfffff801e2893000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049240760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049240790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492407d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049240830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049240860 _sleep() at _sleep+0x306/frame 0xfffffe1049240900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049240960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492409a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049240ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049240ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20647 tid 100264 td 0xfffff801e26fc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491c60a0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491c60d0 critical_exit() at critical_exit+0x8b/frame 0xfffffe10491c60f0 lapic_handle_timer() at lapic_handle_timer+0xb1/frame 0xfffffe10491c6130 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe10491c6130 --- interrupt, rip = 0xffffffff80ab25f3, rsp = 0xfffffe10491c6200, rbp = 0xfffffe10491c6230 --- find_instance() at find_instance+0x23/frame 0xfffffe10491c6230 witness_lock() at witness_lock+0xe1/frame 0xfffffe10491c62a0 __rw_rlock() at __rw_rlock+0x454/frame 0xfffffe10491c6340 cache_lookup() at cache_lookup+0x588/frame 0xfffffe10491c64c0 vfs_cache_lookup() at vfs_cache_lookup+0x12a/frame 0xfffffe10491c6530 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xfe/frame 0xfffffe10491c6560 lookup() at lookup+0x5b2/frame 0xfffffe10491c65f0 namei() at namei+0x592/frame 0xfffffe10491c66b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe10491c6820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10491c69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491c6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491c6ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe3b0 --- Tracing command openat pid 20646 tid 100183 td 0xfffff8011afca000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049031a40 mi_switch() at mi_switch+0x167/frame 0xfffffe1049031a70 ast() at ast+0x273/frame 0xfffffe1049031ab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe1049031ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800b91b1a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20645 tid 100192 td 0xfffff801e2073000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104905ea40 mi_switch() at mi_switch+0x167/frame 0xfffffe104905ea70 ast() at ast+0x273/frame 0xfffffe104905eab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe104905eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800b1f7ca, rsp = 0x7fffffffe2c8, rbp = 0x7fffffffe3b0 --- Tracing command openat pid 20644 tid 100177 td 0xfffff8011aefa000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049013760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049013790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490137d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049013830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049013860 _sleep() at _sleep+0x306/frame 0xfffffe1049013900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049013960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490139a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049013ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049013ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20643 tid 100142 td 0xfffff8010542ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f61760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f61790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f617d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f61830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f61860 _sleep() at _sleep+0x306/frame 0xfffffe1048f61900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048f61960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048f619a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f61ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f61ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command fts pid 20642 tid 100166 td 0xfffff8011ae4ea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fd9a40 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fd9a70 ast() at ast+0x273/frame 0xfffffe1048fd9ab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe1048fd9ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800acde4a, rsp = 0x7fffffffe2e8, rbp = 0x7fffffffe3a0 --- Tracing command fts pid 20641 tid 100116 td 0xfffff800717b9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ecd2a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ecd2d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ecd310 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048ecd340 sleeplk() at sleeplk+0x151/frame 0xfffffe1048ecd3a0 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1048ecd460 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1048ecd4d0 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1048ecd560 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1048ecd590 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1048ecd600 lookup() at lookup+0x109/frame 0xfffffe1048ecd690 namei() at namei+0x592/frame 0xfffffe1048ecd750 kern_statat() at kern_statat+0xa8/frame 0xfffffe1048ecd900 sys_fstatat() at sys_fstatat+0x2c/frame 0xfffffe1048ecd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ecdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ecdab0 --- syscall (493, FreeBSD ELF64, sys_fstatat), rip = 0x800acde4a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command fts pid 20640 tid 100268 td 0xfffff801e26faa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491da2a0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491da2d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491da310 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10491da340 sleeplk() at sleeplk+0x151/frame 0xfffffe10491da3a0 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe10491da460 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe10491da4d0 ffs_lock() at ffs_lock+0x112/frame 0xfffffe10491da560 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe10491da590 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe10491da600 lookup() at lookup+0x109/frame 0xfffffe10491da690 namei() at namei+0x592/frame 0xfffffe10491da750 kern_statat() at kern_statat+0xa8/frame 0xfffffe10491da900 sys_fstatat() at sys_fstatat+0x2c/frame 0xfffffe10491da9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491daab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491daab0 --- syscall (493, FreeBSD ELF64, sys_fstatat), rip = 0x800acde4a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command fts pid 20639 tid 100251 td 0xfffff801e2554500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491852a0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491852d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049185310 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1049185340 sleeplk() at sleeplk+0x151/frame 0xfffffe10491853a0 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1049185460 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe10491854d0 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1049185560 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1049185590 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1049185600 lookup() at lookup+0x109/frame 0xfffffe1049185690 namei() at namei+0x592/frame 0xfffffe1049185750 kern_statat() at kern_statat+0xa8/frame 0xfffffe1049185900 sys_fstatat() at sys_fstatat+0x2c/frame 0xfffffe10491859a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049185ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049185ab0 --- syscall (493, FreeBSD ELF64, sys_fstatat), rip = 0x800acde4a, rsp = 0x7fffffffe368, rbp = 0x7fffffffe420 --- Tracing command lockf pid 20638 tid 100191 td 0xfffff801e2073500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049059760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049059790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490597d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049059830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049059860 _sleep() at _sleep+0x306/frame 0xfffffe1049059900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049059960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490599a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049059ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049059ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20637 tid 100325 td 0xfffff804763bb000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492f4760 mi_switch() at mi_switch+0x167/frame 0xfffffe10492f4790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492f47d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492f4830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10492f4860 _sleep() at _sleep+0x306/frame 0xfffffe10492f4900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10492f4960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492f49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492f4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492f4ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20636 tid 100180 td 0xfffff8011aef9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049022760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049022790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490227d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049022830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049022860 _sleep() at _sleep+0x306/frame 0xfffffe1049022900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049022960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490229a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049022ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049022ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20635 tid 100242 td 0xfffff801e2484500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049158760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049158790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491587d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049158830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049158860 _sleep() at _sleep+0x306/frame 0xfffffe1049158900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049158960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491589a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049158ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049158ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20634 tid 100285 td 0xfffff801e2898000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049231760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049231790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492317d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049231830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049231860 _sleep() at _sleep+0x306/frame 0xfffffe1049231900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049231960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492319a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049231ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049231ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20633 tid 100199 td 0xfffff801e213da00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049081760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049081790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490817d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049081830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049081860 _sleep() at _sleep+0x306/frame 0xfffffe1049081900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049081960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490819a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049081ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049081ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20632 tid 100148 td 0xfffff801189d3a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f7f760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f7f790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f7f7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f7f830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f7f860 _sleep() at _sleep+0x306/frame 0xfffffe1048f7f900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048f7f960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048f7f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f7fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f7fab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20631 tid 100245 td 0xfffff801e2559500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049167760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049167790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491677d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049167830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049167860 _sleep() at _sleep+0x306/frame 0xfffffe1049167900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049167960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491679a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049167ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049167ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20630 tid 100286 td 0xfffff801e2893a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049236760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049236790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492367d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049236830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049236860 _sleep() at _sleep+0x306/frame 0xfffffe1049236900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049236960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492369a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049236ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049236ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20629 tid 100194 td 0xfffff801e2072500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049068760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049068790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490687d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049068830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049068860 _sleep() at _sleep+0x306/frame 0xfffffe1049068900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049068960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490689a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049068ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049068ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20628 tid 100157 td 0xfffff8011ad22a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fac760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fac790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fac7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fac830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048fac860 _sleep() at _sleep+0x306/frame 0xfffffe1048fac900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048fac960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048fac9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048facab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048facab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20627 tid 100297 td 0xfffff801e210e500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049268760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049268790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492687d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049268830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049268860 _sleep() at _sleep+0x306/frame 0xfffffe1049268900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049268960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10492689a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049268ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049268ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20626 tid 100316 td 0xfffff804762a9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492c7200 mi_switch() at mi_switch+0x167/frame 0xfffffe10492c7230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492c7270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10492c72a0 sleeplk() at sleeplk+0x151/frame 0xfffffe10492c7300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe10492c73c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe10492c7430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe10492c74c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe10492c74f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe10492c7560 lookup() at lookup+0x109/frame 0xfffffe10492c75f0 namei() at namei+0x592/frame 0xfffffe10492c76b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe10492c7820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10492c79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492c7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492c7ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf pid 20625 tid 100212 td 0xfffff801e21e2500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490bd200 mi_switch() at mi_switch+0x167/frame 0xfffffe10490bd230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490bd270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10490bd2a0 sleeplk() at sleeplk+0x151/frame 0xfffffe10490bd300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe10490bd3c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe10490bd430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe10490bd4c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe10490bd4f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe10490bd560 lookup() at lookup+0x109/frame 0xfffffe10490bd5f0 namei() at namei+0x592/frame 0xfffffe10490bd6b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe10490bd820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10490bd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490bdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490bdab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf pid 20624 tid 100224 td 0xfffff801e22b0500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490fe760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490fe790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490fe7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490fe830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490fe860 _sleep() at _sleep+0x306/frame 0xfffffe10490fe900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490fe960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490fe9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490feab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490feab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20623 tid 100254 td 0xfffff801e262d500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049194760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049194790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491947d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049194830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049194860 _sleep() at _sleep+0x306/frame 0xfffffe1049194900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049194960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491949a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049194ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049194ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf pid 20622 tid 100293 td 0xfffff8011af67500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049259200 mi_switch() at mi_switch+0x167/frame 0xfffffe1049259230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049259270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10492592a0 sleeplk() at sleeplk+0x151/frame 0xfffffe1049259300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe10492593c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1049259430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe10492594c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe10492594f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1049259560 lookup() at lookup+0x109/frame 0xfffffe10492595f0 namei() at namei+0x592/frame 0xfffffe10492596b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe1049259820 kern_openat() at kern_openat+0x25c/frame 0xfffffe10492599a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049259ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049259ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf pid 20621 tid 100230 td 0xfffff801e23b3500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104911c200 mi_switch() at mi_switch+0x167/frame 0xfffffe104911c230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104911c270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104911c2a0 sleeplk() at sleeplk+0x151/frame 0xfffffe104911c300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe104911c3c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe104911c430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe104911c4c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe104911c4f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe104911c560 lookup() at lookup+0x109/frame 0xfffffe104911c5f0 namei() at namei+0x592/frame 0xfffffe104911c6b0 vn_open_cred() at vn_open_cred+0x102/frame 0xfffffe104911c820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104911c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104911cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104911cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf pid 20620 tid 100155 td 0xfffff8011ad23500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fa2560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fa2590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fa25d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fa2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048fa2660 _sleep() at _sleep+0x32b/frame 0xfffffe1048fa2700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048fa27b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048fa29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fa2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fa2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command symlink pid 20619 tid 100307 td 0xfffff802cd4ca000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104929aa40 mi_switch() at mi_switch+0x167/frame 0xfffffe104929aa70 ast() at ast+0x273/frame 0xfffffe104929aab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe4f0 Tracing command symlink pid 20618 tid 100204 td 0xfffff801e213c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490950b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10490950e0 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe1049095130 __rw_wlock_hard() at __rw_wlock_hard+0xb5/frame 0xfffffe10490951c0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe1049095200 cache_zap_locked_vnode_kl() at cache_zap_locked_vnode_kl+0x1d8/frame 0xfffffe1049095280 cache_purge() at cache_purge+0x1bc/frame 0xfffffe10490952f0 vgonel() at vgonel+0x444/frame 0xfffffe1049095360 vnlru_free_locked() at vnlru_free_locked+0x2c2/frame 0xfffffe10490953d0 getnewvnode() at getnewvnode+0xc9/frame 0xfffffe1049095410 ffs_vgetf() at ffs_vgetf+0xe2/frame 0xfffffe10490954a0 ffs_valloc() at ffs_valloc+0x4e1/frame 0xfffffe1049095540 ufs_makeinode() at ufs_makeinode+0x84/frame 0xfffffe1049095700 ufs_symlink() at ufs_symlink+0x32/frame 0xfffffe1049095750 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x104/frame 0xfffffe1049095780 kern_symlinkat() at kern_symlinkat+0x22f/frame 0xfffffe10490959a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049095ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049095ab0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x800a8409a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command symlink pid 20617 tid 100170 td 0xfffff8011ae4d500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fed150 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fed180 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fed1c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048fed1f0 sleeplk() at sleeplk+0x151/frame 0xfffffe1048fed250 __lockmgr_args() at __lockmgr_args+0x9bf/frame 0xfffffe1048fed310 getblk() at getblk+0x11d/frame 0xfffffe1048fed3b0 breadn_flags() at breadn_flags+0x30/frame 0xfffffe1048fed400 ffs_update() at ffs_update+0x1c6/frame 0xfffffe1048fed480 ufs_direnter() at ufs_direnter+0x881/frame 0xfffffe1048fed540 ufs_makeinode() at ufs_makeinode+0x5e3/frame 0xfffffe1048fed700 ufs_symlink() at ufs_symlink+0x32/frame 0xfffffe1048fed750 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x104/frame 0xfffffe1048fed780 kern_symlinkat() at kern_symlinkat+0x22f/frame 0xfffffe1048fed9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fedab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fedab0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x800a8409a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command symlink pid 20616 tid 100313 td 0xfffff804760ec000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492b8020 mi_switch() at mi_switch+0x167/frame 0xfffffe10492b8050 critical_exit() at critical_exit+0x8b/frame 0xfffffe10492b8070 lapic_handle_timer() at lapic_handle_timer+0xb1/frame 0xfffffe10492b80b0 Xtimerint() at Xtimerint+0x8c/frame 0xfffffe10492b80b0 --- interrupt, rip = 0xffffffff80b05513, rsp = 0xfffffe10492b8180, rbp = 0xfffffe10492b81a0 --- fnv_32_buf() at fnv_32_buf+0x53/frame 0xfffffe10492b81a0 cache_get_hash() at cache_get_hash+0x5c/frame 0xfffffe10492b81e0 NCP2BUCKETLOCK() at NCP2BUCKETLOCK+0x25/frame 0xfffffe10492b8200 cache_zap_locked_vnode_kl() at cache_zap_locked_vnode_kl+0x9f/frame 0xfffffe10492b8280 cache_purge() at cache_purge+0x1bc/frame 0xfffffe10492b82f0 vgonel() at vgonel+0x444/frame 0xfffffe10492b8360 vnlru_free_locked() at vnlru_free_locked+0x2c2/frame 0xfffffe10492b83d0 getnewvnode() at getnewvnode+0xc9/frame 0xfffffe10492b8410 ffs_vgetf() at ffs_vgetf+0xe2/frame 0xfffffe10492b84a0 ffs_valloc() at ffs_valloc+0x4e1/frame 0xfffffe10492b8540 ufs_makeinode() at ufs_makeinode+0x84/frame 0xfffffe10492b8700 ufs_symlink() at ufs_symlink+0x32/frame 0xfffffe10492b8750 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x104/frame 0xfffffe10492b8780 kern_symlinkat() at kern_symlinkat+0x22f/frame 0xfffffe10492b89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492b8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492b8ab0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x800a8409a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command symlink pid 20615 tid 100234 td 0xfffff801e23b2000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049130150 mi_switch() at mi_switch+0x167/frame 0xfffffe1049130180 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491301c0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10491301f0 sleeplk() at sleeplk+0x151/frame 0xfffffe1049130250 __lockmgr_args() at __lockmgr_args+0x9bf/frame 0xfffffe1049130310 getblk() at getblk+0x11d/frame 0xfffffe10491303b0 breadn_flags() at breadn_flags+0x30/frame 0xfffffe1049130400 ffs_update() at ffs_update+0x1c6/frame 0xfffffe1049130480 ufs_direnter() at ufs_direnter+0x881/frame 0xfffffe1049130540 ufs_makeinode() at ufs_makeinode+0x5e3/frame 0xfffffe1049130700 ufs_symlink() at ufs_symlink+0x32/frame 0xfffffe1049130750 VOP_SYMLINK_APV() at VOP_SYMLINK_APV+0x104/frame 0xfffffe1049130780 kern_symlinkat() at kern_symlinkat+0x22f/frame 0xfffffe10491309a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049130ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049130ab0 --- syscall (57, FreeBSD ELF64, sys_symlink), rip = 0x800a8409a, rsp = 0x7fffffffe448, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20614 tid 100216 td 0xfffff801e21e1000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490d1760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490d1790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490d17d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490d1830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490d1860 _sleep() at _sleep+0x306/frame 0xfffffe10490d1900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490d1960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490d19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490d1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490d1ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20613 tid 100203 td 0xfffff801e213c500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490e0760 mi_switch() at mi_switch+0x167/frame 0xfffffe10490e0790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490e07d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490e0830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10490e0860 _sleep() at _sleep+0x306/frame 0xfffffe10490e0900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10490e0960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490e09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490e0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490e0ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20612 tid 100294 td 0xfffff8011af67000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104925e760 mi_switch() at mi_switch+0x167/frame 0xfffffe104925e790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104925e7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104925e830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104925e860 _sleep() at _sleep+0x306/frame 0xfffffe104925e900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104925e960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104925e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104925eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104925eab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20611 tid 100229 td 0xfffff801e23b3a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049117a40 mi_switch() at mi_switch+0x167/frame 0xfffffe1049117a70 ast() at ast+0x273/frame 0xfffffe1049117ab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe1049117ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800b8234a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe4c0 --- Tracing command lockf2 pid 20610 tid 100149 td 0xfffff801189d3500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f84200 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f84230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f84270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048f842a0 sleeplk() at sleeplk+0x151/frame 0xfffffe1048f84300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe1048f843c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe1048f84430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe1048f844c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe1048f844f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe1048f84560 lookup() at lookup+0x109/frame 0xfffffe1048f845f0 namei() at namei+0x592/frame 0xfffffe1048f846b0 vn_open_cred() at vn_open_cred+0x249/frame 0xfffffe1048f84820 kern_openat() at kern_openat+0x25c/frame 0xfffffe1048f849a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f84ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f84ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf2 pid 20609 tid 100298 td 0xfffff801e210e000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104926d760 mi_switch() at mi_switch+0x167/frame 0xfffffe104926d790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104926d7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104926d830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104926d860 _sleep() at _sleep+0x306/frame 0xfffffe104926d900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104926d960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104926d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104926dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104926dab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20608 tid 100274 td 0xfffff801e27c5a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491f8760 mi_switch() at mi_switch+0x167/frame 0xfffffe10491f8790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491f87d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491f8830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10491f8860 _sleep() at _sleep+0x306/frame 0xfffffe10491f8900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe10491f8960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491f89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491f8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491f8ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20607 tid 100235 td 0xfffff801e2486a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049135760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049135790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491357d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049135830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049135860 _sleep() at _sleep+0x306/frame 0xfffffe1049135900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049135960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10491359a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049135ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049135ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20606 tid 100186 td 0xfffff8011afc9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049040760 mi_switch() at mi_switch+0x167/frame 0xfffffe1049040790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490407d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049040830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1049040860 _sleep() at _sleep+0x306/frame 0xfffffe1049040900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1049040960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe10490409a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049040ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049040ab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800b1f7ea, rsp = 0x7fffffffe488, rbp = 0x7fffffffe4f0 --- Tracing command lockf2 pid 20605 tid 100188 td 0xfffff8011afc5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104904a200 mi_switch() at mi_switch+0x167/frame 0xfffffe104904a230 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104904a270 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe104904a2a0 sleeplk() at sleeplk+0x151/frame 0xfffffe104904a300 __lockmgr_args() at __lockmgr_args+0x3df/frame 0xfffffe104904a3c0 _lockmgr_args() at _lockmgr_args+0x8f/frame 0xfffffe104904a430 ffs_lock() at ffs_lock+0x112/frame 0xfffffe104904a4c0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe8/frame 0xfffffe104904a4f0 _vn_lock() at _vn_lock+0xc2/frame 0xfffffe104904a560 lookup() at lookup+0x109/frame 0xfffffe104904a5f0 namei() at namei+0x592/frame 0xfffffe104904a6b0 vn_open_cred() at vn_open_cred+0x249/frame 0xfffffe104904a820 kern_openat() at kern_openat+0x25c/frame 0xfffffe104904a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104904aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104904aab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x800b1f7ca, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe4c0 --- Tracing command lockf2 pid 20604 tid 100119 td 0xfffff800719d0500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048eeba40 mi_switch() at mi_switch+0x167/frame 0xfffffe1048eeba70 ast() at ast+0x273/frame 0xfffffe1048eebab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe1048eebab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800b8234a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe4c0 --- Tracing command symlink pid 20603 tid 100248 td 0xfffff801e2558500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049176560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049176590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491765d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049176630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049176660 _sleep() at _sleep+0x32b/frame 0xfffffe1049176700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491767b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491769a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049176ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049176ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command lockf2 pid 20602 tid 100265 td 0xfffff801e26fba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491cb560 mi_switch() at mi_switch+0x167/frame 0xfffffe10491cb590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491cb5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491cb630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491cb660 _sleep() at _sleep+0x32b/frame 0xfffffe10491cb700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491cb7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491cb9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491cbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491cbab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command link pid 20601 tid 100159 td 0xfffff8011ad22000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fb6540 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fb6570 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe1048fb65c0 __rw_wlock_hard() at __rw_wlock_hard+0xb5/frame 0xfffffe1048fb6650 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe1048fb6690 softdep_setup_unlink() at softdep_setup_unlink+0x4e/frame 0xfffffe1048fb66c0 ufs_dirremove() at ufs_dirremove+0x4d/frame 0xfffffe1048fb6730 ufs_remove() at ufs_remove+0x75/frame 0xfffffe1048fb6790 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x124/frame 0xfffffe1048fb67c0 kern_unlinkat() at kern_unlinkat+0x208/frame 0xfffffe1048fb69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fb6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fb6ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800b892ca, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20600 tid 100256 td 0xfffff801e262ca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104919ea40 mi_switch() at mi_switch+0x167/frame 0xfffffe104919ea70 ast() at ast+0x273/frame 0xfffffe104919eab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe4f0 Tracing command link pid 20599 tid 100073 td 0xfffff8001d178a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048036540 mi_switch() at mi_switch+0x167/frame 0xfffffe1048036570 turnstile_wait() at turnstile_wait+0x3be/frame 0xfffffe10480365c0 __rw_wlock_hard() at __rw_wlock_hard+0xb5/frame 0xfffffe1048036650 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe1048036690 softdep_setup_unlink() at softdep_setup_unlink+0x4e/frame 0xfffffe10480366c0 ufs_dirremove() at ufs_dirremove+0x4d/frame 0xfffffe1048036730 ufs_remove() at ufs_remove+0x75/frame 0xfffffe1048036790 VOP_REMOVE_APV() at VOP_REMOVE_APV+0x124/frame 0xfffffe10480367c0 kern_unlinkat() at kern_unlinkat+0x208/frame 0xfffffe10480369a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048036ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048036ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x800b892ca, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command link pid 20598 tid 100179 td 0xfffff8011aef9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104901d560 mi_switch() at mi_switch+0x167/frame 0xfffffe104901d590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104901d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104901d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104901d660 _sleep() at _sleep+0x32b/frame 0xfffffe104901d700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104901d7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104901d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104901dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104901dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command openat pid 20597 tid 100146 td 0xfffff8011896e500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f75a40 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f75a70 ast() at ast+0x273/frame 0xfffffe1048f75ab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe1048f75ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x800a82b1a, rsp = 0x7fffffffe3b8, rbp = 0x7fffffffe4f0 --- Tracing command openat pid 20596 tid 100117 td 0xfffff800717b9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ed2560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ed2590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ed25d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ed2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ed2660 _sleep() at _sleep+0x32b/frame 0xfffffe1048ed2700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048ed27b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048ed29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ed2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ed2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command fts pid 20595 tid 100144 td 0xfffff8010542e000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f6b560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f6b590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f6b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f6b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f6b660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f6b700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f6b7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f6b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f6bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f6bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command swap pid 20593 tid 100331 td 0xfffff80476489000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049312560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049312590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10493125d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049312630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049312660 _sleep() at _sleep+0x32b/frame 0xfffffe1049312700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10493127b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10493129a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049312ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049312ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command rename pid 20592 tid 100189 td 0xfffff8011afc5000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104904f560 mi_switch() at mi_switch+0x167/frame 0xfffffe104904f590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104904f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104904f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104904f660 _sleep() at _sleep+0x32b/frame 0xfffffe104904f700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104904f7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104904f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104904fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104904fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command mkdir pid 20591 tid 100218 td 0xfffff801e22b6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490db560 mi_switch() at mi_switch+0x167/frame 0xfffffe10490db590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490db5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490db630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10490db660 _sleep() at _sleep+0x32b/frame 0xfffffe10490db700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490db7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490db9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490dbab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490dbab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command creat pid 20590 tid 100322 td 0xfffff804763bc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492e5560 mi_switch() at mi_switch+0x167/frame 0xfffffe10492e5590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492e55d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492e5630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492e5660 _sleep() at _sleep+0x32b/frame 0xfffffe10492e5700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10492e57b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10492e59a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492e5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492e5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command lockf pid 20589 tid 100158 td 0xfffff8011ad22500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fb1560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fb1590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fb15d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fb1630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048fb1660 _sleep() at _sleep+0x32b/frame 0xfffffe1048fb1700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048fb17b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048fb19a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fb1ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fb1ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command link pid 20588 tid 100272 td 0xfffff801e27c6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491ee560 mi_switch() at mi_switch+0x167/frame 0xfffffe10491ee590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491ee5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491ee630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491ee660 _sleep() at _sleep+0x32b/frame 0xfffffe10491ee700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491ee7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491ee9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491eeab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491eeab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command fts pid 20587 tid 100258 td 0xfffff801e262c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491a8560 mi_switch() at mi_switch+0x167/frame 0xfffffe10491a8590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491a85d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491a8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491a8660 _sleep() at _sleep+0x32b/frame 0xfffffe10491a8700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491a87b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491a89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491a8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491a8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command openat pid 20585 tid 100273 td 0xfffff801e27c6000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491f3560 mi_switch() at mi_switch+0x167/frame 0xfffffe10491f3590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491f35d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491f3630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491f3660 _sleep() at _sleep+0x32b/frame 0xfffffe10491f3700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491f37b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491f39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491f3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491f3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command symlink pid 20584 tid 100171 td 0xfffff8011ae4d000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ff2560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ff2590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ff25d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ff2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ff2660 _sleep() at _sleep+0x32b/frame 0xfffffe1048ff2700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048ff27b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048ff29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ff2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ff2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command lockf2 pid 20583 tid 100287 td 0xfffff801e2893500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104923b560 mi_switch() at mi_switch+0x167/frame 0xfffffe104923b590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104923b5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104923b630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104923b660 _sleep() at _sleep+0x32b/frame 0xfffffe104923b700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104923b7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104923b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104923bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104923bab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1f66a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5a0 --- Tracing command sleep pid 20581 tid 100249 td 0xfffff801e2558000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104917b760 mi_switch() at mi_switch+0x167/frame 0xfffffe104917b790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104917b7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104917b830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104917b860 _sleep() at _sleep+0x306/frame 0xfffffe104917b900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe104917b960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe104917b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104917bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104917bab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8009097ea, rsp = 0x7fffffffeb58, rbp = 0x7fffffffeba0 --- Tracing command run pid 19846 tid 100213 td 0xfffff801e21e2000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490c2560 mi_switch() at mi_switch+0x167/frame 0xfffffe10490c2590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490c25d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490c2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10490c2660 _sleep() at _sleep+0x32b/frame 0xfffffe10490c2700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490c27b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490c29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490c2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490c2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffde58, rbp = 0x7fffffffe380 --- Tracing command run pid 19845 tid 100330 td 0xfffff80476489500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104930d560 mi_switch() at mi_switch+0x167/frame 0xfffffe104930d590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104930d5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104930d630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104930d660 _sleep() at _sleep+0x32b/frame 0xfffffe104930d700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104930d7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104930d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104930dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104930dab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffe388, rbp = 0x7fffffffe430 --- Tracing command run pid 19844 tid 100217 td 0xfffff801e22b6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490d6560 mi_switch() at mi_switch+0x167/frame 0xfffffe10490d6590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490d65d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490d6630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10490d6660 _sleep() at _sleep+0x32b/frame 0xfffffe10490d6700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490d67b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490d69a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490d6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490d6ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffe388, rbp = 0x7fffffffe430 --- Tracing command sh pid 19823 tid 100211 td 0xfffff801e21e2a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490b8560 mi_switch() at mi_switch+0x167/frame 0xfffffe10490b8590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490b85d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490b8630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10490b8660 _sleep() at _sleep+0x32b/frame 0xfffffe10490b8700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490b87b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490b89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490b8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490b8ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe258, rbp = 0x7fffffffe310 --- Tracing command su pid 19822 tid 100175 td 0xfffff8011aefaa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049009560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049009590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490095d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049009630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049009660 _sleep() at _sleep+0x32b/frame 0xfffffe1049009700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490097b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490099a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049009ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049009ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800f4666a, rsp = 0x7fffffffe0b8, rbp = 0x7fffffffe630 --- Tracing command md5 pid 19817 tid 100197 td 0xfffff801e2071500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490778e0 mi_switch() at mi_switch+0x167/frame 0xfffffe1049077910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049077950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1049077980 _sleep() at _sleep+0x338/frame 0xfffffe1049077a20 md_kthread() at md_kthread+0x175/frame 0xfffffe1049077a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1049077ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1049077ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 19791 tid 100114 td 0xfffff800717ce000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ec3560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ec3590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ec35d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ec3630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ec3660 _sleep() at _sleep+0x32b/frame 0xfffffe1048ec3700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048ec37b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048ec39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ec3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ec3ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe288, rbp = 0x7fffffffe340 --- Tracing command tee pid 19790 tid 100259 td 0xfffff801e262ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491ad6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491ad6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491ad730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491ad790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491ad7c0 _sleep() at _sleep+0x32b/frame 0xfffffe10491ad860 pipe_read() at pipe_read+0x286/frame 0xfffffe10491ad8c0 dofileread() at dofileread+0xcf/frame 0xfffffe10491ad900 kern_readv() at kern_readv+0x68/frame 0xfffffe10491ad950 sys_read() at sys_read+0x84/frame 0xfffffe10491ad9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491adab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491adab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80097bafa, rsp = 0x7fffffffe608, rbp = 0x7fffffffe640 --- Tracing command sh pid 19789 tid 100282 td 0xfffff801e2899000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049222560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049222590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492225d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049222630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049222660 _sleep() at _sleep+0x32b/frame 0xfffffe1049222700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10492227b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10492229a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049222ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049222ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe1b8, rbp = 0x7fffffffe270 --- Tracing command sh pid 18932 tid 100143 td 0xfffff8010542e500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f66560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f66590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f665d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f66630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f66660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f66700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f667b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f669a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f66ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f66ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe4f8, rbp = 0x7fffffffe5b0 --- Tracing command cat pid 11809 tid 100152 td 0xfffff801189d2500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f936c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f936f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f93730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f93790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f937c0 _sleep() at _sleep+0x32b/frame 0xfffffe1048f93860 pipe_read() at pipe_read+0x286/frame 0xfffffe1048f938c0 dofileread() at dofileread+0xcf/frame 0xfffffe1048f93900 kern_readv() at kern_readv+0x68/frame 0xfffffe1048f93950 sys_read() at sys_read+0x84/frame 0xfffffe1048f939a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f93ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f93ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80097cafa, rsp = 0x7fffffffe7b8, rbp = 0x7fffffffec50 --- Tracing command sh pid 11804 tid 100156 td 0xfffff8011ad23000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fa7560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fa7590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fa75d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fa7630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048fa7660 _sleep() at _sleep+0x32b/frame 0xfffffe1048fa7700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048fa77b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048fa79a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fa7ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fa7ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe580 --- Tracing command find pid 11803 tid 100309 td 0xfffff804553e0500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492a4a40 mi_switch() at mi_switch+0x167/frame 0xfffffe10492a4a70 ast() at ast+0x273/frame 0xfffffe10492a4ab0 Xfast_syscall() at Xfast_syscall+0x160/frame 0xfffffe10492a4ab0 --- syscall (0, FreeBSD ELF64, nosys), rip = 0x8008c3e4a, rsp = 0x7fffffffe8f8, rbp = 0x7fffffffe9b0 --- Tracing command sh pid 11793 tid 100161 td 0xfffff8011aceb500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048fc0560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048fc0590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048fc05d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048fc0630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048fc0660 _sleep() at _sleep+0x32b/frame 0xfffffe1048fc0700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048fc07b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048fc09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048fc0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048fc0ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe998, rbp = 0x7fffffffea50 --- Tracing command mail pid 11792 tid 100252 td 0xfffff801e2554000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104918a6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe104918a6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104918a730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104918a790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104918a7c0 _sleep() at _sleep+0x32b/frame 0xfffffe104918a860 pipe_read() at pipe_read+0x286/frame 0xfffffe104918a8c0 dofileread() at dofileread+0xcf/frame 0xfffffe104918a900 kern_readv() at kern_readv+0x68/frame 0xfffffe104918a950 sys_read() at sys_read+0x84/frame 0xfffffe104918a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104918aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104918aab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800990afa, rsp = 0x7fffffffddd8, rbp = 0x7fffffffddf0 --- Tracing command sh pid 11791 tid 100290 td 0xfffff801e2313500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104924a560 mi_switch() at mi_switch+0x167/frame 0xfffffe104924a590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104924a5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104924a630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104924a660 _sleep() at _sleep+0x32b/frame 0xfffffe104924a700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104924a7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104924a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104924aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104924aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe5c8, rbp = 0x7fffffffe680 --- Tracing command sh pid 11772 tid 100315 td 0xfffff804762a9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492c2560 mi_switch() at mi_switch+0x167/frame 0xfffffe10492c2590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492c25d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492c2630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492c2660 _sleep() at _sleep+0x32b/frame 0xfffffe10492c2700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10492c27b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10492c29a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492c2ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492c2ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffea28, rbp = 0x7fffffffeae0 --- Tracing command lockf pid 11768 tid 100308 td 0xfffff804553e0a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104929f560 mi_switch() at mi_switch+0x167/frame 0xfffffe104929f590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104929f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104929f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104929f660 _sleep() at _sleep+0x32b/frame 0xfffffe104929f700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104929f7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104929f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104929fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104929fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80090966a, rsp = 0x7fffffffeb98, rbp = 0x7fffffffec10 --- Tracing command sh pid 11763 tid 100237 td 0xfffff801e2486000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104913f560 mi_switch() at mi_switch+0x167/frame 0xfffffe104913f590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104913f5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104913f630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104913f660 _sleep() at _sleep+0x32b/frame 0xfffffe104913f700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104913f7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104913f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104913fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104913fab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe6e8, rbp = 0x7fffffffe7a0 --- Tracing command sh pid 11762 tid 100255 td 0xfffff801e262d000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049199560 mi_switch() at mi_switch+0x167/frame 0xfffffe1049199590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491995d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049199630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049199660 _sleep() at _sleep+0x32b/frame 0xfffffe1049199700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491997b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491999a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049199ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049199ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe828, rbp = 0x7fffffffe8e0 --- Tracing command mail pid 11443 tid 100283 td 0xfffff801e2898a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492276c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10492276f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1049227730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049227790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492277c0 _sleep() at _sleep+0x32b/frame 0xfffffe1049227860 pipe_read() at pipe_read+0x286/frame 0xfffffe10492278c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049227900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049227950 sys_read() at sys_read+0x84/frame 0xfffffe10492279a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049227ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049227ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800990afa, rsp = 0x7fffffffddf8, rbp = 0x7fffffffde10 --- Tracing command sh pid 11442 tid 100205 td 0xfffff801e213ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe104909a560 mi_switch() at mi_switch+0x167/frame 0xfffffe104909a590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104909a5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104909a630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104909a660 _sleep() at _sleep+0x32b/frame 0xfffffe104909a700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe104909a7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe104909a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104909aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104909aab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe5f8, rbp = 0x7fffffffe6b0 --- Tracing command sh pid 11432 tid 100150 td 0xfffff801189d3000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f89560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f89590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f895d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f89630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f89660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f89700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f897b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f899a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f89ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f89ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffea58, rbp = 0x7fffffffeb10 --- Tracing command lockf pid 11431 tid 100223 td 0xfffff801e22b0a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10490f9560 mi_switch() at mi_switch+0x167/frame 0xfffffe10490f9590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490f95d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10490f9630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10490f9660 _sleep() at _sleep+0x32b/frame 0xfffffe10490f9700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10490f97b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10490f99a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10490f9ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10490f9ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80090966a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffec40 --- Tracing command sh pid 11429 tid 100270 td 0xfffff801e26fa000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491e4560 mi_switch() at mi_switch+0x167/frame 0xfffffe10491e4590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491e45d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491e4630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491e4660 _sleep() at _sleep+0x32b/frame 0xfffffe10491e4700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10491e47b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10491e49a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491e4ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491e4ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe738, rbp = 0x7fffffffe7f0 --- Tracing command cron pid 11427 tid 100269 td 0xfffff801e26fa500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10491df6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10491df6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491df730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10491df790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10491df7c0 _sleep() at _sleep+0x32b/frame 0xfffffe10491df860 pipe_read() at pipe_read+0x286/frame 0xfffffe10491df8c0 dofileread() at dofileread+0xcf/frame 0xfffffe10491df900 kern_readv() at kern_readv+0x68/frame 0xfffffe10491df950 sys_read() at sys_read+0x84/frame 0xfffffe10491df9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10491dfab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10491dfab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800da3afa, rsp = 0x7fffffffe4c8, rbp = 0x7fffffffe4e0 --- Tracing command getty pid 9216 tid 100334 td 0xfffff80476488000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049321630 mi_switch() at mi_switch+0x167/frame 0xfffffe1049321660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10493216a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049321700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049321730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10493217a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10493217d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe1049321830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1049321860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10493218c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049321900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049321950 sys_read() at sys_read+0x84/frame 0xfffffe10493219a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049321ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049321ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9215 tid 100196 td 0xfffff801e2071a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049072630 mi_switch() at mi_switch+0x167/frame 0xfffffe1049072660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490726a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049072700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049072730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10490727a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10490727d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe1049072830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1049072860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10490728c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049072900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049072950 sys_read() at sys_read+0x84/frame 0xfffffe10490729a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049072ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049072ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9214 tid 100312 td 0xfffff804760ec500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492b3630 mi_switch() at mi_switch+0x167/frame 0xfffffe10492b3660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492b36a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492b3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492b3730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10492b37a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10492b37d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe10492b3830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe10492b3860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10492b38c0 dofileread() at dofileread+0xcf/frame 0xfffffe10492b3900 kern_readv() at kern_readv+0x68/frame 0xfffffe10492b3950 sys_read() at sys_read+0x84/frame 0xfffffe10492b39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492b3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492b3ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9213 tid 100185 td 0xfffff8011afc9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104903b630 mi_switch() at mi_switch+0x167/frame 0xfffffe104903b660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104903b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104903b700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104903b730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe104903b7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe104903b7d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe104903b830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe104903b860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe104903b8c0 dofileread() at dofileread+0xcf/frame 0xfffffe104903b900 kern_readv() at kern_readv+0x68/frame 0xfffffe104903b950 sys_read() at sys_read+0x84/frame 0xfffffe104903b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104903bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104903bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9212 tid 100336 td 0xfffff801e2626500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104932b630 mi_switch() at mi_switch+0x167/frame 0xfffffe104932b660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104932b6a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104932b700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104932b730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe104932b7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe104932b7d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe104932b830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe104932b860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe104932b8c0 dofileread() at dofileread+0xcf/frame 0xfffffe104932b900 kern_readv() at kern_readv+0x68/frame 0xfffffe104932b950 sys_read() at sys_read+0x84/frame 0xfffffe104932b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104932bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104932bab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9211 tid 100190 td 0xfffff801e2073a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049054630 mi_switch() at mi_switch+0x167/frame 0xfffffe1049054660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10490546a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049054700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049054730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10490547a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10490547d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe1049054830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1049054860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10490548c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049054900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049054950 sys_read() at sys_read+0x84/frame 0xfffffe10490549a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049054ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049054ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9210 tid 100314 td 0xfffff804762a9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492bd630 mi_switch() at mi_switch+0x167/frame 0xfffffe10492bd660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492bd6a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492bd700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492bd730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10492bd7a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10492bd7d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe10492bd830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe10492bd860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10492bd8c0 dofileread() at dofileread+0xcf/frame 0xfffffe10492bd900 kern_readv() at kern_readv+0x68/frame 0xfffffe10492bd950 sys_read() at sys_read+0x84/frame 0xfffffe10492bd9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492bdab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492bdab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9209 tid 100238 td 0xfffff801e2485a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1049144630 mi_switch() at mi_switch+0x167/frame 0xfffffe1049144660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10491446a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1049144700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1049144730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10491447a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10491447d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe1049144830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1049144860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10491448c0 dofileread() at dofileread+0xcf/frame 0xfffffe1049144900 kern_readv() at kern_readv+0x68/frame 0xfffffe1049144950 sys_read() at sys_read+0x84/frame 0xfffffe10491449a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1049144ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1049144ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command getty pid 9208 tid 100070 td 0xfffff8001d048a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048027630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048027660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10480276a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048027700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048027730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10480277a0 tty_wait() at tty_wait+0x42/frame 0xfffffe10480277d0 ttydisc_read() at ttydisc_read+0x3ae/frame 0xfffffe1048027830 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe1048027860 devfs_read_f() at devfs_read_f+0xe7/frame 0xfffffe10480278c0 dofileread() at dofileread+0xcf/frame 0xfffffe1048027900 kern_readv() at kern_readv+0x68/frame 0xfffffe1048027950 sys_read() at sys_read+0x84/frame 0xfffffe10480279a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048027ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048027ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800b93afa, rsp = 0x7fffffffec78, rbp = 0x7fffffffecc0 --- Tracing command inetd pid 9188 tid 100323 td 0xfffff804763bba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10492ea5c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10492ea5f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10492ea630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10492ea690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe10492ea6c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10492ea730 seltdwait() at seltdwait+0x8b/frame 0xfffffe10492ea770 kern_select() at kern_select+0x99a/frame 0xfffffe10492ea960 sys_select() at sys_select+0x54/frame 0xfffffe10492ea9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe10492eaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe10492eaab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800faaada, rsp = 0x7fffffffde58, rbp = 0x7fffffffecf0 --- Tracing command bash pid 1448 tid 100139 td 0xfffff8010542fa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f52560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f52590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f525d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f52630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f52660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f52700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f527b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f529a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f52ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f52ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800e5766a, rsp = 0x7fffffffe278, rbp = 0x7fffffffe2d0 --- Tracing command csh pid 1446 tid 100138 td 0xfffff80105488000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f4d770 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f4d7a0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f4d7e0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f4d840 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f4d870 _sleep() at _sleep+0x32b/frame 0xfffffe1048f4d910 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe1048f4d970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe1048f4d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f4dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f4dab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800dde6ea, rsp = 0x7fffffffdfe8, rbp = 0x7fffffffe070 --- Tracing command su pid 1445 tid 100135 td 0xfffff801052cc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f3e560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f3e590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f3e5d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f3e630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f3e660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f3e700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f3e7b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f3e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f3eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f3eab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800f4666a, rsp = 0x7fffffffe468, rbp = 0x7fffffffe9e0 --- Tracing command bash pid 1438 tid 100136 td 0xfffff80105488a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f43560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f43590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f435d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f43630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f43660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f43700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f437b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f439a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f43ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f43ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800e5766a, rsp = 0x7fffffffe4d8, rbp = 0x7fffffffe530 --- Tracing command sshd pid 1437 tid 100131 td 0xfffff801052cd500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f2a5c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f2a5f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f2a630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f2a690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f2a6c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f2a730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f2a770 kern_select() at kern_select+0x99a/frame 0xfffffe1048f2a960 sys_select() at sys_select+0x54/frame 0xfffffe1048f2a9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f2aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f2aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801fc4ada, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sshd pid 1435 tid 100137 td 0xfffff80105488500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f48630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f48660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f486a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f48700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f48730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f487a0 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f487e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048f48980 sys_poll() at sys_poll+0x61/frame 0xfffffe1048f489a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f48ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f48ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x801f644aa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command sh pid 866 tid 100133 td 0xfffff801052cca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f346c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f346f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f34730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f34790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f347c0 _sleep() at _sleep+0x32b/frame 0xfffffe1048f34860 pipe_read() at pipe_read+0x286/frame 0xfffffe1048f348c0 dofileread() at dofileread+0xcf/frame 0xfffffe1048f34900 kern_readv() at kern_readv+0x68/frame 0xfffffe1048f34950 sys_read() at sys_read+0x84/frame 0xfffffe1048f349a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f34ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f34ab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800bd8afa, rsp = 0x7fffffffe6a8, rbp = 0x7fffffffe7b0 --- Tracing command awk pid 864 tid 100132 td 0xfffff801052cd000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f2f6c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f2f6f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f2f730 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f2f790 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f2f7c0 _sleep() at _sleep+0x32b/frame 0xfffffe1048f2f860 pipe_read() at pipe_read+0x286/frame 0xfffffe1048f2f8c0 dofileread() at dofileread+0xcf/frame 0xfffffe1048f2f900 kern_readv() at kern_readv+0x68/frame 0xfffffe1048f2f950 sys_read() at sys_read+0x84/frame 0xfffffe1048f2f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f2fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f2fab0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x800bd4afa, rsp = 0x7fffffffe7d8, rbp = 0x7fffffffe7f0 --- Tracing command sh pid 863 tid 100130 td 0xfffff801052cda00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f25560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f25590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f255d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f25630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f25660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f25700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f257b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f259a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f25ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f25ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe6b8, rbp = 0x7fffffffe770 --- Tracing command top pid 860 tid 100129 td 0xfffff801052ce000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f205b0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f205e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f20620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f20680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f206b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048f20730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048f20770 kern_select() at kern_select+0x99a/frame 0xfffffe1048f20960 sys_select() at sys_select+0x54/frame 0xfffffe1048f209a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f20ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f20ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801222ada, rsp = 0x7fffffffe9c8, rbp = 0x7fffffffeba0 --- Tracing command tail pid 859 tid 100128 td 0xfffff801052ce500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f1b4c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f1b4f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f1b530 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f1b590 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048f1b5c0 _sleep() at _sleep+0x306/frame 0xfffffe1048f1b660 kqueue_kevent() at kqueue_kevent+0x312/frame 0xfffffe1048f1b840 kern_kevent_fp() at kern_kevent_fp+0x99/frame 0xfffffe1048f1b890 kern_kevent() at kern_kevent+0x9f/frame 0xfffffe1048f1b8f0 sys_kevent() at sys_kevent+0x11c/frame 0xfffffe1048f1b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f1bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f1bab0 --- syscall (363, FreeBSD ELF64, sys_kevent), rip = 0x800966d1a, rsp = 0x7fffffffe9f8, rbp = 0x7fffffffeae0 --- Tracing command sh pid 858 tid 100127 td 0xfffff801052cea00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f16560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f16590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f165d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f16630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f16660 _sleep() at _sleep+0x32b/frame 0xfffffe1048f16700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048f167b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048f169a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f16ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f16ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b6666a, rsp = 0x7fffffffe968, rbp = 0x7fffffffea20 --- Tracing command sshd pid 857 tid 100126 td 0xfffff800719cb000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f115c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f115f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f11630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f11690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f116c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f11730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f11770 kern_select() at kern_select+0x99a/frame 0xfffffe1048f11960 sys_select() at sys_select+0x54/frame 0xfffffe1048f119a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f11ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f11ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801fc4ada, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sshd pid 856 tid 100123 td 0xfffff800719cc000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f025c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f025f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f02630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f02690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f026c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f02730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f02770 kern_select() at kern_select+0x99a/frame 0xfffffe1048f02960 sys_select() at sys_select+0x54/frame 0xfffffe1048f029a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f02ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f02ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801fc4ada, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sshd pid 855 tid 100124 td 0xfffff800719cba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f075c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f075f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f07630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f07690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f076c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f07730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f07770 kern_select() at kern_select+0x99a/frame 0xfffffe1048f07960 sys_select() at sys_select+0x54/frame 0xfffffe1048f079a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f07ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f07ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801fc4ada, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe610 --- Tracing command sshd pid 853 tid 100125 td 0xfffff800719cb500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f0c630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f0c660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f0c6a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048f0c700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048f0c730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048f0c7a0 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048f0c7e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048f0c980 sys_poll() at sys_poll+0x61/frame 0xfffffe1048f0c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048f0cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048f0cab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x801f644aa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command sshd pid 849 tid 100121 td 0xfffff800719cca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ef8630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ef8660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ef86a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ef8700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ef8730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048ef87a0 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048ef87e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048ef8980 sys_poll() at sys_poll+0x61/frame 0xfffffe1048ef89a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ef8ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ef8ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x801f644aa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command sshd pid 848 tid 100120 td 0xfffff800719d0000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ef3630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ef3660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ef36a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ef3700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ef3730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048ef37a0 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048ef37e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048ef3980 sys_poll() at sys_poll+0x61/frame 0xfffffe1048ef39a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ef3ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ef3ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x801f644aa, rsp = 0x7fffffffe638, rbp = 0x7fffffffe670 --- Tracing command cron pid 828 tid 100110 td 0xfffff800717cf500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048eaf760 mi_switch() at mi_switch+0x167/frame 0xfffffe1048eaf790 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048eaf7d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048eaf830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048eaf860 _sleep() at _sleep+0x306/frame 0xfffffe1048eaf900 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe1048eaf960 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe1048eaf9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048eafab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048eafab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d317ea, rsp = 0x7fffffffead8, rbp = 0x7fffffffed00 --- Tracing command sendmail pid 824 tid 100109 td 0xfffff800717cfa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048eaa770 mi_switch() at mi_switch+0x167/frame 0xfffffe1048eaa7a0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048eaa7e0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048eaa840 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048eaa870 _sleep() at _sleep+0x32b/frame 0xfffffe1048eaa910 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe1048eaa970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe1048eaa9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048eaaab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048eaaab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x8015526ea, rsp = 0x7fffffffd918, rbp = 0x7fffffffd940 --- Tracing command sendmail pid 821 tid 100107 td 0xfffff8007162b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ea05b0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ea05e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ea0620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ea0680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048ea06b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048ea0730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048ea0770 kern_select() at kern_select+0x99a/frame 0xfffffe1048ea0960 sys_select() at sys_select+0x54/frame 0xfffffe1048ea09a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ea0ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ea0ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8015c4ada, rsp = 0x7fffffffce18, rbp = 0x7fffffffd920 --- Tracing command sshd pid 818 tid 100108 td 0xfffff8007162b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048ea55c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048ea55f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048ea5630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048ea5690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048ea56c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048ea5730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048ea5770 kern_select() at kern_select+0x99a/frame 0xfffffe1048ea5960 sys_select() at sys_select+0x54/frame 0xfffffe1048ea59a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048ea5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048ea5ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801fc4ada, rsp = 0x7fffffffe708, rbp = 0x7fffffffe740 --- Tracing command saslauthd pid 765 tid 100105 td 0xfffff8007162c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e964d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e96500 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e96540 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e965a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e965d0 _sleep() at _sleep+0x32b/frame 0xfffffe1048e96670 lf_advlockasync() at lf_advlockasync+0xe6c/frame 0xfffffe1048e96720 lf_advlock() at lf_advlock+0x45/frame 0xfffffe1048e96770 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe1048e96860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048e96890 kern_fcntl() at kern_fcntl+0xa2d/frame 0xfffffe1048e96930 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa7/frame 0xfffffe1048e969a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e96ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e96ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x802ae534a, rsp = 0x7fffffffea78, rbp = 0x7fffffffeae0 --- Tracing command saslauthd pid 764 tid 100104 td 0xfffff8007162c500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e914d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e91500 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e91540 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e915a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e915d0 _sleep() at _sleep+0x32b/frame 0xfffffe1048e91670 lf_advlockasync() at lf_advlockasync+0xe6c/frame 0xfffffe1048e91720 lf_advlock() at lf_advlock+0x45/frame 0xfffffe1048e91770 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe1048e91860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048e91890 kern_fcntl() at kern_fcntl+0xa2d/frame 0xfffffe1048e91930 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa7/frame 0xfffffe1048e919a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e91ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e91ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x802ae534a, rsp = 0x7fffffffea78, rbp = 0x7fffffffeae0 --- Tracing command saslauthd pid 763 tid 100077 td 0xfffff8001d177500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104811b4d0 mi_switch() at mi_switch+0x167/frame 0xfffffe104811b500 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104811b540 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104811b5a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104811b5d0 _sleep() at _sleep+0x32b/frame 0xfffffe104811b670 lf_advlockasync() at lf_advlockasync+0xe6c/frame 0xfffffe104811b720 lf_advlock() at lf_advlock+0x45/frame 0xfffffe104811b770 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe104811b860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe104811b890 kern_fcntl() at kern_fcntl+0xa2d/frame 0xfffffe104811b930 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa7/frame 0xfffffe104811b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104811bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104811bab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x802ae534a, rsp = 0x7fffffffea78, rbp = 0x7fffffffeae0 --- Tracing command saslauthd pid 762 tid 100089 td 0xfffff8001d431500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e464d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e46500 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e46540 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e465a0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e465d0 _sleep() at _sleep+0x32b/frame 0xfffffe1048e46670 lf_advlockasync() at lf_advlockasync+0xe6c/frame 0xfffffe1048e46720 lf_advlock() at lf_advlock+0x45/frame 0xfffffe1048e46770 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe1048e46860 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x104/frame 0xfffffe1048e46890 kern_fcntl() at kern_fcntl+0xa2d/frame 0xfffffe1048e46930 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa7/frame 0xfffffe1048e469a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e46ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e46ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x802ae534a, rsp = 0x7fffffffea78, rbp = 0x7fffffffeae0 --- Tracing command saslauthd pid 760 tid 100103 td 0xfffff8007162ca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e8c6f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e8c720 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e8c760 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e8c7c0 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e8c7f0 _sleep() at _sleep+0x32b/frame 0xfffffe1048e8c890 kern_accept4() at kern_accept4+0x1a4/frame 0xfffffe1048e8c940 accept1() at accept1+0x60/frame 0xfffffe1048e8c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e8cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e8cab0 --- syscall (30, FreeBSD ELF64, sys_accept), rip = 0x802a828aa, rsp = 0x7fffffffeb98, rbp = 0x7fffffffebd0 --- Tracing command powerd pid 736 tid 100102 td 0xfffff80071631000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e875b0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e875e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e87620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e87680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048e876b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048e87730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048e87770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e87960 sys_select() at sys_select+0x54/frame 0xfffffe1048e879a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e87ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e87ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b90ada, rsp = 0x7fffffffebb8, rbp = 0x7fffffffed00 --- Tracing command ntpd pid 733 tid 100101 td 0xfffff80071631500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e825c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e825f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e82630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e82690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e826c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e82730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048e82770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e82960 sys_select() at sys_select+0x54/frame 0xfffffe1048e829a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e82ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e82ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8013ebada, rsp = 0x7fffffffdc68, rbp = 0x7fffffffdca0 --- Tracing command rpc.lockd pid 696 tid 100100 td 0xfffff80071631a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e7d4a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e7d4d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e7d510 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e7d570 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048e7d5a0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048e7d620 svc_run_internal() at svc_run_internal+0xb80/frame 0xfffffe1048e7d770 svc_run() at svc_run+0x20f/frame 0xfffffe1048e7d7f0 sys_nlm_syscall() at sys_nlm_syscall+0x75f/frame 0xfffffe1048e7d9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e7dab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e7dab0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x800a83eba, rsp = 0x7fffffffebc8, rbp = 0x7fffffffed00 --- Tracing command rpc.statd pid 693 tid 100099 td 0xfffff800715cf000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e785b0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e785e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e78620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e78680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048e786b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048e78730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048e78770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e78960 sys_select() at sys_select+0x54/frame 0xfffffe1048e789a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e78ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e78ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b88ada, rsp = 0x7fffffffeab8, rbp = 0x7fffffffec00 --- Tracing command nfsd pid 692 tid 100091 td 0xfffff800715c8a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e4fea0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e4fed0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e4ff10 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e4ff70 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048e4ffa0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048e50020 svc_run_internal() at svc_run_internal+0xb80/frame 0xfffffe1048e50170 svc_run() at svc_run+0x20f/frame 0xfffffe1048e501f0 nfsrvd_nfsd() at nfsrvd_nfsd+0x1f3/frame 0xfffffe1048e50350 nfssvc_nfsd() at nfssvc_nfsd+0x1ef/frame 0xfffffe1048e50970 sys_nfssvc() at sys_nfssvc+0xdb/frame 0xfffffe1048e509a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e50ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e50ab0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100092 td 0xfffff800715c8500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e557a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e557d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e55810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e55870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e558a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e55910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e55a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e55a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e55ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e55ab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100093 td 0xfffff800715c8000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e5a7a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e5a7d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e5a810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e5a870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e5a8a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e5a910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e5aa60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e5aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e5aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e5aab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100094 td 0xfffff800715b9a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e5f7a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e5f7d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e5f810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e5f870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e5f8a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e5f910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e5fa60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e5fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e5fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e5fab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100095 td 0xfffff800715b9500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e647a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e647d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e64810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e64870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e648a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e64910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e64a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e64a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e64ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e64ab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100096 td 0xfffff800715b9000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e697a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e697d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e69810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e69870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e698a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e69910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e69a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e69a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e69ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e69ab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100097 td 0xfffff800715cfa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e6e7a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e6e7d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e6e810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e6e870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e6e8a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e6e910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e6ea60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e6ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e6eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e6eab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 692 tid 100098 td 0xfffff800715cf500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e737a0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e737d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e73810 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e73870 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e738a0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e73910 svc_run_internal() at svc_run_internal+0xb91/frame 0xfffffe1048e73a60 svc_thread_start() at svc_thread_start+0xb/frame 0xfffffe1048e73a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048e73ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048e73ab0 --- trap 0xc, rip = 0x800870e9a, rsp = 0x7fffffffe5e8, rbp = 0x7fffffffe890 --- Tracing command nfsd pid 689 tid 100090 td 0xfffff8001d431000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e4b5c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e4b5f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e4b630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e4b690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e4b6c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e4b730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048e4b770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e4b960 sys_select() at sys_select+0x54/frame 0xfffffe1048e4b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e4bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e4bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80097eada, rsp = 0x7fffffffe898, rbp = 0x7fffffffed00 --- Tracing command mountd pid 683 tid 100088 td 0xfffff8001d431a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e415c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e415f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e41630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e41690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e416c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e41730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048e41770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e41960 sys_select() at sys_select+0x54/frame 0xfffffe1048e419a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e41ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e41ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b98ada, rsp = 0x7fffffffe698, rbp = 0x7fffffffed00 --- Tracing command nfsuserd pid 677 tid 100074 td 0xfffff8001d178500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104803b5b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104803b5e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104803b620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104803b680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104803b6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe104803b730 seltdwait() at seltdwait+0x71/frame 0xfffffe104803b770 kern_select() at kern_select+0x99a/frame 0xfffffe104803b960 sys_select() at sys_select+0x54/frame 0xfffffe104803b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104803bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104803bab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80097dada, rsp = 0x7fffffffd9c8, rbp = 0x7fffffffdb10 --- Tracing command nfsuserd pid 676 tid 100072 td 0xfffff8001d048000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10480315b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10480315e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048031620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048031680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10480316b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048031730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048031770 kern_select() at kern_select+0x99a/frame 0xfffffe1048031960 sys_select() at sys_select+0x54/frame 0xfffffe10480319a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048031ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048031ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80097dada, rsp = 0x7fffffffd9c8, rbp = 0x7fffffffdb10 --- Tracing command nfsuserd pid 675 tid 100071 td 0xfffff8001d048500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104802c5b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104802c5e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104802c620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104802c680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104802c6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe104802c730 seltdwait() at seltdwait+0x71/frame 0xfffffe104802c770 kern_select() at kern_select+0x99a/frame 0xfffffe104802c960 sys_select() at sys_select+0x54/frame 0xfffffe104802c9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104802cab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104802cab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80097dada, rsp = 0x7fffffffd9c8, rbp = 0x7fffffffdb10 --- Tracing command nfsuserd pid 674 tid 100076 td 0xfffff8001d177a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10481165b0 mi_switch() at mi_switch+0x167/frame 0xfffffe10481165e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048116620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048116680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe10481166b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe1048116730 seltdwait() at seltdwait+0x71/frame 0xfffffe1048116770 kern_select() at kern_select+0x99a/frame 0xfffffe1048116960 sys_select() at sys_select+0x54/frame 0xfffffe10481169a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048116ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048116ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80097dada, rsp = 0x7fffffffd9c8, rbp = 0x7fffffffdb10 --- Tracing command nfsuserd pid 672 tid 100086 td 0xfffff8001d432500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e2b770 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e2b7a0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e2b7e0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e2b840 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e2b870 _sleep() at _sleep+0x32b/frame 0xfffffe1048e2b910 kern_sigsuspend() at kern_sigsuspend+0xb4/frame 0xfffffe1048e2b970 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe1048e2b9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e2bab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e2bab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x80090b6ea, rsp = 0x7fffffffdb18, rbp = 0x7fffffffed00 --- Tracing command watchdogd pid 637 tid 100087 td 0xfffff8001d432000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e30560 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e30590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e305d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e30630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e30660 _sleep() at _sleep+0x32b/frame 0xfffffe1048e30700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe1048e307b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe1048e309a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e30ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e30ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b1e66a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb80 --- Tracing command rpcbind pid 559 tid 100083 td 0xfffff8001d433500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048139620 mi_switch() at mi_switch+0x167/frame 0xfffffe1048139650 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048139690 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe10481396f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe1048139720 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe10481397a0 seltdwait() at seltdwait+0x71/frame 0xfffffe10481397e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048139980 sys_poll() at sys_poll+0x61/frame 0xfffffe10481399a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048139ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048139ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800b2d4aa, rsp = 0x7fffffffca68, rbp = 0x7fffffffec80 --- Tracing command syslogd pid 551 tid 100084 td 0xfffff8001d433000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104813e5c0 mi_switch() at mi_switch+0x167/frame 0xfffffe104813e5f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104813e630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104813e690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe104813e6c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe104813e730 seltdwait() at seltdwait+0x8b/frame 0xfffffe104813e770 kern_select() at kern_select+0x99a/frame 0xfffffe104813e960 sys_select() at sys_select+0x54/frame 0xfffffe104813e9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104813eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104813eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b97ada, rsp = 0x7fffffffde58, rbp = 0x7fffffffed00 --- Tracing command rtsold pid 519 tid 100082 td 0xfffff8001d433a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048134630 mi_switch() at mi_switch+0x167/frame 0xfffffe1048134660 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10481346a0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048134700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048134730 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe10481347a0 seltdwait() at seltdwait+0x8b/frame 0xfffffe10481347e0 kern_poll() at kern_poll+0x447/frame 0xfffffe1048134980 sys_poll() at sys_poll+0x61/frame 0xfffffe10481349a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048134ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048134ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8009214aa, rsp = 0x7fffffffec78, rbp = 0x7fffffffed00 --- Tracing command moused pid 467 tid 100085 td 0xfffff8001d432a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048e265c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1048e265f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048e26630 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1048e26690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1048e266c0 _cv_wait_sig() at _cv_wait_sig+0x1ec/frame 0xfffffe1048e26730 seltdwait() at seltdwait+0x8b/frame 0xfffffe1048e26770 kern_select() at kern_select+0x99a/frame 0xfffffe1048e26960 sys_select() at sys_select+0x54/frame 0xfffffe1048e269a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1048e26ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1048e26ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800dc0ada, rsp = 0x7fffffffe8c8, rbp = 0x7fffffffeca0 --- Tracing command devd pid 454 tid 100081 td 0xfffff8001d176000 sched_switch() at sched_switch+0x48a/frame 0xfffffe104812f5b0 mi_switch() at mi_switch+0x167/frame 0xfffffe104812f5e0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104812f620 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe104812f680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe104812f6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x21f/frame 0xfffffe104812f730 seltdwait() at seltdwait+0x71/frame 0xfffffe104812f770 kern_select() at kern_select+0x99a/frame 0xfffffe104812f960 sys_select() at sys_select+0x54/frame 0xfffffe104812f9a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe104812fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe104812fab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x4a54da, rsp = 0x7fffffffcbb8, rbp = 0x7fffffffed20 --- Tracing command vnlru pid 22 tid 100068 td 0xfffff8001d049500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104801d8a0 mi_switch() at mi_switch+0x167/frame 0xfffffe104801d8d0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104801d910 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe104801d940 _sleep() at _sleep+0x318/frame 0xfffffe104801d9e0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe104801da70 fork_exit() at fork_exit+0x84/frame 0xfffffe104801dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104801dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 21 tid 100067 td 0xfffff8001d049a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10480188c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10480188f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048018930 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1048018960 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x21f/frame 0xfffffe10480189e0 sched_sync() at sched_sync+0x5fc/frame 0xfffffe1048018a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048018ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048018ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100066 td 0xfffff8001d04a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048013900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048013930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048013970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10480139a0 _sleep() at _sleep+0x318/frame 0xfffffe1048013a40 buf_daemon() at buf_daemon+0x68/frame 0xfffffe1048013a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048013ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048013ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100075 td 0xfffff8001d178000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048111900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048111930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048111970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10481119a0 _sleep() at _sleep+0x318/frame 0xfffffe1048111a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe1048111a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048111ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048111ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100078 td 0xfffff8001d177000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048120900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048120930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048120970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10481209a0 _sleep() at _sleep+0x318/frame 0xfffffe1048120a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe1048120a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048120ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048120ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100080 td 0xfffff8001d176500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104812a900 mi_switch() at mi_switch+0x167/frame 0xfffffe104812a930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104812a970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe104812a9a0 _sleep() at _sleep+0x318/frame 0xfffffe104812aa40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe104812aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe104812aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104812aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 20 tid 100341 td 0xfffff8011ad23a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048f9d900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048f9d930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048f9d970 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1048f9d9a0 _sleep() at _sleep+0x318/frame 0xfffffe1048f9da40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe1048f9da70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048f9dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048f9dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 19 tid 100065 td 0xfffff8001d04a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe104800e910 mi_switch() at mi_switch+0x167/frame 0xfffffe104800e940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe104800e980 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe104800e9b0 _sleep() at _sleep+0x318/frame 0xfffffe104800ea50 bufspace_daemon() at bufspace_daemon+0x1b7/frame 0xfffffe104800ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe104800eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe104800eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 18 tid 100064 td 0xfffff8001d04aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10480098c0 mi_switch() at mi_switch+0x167/frame 0xfffffe10480098f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048009930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1048009960 _sleep() at _sleep+0x338/frame 0xfffffe1048009a00 vm_daemon() at vm_daemon+0x96/frame 0xfffffe1048009a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048009ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048009ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100063 td 0xfffff8001af2b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048004820 mi_switch() at mi_switch+0x167/frame 0xfffffe1048004850 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048004890 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe10480048c0 _sleep() at _sleep+0x318/frame 0xfffffe1048004960 vm_pageout() at vm_pageout+0x2b2/frame 0xfffffe1048004a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048004ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048004ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 17 tid 100069 td 0xfffff8001d049000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048022910 mi_switch() at mi_switch+0x167/frame 0xfffffe1048022940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048022980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10480229b0 _sleep() at _sleep+0x338/frame 0xfffffe1048022a50 uma_reclaim_worker() at uma_reclaim_worker+0x71/frame 0xfffffe1048022a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048022ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048022ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 16 tid 100062 td 0xfffff8001af2b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047ffe8c0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047ffe8f0 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047ffe930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1047ffe960 _sleep() at _sleep+0x338/frame 0xfffffe1047ffea00 enc_daemon() at enc_daemon+0x26f/frame 0xfffffe1047ffea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047ffeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047ffeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 15 tid 100061 td 0xfffff8001af2ba00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047ff98f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047ff9920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047ff9960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1047ff9990 _sleep() at _sleep+0x318/frame 0xfffffe1047ff9a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe1047ff9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047ff9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047ff9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 9 tid 100060 td 0xfffff8001af2c000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047ff48f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047ff4920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047ff4960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1047ff4990 _sleep() at _sleep+0x318/frame 0xfffffe1047ff4a30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe1047ff4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047ff4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047ff4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 8 tid 100059 td 0xfffff8001af2c500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047fef8f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047fef920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047fef960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1047fef990 _sleep() at _sleep+0x318/frame 0xfffffe1047fefa30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe1047fefa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047fefab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047fefab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 7 tid 100058 td 0xfffff8001af2ca00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047fea8f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047fea920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047fea960 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1047fea990 _sleep() at _sleep+0x318/frame 0xfffffe1047feaa30 soaio_kproc_loop() at soaio_kproc_loop+0x13e/frame 0xfffffe1047feaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047feaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047feaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 6 tid 100055 td 0xfffff8001af2da00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e1b8d0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e1b900 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047e1b940 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xfffffe1047e1b970 _sleep() at _sleep+0x318/frame 0xfffffe1047e1ba10 random_kthread() at random_kthread+0x230/frame 0xfffffe1047e1ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e1bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e1bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 5 tid 100054 td 0xfffff80010d85000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e16910 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e16940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047e16980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1047e169b0 _sleep() at _sleep+0x338/frame 0xfffffe1047e16a50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe1047e16a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e16ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e16ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100026 td 0xfffff8000b8b4500 sched_switch() at sched_switch+0x48a/frame 0xfffffe000036c940 mi_switch() at mi_switch+0x167/frame 0xfffffe000036c970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe000036c9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000036c9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe000036ca40 usb_process() at usb_process+0x13b/frame 0xfffffe000036ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000036cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000036cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100027 td 0xfffff8000b8b4000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0000371940 mi_switch() at mi_switch+0x167/frame 0xfffffe0000371970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003719b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003719e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000371a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000371a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000371ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000371ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100028 td 0xfffff80010d06a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe0000376940 mi_switch() at mi_switch+0x167/frame 0xfffffe0000376970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003769b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003769e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000376a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000376a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000376ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000376ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100029 td 0xfffff80010d06500 sched_switch() at sched_switch+0x48a/frame 0xfffffe000037b940 mi_switch() at mi_switch+0x167/frame 0xfffffe000037b970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe000037b9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000037b9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe000037ba40 usb_process() at usb_process+0x13b/frame 0xfffffe000037ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000037bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000037bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100030 td 0xfffff80010d06000 sched_switch() at sched_switch+0x48a/frame 0xfffffe0000380940 mi_switch() at mi_switch+0x167/frame 0xfffffe0000380970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003809b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003809e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe0000380a40 usb_process() at usb_process+0x13b/frame 0xfffffe0000380a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000380ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000380ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100039 td 0xfffff80010d46000 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003c9940 mi_switch() at mi_switch+0x167/frame 0xfffffe00003c9970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003c99b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003c99e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe00003c9a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003c9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100040 td 0xfffff80010d45a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003ce940 mi_switch() at mi_switch+0x167/frame 0xfffffe00003ce970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003ce9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003ce9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe00003cea40 usb_process() at usb_process+0x13b/frame 0xfffffe00003cea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100041 td 0xfffff80010d45500 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003d3940 mi_switch() at mi_switch+0x167/frame 0xfffffe00003d3970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003d39b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003d39e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe00003d3a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003d3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100042 td 0xfffff80010d45000 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003d8940 mi_switch() at mi_switch+0x167/frame 0xfffffe00003d8970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003d89b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003d89e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe00003d8a40 usb_process() at usb_process+0x13b/frame 0xfffffe00003d8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100043 td 0xfffff80010d44a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003dd940 mi_switch() at mi_switch+0x167/frame 0xfffffe00003dd970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003dd9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003dd9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe00003dda40 usb_process() at usb_process+0x13b/frame 0xfffffe00003dda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003ddab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003ddab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100045 td 0xfffff80010d44000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d6a940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d6a970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045d6a9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045d6a9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045d6aa40 usb_process() at usb_process+0x13b/frame 0xfffffe1045d6aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d6aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d6aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100046 td 0xfffff80010d87a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d6f940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d6f970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045d6f9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045d6f9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045d6fa40 usb_process() at usb_process+0x13b/frame 0xfffffe1045d6fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d6fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d6fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100047 td 0xfffff80010d87500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d74940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d74970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045d749b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045d749e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045d74a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045d74a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d74ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d74ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100048 td 0xfffff80010d87000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d79940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d79970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045d799b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045d799e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045d79a40 usb_process() at usb_process+0x13b/frame 0xfffffe1045d79a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d79ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d79ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 14 tid 100049 td 0xfffff80010d86a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d7e940 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d7e970 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1045d7e9b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1045d7e9e0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1045d7ea40 usb_process() at usb_process+0x13b/frame 0xfffffe1045d7ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d7eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d7eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100019 td 0xfffff8000b8b6a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057ab8e0 mi_switch() at mi_switch+0x167/frame 0xfffffe10057ab910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057ab950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057ab980 _sleep() at _sleep+0x338/frame 0xfffffe10057aba20 xpt_done_td() at xpt_done_td+0x13f/frame 0xfffffe10057aba70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057abab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057abab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 4 tid 100057 td 0xfffff8001af2d000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e258e0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e25910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047e25950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1047e25980 _sleep() at _sleep+0x338/frame 0xfffffe1047e25a20 xpt_scanner_thread() at xpt_scanner_thread+0xa4/frame 0xfffffe1047e25a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e25ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e25ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 3 tid 100018 td 0xfffff8000b719000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057a68f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10057a6920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057a6960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057a6990 _sleep() at _sleep+0x338/frame 0xfffffe10057a6a30 crypto_ret_proc() at crypto_ret_proc+0x1da/frame 0xfffffe10057a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100017 td 0xfffff8000b719500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057a18f0 mi_switch() at mi_switch+0x167/frame 0xfffffe10057a1920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057a1960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057a1990 _sleep() at _sleep+0x338/frame 0xfffffe10057a1a30 crypto_proc() at crypto_proc+0x394/frame 0xfffffe10057a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffff8000b71a500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057928f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1005792920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005792960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1005792990 _sleep() at _sleep+0x338/frame 0xfffffe1005792a30 g_run_events() at g_run_events+0x50/frame 0xfffffe1005792a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005792ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005792ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffff8000b71a000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057978f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1005797920 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005797960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1005797990 _sleep() at _sleep+0x338/frame 0xfffffe1005797a30 g_io_schedule_up() at g_io_schedule_up+0xf7/frame 0xfffffe1005797a60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe1005797a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005797ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005797ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100016 td 0xfffff8000b719a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe100579c8e0 mi_switch() at mi_switch+0x167/frame 0xfffffe100579c910 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe100579c950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe100579c980 _sleep() at _sleep+0x338/frame 0xfffffe100579ca20 g_io_schedule_down() at g_io_schedule_down+0x12c/frame 0xfffffe100579ca60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe100579ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe100579cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe100579cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100004 td 0xfffff8000b6d7a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057609f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1005760a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1005760a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005760ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005760ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100005 td 0xfffff8000b6d7500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100006 td 0xfffff8000b6d7000 sched_switch() at sched_switch+0x48a/frame 0xfffffe100576a9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe100576aa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe100576aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe100576aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe100576aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100007 td 0xfffff8000b6d1a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe100576f9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe100576fa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe100576fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe100576fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe100576fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100010 td 0xfffff8000b71ba00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xfffff8000b71b000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057889f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1005788a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1005788a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005788ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005788ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100023 td 0xfffff8000b8b5500 sched_switch() at sched_switch+0x48a/frame 0xfffffe0f8f7d29f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0f8f7d2a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0f8f7d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0f8f7d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0f8f7d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100024 td 0xfffff8000b8b5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xfffff8000b8b4a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003679f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0000367a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000367a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000367ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000367ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100031 td 0xfffff80010d05a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003859f0 mi_switch() at mi_switch+0x167/frame 0xfffffe0000385a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe0000385a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000385ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000385ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100032 td 0xfffff80010d05500 sched_switch() at sched_switch+0x48a/frame 0xfffffe000039c9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe000039ca20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe000039ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000039cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000039cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100034 td 0xfffff80010d04a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003a69f0 mi_switch() at mi_switch+0x167/frame 0xfffffe00003a6a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe00003a6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100035 td 0xfffff80010d04500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100037 td 0xfffff80010d46a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100038 td 0xfffff80010d46500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100044 td 0xfffff80010d44500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d659f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d65a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045d65a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d65ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d65ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffff80010d86500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1045d839f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1045d83a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1045d83a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1045d83ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1045d83ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffff80010d86000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047dff9f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047dffa20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1047dffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047dffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047dffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffff80010d85a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e079f0 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e07a20 ithread_loop() at ithread_loop+0x1e1/frame 0xfffffe1047e07a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e07ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e07ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffff8000b6d8000 sched_switch() at sched_switch+0x48a/frame 0xfffffe100575b930 mi_switch() at mi_switch+0x167/frame 0xfffffe100575b960 critical_exit() at critical_exit+0x8b/frame 0xfffffe100575b980 sched_idletd() at sched_idletd+0x4a5/frame 0xfffffe100575ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe100575bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe100575bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000b6d8500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1005756560 mi_switch() at mi_switch+0x167/frame 0xfffffe1005756590 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057565d0 sleepq_catch_signals() at sleepq_catch_signals+0x32c/frame 0xfffffe1005756630 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe1005756660 _sleep() at _sleep+0x32b/frame 0xfffffe1005756700 kern_wait6() at kern_wait6+0x422/frame 0xfffffe10057567b0 sys_wait4() at sys_wait4+0x7b/frame 0xfffffe10057569a0 amd64_syscall() at amd64_syscall+0x2f6/frame 0xfffffe1005756ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe1005756ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41d37a, rsp = 0x7fffffffe7a8, rbp = 0x7fffffffe810 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000b6d8a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1005751910 mi_switch() at mi_switch+0x167/frame 0xfffffe1005751940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005751980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057519b0 _cv_wait() at _cv_wait+0x1e4/frame 0xfffffe1005751a10 audit_worker() at audit_worker+0xa3/frame 0xfffffe1005751a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005751ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005751ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81dfdc10 sched_switch() at sched_switch+0x48a/frame 0xffffffff821d99e0 mi_switch() at mi_switch+0x167/frame 0xffffffff821d9a10 sleepq_switch() at sleepq_switch+0xe7/frame 0xffffffff821d9a50 sleepq_timedwait() at sleepq_timedwait+0x43/frame 0xffffffff821d9a80 _sleep() at _sleep+0x318/frame 0xffffffff821d9b20 swapper() at swapper+0x248/frame 0xffffffff821d9b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100008 td 0xfffff8000b6d1500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1005774900 mi_switch() at mi_switch+0x167/frame 0xfffffe1005774930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005774970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057749a0 _sleep() at _sleep+0x338/frame 0xfffffe1005774a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1005774a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005774ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005774ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100009 td 0xfffff8000b6d1000 sched_switch() at sched_switch+0x48a/frame 0xfffffe1005779900 mi_switch() at mi_switch+0x167/frame 0xfffffe1005779930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005779970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057799a0 _sleep() at _sleep+0x338/frame 0xfffffe1005779a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1005779a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005779ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005779ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100011 td 0xfffff8000b71b500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1005783900 mi_switch() at mi_switch+0x167/frame 0xfffffe1005783930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1005783970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057839a0 _sleep() at _sleep+0x338/frame 0xfffffe1005783a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1005783a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1005783ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1005783ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100013 td 0xfffff8000b71aa00 sched_switch() at sched_switch+0x48a/frame 0xfffffe100578d900 mi_switch() at mi_switch+0x167/frame 0xfffffe100578d930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe100578d970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe100578d9a0 _sleep() at _sleep+0x338/frame 0xfffffe100578da40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe100578da70 fork_exit() at fork_exit+0x84/frame 0xfffffe100578dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe100578dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff8000b8b6500 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057b0910 mi_switch() at mi_switch+0x167/frame 0xfffffe10057b0940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057b0980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057b09b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10057b0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10057b0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffff8000b8b6000 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057b5910 mi_switch() at mi_switch+0x167/frame 0xfffffe10057b5940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057b5980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057b59b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10057b5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10057b5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057b5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057b5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff8000b8b5a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe10057ba910 mi_switch() at mi_switch+0x167/frame 0xfffffe10057ba940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe10057ba980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10057ba9b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe10057baa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe10057baa70 fork_exit() at fork_exit+0x84/frame 0xfffffe10057baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe10057baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80010d05000 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003a1900 mi_switch() at mi_switch+0x167/frame 0xfffffe00003a1930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003a1970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003a19a0 _sleep() at _sleep+0x338/frame 0xfffffe00003a1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003a1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003a1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003a1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80010d04000 sched_switch() at sched_switch+0x48a/frame 0xfffffe00003b8900 mi_switch() at mi_switch+0x167/frame 0xfffffe00003b8930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe00003b8970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00003b89a0 _sleep() at _sleep+0x338/frame 0xfffffe00003b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00003b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00003b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00003b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff80010d85500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e10910 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e10940 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047e10980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1047e109b0 msleep_spin_sbt() at msleep_spin_sbt+0x1ec/frame 0xfffffe1047e10a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe1047e10a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e10ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e10ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff8001af2d500 sched_switch() at sched_switch+0x48a/frame 0xfffffe1047e20900 mi_switch() at mi_switch+0x167/frame 0xfffffe1047e20930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1047e20970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe1047e209a0 _sleep() at _sleep+0x338/frame 0xfffffe1047e20a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1047e20a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1047e20ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1047e20ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffff8001d176a00 sched_switch() at sched_switch+0x48a/frame 0xfffffe1048125900 mi_switch() at mi_switch+0x167/frame 0xfffffe1048125930 sleepq_switch() at sleepq_switch+0xe7/frame 0xfffffe1048125970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe10481259a0 _sleep() at _sleep+0x338/frame 0xfffffe1048125a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe1048125a70 fork_exit() at fork_exit+0x84/frame 0xfffffe1048125ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe1048125ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> call doadump Dumping 4496 out of 65427 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete = 0 db:0:doadump> reset (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:221 #1 0xffffffff80394e86 in db_fncall (dummy1=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:581 #2 0xffffffff803949e9 in db_command (cmd_table=) at ../../../ddb/db_command.c:453 #3 0xffffffff80399418 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:302 #4 0xffffffff803949e9 in db_command (cmd_table=) at ../../../ddb/db_command.c:453 #5 0xffffffff80394744 in db_command_loop () at ../../../ddb/db_command.c:506 #6 0xffffffff803977ff in db_trap (type=, code=) at ../../../ddb/db_main.c:248 #7 0xffffffff80a93f63 in kdb_trap (type=, code=, tf=) at ../../../kern/subr_kdb.c:654 #8 0xffffffff80ed2bbd in trap (frame=0xfffffe1048fdde30) at ../../../amd64/amd64/trap.c:556 #9 0xffffffff80eb2c21 in calltrap () at ../../../amd64/amd64/exception.S:236 #10 0xffffffff80a9360b in kdb_enter (why=0xffffffff810870c5 "watchdog", msg=0x80
) at cpufunc.h:63 #11 0xffffffff809f215e in hardclock_cnt (cnt=, usermode=) at ../../../kern/kern_clock.c:602 #12 0xffffffff80fe7345 in handleevents (now=, fake=) at ../../../kern/kern_clocksource.c:185 #13 0xffffffff80fe7af7 in timercb (et=, arg=) at ../../../kern/kern_clocksource.c:352 #14 0xffffffff810271df in lapic_handle_timer (frame=0xfffffe1048fde040) at ../../../x86/x86/local_apic.c:1180 #15 0xffffffff80eb381c in Xtimerint () at apic_vector.S:133 #16 0xffffffff80b054c4 in fnv_32_buf (buf=0x28, len=0xfffffe1048fde100, hval=0x0) at fnv_hash.h:24 #17 0xffffffff80b0022c in cache_get_hash (name=0xfffff80a577ebe42 "pkg-descr", len=0x9, dvp=0xfffff8080890c4e0) at ../../../kern/vfs_cache.c:444 #18 0xffffffff80b05255 in NCP2BUCKETLOCK (ncp=0xfffff80a577ebe00) at ../../../kern/vfs_cache.c:453 #19 0xffffffff80b0293f in cache_zap_locked_vnode_kl (ncp=0xfffff80a577ebe00, vp=0xfffff8042532d750) at ../../../kern/vfs_cache.c:860 #20 0xffffffff80b0268c in cache_purge (vp=0xfffff8042532d750) at ../../../kern/vfs_cache.c:1716 #21 0xffffffff80b1b3b4 in vgonel (vp=) at ../../../kern/vfs_subr.c:3262 #22 0xffffffff80b16932 in vnlru_free_locked (count=, mnt_op=) at ../../../kern/vfs_subr.c:1221 #23 0xffffffff80b16ed9 in getnewvnode (tag=0xffffffff813ed57e "ufs", mp=0xfffff8001d05b790, vops=0xffffffff819649d0, vpp=) at ../../../kern/vfs_subr.c:1364 #24 0xffffffff80d1bcd2 in ffs_vgetf (mp=, ino=0x10828, flags=, vpp=, ffs_flags=0x0) at ../../../ufs/ffs/ffs_vfsops.c:1684 #25 0xffffffff80cef6d1 in ffs_valloc (pvp=, mode=, cred=0xfffff803c41c4300, vpp=0xfffffe1048fde4f0) at ../../../ufs/ffs/ffs_alloc.c:1074 #26 0xffffffff80d34d94 in ufs_makeinode (mode=, dvp=0xfffff80325b77c30, vpp=0xfffffe1048fde8e8, cnp=0xfffffe1048fde910) at ../../../ufs/ufs/ufs_vnops.c:2589 #27 0xffffffff80d30e03 in ufs_create (ap=0xfffffe1048fde7d0) at ../../../ufs/ufs/ufs_vnops.c:206 #28 0xffffffff8103447e in VOP_CREATE_APV (vop=, a=) at vnode_if.c:263 #29 0xffffffff80b29672 in vn_open_cred (ndp=, flagp=0xfffffe1048fde95c, cmode=0x1b0, vn_open_flags=, cred=, fp=0xffffffff814122e6) at vnode_if.h:109 #30 0xffffffff80b2297c in kern_openat (td=0xfffff8011ae4e500, fd=0xffffff9c, path=0x7fffffffe450
, pathseg=UIO_USERSPACE, flags=Cannot access memory at address 0x8 ) at ../../../kern/vfs_syscalls.c:998 #31 0xffffffff80ed3ca6 in amd64_syscall (td=0xfffff8011ae4e500, traced=) at subr_syscall.c:135 #32 0xffffffff80eb2f0b in Xfast_syscall () at ../../../amd64/amd64/exception.S:396 #33 0x0000000800b1f7ca in ?? () Previous frame inner to this frame (corrupt stack?) Current language: auto; currently minimal (kgdb) f 19 #19 0xffffffff80b0293f in cache_zap_locked_vnode_kl (ncp=0xfffff80a577ebe00, vp=0xfffff8042532d750) at ../../../kern/vfs_cache.c:860 860 blp = NCP2BUCKETLOCK(ncp); (kgdb) l 855 856 MPASS(vp == ncp->nc_dvp || vp == ncp->nc_vp); 857 cache_assert_vnode_locked(vp); 858 859 pvlp = VP2VNODELOCK(vp); 860 blp = NCP2BUCKETLOCK(ncp); 861 if (ncp->nc_vp == NULL) { 862 if (!cache_trylock_ncp(ncp)) 863 goto out_unlock_pvlp; 864 rw_wlock(blp); (kgdb) info loc pvlp = (struct mtx *) 0xfffff800180cdae0 vlp1 = (struct mtx *) 0xfffff8042532d8b8 vlp2 = (struct mtx *) 0xfffff800180cdae0 to_unlock = (struct mtx *) 0x286 blp = (struct rwlock *) 0xfffffe0000f62480 (kgdb) p *ncp $1 = {nc_hash = {le_next = 0x0, le_prev = 0xfffffe000154fb48}, nc_src = {le_next = 0xfffff80a577ebe70, le_prev = 0xfffff8080890c528}, nc_dst = {tqe_next = 0x0, tqe_prev = 0xfffff8042532d7a0}, nc_dvp = 0xfffff8080890c4e0, nc_vp = 0xfffff8042532d750, nc_flag = 0x0, nc_nlen = 0x9, nc_name = 0xfffff80a577ebe42 "pkg-descr"} (kgdb) p *vp $2 = {v_tag = 0xffffffff813ed57e "ufs", v_op = 0xffffffff819649d0, v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0xfffff8080881e750, tqe_prev = 0xfffff8042532d9e0}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffff804ceecd788}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xfffff80a577ebe00, tqh_last = 0xfffff80a577ebe20}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff813ed57e "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffffe0000be5380}, lk_lock = 0xfffff8011ae4e500, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = { depth = 0xf, pcs = 0xfffff8042532d7f0}}, v_interlock = {lock_object = {lo_name = 0xffffffff8140b250 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8580}, mtx_lock = 0x4}, v_vnlock = 0xfffff8042532d7b8, v_actfreelist = {tqe_next = 0xfffff8042532d4e0, tqe_prev = 0xffffffff81d7f668}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff81414bb4 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe0000be2880}, rw_lock = 0x1}, bo_ops = 0xffffffff8192fbc0, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xfffff8042532d750, __bo_vnode = 0xfffff8042532d750, bo_clean = { bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8042532d908}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8042532d928}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x4, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = { tqh_first = 0x0, tqh_last = 0xfffff8042532d970}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x0, v_iflag = 0x80, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x2e9ccd1, v_type = VREG} (kgdb) p *pvlp $3 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff8011ae4e500} (kgdb) p *vlp1 $4 = {lock_object = {lo_name = 0xffffffff81414bb4 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe0000be2880}, mtx_lock = 0x1} (kgdb) p *vlp2 $5 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff8011ae4e500} (kgdb) p *blp $6 = {lock_object = {lo_name = 0xffffffff8140b2c5 "ncbuc", lo_flags = 0x56b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8c00}, rw_lock = 0x1} (kgdb) (kgdb) proc 20618 [Switching to thread 215 (Thread 100204)]#0 sched_switch (td=0xfffff801e213c000, newtd=0xfffff8011ae4e500, flags=) at ../../../kern/sched_ule.c:1973 1973 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffff801e213c000, newtd=0xfffff8011ae4e500, flags=) at ../../../kern/sched_ule.c:1973 #1 0xffffffff80a5bf77 in mi_switch (flags=0x103, newtd=0x0) at ../../../kern/kern_synch.c:455 #2 0xffffffff80aa8f5e in turnstile_wait (ts=, owner=, queue=) at ../../../kern/subr_turnstile.c:751 #3 0xffffffff80a4d705 in __rw_wlock_hard (c=, tid=, file=, line=) at ../../../kern/kern_rwlock.c:935 #4 0xffffffff80a4d5ec in _rw_wlock_cookie (c=0xfffffe0000f61798, file=0xffffffff814122e6 "../../../kern/vfs_cache.c", line=0x372) at ../../../kern/kern_rwlock.c:296 #5 0xffffffff80b02a78 in cache_zap_locked_vnode_kl (ncp=0xfffff8047697ae70, vp=0xfffff8047639c4e0) at ../../../kern/vfs_cache.c:882 #6 0xffffffff80b0268c in cache_purge (vp=0xfffff8047639c4e0) at ../../../kern/vfs_cache.c:1716 #7 0xffffffff80b1b3b4 in vgonel (vp=) at ../../../kern/vfs_subr.c:3262 #8 0xffffffff80b16932 in vnlru_free_locked (count=, mnt_op=) at ../../../kern/vfs_subr.c:1221 #9 0xffffffff80b16ed9 in getnewvnode (tag=0xffffffff813ed57e "ufs", mp=0xfffff8001d05b790, vops=0xffffffff819649d0, vpp=) at ../../../kern/vfs_subr.c:1364 #10 0xffffffff80d1bcd2 in ffs_vgetf (mp=, ino=0x1082f, flags=, vpp=, ffs_flags=0x0) at ../../../ufs/ffs/ffs_vfsops.c:1684 #11 0xffffffff80cef6d1 in ffs_valloc (pvp=, mode=, cred=0xfffff803c41c4300, vpp=0xfffffe1049095590) at ../../../ufs/ffs/ffs_alloc.c:1074 #12 0xffffffff80d34d94 in ufs_makeinode (mode=, dvp=0xfffff8025bb53270, vpp=0xfffffe1049095830, cnp=0xfffffe1049095858) at ../../../ufs/ufs/ufs_vnops.c:2589 #13 0xffffffff80d347e2 in ufs_symlink (ap=0xfffffe1049095948) at ../../../ufs/ufs/ufs_vnops.c:2109 #14 0xffffffff81036b94 in VOP_SYMLINK_APV (vop=, a=) at vnode_if.c:1753 #15 0xffffffff80b23a8f in kern_symlinkat (td=, path1=, fd=0xffffff9c, path2=0x7fffffffe450
, segflg=UIO_USERSPACE) at vnode_if.h:723 #16 0xffffffff80ed3ca6 in amd64_syscall (td=0xfffff801e213c000, traced=) at subr_syscall.c:135 #17 0xffffffff80eb2f0b in Xfast_syscall () at ../../../amd64/amd64/exception.S:396 #18 0x0000000800a8409a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 5 #5 0xffffffff80b02a78 in cache_zap_locked_vnode_kl (ncp=0xfffff8047697ae70, vp=0xfffff8047639c4e0) at ../../../kern/vfs_cache.c:882 882 rw_wlock(blp); (kgdb) l 877 } else { 878 if (!cache_mtx_trylock(vlp1)) 879 goto out_unlock_pvlp; 880 to_unlock = vlp1; 881 } 882 rw_wlock(blp); 883 cache_zap_locked_all(ncp); 884 rw_wunlock(blp); 885 mtx_unlock(to_unlock); 886 return (0); (kgdb) info loc pvlp = (struct mtx *) 0xfffff800180cd880 vlp1 = (struct mtx *) 0xfffff800180cd880 vlp2 = (struct mtx *) 0xfffff800180cdb20 to_unlock = (struct mtx *) 0xfffff800180cdb20 blp = (struct rwlock *) 0xfffffe0000f61780 (kgdb) p *blp $2 = {lock_object = {lo_name = 0xffffffff8140b2c5 "ncbuc", lo_flags = 0x56b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8c00}, rw_lock = 0x1d} (kgdb) p *ncp $3 = {nc_hash = {le_next = 0x0, le_prev = 0xfffff80c3667d3f0}, nc_src = {le_next = 0x0, le_prev = 0xfffff8047697ae10}, nc_dst = {tqe_next = 0x0, tqe_prev = 0xfffff8047639c530}, nc_dvp = 0xfffff8042532d9c0, nc_vp = 0xfffff8047639c4e0, nc_flag = 0x0, nc_nlen = 0xb, nc_name = 0xfffff8047697aeb2 "patch-rec.c"} (kgdb) p *vp $4 = {v_tag = 0xffffffff813ed57e "ufs", v_op = 0xffffffff819649d0, v_data = 0x0, v_mount = 0x0, v_nmntvnodes = {tqe_next = 0xfffff8080881e750, tqe_prev = 0xfffff8042532d770}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffff802cdd24788}, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0xfffff8047697ae70, tqh_last = 0xfffff8047697ae90}, v_cache_dd = 0x0, v_lock = {lock_object = {lo_name = 0xffffffff813ed57e "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffffe0000be5380}, lk_lock = 0xfffff801e213c000, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = { depth = 0xe, pcs = 0xfffff8047639c580}}, v_interlock = {lock_object = {lo_name = 0xffffffff8140b250 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8580}, mtx_lock = 0x4}, v_vnlock = 0xfffff8047639c548, v_actfreelist = {tqe_next = 0xfffff8080881e750, tqe_prev = 0xffffffff81d7f668}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff81414bb4 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe0000be2880}, rw_lock = 0x1}, bo_ops = 0xffffffff8192fbc0, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0xfffff8047639c4e0, __bo_vnode = 0xfffff8047639c4e0, bo_clean = { bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8047639c698}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8047639c6b8}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x4, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = { tqh_first = 0x0, tqh_last = 0xfffff8047639c700}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x1, v_usecount = 0x0, v_iflag = 0x80, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x2e9cccf, v_type = VREG} (kgdb) p *pvlp $5 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff801e213c000} (kgdb) p *vlp1 $6 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff801e213c000} (kgdb) p *vlp2 $7 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff801e213c000} (kgdb) p *to_unlock $8 = {lock_object = {lo_name = 0xffffffff8140b2c0 "ncvn", lo_flags = 0x14b0000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8b80}, mtx_lock = 0xfffff801e213c000} (kgdb) (kgdb) proc 20750 [Switching to thread 316 (Thread 100172)]#0 sched_switch (td=0xfffff8011aefba00, newtd=0xfffff80010d44500, flags=) at ../../../kern/sched_ule.c:1973 1973 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffff8011aefba00, newtd=0xfffff80010d44500, flags=) at ../../../kern/sched_ule.c:1973 #1 0xffffffff80a5bf77 in mi_switch (flags=0x602, newtd=0x0) at ../../../kern/kern_synch.c:455 #2 0xffffffff80a5940b in critical_exit () at ../../../kern/kern_switch.c:218 #3 0xffffffff80a188e7 in intr_event_handle (ie=, frame=) at ../../../kern/kern_intr.c:1477 #4 0xffffffff810222f8 in intr_execute_handlers (isrc=0xfffff8000b702590, frame=0xfffffe1048ff71d0) at ../../../x86/x86/intr_machdep.c:268 #5 0xffffffff81027108 in lapic_handle_intr (vector=0x44, frame=0xfffffe1048ff71d0) at ../../../x86/x86/local_apic.c:1142 #6 0xffffffff80eb33c7 in Xapic_isr2 () at apic_vector.S:117 #7 0xffffffff80b00f8e in cache_enter_time (dvp=0xfffff8001d1d24e0, vp=0x0, cnp=0xfffffe1048ff7898, tsp=0x0, dtsp=0x0) at ../../../kern/vfs_cache.c:1545 #8 0xffffffff80d2b331 in ufs_lookup_ino (vdp=, vpp=, cnp=, dd_ino=0x0) at ../../../ufs/ufs/ufs_lookup.c:746 #9 0xffffffff810342ae in VOP_CACHEDLOOKUP_APV (vop=, a=) at vnode_if.c:195 #10 0xffffffff80b0340d in VOP_CACHEDLOOKUP (dvp=0xfffff8001d1d24e0, vpp=0xfffffe1048ff7870, cnp=0xfffffe1048ff7898) at vnode_if.h:80 #11 0xffffffff80b03328 in vfs_cache_lookup (ap=0xfffffe1048ff7648) at ../../../kern/vfs_cache.c:1843 #12 0xffffffff810340de in VOP_LOOKUP_APV (vop=, a=) at vnode_if.c:127 #13 0xffffffff80b0ddd2 in lookup (ndp=) at vnode_if.h:54 #14 0xffffffff80b0d462 in namei (ndp=) at ../../../kern/vfs_lookup.c:304 #15 0xffffffff80b24648 in kern_statat (td=0xfffff8011aefba00, flag=, fd=0xffffff9c, path=0xffffffff814122e6 "../../../kern/vfs_cache.c", pathseg=, sbp=, hook=0x8014189c0) at ../../../kern/vfs_syscalls.c:2160 #16 0xffffffff80b2457d in sys_stat (td=0x1, uap=0xfffffe1048ff7a40) at ../../../kern/vfs_syscalls.c:2115 #17 0xffffffff80ed3ca6 in amd64_syscall (td=0xfffff8011aefba00, traced=) at subr_syscall.c:135 #18 0xffffffff80eb2f0b in Xfast_syscall () at ../../../amd64/amd64/exception.S:396 #19 0x0000000800bd333a in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 7 #7 0xffffffff80b00f8e in cache_enter_time (dvp=0xfffff8001d1d24e0, vp=0x0, cnp=0xfffffe1048ff7898, tsp=0x0, dtsp=0x0) at ../../../kern/vfs_cache.c:1545 1545 LIST_INSERT_HEAD(&dvp->v_cache_src, ncp, nc_src); (kgdb) l 1540 if (flag != NCF_ISDOTDOT) { 1541 if (LIST_EMPTY(&dvp->v_cache_src)) { 1542 vhold(dvp); 1543 atomic_add_rel_long(&numcachehv, 1); 1544 } 1545 LIST_INSERT_HEAD(&dvp->v_cache_src, ncp, nc_src); 1546 } 1547 1548 /* 1549 * Insert the new namecache entry into the appropriate chain (kgdb) info loc cel = {vlp = 0xfffffe1048ff7368, blp = 0xfffffe1048ff7380, ncp = 0x0} ncp = (struct namecache *) 0xfffff8025b8909a0 n2 = (struct namecache *) 0x0 ndd = (struct namecache *) 0x0 n3 = (struct namecache_ts *) 0x200 ncpp = (struct nchashhead *) 0xfffffe0001887238 hash = 0xcfceae47 flag = 0x0 len = 0xf (kgdb) p *dvp $9 = {v_tag = 0xffffffff813ed57e "ufs", v_op = 0xffffffff819649d0, v_data = 0xfffff8001d174840, v_mount = 0xfffff8001d05cb58, v_nmntvnodes = {tqe_next = 0xfffff8001d1d2000, tqe_prev = 0xfffff8001d1d3020}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0xfffff804cebe29f8}, v_cache_src = {lh_first = 0xfffff80afc41fcb0}, v_cache_dst = {tqh_first = 0xfffff8001d1ed2a0, tqh_last = 0xfffff8001d1ed2c0}, v_cache_dd = 0xfffff8001d1ed2a0, v_lock = { lock_object = {lo_name = 0xffffffff813ed57e "ufs", lo_flags = 0x6fb0000, lo_data = 0x0, lo_witness = 0xfffffe0000be5380}, lk_lock = 0x11, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0xb, pcs = 0xfffff8001d1d2580}}, v_interlock = {lock_object = {lo_name = 0xffffffff8140b250 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xfffffe0000bd8580}, mtx_lock = 0x4}, v_vnlock = 0xfffff8001d1d2548, v_actfreelist = {tqe_next = 0xfffff8001d18f4e0, tqe_prev = 0xfffff8001d1d2158}, v_bufobj = {bo_lock = {lock_object = {lo_name = 0xffffffff81414bb4 "bufobj interlock", lo_flags = 0x5230000, lo_data = 0x0, lo_witness = 0xfffffe0000be2880}, rw_lock = 0x1}, bo_ops = 0xffffffff8192fbc0, bo_object = 0xfffff8001d1c9420, bo_synclist = {le_next = 0xfffff8032592b8b8, le_prev = 0xfffff8000b723a40}, bo_private = 0xfffff8001d1d24e0, __bo_vnode = 0xfffff8001d1d24e0, bo_clean = {bv_hd = {tqh_first = 0x0, tqh_last = 0xfffff8001d1d2698}, bv_root = {pt_root = 0x0}, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0xfffffe0f924837c0, tqh_last = 0xfffffe0f92483810}, bv_root = {pt_root = 0xfffffe0f92483919}, bv_cnt = 0x1}, bo_numoutput = 0x0, bo_flag = 0x1, bo_bsize = 0x8000}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xfffff8001d1d2700}, rl_currdep = 0x0}, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_holdcnt = 0x9, v_usecount = 0x6, v_iflag = 0x200, v_vflag = 0x0, v_writecount = 0x0, v_hash = 0x1f88a3e, v_type = VDIR} (kgdb) p *cnp $10 = {cn_nameiop = 0x0, cn_flags = 0x400c144, cn_thread = 0xfffff8011aefba00, cn_cred = 0xfffff802cdd48300, cn_lkflags = 0x202000, cn_pnbuf = 0xfffff804766e0800 "saved-entropy.5", cn_nameptr = 0xfffff804766e0800 "saved-entropy.5", cn_namelen = 0xf} (kgdb) $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/kern/subr_witness.c =================================================================== --- /usr/src/sys/kern/subr_witness.c (revision 305815) +++ /usr/src/sys/kern/subr_witness.c (working copy) @@ -623,12 +623,12 @@ static struct witness_order_list_entry order_lists { "vnode interlock", &lock_class_mtx_sleep }, { NULL, NULL }, /* - * VFS namecache + * vfs namecache */ - { "ncglobal", &lock_class_rw }, + { "ncen", &lock_class_mtx_sleep }, + { "ncvn", &lock_class_mtx_sleep }, { "ncbuc", &lock_class_rw }, { "vnode interlock", &lock_class_mtx_sleep }, - { "ncneg", &lock_class_mtx_sleep }, { NULL, NULL }, /* * ZFS locking Index: /usr/src/sys/kern/vfs_cache.c =================================================================== --- /usr/src/sys/kern/vfs_cache.c (revision 305815) +++ /usr/src/sys/kern/vfs_cache.c (working copy) @@ -150,22 +150,48 @@ struct namecache_ts { * is for DELETE, or NOCACHE is set (rewrite), and the * name is located in the cache, it will be dropped. * - * These locks are used (in the order in which they can be taken): + * These locks are used (in order in which they can be taken): * NAME TYPE ROLE - * cache_lock rwlock global, needed for all modifications - * bucketlock rwlock for access to given hash bucket + * ncelock mtx per entry, taken if the entry is to be zapped (see below) + * vnodelock mtx vnode lists and v_cache_dd field protection + * bucketlock rwlock for access to given to given set of hash buckets * ncneg_mtx mtx negative entry LRU management * - * A name -> vnode lookup can be safely performed by either locking cache_lock - * or the relevant hash bucket. + * Additionally ncneg_shrink_lock mtx is used to have at most one thread doing + * LRU list shrinking. * - * ".." and vnode -> name lookups require cache_lock. + * It is legal to take multiple vnodelock and bucketlock locks. The locking + * order is lower address first. Both are recursive. * - * Modifications require both cache_lock and relevant bucketlock taken for - * writing. + * "." lookups are lockless. * - * Negative entry LRU management requires ncneg_mtx taken on top of either - * cache_lock or bucketlock. + * ".." and vnode -> name lookups require vnodelock. + * + * name -> vnode lookup requires relevant bucketlock to be held for reading. + * + * Insertions and removals of entries require involved vnodes and bucketlocks + * to be write-locked to prevent other threads from seeing the entry. + * + * Some lookups result in removal of found entry (e.g. getting rid of negative + * entry with the intent to create a positive one), which poses a problem when + * multiple threads reach the state. Similarly, two different threads can purge + * two different vnodes and try to remove the same name. + * + * Problematic cases are resolved with the help of ncelock placed in the entry. + * + * The general scheme requires users to acquire one lock allowing to find the + * entry (either vnodelock or bucketlock). Then they trylock the ncelock lock + * and on failure drop their locks and retry the lookup. The thread which + * succeeded takes all locks in order, effectively guaranteeing that no other + * thread can access the entry. Threads which retry fail their lookups if the + * entry was removed and no new matching entry was inserted. + * + * Note that ncelock itself does not prevent other threads from seeing the entry. + * Rather, it is only used to safely take all relevant locks in order and that's + * what keeps other threads out. + * As such, as a microoptisation the code can trylock things in reverse order. + * Similarly, if the thread already holds the top lock (lowest vnode address), + * it can just lock things in order without having to resort to ncelock trylock. */ /* @@ -196,16 +222,10 @@ SYSCTL_UINT(_vfs, OID_AUTO, ncsizefactor, CTLFLAG_ struct nchstats nchstats; /* cache effectiveness statistics */ -static struct rwlock cache_lock; -RW_SYSINIT(vfscache, &cache_lock, "ncglobal"); +static struct mtx ncneg_shrink_lock; +MTX_SYSINIT(vfscache_shrink_neg, &ncneg_shrink_lock, "Name Cache shrink neg", + MTX_DEF); -#define CACHE_TRY_WLOCK() rw_try_wlock(&cache_lock) -#define CACHE_UPGRADE_LOCK() rw_try_upgrade(&cache_lock) -#define CACHE_RLOCK() rw_rlock(&cache_lock) -#define CACHE_RUNLOCK() rw_runlock(&cache_lock) -#define CACHE_WLOCK() rw_wlock(&cache_lock) -#define CACHE_WUNLOCK() rw_wunlock(&cache_lock) - static struct mtx_padalign ncneg_mtx; MTX_SYSINIT(vfscache_neg, &ncneg_mtx, "ncneg", MTX_DEF); @@ -214,6 +234,51 @@ static struct rwlock_padalign *bucketlocks; #define HASH2BUCKETLOCK(hash) \ ((struct rwlock *)(&bucketlocks[((hash) % numbucketlocks)])) +static u_int numvnodelocks; +static struct mtx *vnodelocks; +static inline struct mtx * +VP2VNODELOCK(struct vnode *vp) +{ + struct mtx *vlp; + + if (vp == NULL) + return (NULL); + /* XXXMJG find the right method */ + vlp = &vnodelocks[(((uintptr_t)(vp) >> 8) % numvnodelocks)]; + return (vlp); +} + +static u_int numncelocks; +static struct mtx *ncelocks; +static inline struct mtx * +NCP2NCELOCK(struct namecache *ncp) +{ + struct mtx *nclp; + + /* XXXMJG find the right method */ + nclp = &ncelocks[(((uintptr_t)(ncp) >> 8) % numncelocks)]; + return (nclp); +} + +static int random_trylock_do_fail = 0; +SYSCTL_INT(_debug, OID_AUTO, cache_random_trylock_do_fail, CTLFLAG_RW, + &random_trylock_do_fail, 0, "VFS cache random trylock fail"); + +static u_long random_trylock_numfail; +SYSCTL_ULONG(_debug, OID_AUTO, cache_random_trylock_numfail, CTLFLAG_RW, + &random_trylock_numfail, 0, "VFS cache random trylock fail"); + +static int cache_mtx_trylock(struct mtx *lock) +{ + + if (*(volatile int *)&random_trylock_do_fail && (cpu_ticks() % 2)) { + random_trylock_numfail++; + return (0); + } + + return (mtx_trylock(lock)); +} + /* * UMA zones for the VFS cache. * @@ -333,15 +398,43 @@ static long numupgrades; STATNODE_ULONG(numupgrade "Number of updates of the cache after lookup (write lock + retry)"); static long zap_and_exit_bucket_fail; STATNODE_ULONG(zap_and_exit_bucket_fail, "Number of times bucketlocked zap_and_exit case failed to writelock"); +static long cache_lock_vnodes_cel_3_failures; +STATNODE_ULONG(cache_lock_vnodes_cel_3_failures, + "Number of times bucketlocked zap_and_exit case failed to writelock"); -static void cache_zap(struct namecache *ncp); -static int vn_vptocnp_locked(struct vnode **vp, struct ucred *cred, char *buf, - u_int *buflen); +static void cache_zap_locked_ncp(struct namecache *ncp); static int vn_fullpath1(struct thread *td, struct vnode *vp, struct vnode *rdir, char *buf, char **retbuf, u_int buflen); static MALLOC_DEFINE(M_VFSCACHE, "vfscache", "VFS name cache entries"); +static inline void +cache_assert_vlp_locked(struct mtx *vlp) +{ + + if (vlp != NULL) + mtx_assert(vlp, MA_OWNED); +} + +static inline void +cache_assert_ncp_locked(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + mtx_assert(ncelp, MA_OWNED); +} + +static inline void +cache_assert_vnode_locked(struct vnode *vp) +{ + struct mtx *vlp; + + vlp = VP2VNODELOCK(vp); + cache_assert_vlp_locked(vlp); +} + static uint32_t cache_get_hash(char *name, u_char len, struct vnode *dvp) { @@ -352,22 +445,63 @@ cache_get_hash(char *name, u_char len, struct vnod return (hash); } +static inline struct rwlock * +NCP2BUCKETLOCK(struct namecache *ncp) +{ + uint32_t hash; + + hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); + return (HASH2BUCKETLOCK(hash)); +} + +static int +cache_trylock_ncp(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + return (cache_mtx_trylock(ncelp)); +} + +static void +cache_unlock_ncp(struct namecache *ncp) +{ + struct mtx *ncelp; + + ncelp = NCP2NCELOCK(ncp); + + mtx_unlock(ncelp); +} + + #ifdef INVARIANTS static void cache_assert_bucket_locked(struct namecache *ncp, int mode) { - struct rwlock *bucketlock; - uint32_t hash; + struct rwlock *blp; - hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); - bucketlock = HASH2BUCKETLOCK(hash); - rw_assert(bucketlock, mode); + blp = NCP2BUCKETLOCK(ncp); + rw_assert(blp, mode); } #else #define cache_assert_bucket_locked(x, y) do { } while (0) #endif +#define cache_sort(x, y) _cache_sort((void **)(x), (void **)(y)) static void +_cache_sort(void **p1, void **p2) +{ + void *tmp; + + if (*p1 > *p2) { + tmp = *p2; + *p2 = *p1; + *p1 = tmp; + } +} + +static void cache_lock_all_buckets(void) { u_int i; @@ -385,6 +519,24 @@ cache_unlock_all_buckets(void) rw_wunlock(&bucketlocks[i]); } +static void +cache_lock_all_vnodes(void) +{ + u_int i; + + for (i = 0; i < numvnodelocks; i++) + mtx_lock(&vnodelocks[i]); +} + +static void +cache_unlock_all_vnodes(void) +{ + u_int i; + + for (i = 0; i < numvnodelocks; i++) + mtx_unlock(&vnodelocks[i]); +} + static int sysctl_nchstats(SYSCTL_HANDLER_ARGS) { @@ -426,9 +578,9 @@ retry: if (req->oldptr == NULL) return SYSCTL_OUT(req, 0, n_nchash * sizeof(int)); cntbuf = malloc(n_nchash * sizeof(int), M_TEMP, M_ZERO | M_WAITOK); - CACHE_RLOCK(); + cache_lock_all_buckets(); if (n_nchash != nchash + 1) { - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); free(cntbuf, M_TEMP); goto retry; } @@ -436,7 +588,7 @@ retry: for (ncpp = nchashtbl, i = 0; i < n_nchash; ncpp++, i++) LIST_FOREACH(ncp, ncpp, nc_hash) cntbuf[i]++; - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); for (error = 0, i = 0; i < n_nchash; i++) if ((error = SYSCTL_OUT(req, &cntbuf[i], sizeof(int))) != 0) break; @@ -459,7 +611,7 @@ sysctl_debug_hashstat_nchash(SYSCTL_HANDLER_ARGS) if (!req->oldptr) return SYSCTL_OUT(req, 0, 4 * sizeof(int)); - CACHE_RLOCK(); + cache_lock_all_buckets(); n_nchash = nchash + 1; /* nchash is max index, not count */ used = 0; maxlength = 0; @@ -476,7 +628,7 @@ sysctl_debug_hashstat_nchash(SYSCTL_HANDLER_ARGS) maxlength = count; } n_nchash = nchash + 1; - CACHE_RUNLOCK(); + cache_unlock_all_buckets(); pct = (used * 100) / (n_nchash / 100); error = SYSCTL_OUT(req, &n_nchash, sizeof(n_nchash)); if (error) @@ -497,6 +649,14 @@ SYSCTL_PROC(_debug_hashstat, OID_AUTO, nchash, CTL "nchash statistics (number of total/used buckets, maximum chain length, usage percentage)"); #endif +static void +cache_dump_ncp(struct vnode *dvp, struct vnode *vp, struct namecache *ncp, int line) +{ + + panic("dvp %p vp %p ncp %p ncp->vp %p ncp->dvp %p LINE %d\n", + dvp, vp, ncp, ncp->nc_vp, ncp->nc_dvp, line); +} + /* * Negative entries management */ @@ -504,6 +664,7 @@ static void cache_negative_hit(struct namecache *ncp) { + MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); TAILQ_REMOVE(&ncneg, ncp, nc_dst); TAILQ_INSERT_TAIL(&ncneg, ncp, nc_dst); @@ -514,7 +675,6 @@ static void cache_negative_insert(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); cache_assert_bucket_locked(ncp, RA_WLOCKED); MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); @@ -527,7 +687,6 @@ static void cache_negative_remove(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); cache_assert_bucket_locked(ncp, RA_WLOCKED); MPASS(ncp->nc_vp == NULL); mtx_lock(&ncneg_mtx); @@ -536,17 +695,27 @@ cache_negative_remove(struct namecache *ncp) mtx_unlock(&ncneg_mtx); } -static struct namecache * +static void cache_negative_zap_one(void) { struct namecache *ncp; - rw_assert(&cache_lock, RA_WLOCKED); + if (!mtx_trylock(&ncneg_shrink_lock)) + return; + + mtx_lock(&ncneg_mtx); ncp = TAILQ_FIRST(&ncneg); - KASSERT(ncp->nc_vp == NULL, ("ncp %p vp %p on ncneg", - ncp, ncp->nc_vp)); - cache_zap(ncp); - return (ncp); + if (ncp == NULL || !cache_trylock_ncp(ncp)) { + mtx_unlock(&ncneg_mtx); + ncp = NULL; + } else { + mtx_unlock(&ncneg_mtx); + KASSERT(ncp->nc_vp == NULL, ("ncp %p vp %p on ncneg", + ncp, ncp->nc_vp)); + cache_zap_locked_ncp(ncp); + } + mtx_unlock(&ncneg_shrink_lock); + cache_free(ncp); } /* @@ -556,11 +725,15 @@ cache_negative_zap_one(void) * pointer to a vnode or if it is just a negative cache entry. */ static void -cache_zap_locked(struct namecache *ncp) +cache_zap_locked_all(struct namecache *ncp) { - rw_assert(&cache_lock, RA_WLOCKED); + cache_assert_vnode_locked(ncp->nc_vp); + cache_assert_vnode_locked(ncp->nc_dvp); cache_assert_bucket_locked(ncp, RA_WLOCKED); + if (ncp->nc_vp == NULL) + cache_assert_ncp_locked(ncp); + CTR2(KTR_VFS, "cache_zap(%p) vp %p", ncp, ncp->nc_vp); if (ncp->nc_vp != NULL) { SDT_PROBE3(vfs, namecache, zap, done, ncp->nc_dvp, @@ -577,7 +750,7 @@ static void LIST_REMOVE(ncp, nc_src); if (LIST_EMPTY(&ncp->nc_dvp->v_cache_src)) { ncp->nc_flag |= NCF_DVDROP; - numcachehv--; + atomic_subtract_rel_long(&numcachehv, 1); } } if (ncp->nc_vp) { @@ -587,24 +760,197 @@ static void } else { cache_negative_remove(ncp); } - numcache--; + atomic_subtract_rel_long(&numcache, 1); } static void -cache_zap(struct namecache *ncp) +cache_lock_vnodes(struct mtx *vlp1, struct mtx *vlp2) { - struct rwlock *bucketlock; - uint32_t hash; - rw_assert(&cache_lock, RA_WLOCKED); + cache_sort(&vlp1, &vlp2); - hash = cache_get_hash(nc_get_name(ncp), ncp->nc_nlen, ncp->nc_dvp); - bucketlock = HASH2BUCKETLOCK(hash); - rw_wlock(bucketlock); - cache_zap_locked(ncp); - rw_wunlock(bucketlock); + if (vlp1 != NULL) + mtx_lock(vlp1); + mtx_lock(vlp2); } +static int +cache_trylock_vnodes(struct mtx *vlp1, struct mtx *vlp2) +{ + + cache_sort(&vlp1, &vlp2); + MPASS(vlp2 != NULL); + + if (vlp1 != NULL) { + if (!mtx_trylock(vlp1)) + return (EAGAIN); + } + if (!mtx_trylock(vlp2)) { + if (vlp1 != NULL) + mtx_unlock(vlp1); + return (EAGAIN); + } + + return (0); +} + +static void +cache_unlock_vnodes(struct mtx *vlp1, struct mtx *vlp2) +{ + + MPASS(vlp1 != NULL || vlp2 != NULL); + + if (vlp1 != NULL) + mtx_unlock(vlp1); + if (vlp2 != NULL) + mtx_unlock(vlp2); +} + +static void +cache_zap_locked_ncp(struct namecache *ncp) +{ + struct rwlock *blp; + struct mtx *dvlp, *vlp; + + cache_assert_ncp_locked(ncp); + + blp = NCP2BUCKETLOCK(ncp); + dvlp = VP2VNODELOCK(ncp->nc_dvp); + vlp = VP2VNODELOCK(ncp->nc_vp); + + cache_lock_vnodes(dvlp, vlp); + rw_wlock(blp); + + cache_zap_locked_all(ncp); + + rw_wunlock(blp); + cache_unlock_vnodes(dvlp, vlp); + cache_unlock_ncp(ncp); +} + +static int +cache_zap_locked_vnode(struct namecache *ncp, struct vnode *vp) +{ + struct mtx *vlp; + + MPASS(vp == ncp->nc_dvp || vp == ncp->nc_vp); + cache_assert_vnode_locked(vp); + vlp = VP2VNODELOCK(vp); + + if (!cache_trylock_ncp(ncp)) { + mtx_unlock(vlp); + return (EAGAIN); + } + + mtx_unlock(vlp); + cache_zap_locked_ncp(ncp); + return (0); +} + +static int +cache_zap_locked_vnode_kl(struct namecache *ncp, struct vnode *vp) +{ + struct mtx *pvlp, *vlp1, *vlp2, *to_unlock; + struct rwlock *blp; + + MPASS(vp == ncp->nc_dvp || vp == ncp->nc_vp); + cache_assert_vnode_locked(vp); + + pvlp = VP2VNODELOCK(vp); + blp = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp == NULL) { + if (!cache_trylock_ncp(ncp)) + goto out_unlock_pvlp; + rw_wlock(blp); + cache_zap_locked_all(ncp); + rw_wunlock(blp); + cache_unlock_ncp(ncp); + return (0); + } + + vlp1 = VP2VNODELOCK(ncp->nc_dvp); + vlp2 = VP2VNODELOCK(ncp->nc_vp); + cache_sort(&vlp1, &vlp2); + if (vlp1 == pvlp) { + mtx_lock(vlp2); + to_unlock = vlp2; + } else { + if (!cache_mtx_trylock(vlp1)) + goto out_unlock_pvlp; + to_unlock = vlp1; + } + rw_wlock(blp); + cache_zap_locked_all(ncp); + rw_wunlock(blp); + mtx_unlock(to_unlock); + return (0); + +out_unlock_pvlp: + mtx_unlock(pvlp); + return (EAGAIN); +} + +static int +cache_zap_rlocked_bucket(struct namecache *ncp, struct rwlock *blp) +{ + + cache_assert_bucket_locked(ncp, RA_RLOCKED); + + if (!cache_trylock_ncp(ncp)) { + rw_runlock(blp); + return (EAGAIN); + } + + rw_runlock(blp); + cache_zap_locked_ncp(ncp); + return (0); +} + +static int +cache_zap_wlocked_bucket_kl(struct namecache *ncp, struct rwlock *blp) +{ + struct mtx *dvlp, *vlp; + + cache_assert_bucket_locked(ncp, RA_WLOCKED); + + dvlp = VP2VNODELOCK(ncp->nc_dvp); + if (ncp->nc_vp == NULL) { + if (!cache_trylock_ncp(ncp)) + goto out_unlock_bucket; + if (!cache_mtx_trylock(dvlp)) { + cache_unlock_ncp(ncp); + goto out_unlock_bucket; + } + cache_zap_locked_all(ncp); + mtx_unlock(dvlp); + cache_unlock_ncp(ncp); + return (0); + } + + vlp = VP2VNODELOCK(ncp->nc_vp); + if (cache_trylock_vnodes(dvlp, vlp) == 0) { + cache_zap_locked_all(ncp); + cache_unlock_vnodes(dvlp, vlp); + return (0); + } + +out_unlock_bucket: + rw_wunlock(blp); + return (EAGAIN); +} + +static void +cache_lookup_unlock(struct rwlock *blp, struct mtx *vlp) +{ + + if (blp != NULL) { + rw_runlock(blp); + mtx_assert(vlp, MA_NOTOWNED); + } else { + mtx_unlock(vlp); + } +} + /* * Lookup an entry in the cache * @@ -622,32 +968,15 @@ static void * not recursively acquired. */ -enum { UNLOCKED, WLOCKED, RLOCKED }; - -static void -cache_unlock(int cache_locked) -{ - - switch (cache_locked) { - case UNLOCKED: - break; - case WLOCKED: - CACHE_WUNLOCK(); - break; - case RLOCKED: - CACHE_RUNLOCK(); - break; - } -} - int cache_lookup(struct vnode *dvp, struct vnode **vpp, struct componentname *cnp, struct timespec *tsp, int *ticksp) { - struct rwlock *bucketlock; struct namecache *ncp; + struct rwlock *blp; + struct mtx *dvlp; uint32_t hash; - int error, ltype, cache_locked; + int error, ltype; if (!doingcache) { cnp->cn_flags &= ~MAKEENTRY; @@ -654,12 +983,11 @@ cache_lookup(struct vnode *dvp, struct vnode **vpp return (0); } retry: - bucketlock = NULL; - cache_locked = UNLOCKED; + blp = NULL; + dvlp = VP2VNODELOCK(dvp); error = 0; counter_u64_add(numcalls, 1); -retry_wlocked: if (cnp->cn_nameptr[0] == '.') { if (cnp->cn_namelen == 1) { *vpp = dvp; @@ -693,32 +1021,32 @@ retry: } if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { counter_u64_add(dotdothits, 1); - if (cache_locked == UNLOCKED) { - CACHE_RLOCK(); - cache_locked = RLOCKED; - } - - if (dvp->v_cache_dd == NULL) { +retry_dotdot: + mtx_lock(dvlp); + ncp = dvp->v_cache_dd; + if (ncp == NULL) { SDT_PROBE3(vfs, namecache, lookup, miss, dvp, "..", NULL); - goto unlock; + mtx_unlock(dvlp); + return (0); } if ((cnp->cn_flags & MAKEENTRY) == 0) { - if (cache_locked != WLOCKED && - !CACHE_UPGRADE_LOCK()) - goto wlock; - ncp = NULL; - if (dvp->v_cache_dd->nc_flag & NCF_ISDOTDOT) { - ncp = dvp->v_cache_dd; - cache_zap(ncp); + if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) { + if (ncp->nc_dvp != dvp) + panic("dvp %p v_cache_dd %p\n", dvp, ncp); + if (cache_zap_locked_vnode(ncp, dvp) != 0) + goto retry_dotdot; + /* XXXMJG ensure this is really null here. + * note the lock is dropped in the meantime. + */ + cache_free(ncp); + } else { + dvp->v_cache_dd = NULL; + mtx_unlock(dvlp); } - dvp->v_cache_dd = NULL; - CACHE_WUNLOCK(); - cache_free(ncp); return (0); } - ncp = dvp->v_cache_dd; - if (ncp->nc_flag & NCF_ISDOTDOT) + if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) *vpp = ncp->nc_vp; else *vpp = ncp->nc_dvp; @@ -739,10 +1067,8 @@ retry: } hash = cache_get_hash(cnp->cn_nameptr, cnp->cn_namelen, dvp); - if (cache_locked == UNLOCKED) { - bucketlock = HASH2BUCKETLOCK(hash); - rw_rlock(bucketlock); - } + blp = HASH2BUCKETLOCK(hash); + rw_rlock(blp); LIST_FOREACH(ncp, (NCHHASH(hash)), nc_hash) { counter_u64_add(numchecks, 1); @@ -795,24 +1121,9 @@ negative_success: SDT_PROBE2(vfs, namecache, lookup, hit__negative, dvp, nc_get_name(ncp)); cache_out_ts(ncp, tsp, ticksp); - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); return (ENOENT); -wlock: - /* - * We need to update the cache after our lookup, so upgrade to - * a write lock and retry the operation. - */ - CACHE_RUNLOCK(); -wlock_unlocked: - CACHE_WLOCK(); - numupgrades++; - cache_locked = WLOCKED; - goto retry_wlocked; - success: /* * On success we return a locked and ref'd vnode as per the lookup @@ -825,10 +1136,7 @@ success: VOP_UNLOCK(dvp, 0); } vhold(*vpp); - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); error = vget(*vpp, cnp->cn_lkflags | LK_VNHELD, cnp->cn_thread); if (cnp->cn_flags & ISDOTDOT) { vn_lock(dvp, ltype | LK_RETRY); @@ -850,33 +1158,227 @@ success: return (-1); unlock: - MPASS(bucketlock != NULL || cache_locked != UNLOCKED); - if (bucketlock != NULL) - rw_runlock(bucketlock); - cache_unlock(cache_locked); + cache_lookup_unlock(blp, dvlp); return (0); zap_and_exit: - if (bucketlock != NULL) { - rw_assert(&cache_lock, RA_UNLOCKED); - if (!CACHE_TRY_WLOCK()) { - rw_runlock(bucketlock); - bucketlock = NULL; - zap_and_exit_bucket_fail++; - goto wlock_unlocked; - } - cache_locked = WLOCKED; - rw_runlock(bucketlock); - bucketlock = NULL; - } else if (cache_locked != WLOCKED && !CACHE_UPGRADE_LOCK()) - goto wlock; - cache_zap(ncp); - CACHE_WUNLOCK(); + if (blp != NULL) + error = cache_zap_rlocked_bucket(ncp, blp); + else + error = cache_zap_locked_vnode(ncp, dvp); + if (error != 0) { + zap_and_exit_bucket_fail++; + goto retry; + } cache_free(ncp); return (0); } +struct celockstate { + struct mtx *vlp[3]; + struct rwlock *blp[2]; + struct namecache *ncp; +}; +CTASSERT((nitems(((struct celockstate *)0)->vlp) == 3)); +CTASSERT((nitems(((struct celockstate *)0)->blp) == 2)); + +static inline void +cache_celockstate_init(struct celockstate *cel) +{ + + bzero(cel, sizeof(*cel)); +} + +static void +cache_lock_vnodes_cel(struct celockstate *cel, struct vnode *vp, + struct vnode *dvp) +{ + struct mtx *vlp1, *vlp2; + + MPASS(cel->vlp[0] == NULL); + MPASS(cel->vlp[1] == NULL); + MPASS(cel->vlp[2] == NULL); + + MPASS(vp != NULL || dvp != NULL); + + vlp1 = VP2VNODELOCK(vp); + vlp2 = VP2VNODELOCK(dvp); + cache_sort(&vlp1, &vlp2); + + if (vlp1 != NULL) { + mtx_lock(vlp1); + cel->vlp[0] = vlp1; + } + mtx_lock(vlp2); + cel->vlp[1] = vlp2; +} + +static void +cache_unlock_vnodes_cel(struct celockstate *cel) +{ + + MPASS(cel->vlp[0] != NULL || cel->vlp[1] != NULL); + + if (cel->vlp[0] != NULL) + mtx_unlock(cel->vlp[0]); + if (cel->vlp[1] != NULL) + mtx_unlock(cel->vlp[1]); + if (cel->vlp[2] != NULL) + mtx_unlock(cel->vlp[2]); +} + +static int +cache_lock_vnodes_cel_3(struct celockstate *cel, struct vnode *vp) +{ + struct mtx *vlp; + int error; + + cache_assert_vlp_locked(cel->vlp[0]); + cache_assert_vlp_locked(cel->vlp[1]); + MPASS(cel->vlp[2] == NULL); + + MPASS(vp != NULL); + + vlp = VP2VNODELOCK(vp); + + error = 0; + if (vlp > cel->vlp[1]) { + mtx_lock(vlp); + } else { + if (!cache_mtx_trylock(vlp)) { + cache_lock_vnodes_cel_3_failures++; + error = EAGAIN; + goto out; + } + } + cel->vlp[2] = vlp; +out: + return (error); +} + +static void +cache_lock_buckets_cel(struct celockstate *cel, struct rwlock *blp1, + struct rwlock *blp2) +{ + + MPASS(cel->blp[0] == NULL); + MPASS(cel->blp[1] == NULL); + + cache_sort(&blp1, &blp2); + + if (blp1 != NULL) { + rw_wlock(blp1); + cel->blp[0] = blp1; + } + rw_wlock(blp2); + cel->blp[1] = blp2; +} + +static void +cache_unlock_buckets_cel(struct celockstate *cel) +{ + + if (cel->blp[0] != NULL) + rw_wunlock(cel->blp[0]); + rw_wunlock(cel->blp[1]); +} + /* + * Lock part of the cache affected by the insertion. + * + * This means vnodelocks for dvp, vp and the relevant bucketlock. + * However, insertion can result in removal of an old entry. In this + * case we have an additional vnode and bucketlock pair to lock. If the + * entry is negative, ncelock is locked instead of the vnode. + * + * That is, in the worst case we have to lock 3 vnodes and 2 bucketlocks, while + * preserving the locking order (smaller address first). + */ +static void +cache_enter_lock(struct celockstate *cel, struct vnode *dvp, struct vnode *vp, + uint32_t hash) +{ + struct namecache *ncp; + struct rwlock *blps[2]; + + blps[0] = HASH2BUCKETLOCK(hash); + for (;;) { + blps[1] = NULL; + cache_lock_vnodes_cel(cel, dvp, vp); + if (vp == NULL || vp->v_type != VDIR) + break; + ncp = vp->v_cache_dd; + if (ncp == NULL) + break; + if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) + break; + if (ncp->nc_dvp != vp && ncp->nc_vp != vp) + cache_dump_ncp(dvp, vp, ncp, __LINE__); + blps[1] = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp != NULL) { + if (cache_lock_vnodes_cel_3(cel, ncp->nc_vp) == 0) + break; + } else { + if (cache_trylock_ncp(ncp)) { + cel->ncp = ncp; + break; + } + } + cache_unlock_vnodes_cel(cel); + cel->vlp[0] = NULL; + cel->vlp[1] = NULL; + printf("%s: restarting for dvp %p vp %p ncp %p\n", __func__, dvp, vp, ncp); + } + cache_lock_buckets_cel(cel, blps[0], blps[1]); +} + +static void +cache_enter_lock_dd(struct celockstate *cel, struct vnode *dvp, struct vnode *vp, + uint32_t hash) +{ + struct namecache *ncp; + struct rwlock *blps[2]; + + blps[0] = HASH2BUCKETLOCK(hash); + for (;;) { + blps[1] = NULL; + cache_lock_vnodes_cel(cel, dvp, vp); + ncp = dvp->v_cache_dd; + if (ncp == NULL) + break; + if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) + break; + if (ncp->nc_dvp != dvp && ncp->nc_vp != dvp) + cache_dump_ncp(dvp, vp, ncp, __LINE__); + blps[1] = NCP2BUCKETLOCK(ncp); + if (ncp->nc_vp != NULL) { + if (cache_lock_vnodes_cel_3(cel, ncp->nc_vp) == 0) + break; + } else { + if (cache_trylock_ncp(ncp)) { + cel->ncp = ncp; + break; + } + } + cache_unlock_vnodes_cel(cel); + cel->vlp[0] = NULL; + cel->vlp[1] = NULL; + printf("%s: restarting for dvp %p vp %p ncp %p\n", __func__, dvp, vp, ncp); + } + cache_lock_buckets_cel(cel, blps[0], blps[1]); +} + +static void +cache_enter_unlock(struct celockstate *cel) +{ + + cache_unlock_buckets_cel(cel); + cache_unlock_vnodes_cel(cel); + if (cel->ncp != NULL) + cache_unlock_ncp(cel->ncp); +} + +/* * Add an entry to the cache. */ void @@ -883,8 +1385,8 @@ void cache_enter_time(struct vnode *dvp, struct vnode *vp, struct componentname *cnp, struct timespec *tsp, struct timespec *dtsp) { - struct rwlock *bucketlock; - struct namecache *ncp, *n2, *ndd, *nneg; + struct celockstate cel; + struct namecache *ncp, *n2, *ndd; struct namecache_ts *n3; struct nchashhead *ncpp; uint32_t hash; @@ -906,13 +1408,16 @@ cache_enter_time(struct vnode *dvp, struct vnode * if (numcache >= desiredvnodes * ncsizefactor) return; - ndd = nneg = NULL; + cache_celockstate_init(&cel); + ndd = NULL; flag = 0; if (cnp->cn_nameptr[0] == '.') { if (cnp->cn_namelen == 1) return; if (cnp->cn_namelen == 2 && cnp->cn_nameptr[1] == '.') { - CACHE_WLOCK(); + len = cnp->cn_namelen; + hash = cache_get_hash(cnp->cn_nameptr, len, dvp); + cache_enter_lock_dd(&cel, dvp, vp, hash); /* * If dotdot entry already exists, just retarget it * to new parent vnode, otherwise continue with new @@ -935,12 +1440,13 @@ cache_enter_time(struct vnode *dvp, struct vnode * cache_negative_insert(ncp); } ncp->nc_vp = vp; - CACHE_WUNLOCK(); + cache_enter_unlock(&cel); return; } dvp->v_cache_dd = NULL; + cache_enter_unlock(&cel); + cache_celockstate_init(&cel); SDT_PROBE3(vfs, namecache, enter, done, dvp, "..", vp); - CACHE_WUNLOCK(); flag = NCF_ISDOTDOT; } } @@ -966,7 +1472,7 @@ cache_enter_time(struct vnode *dvp, struct vnode * len = ncp->nc_nlen = cnp->cn_namelen; hash = cache_get_hash(cnp->cn_nameptr, len, dvp); strlcpy(nc_get_name(ncp), cnp->cn_nameptr, len + 1); - CACHE_WLOCK(); + cache_enter_lock(&cel, dvp, vp, hash); /* * See if this vnode or negative entry is already in the cache @@ -993,9 +1499,7 @@ cache_enter_time(struct vnode *dvp, struct vnode * n3->nc_flag |= NCF_DTS; } } - CACHE_WUNLOCK(); - cache_free(ncp); - return; + goto out_unlock_free; } } @@ -1004,17 +1508,14 @@ cache_enter_time(struct vnode *dvp, struct vnode * * See if we are trying to add .. entry, but some other lookup * has populated v_cache_dd pointer already. */ - if (dvp->v_cache_dd != NULL) { - CACHE_WUNLOCK(); - cache_free(ncp); - return; - } + if (dvp->v_cache_dd != NULL) + goto out_unlock_free; KASSERT(vp == NULL || vp->v_type == VDIR, ("wrong vnode type %p", vp)); dvp->v_cache_dd = ncp; } - numcache++; + atomic_add_rel_long(&numcache, 1); if (vp != NULL) { if (vp->v_type == VDIR) { if (flag != NCF_ISDOTDOT) { @@ -1024,9 +1525,9 @@ cache_enter_time(struct vnode *dvp, struct vnode * * directory's parent. */ if ((ndd = vp->v_cache_dd) != NULL) { - if ((ndd->nc_flag & NCF_ISDOTDOT) != 0) - cache_zap(ndd); - else + if ((ndd->nc_flag & NCF_ISDOTDOT) != 0) { + cache_zap_locked_all(ndd); + } else ndd = NULL; } vp->v_cache_dd = ncp; @@ -1039,14 +1540,11 @@ cache_enter_time(struct vnode *dvp, struct vnode * if (flag != NCF_ISDOTDOT) { if (LIST_EMPTY(&dvp->v_cache_src)) { vhold(dvp); - numcachehv++; + atomic_add_rel_long(&numcachehv, 1); } LIST_INSERT_HEAD(&dvp->v_cache_src, ncp, nc_src); } - bucketlock = HASH2BUCKETLOCK(hash); - rw_wlock(bucketlock); - /* * Insert the new namecache entry into the appropriate chain * within the cache entries table. @@ -1069,12 +1567,15 @@ cache_enter_time(struct vnode *dvp, struct vnode * SDT_PROBE2(vfs, namecache, enter_negative, done, dvp, nc_get_name(ncp)); } - rw_wunlock(bucketlock); + cache_enter_unlock(&cel); if (numneg * ncnegfactor > numcache) - nneg = cache_negative_zap_one(); - CACHE_WUNLOCK(); + cache_negative_zap_one(); cache_free(ndd); - cache_free(nneg); + return; +out_unlock_free: + cache_enter_unlock(&cel); + cache_free(ncp); + return; } static u_int @@ -1112,13 +1613,21 @@ nchinit(void *dummy __unused) NULL, NULL, NULL, NULL, UMA_ALIGN_PTR, UMA_ZONE_ZINIT); nchashtbl = hashinit(desiredvnodes * 2, M_VFSCACHE, &nchash); - numbucketlocks = cache_roundup_2(mp_ncpus * 16); - if (numbucketlocks > nchash) - numbucketlocks = nchash; + numbucketlocks = cache_roundup_2(mp_ncpus * 64); bucketlocks = malloc(sizeof(*bucketlocks) * numbucketlocks, M_VFSCACHE, M_WAITOK | M_ZERO); for (i = 0; i < numbucketlocks; i++) - rw_init_flags(&bucketlocks[i], "ncbuc", RW_DUPOK); + rw_init_flags(&bucketlocks[i], "ncbuc", RW_DUPOK | RW_RECURSE); + numvnodelocks = cache_roundup_2(mp_ncpus * 64); + vnodelocks = malloc(sizeof(*vnodelocks) * numvnodelocks, M_VFSCACHE, + M_WAITOK | M_ZERO); + for (i = 0; i < numvnodelocks; i++) + mtx_init(&vnodelocks[i], "ncvn", NULL, MTX_DUPOK | MTX_RECURSE); + numncelocks = cache_roundup_2(mp_ncpus * 64); + ncelocks = malloc(sizeof(*ncelocks) * numncelocks, M_VFSCACHE, + M_WAITOK | M_ZERO); + for (i = 0; i < numncelocks; i++) + mtx_init(&ncelocks[i], "ncen", NULL, MTX_DEF); numcalls = counter_u64_alloc(M_WAITOK); dothits = counter_u64_alloc(M_WAITOK); @@ -1158,7 +1667,7 @@ cache_changesize(int newmaxvnodes) * None of the namecache entries in the table can be removed * because to do so, they have to be removed from the hash table. */ - CACHE_WLOCK(); + cache_lock_all_vnodes(); cache_lock_all_buckets(); old_nchashtbl = nchashtbl; old_nchash = nchash; @@ -1173,7 +1682,7 @@ cache_changesize(int newmaxvnodes) } } cache_unlock_all_buckets(); - CACHE_WUNLOCK(); + cache_unlock_all_vnodes(); free(old_nchashtbl, M_VFSCACHE); } @@ -1185,30 +1694,40 @@ cache_purge(struct vnode *vp) { TAILQ_HEAD(, namecache) ncps; struct namecache *ncp, *nnp; + struct mtx *vlp; CTR1(KTR_VFS, "cache_purge(%p)", vp); SDT_PROBE1(vfs, namecache, purge, done, vp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); + if (LIST_EMPTY(&vp->v_cache_src) && TAILQ_EMPTY(&vp->v_cache_dst) && + vp->v_cache_dd == NULL) + return; + vlp = VP2VNODELOCK(vp); +retry: + mtx_lock(vlp); while (!LIST_EMPTY(&vp->v_cache_src)) { ncp = LIST_FIRST(&vp->v_cache_src); - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } while (!TAILQ_EMPTY(&vp->v_cache_dst)) { ncp = TAILQ_FIRST(&vp->v_cache_dst); - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } - if (vp->v_cache_dd != NULL) { - ncp = vp->v_cache_dd; - KASSERT(ncp->nc_flag & NCF_ISDOTDOT, - ("lost dotdot link")); - cache_zap(ncp); - TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); - } + ncp = vp->v_cache_dd; + if (ncp == NULL) + goto out; + KASSERT(ncp->nc_flag & NCF_ISDOTDOT, + ("lost dotdot link")); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; + TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); +out: KASSERT(vp->v_cache_dd == NULL, ("incomplete purge")); - CACHE_WUNLOCK(); + mtx_unlock(vlp); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1222,18 +1741,22 @@ cache_purge_negative(struct vnode *vp) { TAILQ_HEAD(, namecache) ncps; struct namecache *ncp, *nnp; + struct mtx *vlp; CTR1(KTR_VFS, "cache_purge_negative(%p)", vp); SDT_PROBE1(vfs, namecache, purge_negative, done, vp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); + vlp = VP2VNODELOCK(vp); +retry: + mtx_lock(vlp); LIST_FOREACH_SAFE(ncp, &vp->v_cache_src, nc_src, nnp) { if (ncp->nc_vp != NULL) continue; - cache_zap(ncp); + if (cache_zap_locked_vnode_kl(ncp, vp) != 0) + goto retry; TAILQ_INSERT_TAIL(&ncps, ncp, nc_dst); } - CACHE_WUNLOCK(); + mtx_unlock(vlp); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1245,33 +1768,41 @@ cache_purge_negative(struct vnode *vp) void cache_purgevfs(struct mount *mp) { + /* + * XXXMJG implement batching of free vnode list insertions + */ TAILQ_HEAD(, namecache) ncps; - struct rwlock *bucketlock; + struct rwlock *blp; struct nchashhead *bucket; struct namecache *ncp, *nnp; u_long i, j, n_nchash; + int error; /* Scan hash tables for applicable entries */ SDT_PROBE1(vfs, namecache, purgevfs, done, mp); TAILQ_INIT(&ncps); - CACHE_WLOCK(); n_nchash = nchash + 1; for (i = 0; i < numbucketlocks; i++) { - bucketlock = (struct rwlock *)&bucketlocks[i]; - rw_wlock(bucketlock); + blp = (struct rwlock *)&bucketlocks[i]; + rw_wlock(blp); for (j = i; j < n_nchash; j += numbucketlocks) { +retry: bucket = &nchashtbl[j]; LIST_FOREACH_SAFE(ncp, bucket, nc_hash, nnp) { cache_assert_bucket_locked(ncp, RA_WLOCKED); if (ncp->nc_dvp->v_mount != mp) continue; - cache_zap_locked(ncp); + error = cache_zap_wlocked_bucket_kl(ncp, blp); + if (error != 0) { + printf("%s: error on ncp %p\n", __func__, ncp); + rw_wlock(blp); + goto retry; + } TAILQ_INSERT_HEAD(&ncps, ncp, nc_dst); } } - rw_wunlock(bucketlock); + rw_wunlock(blp); } - CACHE_WUNLOCK(); TAILQ_FOREACH_SAFE(ncp, &ncps, nc_dst, nnp) { cache_free(ncp); } @@ -1443,23 +1974,13 @@ vn_fullpath_global(struct thread *td, struct vnode int vn_vptocnp(struct vnode **vp, struct ucred *cred, char *buf, u_int *buflen) { - int error; - - CACHE_RLOCK(); - error = vn_vptocnp_locked(vp, cred, buf, buflen); - if (error == 0) - CACHE_RUNLOCK(); - return (error); -} - -static int -vn_vptocnp_locked(struct vnode **vp, struct ucred *cred, char *buf, - u_int *buflen) -{ struct vnode *dvp; struct namecache *ncp; + struct mtx *vlp; int error; + vlp = VP2VNODELOCK(*vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &((*vp)->v_cache_dst), nc_dst) { if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) break; @@ -1466,7 +1987,7 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, } if (ncp != NULL) { if (*buflen < ncp->nc_nlen) { - CACHE_RUNLOCK(); + mtx_unlock(vlp); vrele(*vp); counter_u64_add(numfullpathfail4, 1); error = ENOMEM; @@ -1481,14 +2002,13 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, dvp = *vp; *vp = ncp->nc_dvp; vref(*vp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); vrele(dvp); - CACHE_RLOCK(); return (0); } SDT_PROBE1(vfs, namecache, fullpath, miss, vp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); vn_lock(*vp, LK_SHARED | LK_RETRY); error = VOP_VPTOCNP(*vp, &dvp, cred, buf, buflen); vput(*vp); @@ -1499,10 +2019,8 @@ vn_vptocnp(struct vnode **vp, struct ucred *cred, } *vp = dvp; - CACHE_RLOCK(); if (dvp->v_iflag & VI_DOOMED) { /* forced unmount */ - CACHE_RUNLOCK(); vrele(dvp); error = ENOENT; SDT_PROBE3(vfs, namecache, fullpath, return, error, vp, NULL); @@ -1536,13 +2054,11 @@ vn_fullpath1(struct thread *td, struct vnode *vp, SDT_PROBE1(vfs, namecache, fullpath, entry, vp); counter_u64_add(numfullpathcalls, 1); vref(vp); - CACHE_RLOCK(); if (vp->v_type != VDIR) { - error = vn_vptocnp_locked(&vp, td->td_ucred, buf, &buflen); + error = vn_vptocnp(&vp, td->td_ucred, buf, &buflen); if (error) return (error); if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); return (ENOMEM); } @@ -1552,7 +2068,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, while (vp != rdir && vp != rootvnode) { if (vp->v_vflag & VV_ROOT) { if (vp->v_iflag & VI_DOOMED) { /* forced unmount */ - CACHE_RUNLOCK(); vrele(vp); error = ENOENT; SDT_PROBE3(vfs, namecache, fullpath, return, @@ -1561,14 +2076,11 @@ vn_fullpath1(struct thread *td, struct vnode *vp, } vp1 = vp->v_mount->mnt_vnodecovered; vref(vp1); - CACHE_RUNLOCK(); vrele(vp); vp = vp1; - CACHE_RLOCK(); continue; } if (vp->v_type != VDIR) { - CACHE_RUNLOCK(); vrele(vp); counter_u64_add(numfullpathfail1, 1); error = ENOTDIR; @@ -1576,11 +2088,10 @@ vn_fullpath1(struct thread *td, struct vnode *vp, error, vp, NULL); break; } - error = vn_vptocnp_locked(&vp, td->td_ucred, buf, &buflen); + error = vn_vptocnp(&vp, td->td_ucred, buf, &buflen); if (error) break; if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); error = ENOMEM; SDT_PROBE3(vfs, namecache, fullpath, return, error, @@ -1594,7 +2105,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, return (error); if (!slash_prefixed) { if (buflen == 0) { - CACHE_RUNLOCK(); vrele(vp); counter_u64_add(numfullpathfail4, 1); SDT_PROBE3(vfs, namecache, fullpath, return, ENOMEM, @@ -1604,7 +2114,6 @@ vn_fullpath1(struct thread *td, struct vnode *vp, buf[--buflen] = '/'; } counter_u64_add(numfullpathfound, 1); - CACHE_RUNLOCK(); vrele(vp); SDT_PROBE3(vfs, namecache, fullpath, return, 0, startvp, buf + buflen); @@ -1617,20 +2126,22 @@ vn_dir_dd_ino(struct vnode *vp) { struct namecache *ncp; struct vnode *ddvp; + struct mtx *vlp; ASSERT_VOP_LOCKED(vp, "vn_dir_dd_ino"); - CACHE_RLOCK(); + vlp = VP2VNODELOCK(vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &(vp->v_cache_dst), nc_dst) { if ((ncp->nc_flag & NCF_ISDOTDOT) != 0) continue; ddvp = ncp->nc_dvp; vhold(ddvp); - CACHE_RUNLOCK(); + mtx_unlock(vlp); if (vget(ddvp, LK_SHARED | LK_NOWAIT | LK_VNHELD, curthread)) return (NULL); return (ddvp); } - CACHE_RUNLOCK(); + mtx_unlock(vlp); return (NULL); } @@ -1638,19 +2149,21 @@ int vn_commname(struct vnode *vp, char *buf, u_int buflen) { struct namecache *ncp; + struct mtx *vlp; int l; - CACHE_RLOCK(); + vlp = VP2VNODELOCK(vp); + mtx_lock(vlp); TAILQ_FOREACH(ncp, &vp->v_cache_dst, nc_dst) if ((ncp->nc_flag & NCF_ISDOTDOT) == 0) break; if (ncp == NULL) { - CACHE_RUNLOCK(); + mtx_unlock(vlp); return (ENOENT); } l = min(ncp->nc_nlen, buflen - 1); memcpy(buf, nc_get_name(ncp), l); - CACHE_RUNLOCK(); + mtx_unlock(vlp); buf[l] = '\0'; return (0); } -- Test scenario: misc/marcus.sh