GENERIC HEAD from 2018-04-16 18:12:15 UTC, r332641M, vmcore.869 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-CURRENT #0 r332641M: Tue Apr 17 19:55:46 CEST 2018 pho@t1.osted.lan:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Entering uma_startup with 10 boot pages configured startup_alloc from "UMA Kegs", 8 boot pages left startup_alloc from "UMA Zones", 7 boot pages left startup_alloc from "UMA Zones", 6 boot pages left startup_alloc from "UMA Zones", 5 boot pages left startup_alloc from "UMA Zones", 4 boot pages left startup_alloc from "UMA Zones", 3 boot pages left startup_alloc from "UMA Hash", 2 boot pages left startup_alloc from "UMA Zones", 1 boot pages left Entering uma_startup1 with 0 boot pages left Entering uma_startup2 with 0 boot pages left VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1995.24-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0xbfebfbff Features2=0x1fbee3ff AMD Features=0x2c100800 AMD Features2=0x1 XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 68719476736 (65536 MB) avail memory = 66742296576 (63650 MB) : Trying to mount root from ufs:/dev/gpt/root [rw]... WARNING: DIAGNOSTIC option enabled, expect reduced performance. Expensive timeout(9) function: 0xffffffff809be3d0(0xffffffff81b06080) 0.010649191 s uhub2: 4 ports with 4 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub0: 2 ports with 2 removable, self powered Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/gpt/root: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/root: clean, 50398782 free (1577862 frags, 6102615 blocks, 1.6% fragmentation) /dev/gpt/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/gpt/tmp: clean, 23700033 free (5777 frags, 2961782 blocks, 0.0% fragmentation) Mounting local filesystems:. ugen0.2: at usbus0 uhub3 on uhub1 uhub3: on usbus0 ugen2.2: at usbus2 uhub4 on uhub0 uhub4: on usbus2 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/gcc5 /usr/local/lib/gcc6 /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE /usr/local/lib/qt4 /usr/local/llvm37/lib 32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat Setting hostname: t1.osted.lan. Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy: . uhub3: 6 ports with 6 removable, self powered uhub4: 8 ports with 8 removable, self powered ugen2.3: at usbus2 uhub5 on uhub4 uhub5: on usbus2 uhub5: MTT enabled uhub5: 4 ports with 4 removable, self powered ugen2.4: at usbus2 ukbd0 on uhub4 ukbd0: on usbus2 kbd2 at ukbd0 Starting Network: lo0 igb0 igb1. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo igb0: flags=8843 metric 0 mtu 1500 options=e525bb ether 00:1e:67:56:c1:68 inet 192.168.1.108 netmask 0xffffff00 broadcast 192.168.1.255 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active igb1: flags=8802 metric 0 mtu 1500 options=e525bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Starting devd. Autoloading module: ioat.ko ioat0: mem 0xd7fa0000-0xd7fa3fff irq 31 at device 4.0 on pci0 ioat0: Capabilities: 2f7 ioat1: mem 0xd7f90000-0xd7f93fff irq 39 at device 4.1 on pci0 ioat1: Capabilities: 2f7 ioat2: mem 0xd7f80000-0xd7f83fff irq 31 at device 4.2 on pci0 ioat2: Capabilities: f7 ioat3: mem 0xd7f70000-0xd7f73fff irq 39 at device 4.3 on pci0 ioat3: Capabilities: f7 ioat4: mem 0xd7f60000-0xd7f63fff irq 31 at device 4.4 on pci0 ioat4: Capabilities: f7 ioat5: mem 0xd7f50000-0xd7f53fff irq 39 at device 4.5 on pci0 ioat5: Capabilities: f7 ioat6: mem 0xd7f40000-0xd7f43fff irq 31 at device 4.6 on pci0 ioat6: Capabilities: f7 ioat7: mem 0xd7f30000-0xd7f33fff irq 39 at device 4.7 on pci0 ioat7: Capabilities: f7 ioat8: mem 0xfbf70000-0xfbf73fff irq 55 at device 4.0 on pci11 ioat8: Capabilities: 2f7 ioat9: mem 0xfbf60000-0xfbf63fff irq 63 at device 4.1 on pci11 ioat9: Capabilities: 2f7 ioat10: mem 0xfbf50000-0xfbf53fff irq 55 at device 4.2 on pci11 ioat10: Capabilities: f7 ioat11: mem 0xfbf40000-0xfbf43fff irq 63 at device 4.3 on pci11 ioat11: Capabilities: f7 ioat12: mem 0xfbf30000-0xfbf33fff irq 55 at device 4.4 on pci11 ioat12: Capabilities: f7 ioat13: mem 0xfbf20000-0xfbf23fff irq 63 at device 4.5 on pci11 ioat13: Capabilities: f7 ioat14: mem 0xfbf10000-0xfbf13fff irq 55 at device 4.6 on pci11 ioat14: Capabilities: f7 ioat15: mem 0xfbf00000-0xfbf03fff irq 63 at device 4.7 on pci11 ioat15: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8802 metric 0 mtu 1500 options=e525bb ether 00:1e:67:56:c1:69 nd6 options=29 media: Ethernet autoselect status: no carrier Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Configuring vt: keymap. Autoloading module: ums.ko Autoloading module: uhid.ko ums0 on uhub4 ums0: on usbus2 ums0: 3 buttons and [Z] coordinates ID=0 Starting ums0 moused. add host 127.0.0.1: gateway lo0 fib 0: route already in table add net default: gateway 192.168.1.1 add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Starting watchdogd. No core dumps found. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xfffffe0000f1bfd0 bufwait (bufwait) @ kern/vfs_bio.c:3893 2nd 0xfffff8007d447c00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:289 stack backtrace: #0 0xffffffff80ba8211 at witness_debugger+0xf1 #1 0xffffffff80ba7ae6 at witness_checkorder+0xf16 #2 0xffffffff80b49968 at _sx_xlock+0x68 #3 0xffffffff80e4f69d at ufsdirhash_add+0x4d #4 0xffffffff80e541bf at ufs_direnter+0x49f #5 0xffffffff80e5c7bc at ufs_mkdir+0x8dc #6 0xffffffff8118ae5d at VOP_MKDIR_APV+0xfd #7 0xffffffff80c23316 at kern_mkdirat+0x1d6 #8 0xffffffff810150db at amd64_syscall+0x7ab #9 0xffffffff80fef8dd at fast_syscall_common+0x101 Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Starting statd. Starting lockd. Recovering vi editor sessions:. Updating motd:. Mounting late filesystems:. Starting ntpd. Starting powerd. Starting saslauthd. Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backup. sysctl: unknown oid 'debug.mnowait_failure.zalloc_whitelist' at line 13 sysctl: unknown oid 'debug.fail_point.uma_zalloc_arg' at line 14 Starting nfscbd. Starting default mousedmoused: unable to open /dev/psm0: No such file or directory . Starting inetd. Tue Apr 17 20:02 FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: Apr 17 20:06:00 t1 su[3228]: pho to root on /dev/pts/1 20180417 20:06:26 all (1/284): nfssillyrename.sh 20180417 20:06:32 all (2/284): nullfs.sh 20180417 20:11:38 all (3/284): nullfs10.sh lock order reversal: 1st 0xfffff8001ab54cc0 ufs (ufs) @ kern/vfs_mount.c:1335 2nd 0xfffff8014acb12e0 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1371 stack backtrace: #0 0xffffffff80ba8211 at witness_debugger+0xf1 #1 0xffffffff80ba7ae6 at witness_checkorder+0xf16 #2 0xffffffff80b15b3e at lockmgr_lock_fast_path+0x17e #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80e45bc4 at ffs_flushfiles+0xa4 #6 0xffffffff80e28e82 at softdep_flushfiles+0x82 #7 0xffffffff80e48309 at ffs_unmount+0xd9 #8 0xffffffff80c0c8a9 at dounmount+0x519 #9 0xffffffff80c0c300 at sys_unmount+0x310 #10 0xffffffff810150db at amd64_syscall+0x7ab #11 0xffffffff80fef8dd at fast_syscall_common+0x101 routetbl leak: 4/36 mount leak: 1/50 20180417 20:11:43 all (4/284): nullfs11.sh routetbl leak: 8/44 mount leak: 2/52 20180417 20:14:35 all (5/284): nullfs12.sh lock order reversal: 1st 0xfffff8098ddb57d0 ufs (ufs) @ kern/vfs_subr.c:2570 2nd 0xfffffe000412d740 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:282 3rd 0xfffff801453f9558 ufs (ufs) @ kern/vfs_subr.c:2570 stack backtrace: #0 0xffffffff80ba8211 at witness_debugger+0xf1 #1 0xffffffff80ba7ae6 at witness_checkorder+0xf16 #2 0xffffffff80b1600b at lockmgr_xlock_hard+0x6b #3 0xffffffff80b169ea at __lockmgr_args+0x51a #4 0xffffffff80e4a45f at ffs_lock+0xaf #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c145b8 at vget+0x98 #8 0xffffffff80c06521 at vfs_hash_get+0xd1 #9 0xffffffff80e45d0f at ffs_vgetf+0x3f #10 0xffffffff80e3bbc6 at softdep_sync_buf+0xd16 #11 0xffffffff80e4b264 at ffs_syncvnode+0x294 #12 0xffffffff80e489fd at ffs_sync+0x20d #13 0xffffffff80c0c8e5 at dounmount+0x555 #14 0xffffffff80c0c300 at sys_unmount+0x310 #15 0xffffffff810150db at amd64_syscall+0x7ab #16 0xffffffff80fef8dd at fast_syscall_common+0x101 routetbl leak: 4/48 mount leak: 1/53 20180417 20:14:40 all (6/284): nullfs13.sh routetbl leak: 4/52 mount leak: 1/54 20180417 20:14:45 all (7/284): nullfs14.sh routetbl leak: 4/56 mount leak: 1/55 20180417 20:14:49 all (8/284): nullfs15.sh freework leak: 6/16. newblk leak: 308/318. routetbl leak: 4/60 mount leak: 1/56 20180417 20:14:53 all (9/284): nullfs16.sh 20180417 20:15:00 all (10/284): nullfs17.sh 20180417 20:20:05 all (11/284): nullfs18.sh routetbl leak: 4/64 mount leak: 1/57 20180417 20:22:48 all (12/284): nullfs19.sh routetbl leak: 4/68 mount leak: 1/58 20180417 20:25:57 all (13/284): nullfs2.sh FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: FreeBSD/amd64 (t1.osted.lan) (ttyu1) login: interrupt total irq3: uart1 396 irq9: acpi0 2 irq20: ehci1 13440 irq22: ehci0 6693 cpu0:timer 929754 cpu1:timer 970748 cpu15:timer 977355 cpu9:timer 1001394 cpu3:timer 971763 cpu7:timer 987385 cpu18:timer 972480 cpu10:timer 964097 cpu14:timer 1007070 cpu5:timer 946215 cpu12:timer 977031 cpu11:timer 989683 cpu21:timer 946775 cpu16:timer 948169 cpu17:timer 1022211 cpu6:timer 988435 cpu20:timer 977002 cpu13:timer 1015052 cpu2:timer 884187 cpu23:timer 998220 cpu4:timer 992491 cpu19:timer 969253 cpu22:timer 987840 cpu8:timer 932050 irq264: isci0 231971 irq266: hdac0 48 irq267: igb0:rxq0 1192 irq268: igb0:rxq1 4849 irq269: igb0:rxq2 1248 irq270: igb0:rxq3 165 irq271: igb0:rxq4 22 irq272: igb0:rxq5 64610 irq273: igb0:rxq6 18 irq274: igb0:rxq7 114 irq275: igb0:aq 1 irq286: ahci0 263 irq287: hdac1 3 Total 23681695 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897d6f0 watchdog_fire() at watchdog_fire+0x8b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- KDB: enter: watchdog timeout [ thread pid 11 tid 100010 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> bt Tracing pid 11 tid 100010 td 0xfffff80003770560 kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:1:pho1> show allpcpu Current CPU: 7 cpuid = 0 dynamic pcpu = 0x85ca40 curthread = 0xfffff8000375c000: pid 11 tid 100003 "idle: cpu0" curpcb = 0xfffffe007895ab80 fpcurthread = none idlethread = 0xfffff8000375c000: tid 100003 "idle: cpu0" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82028f90 commontssp = 0xffffffff82028f90 rsp0 = 0xfffffe007895ab80 gs32p = 0xffffffff8202f7d8 ldt = 0xffffffff8202f818 tss = 0xffffffff8202f808 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe0085612a40 curthread = 0xfffff8000375b560: pid 11 tid 100004 "idle: cpu1" curpcb = 0xfffffe007895fb80 fpcurthread = none idlethread = 0xfffff8000375b560: tid 100004 "idle: cpu1" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82028ff8 commontssp = 0xffffffff82028ff8 rsp0 = 0xfffffe007895fb80 gs32p = 0xffffffff8202f840 ldt = 0xffffffff8202f880 tss = 0xffffffff8202f870 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe008561da40 curthread = 0xfffff8000375b000: pid 11 tid 100005 "idle: cpu2" curpcb = 0xfffffe0078964b80 fpcurthread = none idlethread = 0xfffff8000375b000: tid 100005 "idle: cpu2" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029060 commontssp = 0xffffffff82029060 rsp0 = 0xfffffe0078964b80 gs32p = 0xffffffff8202f8a8 ldt = 0xffffffff8202f8e8 tss = 0xffffffff8202f8d8 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe0085628a40 curthread = 0xfffff8000375a560: pid 11 tid 100006 "idle: cpu3" curpcb = 0xfffffe0078969b80 fpcurthread = none idlethread = 0xfffff8000375a560: tid 100006 "idle: cpu3" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820290c8 commontssp = 0xffffffff820290c8 rsp0 = 0xfffffe0078969b80 gs32p = 0xffffffff8202f910 ldt = 0xffffffff8202f950 tss = 0xffffffff8202f940 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe0085633a40 curthread = 0xfffff8000375a000: pid 11 tid 100007 "idle: cpu4" curpcb = 0xfffffe007896eb80 fpcurthread = none idlethread = 0xfffff8000375a000: tid 100007 "idle: cpu4" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029130 commontssp = 0xffffffff82029130 rsp0 = 0xfffffe007896eb80 gs32p = 0xffffffff8202f978 ldt = 0xffffffff8202f9b8 tss = 0xffffffff8202f9a8 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe008563ea40 curthread = 0xfffff80003759560: pid 11 tid 100008 "idle: cpu5" curpcb = 0xfffffe0078973b80 fpcurthread = none idlethread = 0xfffff80003759560: tid 100008 "idle: cpu5" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029198 commontssp = 0xffffffff82029198 rsp0 = 0xfffffe0078973b80 gs32p = 0xffffffff8202f9e0 ldt = 0xffffffff8202fa20 tss = 0xffffffff8202fa10 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe0085649a40 curthread = 0xfffff80003759000: pid 11 tid 100009 "idle: cpu6" curpcb = 0xfffffe0078978b80 fpcurthread = none idlethread = 0xfffff80003759000: tid 100009 "idle: cpu6" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029200 commontssp = 0xffffffff82029200 rsp0 = 0xfffffe0078978b80 gs32p = 0xffffffff8202fa48 ldt = 0xffffffff8202fa88 tss = 0xffffffff8202fa78 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe0085654a40 curthread = 0xfffff80003770560: pid 11 tid 100010 "idle: cpu7" curpcb = 0xfffffe007897db80 fpcurthread = none idlethread = 0xfffff80003770560: tid 100010 "idle: cpu7" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029268 commontssp = 0xffffffff82029268 rsp0 = 0xfffffe007897db80 gs32p = 0xffffffff8202fab0 ldt = 0xffffffff8202faf0 tss = 0xffffffff8202fae0 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe007f159a40 curthread = 0xfffff80003770000: pid 11 tid 100011 "idle: cpu8" curpcb = 0xfffffe0078982b80 fpcurthread = none idlethread = 0xfffff80003770000: tid 100011 "idle: cpu8" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820292d0 commontssp = 0xffffffff820292d0 rsp0 = 0xfffffe0078982b80 gs32p = 0xffffffff8202fb18 ldt = 0xffffffff8202fb58 tss = 0xffffffff8202fb48 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe007f164a40 curthread = 0xfffff8000376f560: pid 11 tid 100012 "idle: cpu9" curpcb = 0xfffffe0078987b80 fpcurthread = none idlethread = 0xfffff8000376f560: tid 100012 "idle: cpu9" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029338 commontssp = 0xffffffff82029338 rsp0 = 0xfffffe0078987b80 gs32p = 0xffffffff8202fb80 ldt = 0xffffffff8202fbc0 tss = 0xffffffff8202fbb0 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe007f16fa40 curthread = 0xfffff8000376f000: pid 11 tid 100013 "idle: cpu10" curpcb = 0xfffffe007898cb80 fpcurthread = none idlethread = 0xfffff8000376f000: tid 100013 "idle: cpu10" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820293a0 commontssp = 0xffffffff820293a0 rsp0 = 0xfffffe007898cb80 gs32p = 0xffffffff8202fbe8 ldt = 0xffffffff8202fc28 tss = 0xffffffff8202fc18 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe007f17aa40 curthread = 0xfffff8000376e560: pid 11 tid 100014 "idle: cpu11" curpcb = 0xfffffe0078991b80 fpcurthread = none idlethread = 0xfffff8000376e560: tid 100014 "idle: cpu11" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029408 commontssp = 0xffffffff82029408 rsp0 = 0xfffffe0078991b80 gs32p = 0xffffffff8202fc50 ldt = 0xffffffff8202fc90 tss = 0xffffffff8202fc80 curvnet = 0 spin locks held: cpuid = 12 dynamic pcpu = 0xfffffe007f185a40 curthread = 0xfffff8000376e000: pid 11 tid 100015 "idle: cpu12" curpcb = 0xfffffe0078996b80 fpcurthread = none idlethread = 0xfffff8000376e000: tid 100015 "idle: cpu12" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029470 commontssp = 0xffffffff82029470 rsp0 = 0xfffffe0078996b80 gs32p = 0xffffffff8202fcb8 ldt = 0xffffffff8202fcf8 tss = 0xffffffff8202fce8 curvnet = 0 spin locks held: cpuid = 13 dynamic pcpu = 0xfffffe007f190a40 curthread = 0xfffff8000376d560: pid 11 tid 100016 "idle: cpu13" curpcb = 0xfffffe007899bb80 fpcurthread = none idlethread = 0xfffff8000376d560: tid 100016 "idle: cpu13" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820294d8 commontssp = 0xffffffff820294d8 rsp0 = 0xfffffe007899bb80 gs32p = 0xffffffff8202fd20 ldt = 0xffffffff8202fd60 tss = 0xffffffff8202fd50 curvnet = 0 spin locks held: cpuid = 14 dynamic pcpu = 0xfffffe007f19ba40 curthread = 0xfffff8000376d000: pid 11 tid 100017 "idle: cpu14" curpcb = 0xfffffe00789a0b80 fpcurthread = none idlethread = 0xfffff8000376d000: tid 100017 "idle: cpu14" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029540 commontssp = 0xffffffff82029540 rsp0 = 0xfffffe00789a0b80 gs32p = 0xffffffff8202fd88 ldt = 0xffffffff8202fdc8 tss = 0xffffffff8202fdb8 curvnet = 0 spin locks held: cpuid = 15 dynamic pcpu = 0xfffffe007f1a6a40 curthread = 0xfffff8000375d560: pid 11 tid 100018 "idle: cpu15" curpcb = 0xfffffe00789a5b80 fpcurthread = none idlethread = 0xfffff8000375d560: tid 100018 "idle: cpu15" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820295a8 commontssp = 0xffffffff820295a8 rsp0 = 0xfffffe00789a5b80 gs32p = 0xffffffff8202fdf0 ldt = 0xffffffff8202fe30 tss = 0xffffffff8202fe20 curvnet = 0 spin locks held: cpuid = 16 dynamic pcpu = 0xfffffe007f1b1a40 curthread = 0xfffff80003775000: pid 11 tid 100019 "idle: cpu16" curpcb = 0xfffffe00789aab80 fpcurthread = none idlethread = 0xfffff80003775000: tid 100019 "idle: cpu16" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029610 commontssp = 0xffffffff82029610 rsp0 = 0xfffffe00789aab80 gs32p = 0xffffffff8202fe58 ldt = 0xffffffff8202fe98 tss = 0xffffffff8202fe88 curvnet = 0 spin locks held: cpuid = 17 dynamic pcpu = 0xfffffe007f1bca40 curthread = 0xfffff80003774560: pid 11 tid 100020 "idle: cpu17" curpcb = 0xfffffe00789afb80 fpcurthread = none idlethread = 0xfffff80003774560: tid 100020 "idle: cpu17" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029678 commontssp = 0xffffffff82029678 rsp0 = 0xfffffe00789afb80 gs32p = 0xffffffff8202fec0 ldt = 0xffffffff8202ff00 tss = 0xffffffff8202fef0 curvnet = 0 spin locks held: cpuid = 18 dynamic pcpu = 0xfffffe007f1c7a40 curthread = 0xfffff80003774000: pid 11 tid 100021 "idle: cpu18" curpcb = 0xfffffe00789b4b80 fpcurthread = none idlethread = 0xfffff80003774000: tid 100021 "idle: cpu18" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820296e0 commontssp = 0xffffffff820296e0 rsp0 = 0xfffffe00789b4b80 gs32p = 0xffffffff8202ff28 ldt = 0xffffffff8202ff68 tss = 0xffffffff8202ff58 curvnet = 0 spin locks held: cpuid = 19 dynamic pcpu = 0xfffffe007f1d2a40 curthread = 0xfffff80003773560: pid 11 tid 100022 "idle: cpu19" curpcb = 0xfffffe00789b9b80 fpcurthread = none idlethread = 0xfffff80003773560: tid 100022 "idle: cpu19" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029748 commontssp = 0xffffffff82029748 rsp0 = 0xfffffe00789b9b80 gs32p = 0xffffffff8202ff90 ldt = 0xffffffff8202ffd0 tss = 0xffffffff8202ffc0 curvnet = 0 spin locks held: cpuid = 20 dynamic pcpu = 0xfffffe007f1dda40 curthread = 0xfffff80003773000: pid 11 tid 100023 "idle: cpu20" curpcb = 0xfffffe00789beb80 fpcurthread = none idlethread = 0xfffff80003773000: tid 100023 "idle: cpu20" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820297b0 commontssp = 0xffffffff820297b0 rsp0 = 0xfffffe00789beb80 gs32p = 0xffffffff8202fff8 ldt = 0xffffffff82030038 tss = 0xffffffff82030028 curvnet = 0 spin locks held: cpuid = 21 dynamic pcpu = 0xfffffe007f1e8a40 curthread = 0xfffff80003772560: pid 11 tid 100024 "idle: cpu21" curpcb = 0xfffffe00789c3b80 fpcurthread = none idlethread = 0xfffff80003772560: tid 100024 "idle: cpu21" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029818 commontssp = 0xffffffff82029818 rsp0 = 0xfffffe00789c3b80 gs32p = 0xffffffff82030060 ldt = 0xffffffff820300a0 tss = 0xffffffff82030090 curvnet = 0 spin locks held: cpuid = 22 dynamic pcpu = 0xfffffe007f1f3a40 curthread = 0xfffff80003772000: pid 11 tid 100025 "idle: cpu22" curpcb = 0xfffffe00789c8b80 fpcurthread = none idlethread = 0xfffff80003772000: tid 100025 "idle: cpu22" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff82029880 commontssp = 0xffffffff82029880 rsp0 = 0xfffffe00789c8b80 gs32p = 0xffffffff820300c8 ldt = 0xffffffff82030108 tss = 0xffffffff820300f8 curvnet = 0 spin locks held: cpuid = 23 dynamic pcpu = 0xfffffe007f1fea40 curthread = 0xfffff80003771560: pid 11 tid 100026 "idle: cpu23" curpcb = 0xfffffe00789cdb80 fpcurthread = none idlethread = 0xfffff80003771560: tid 100026 "idle: cpu23" curpmap = 0xffffffff81ffe680 tssp = 0xffffffff820298e8 commontssp = 0xffffffff820298e8 rsp0 = 0xfffffe00789cdb80 gs32p = 0xffffffff82030130 ldt = 0xffffffff82030170 tss = 0xffffffff82030160 curvnet = 0 spin locks held: db:1:pho1> show alllocks Process 34887 (ls) thread 0xfffff8014ed52560 (100589) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34885 (ls) thread 0xfffff8020697d000 (100796) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34883 (ls) thread 0xfffff8020690e000 (100798) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34881 (ls) thread 0xfffff800037c4560 (100242) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34879 (ls) thread 0xfffff800037c4000 (100243) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34877 (ls) thread 0xfffff80027348560 (100609) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34875 (ls) thread 0xfffff8014e23e560 (100532) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34873 (ls) thread 0xfffff80027083560 (100531) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34871 (ls) thread 0xfffff80027083000 (100732) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34869 (ls) thread 0xfffff800277b6000 (100540) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34867 (ls) thread 0xfffff800277aa560 (100545) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34865 (ls) thread 0xfffff8001aefb000 (100261) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34863 (ls) thread 0xfffff8001aefa000 (100621) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34861 (ls) thread 0xfffff802063e4000 (100719) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34859 (ls) thread 0xfffff80206127560 (100650) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34857 (ls) thread 0xfffff80206126560 (100687) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34855 (ls) thread 0xfffff80590094000 (100856) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34853 (ls) thread 0xfffff80206d12560 (100857) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34851 (ls) thread 0xfffff802069e6560 (100827) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34849 (ls) thread 0xfffff8001a987000 (100295) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34847 (ls) thread 0xfffff8001a986000 (100533) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34845 (ls) thread 0xfffff8002710c000 (100236) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34843 (ls) thread 0xfffff80027085560 (100610) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34841 (ls) thread 0xfffff800270cd560 (100637) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34839 (ls) thread 0xfffff8014ecfb560 (100723) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34837 (ls) thread 0xfffff8001a96c000 (100764) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34835 (ls) thread 0xfffff8001aa7a000 (100258) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34833 (ls) thread 0xfffff8001aa6a000 (100529) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34831 (ls) thread 0xfffff8007dfbd560 (100522) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34829 (ls) thread 0xfffff8014eccc000 (100590) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34827 (ls) thread 0xfffff8001acf3000 (100581) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34825 (ls) thread 0xfffff80206140000 (100727) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34821 (ls) thread 0xfffff8007dbc9000 (100506) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34819 (ls) thread 0xfffff8007dbc8560 (100514) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34817 (ls) thread 0xfffff80027055560 (100305) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34815 (ls) thread 0xfffff8001aa7d000 (100217) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34813 (ls) thread 0xfffff8001aa7c000 (100228) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34811 (ls) thread 0xfffff800037c3000 (100274) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34809 (ls) thread 0xfffff800037c2560 (100308) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 34789 (ls) thread 0xfffff8014e257000 (100631) shared lockmgr ufs (ufs) r = 0 (0xfffff809b31587d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31960 (link) thread 0xfffff80206194560 (100670) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003843778) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80d4ce72558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80948262068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31958 (link) thread 0xfffff80206195000 (100669) exclusive lockmgr ufs (ufs) r = 0 (0xfffff806446f57d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8078903d7d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31956 (link) thread 0xfffff80206195560 (100668) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00067888d8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c2626d558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8064430aa48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31952 (link) thread 0xfffff80206593560 (100748) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0005b909a8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c5b4b2558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff804530c9cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31950 (rw) thread 0xfffff8014ed50560 (100682) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00036b8c30) locked @ kern/vfs_bio.c:3893 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003d43320) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806bd6332e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31948 (link) thread 0xfffff8020673c000 (100747) exclusive lockmgr ufs (ufs) r = 0 (0xfffff809b37c1558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80576b0a558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31946 (rw) thread 0xfffff8001ac14560 (100303) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000215a250) locked @ kern/vfs_bio.c:3893 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0001e34660) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801968177d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31944 (link) thread 0xfffff8014e23f000 (100528) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00017adcf0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802eca612e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8014c255558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31943 (rw) thread 0xfffff80027b17560 (100307) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0001b5dee0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff809b33a42e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31940 (link) thread 0xfffff800274cc000 (100591) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003e66998) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80b15735a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80e2b481cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31938 (rw) thread 0xfffff8001ae56560 (100225) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000685bf58) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0001a5a3c8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80ab69b0068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31936 (link) thread 0xfffff8014e2f1000 (100749) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00054412d8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c59f8e068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8092c858068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31934 (rw) thread 0xfffff8092c074000 (100896) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000627dc60) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00011c7ef8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80aeffa02e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31932 (link) thread 0xfffff802064fa560 (100754) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004adf508) locked @ kern/vfs_bio.c:3893 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00071a5140) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80883e422e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80118bd9cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31930 (rw) thread 0xfffff8014e495000 (100681) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00027e86c0) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0005d590c8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80151251a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31926 (link) thread 0xfffff802069b9560 (100833) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000474d768) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80027047558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8014c19a558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31925 (rw) thread 0xfffff8001aa7c560 (100218) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004dbb8c8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806abc21068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31923 (link) thread 0xfffff80206140560 (100726) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0002a0af48) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff805766da7d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80ca1a917d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31921 (rw) thread 0xfffff8020607b560 (100661) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0005cf7c10) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00025ae1b0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c26290cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31919 (link) thread 0xfffff80206141000 (100678) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0002fc1be0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80368aa37d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80e2b483cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31917 (rw) thread 0xfffff8014ed38000 (100594) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004037368) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0002f93db8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8014a9ae2e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31915 (creat) thread 0xfffff801381a8000 (100651) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80644e5d068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31912 (link) thread 0xfffff8014eccc560 (100588) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000288cbe0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c5e656558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80b15786cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31909 (rw) thread 0xfffff8020697d560 (100795) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00024c7000) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00060f1de0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8098f296068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31908 (creat) thread 0xfffff8001aecc560 (100761) exclusive lockmgr ufs (ufs) r = 0 (0xfffff809b3f87558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31907 (link) thread 0xfffff80206127000 (100657) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000426a528) locked @ kern/vfs_bio.c:1667 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8099c7187d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802eca4d558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31906 (openat) thread 0xfffff8001a970000 (100743) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80368bcc068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31903 (link) thread 0xfffff8014ef94560 (100642) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00044c5ca8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c615962e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8095faa32e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31902 (creat) thread 0xfffff8001aede560 (100759) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8088351c2e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31901 (openat) thread 0xfffff8020618f560 (100658) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff801966dc7d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80789fa2068) locked @ kern/vfs_subr.c:2570 Process 31900 (rw) thread 0xfffff802064ca560 (100705) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004b2d640) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0001515148) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8014c320a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31896 (link) thread 0xfffff8014ecb4560 (100628) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00054a9eb8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80e2b1557d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c61028558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31895 (creat) thread 0xfffff80995774000 (100920) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80dba251cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31894 (openat) thread 0xfffff8007dbc7000 (100607) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff80789cf1a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802eca4da48) locked @ kern/vfs_subr.c:2570 Process 31892 (rw) thread 0xfffff8092c2c8000 (100946) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0005838a60) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0001073860) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff807892c3558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31891 (openat) thread 0xfffff80995c14560 (100917) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff806679dacc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802060912e0) locked @ kern/vfs_subr.c:2570 Process 31890 (rw) thread 0xfffff80206bd6560 (100818) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004513a08) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0007092f88) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c5b4b2cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31889 (link) thread 0xfffff8014ecb5560 (100587) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003957fa0) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806447a8068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80dcd6daa48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31888 (mkdir) thread 0xfffff8014ed17560 (100684) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0000e680d8) locked @ kern/vfs_bio.c:1667 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80d1c3017d0) locked @ ufs/ffs/ffs_vfsops.c:1677 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801388d2cc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31887 (openat) thread 0xfffff803a5f9e560 (100960) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff8014ad29068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80dcdbb3558) locked @ kern/vfs_subr.c:2570 Process 31885 (creat) thread 0xfffff80206799000 (100912) exclusive lockmgr ufs (ufs) r = 0 (0xfffff8028e40ea48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31884 (rw) thread 0xfffff8014e27b560 (100557) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00023e24c0) locked @ kern/vfs_bio.c:1667 exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0006991dc8) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff801fba192e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31882 (link) thread 0xfffff80206c0a560 (100821) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004b5d700) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8014aec5a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806c57c4a48) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31880 (rw) thread 0xfffff80003aba560 (100674) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0004c6d620) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8000373dcc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31878 (openat) thread 0xfffff80206610560 (100815) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff8006112a558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff802eca4d2e0) locked @ kern/vfs_subr.c:2570 Process 31875 (link) thread 0xfffff800270d4560 (100235) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0007007650) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806bd48a558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 exclusive lockmgr ufs (ufs) r = 0 (0xfffff8028e05a7d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31874 (openat) thread 0xfffff80206bd7000 (100882) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff805760797d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80145bb02e0) locked @ kern/vfs_subr.c:2570 Process 31872 (rw) thread 0xfffff802061bf560 (100679) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003f6c748) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80ee87567d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31869 (openat) thread 0xfffff8014ed5f560 (100595) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80c5ba57068) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31867 (rw) thread 0xfffff801381a8560 (100647) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe00014e5088) locked @ kern/vfs_bio.c:3893 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806764fb558) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31865 (openat) thread 0xfffff8014e257560 (100630) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff8029346e2e0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff80dcdbb3cc0) locked @ kern/vfs_subr.c:2570 Process 31862 (openat) thread 0xfffff80003be8560 (100602) exclusive lockmgr ufs (ufs) r = 0 (0xfffff80883dca7d0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:672 Process 31861 (openat) thread 0xfffff80995adc560 (100891) exclusive lockmgr nullfs (nullfs) r = 0 (0xfffff806ce44bcc0) locked @ /usr/src/sys/fs/nullfs/null_vnops.c:800 exclusive lockmgr ufs (ufs) r = 0 (0xfffff806b4b17cc0) locked @ kern/vfs_subr.c:2570 Process 1403 (syslogd) thread 0xfffff8001acf4000 (100294) shared sx vm map (user) (vm map (user)) r = 0 (0xfffff8002739d078) locked @ vm/vm_map.c:4065 Process 44 (syncer) thread 0xfffff8001a970560 (100209) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe000506d430) locked @ kern/vfs_bio.c:1667 exclusive lockmgr syncer (syncer) r = 0 (0xfffff8001aeb47d0) locked @ kern/vfs_subr.c:2151 Process 40 (pagedaemon) thread 0xfffff8001a988000 (100206) exclusive lockmgr bufwait (bufwait) r = 0 (0xfffffe0003180d18) locked @ kern/vfs_bio.c:1667 exclusive lockmgr ufs (ufs) r = 0 (0xfffff800271782e0) locked @ kern/vfs_subr.c:2570 db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80027178278: tag ufs, type VREG usecount 7, writecount 0, refcount 9 flags (VV_TEXT|VI_ACTIVE) v_object 0xfffff8001acab900 ref 5 pages 13 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001a988000 (pid 40, pagedaemon, tid 100206) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80e924a7 at vm_pageout_clean+0x1e7 #7 0xffffffff80e91c3b at vm_pageout_launder+0xd4b #8 0xffffffff80e9092e at vm_pageout_laundry_worker+0x3ae #9 0xffffffff80b01754 at fork_exit+0x84 #10 0xffffffff80fefdae at fork_trampoline+0xe ino 37094074, on dev gpt/root vnode 0xfffff8001aeb4768: tag syncer, type VNON usecount 1, writecount 0, refcount 2 flags (VI_ACTIVE) lock type syncer: EXCL by thread 0xfffff8001a970560 (pid 44, syncer, tid 100209) #0 0xffffffff80b15ba3 at lockmgr_lock_fast_path+0x1e3 #1 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #2 0xffffffff80c26216 at _vn_lock+0x66 #3 0xffffffff80c19766 at sched_sync+0x256 #4 0xffffffff80b01754 at fork_exit+0x84 #5 0xffffffff80fefdae at fork_trampoline+0xe vnode 0xfffff809b3158768: tag ufs, type VDIR usecount 1, writecount 0, refcount 42 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805900ded00 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: SHARED (count 40) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c20198 at kern_statat+0x98 #10 0xffffffff80c208cf at sys_fstatat+0x2f #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561795, on dev gpt/tmp vnode 0xfffff801388d2c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 55 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8068b6b7200 ref 0 pages 6 cleanbuf 0 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8014ed17560 (pid 31888, mkdir, tid 100684) with exclusive waiters pending with shared waiters pending #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b1649c at lockmgr_upgrade+0x11c #2 0xffffffff80b168e8 at __lockmgr_args+0x418 #3 0xffffffff80e4a45f at ffs_lock+0xaf #4 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #5 0xffffffff82630a13 at null_lock+0xe3 #6 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #7 0xffffffff80c26216 at _vn_lock+0x66 #8 0xffffffff80c083de at lookup+0x59e #9 0xffffffff80c07a1b at namei+0x53b #10 0xffffffff80c231ea at kern_mkdirat+0xaa #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561797, on dev gpt/tmp vnode 0xfffff8028e05a768: tag ufs, type VDIR usecount 1, writecount 0, refcount 26 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80661d00900 ref 0 pages 176 cleanbuf 22 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff800270d4560 (pid 31875, link, tid 100235) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561834, on dev gpt/tmp vnode 0xfffff8028e40e9e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805902f0800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206799000 (pid 31885, creat, tid 100912) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561839, on dev gpt/tmp vnode 0xfffff80883dca768: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2977400 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80003be8560 (pid 31862, openat, tid 100602) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561817, on dev gpt/tmp vnode 0xfffff80c5ba57000: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806602bf500 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014ed5f560 (pid 31869, openat, tid 100595) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561818, on dev gpt/tmp vnode 0xfffff806c57c49e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80660513a00 ref 0 pages 112 cleanbuf 14 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206c0a560 (pid 31882, link, tid 100821) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561846, on dev gpt/tmp vnode 0xfffff80dba251c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806927ef800 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80995774000 (pid 31895, creat, tid 100920) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561849, on dev gpt/tmp vnode 0xfffff80c610284f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 23 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675b62300 ref 0 pages 152 cleanbuf 19 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014ecb4560 (pid 31896, link, tid 100628) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561850, on dev gpt/tmp vnode 0xfffff8088351c278: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675f19700 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8001aede560 (pid 31902, creat, tid 100759) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561857, on dev gpt/tmp vnode 0xfffff809b3f874f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2424200 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8001aecc560 (pid 31908, creat, tid 100761) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561859, on dev gpt/tmp vnode 0xfffff80b15786c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 11 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2118200 ref 0 pages 52 cleanbuf 1 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff8014eccc560 (pid 31912, link, tid 100588) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561860, on dev gpt/tmp vnode 0xfffff80644e5d000: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675c3a100 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff801381a8000 (pid 31915, creat, tid 100651) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561861, on dev gpt/tmp vnode 0xfffff80e2b483c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 15 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2118400 ref 0 pages 83 cleanbuf 1 dirtybuf 11 lock type ufs: EXCL by thread 0xfffff80206141000 (pid 31919, link, tid 100678) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561862, on dev gpt/tmp vnode 0xfffff80368bcc000: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80145548e00 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8001a970000 (pid 31906, openat, tid 100743) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561863, on dev gpt/tmp vnode 0xfffff80dcd6da9e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff802068d7b00 ref 0 pages 112 cleanbuf 14 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014ecb5560 (pid 31889, link, tid 100587) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561864, on dev gpt/tmp vnode 0xfffff8092c858000: tag ufs, type VDIR usecount 1, writecount 0, refcount 26 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806611b9a00 ref 0 pages 176 cleanbuf 22 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014e2f1000 (pid 31936, link, tid 100749) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561866, on dev gpt/tmp vnode 0xfffff80ca1a91768: tag ufs, type VDIR usecount 1, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675bb8400 ref 0 pages 112 cleanbuf 14 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206140560 (pid 31923, link, tid 100726) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561867, on dev gpt/tmp vnode 0xfffff8095faa3278: tag ufs, type VDIR usecount 1, writecount 0, refcount 15 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805903b8b00 ref 0 pages 85 cleanbuf 1 dirtybuf 11 lock type ufs: EXCL by thread 0xfffff8014ef94560 (pid 31903, link, tid 100642) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561868, on dev gpt/tmp vnode 0xfffff8014c19a4f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806ab68f300 ref 0 pages 112 cleanbuf 14 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff802069b9560 (pid 31926, link, tid 100833) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561876, on dev gpt/tmp vnode 0xfffff802eca4d4f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 16 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806aba74300 ref 0 pages 88 cleanbuf 2 dirtybuf 11 lock type ufs: EXCL by thread 0xfffff80206127000 (pid 31907, link, tid 100657) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561879, on dev gpt/tmp vnode 0xfffff80e2b481c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 12 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801455ff100 ref 0 pages 58 cleanbuf 1 dirtybuf 8 lock type ufs: EXCL by thread 0xfffff800274cc000 (pid 31940, link, tid 100591) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561880, on dev gpt/tmp vnode 0xfffff8064430a9e0: tag ufs, type VDIR usecount 1, writecount 0, refcount 18 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80661db2700 ref 0 pages 112 cleanbuf 14 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206195560 (pid 31956, link, tid 100668) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561881, on dev gpt/tmp vnode 0xfffff8014c2554f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 26 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80692f95800 ref 0 pages 176 cleanbuf 22 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014e23f000 (pid 31944, link, tid 100528) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561883, on dev gpt/tmp vnode 0xfffff80576b0a4f0: tag ufs, type VDIR usecount 1, writecount 0, refcount 11 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80660ce8800 ref 0 pages 56 cleanbuf 1 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff8020673c000 (pid 31948, link, tid 100747) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561886, on dev gpt/tmp vnode 0xfffff804530c9c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 20 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8001ab2e800 ref 0 pages 128 cleanbuf 16 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206593560 (pid 31952, link, tid 100748) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561888, on dev gpt/tmp vnode 0xfffff80118bd9c58: tag ufs, type VDIR usecount 1, writecount 0, refcount 15 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80692f93300 ref 0 pages 86 cleanbuf 1 dirtybuf 11 lock type ufs: EXCL by thread 0xfffff802064fa560 (pid 31932, link, tid 100754) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561890, on dev gpt/tmp vnode 0xfffff8078903d768: tag ufs, type VDIR usecount 1, writecount 0, refcount 11 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801455ff500 ref 0 pages 56 cleanbuf 1 dirtybuf 7 lock type ufs: EXCL by thread 0xfffff80206195000 (pid 31958, link, tid 100669) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561894, on dev gpt/tmp vnode 0xfffff80948262000: tag ufs, type VDIR usecount 1, writecount 0, refcount 12 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80662e59800 ref 0 pages 58 cleanbuf 1 dirtybuf 8 lock type ufs: EXCL by thread 0xfffff80206194560 (pid 31960, link, tid 100670) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561895, on dev gpt/tmp vnode 0xfffff80ee8756768: tag ufs, type VREG usecount 1, writecount 1, refcount 2327 flags (VI_ACTIVE) v_object 0xfffff806c6e31200 ref 0 pages 18600 cleanbuf 2322 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff802061bf560 (pid 31872, rw, tid 100679) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562115, on dev gpt/tmp vnode 0xfffff80c59f8e000: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806618b9b00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e2f1000 (pid 31936, link, tid 100749) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562116, on dev gpt/tmp vnode 0xfffff806bd48a4f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806bd823200 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800270d4560 (pid 31875, link, tid 100235) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562119, on dev gpt/tmp vnode 0xfffff806764fb4f0: tag ufs, type VREG usecount 1, writecount 1, refcount 4203 flags (VI_ACTIVE) v_object 0xfffff80660513e00 ref 0 pages 33608 cleanbuf 4198 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff801381a8560 (pid 31867, rw, tid 100647) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562120, on dev gpt/tmp vnode 0xfffff801fba19278: tag ufs, type VREG usecount 1, writecount 1, refcount 3005 flags (VI_ACTIVE) v_object 0xfffff801455ffa00 ref 0 pages 24016 cleanbuf 3000 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8014e27b560 (pid 31884, rw, tid 100557) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562123, on dev gpt/tmp vnode 0xfffff80e2b155768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80206b48000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb4560 (pid 31896, link, tid 100628) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562124, on dev gpt/tmp vnode 0xfffff802eca61278: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80003927c00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e23f000 (pid 31944, link, tid 100528) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562125, on dev gpt/tmp vnode 0xfffff80ab69b0000: tag ufs, type VREG usecount 1, writecount 1, refcount 1864 flags (VI_ACTIVE) v_object 0xfffff8014a976300 ref 0 pages 14888 cleanbuf 1859 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8001ae56560 (pid 31938, rw, tid 100225) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562126, on dev gpt/tmp vnode 0xfffff8014aec59e0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80145442a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206c0a560 (pid 31882, link, tid 100821) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562048, on dev gpt/tmp vnode 0xfffff805766da768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806a2eb9a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206140560 (pid 31923, link, tid 100726) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562148, on dev gpt/tmp vnode 0xfffff8000373dc58: tag ufs, type VREG usecount 1, writecount 1, refcount 3472 flags (VI_ACTIVE) v_object 0xfffff806aba74400 ref 0 pages 27760 cleanbuf 3467 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff80003aba560 (pid 31880, rw, tid 100674) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562049, on dev gpt/tmp vnode 0xfffff80b157359e0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590351000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800274cc000 (pid 31940, link, tid 100591) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562053, on dev gpt/tmp vnode 0xfffff806446f5768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80660fb8000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195000 (pid 31958, link, tid 100669) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562054, on dev gpt/tmp vnode 0xfffff80d4ce724f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8067cebf400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206194560 (pid 31960, link, tid 100670) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562055, on dev gpt/tmp vnode 0xfffff80c5e6564f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806c630c500 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014eccc560 (pid 31912, link, tid 100588) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562056, on dev gpt/tmp vnode 0xfffff8014a9ae278: tag ufs, type VREG usecount 1, writecount 1, refcount 2940 flags (VI_ACTIVE) v_object 0xfffff80692ded700 ref 0 pages 23498 cleanbuf 2934 dirtybuf 4 lock type ufs: EXCL by thread 0xfffff8014ed38000 (pid 31917, rw, tid 100594) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562057, on dev gpt/tmp vnode 0xfffff809b37c14f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80699a4ed00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020673c000 (pid 31948, link, tid 100747) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562050, on dev gpt/tmp vnode 0xfffff80c2626d4f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80206e63000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195560 (pid 31956, link, tid 100668) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561800, on dev gpt/tmp vnode 0xfffff80368aa3768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80692588e00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206141000 (pid 31919, link, tid 100678) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561802, on dev gpt/tmp vnode 0xfffff80c61596278: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8068b161400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ef94560 (pid 31903, link, tid 100642) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561803, on dev gpt/tmp vnode 0xfffff8099c718768: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8014aacf100 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206127000 (pid 31907, link, tid 100657) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561804, on dev gpt/tmp vnode 0xfffff80c26290c58: tag ufs, type VREG usecount 1, writecount 1, refcount 959 flags (VI_ACTIVE) v_object 0xfffff8068b37eb00 ref 0 pages 7655 cleanbuf 955 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8020607b560 (pid 31921, rw, tid 100661) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561814, on dev gpt/tmp vnode 0xfffff806bd633278: tag ufs, type VREG usecount 1, writecount 1, refcount 4424 flags (VI_ACTIVE) v_object 0xfffff806ab129100 ref 0 pages 35376 cleanbuf 4419 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8014ed50560 (pid 31950, rw, tid 100682) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561820, on dev gpt/tmp vnode 0xfffff8098f296000: tag ufs, type VREG usecount 1, writecount 1, refcount 3888 flags (VI_ACTIVE) v_object 0xfffff806a239bd00 ref 0 pages 31080 cleanbuf 3883 dirtybuf 3 lock type ufs: EXCL by thread 0xfffff8020697d560 (pid 31909, rw, tid 100795) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561885, on dev gpt/tmp vnode 0xfffff806447a8000: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590c95500 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb5560 (pid 31889, link, tid 100587) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561900, on dev gpt/tmp vnode 0xfffff807892c34f0: tag ufs, type VREG usecount 1, writecount 1, refcount 1815 flags (VI_ACTIVE) v_object 0xfffff80683096800 ref 0 pages 14496 cleanbuf 1812 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8092c2c8000 (pid 31892, rw, tid 100946) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561901, on dev gpt/tmp vnode 0xfffff80196817768: tag ufs, type VREG usecount 1, writecount 1, refcount 984 flags (VI_ACTIVE) v_object 0xfffff80206b66e00 ref 0 pages 7856 cleanbuf 981 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8001ac14560 (pid 31946, rw, tid 100303) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561902, on dev gpt/tmp vnode 0xfffff80883e42278: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590878b00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802064fa560 (pid 31932, link, tid 100754) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561903, on dev gpt/tmp vnode 0xfffff800270474f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80683224900 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802069b9560 (pid 31926, link, tid 100833) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 561904, on dev gpt/tmp vnode 0xfffff8014c3209e0: tag ufs, type VREG usecount 1, writecount 1, refcount 548 flags (VI_ACTIVE) v_object 0xfffff806b4085700 ref 0 pages 4360 cleanbuf 545 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff802064ca560 (pid 31900, rw, tid 100705) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562783, on dev gpt/tmp vnode 0xfffff80aeffa0278: tag ufs, type VREG usecount 1, writecount 1, refcount 592 flags (VI_ACTIVE) v_object 0xfffff8067ca1f300 ref 0 pages 4712 cleanbuf 588 dirtybuf 2 lock type ufs: EXCL by thread 0xfffff8092c074000 (pid 31934, rw, tid 100896) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562793, on dev gpt/tmp vnode 0xfffff801512519e0: tag ufs, type VREG usecount 1, writecount 1, refcount 945 flags (VI_ACTIVE) v_object 0xfffff806b4085900 ref 0 pages 7536 cleanbuf 942 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8014e495000 (pid 31930, rw, tid 100681) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 562806, on dev gpt/tmp vnode 0xfffff809b33a4278: tag ufs, type VREG usecount 1, writecount 1, refcount 2559 flags (VI_ACTIVE) v_object 0xfffff80145d8d700 ref 0 pages 20456 cleanbuf 2556 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80027b17560 (pid 31943, rw, tid 100307) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 566271, on dev gpt/tmp vnode 0xfffff80c5b4b2c58: tag ufs, type VREG usecount 1, writecount 1, refcount 1597 flags (VI_ACTIVE) v_object 0xfffff8066056e500 ref 0 pages 12752 cleanbuf 1594 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff80206bd6560 (pid 31890, rw, tid 100818) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 566275, on dev gpt/tmp vnode 0xfffff806abc21000: tag ufs, type VREG usecount 1, writecount 1, refcount 1776 flags (VI_ACTIVE) v_object 0xfffff80692949e00 ref 0 pages 14192 cleanbuf 1773 dirtybuf 1 lock type ufs: EXCL by thread 0xfffff8001aa7c560 (pid 31925, rw, tid 100218) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 565730, on dev gpt/tmp vnode 0xfffff80c5b4b24f0: tag ufs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80675240a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206593560 (pid 31952, link, tid 100748) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 566343, on dev gpt/tmp vnode 0xfffff80d1c301768: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type ufs: EXCL by thread 0xfffff8014ed17560 (pid 31888, mkdir, tid 100684) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e45e09 at ffs_vgetf+0x139 #3 0xffffffff80e19607 at ffs_valloc+0x567 #4 0xffffffff80e5bfb0 at ufs_mkdir+0xd0 #5 0xffffffff8118ae5d at VOP_MKDIR_APV+0xfd #6 0xffffffff826301ec at null_bypass+0x10c #7 0xffffffff8118ae62 at VOP_MKDIR_APV+0x102 #8 0xffffffff80c23316 at kern_mkdirat+0x1d6 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 ino 4895754, on dev gpt/tmp vnode 0xfffff80145bb0278: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80699affa00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206bd7000 (pid 31874, openat, tid 100882) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564511, on dev gpt/tmp vnode 0xfffff806b4b17c58: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80699ec4200 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80995adc560 (pid 31861, openat, tid 100891) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564550, on dev gpt/tmp vnode 0xfffff80789fa2000: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8067c7a2300 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020618f560 (pid 31901, openat, tid 100658) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564537, on dev gpt/tmp vnode 0xfffff80dcdbb34f0: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80692efe000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff803a5f9e560 (pid 31887, openat, tid 100960) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564556, on dev gpt/tmp vnode 0xfffff802eca4d9e0: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff8067c7a2b00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8007dbc7000 (pid 31894, openat, tid 100607) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564554, on dev gpt/tmp vnode 0xfffff80dcdbb3c58: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80699aff900 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e257560 (pid 31865, openat, tid 100630) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564566, on dev gpt/tmp vnode 0xfffff802eca4d278: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80699ec4800 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206610560 (pid 31878, openat, tid 100815) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564545, on dev gpt/tmp vnode 0xfffff80206091278: tag ufs, type VREG usecount 0, writecount 0, refcount 1 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xfffff80692efec00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80995c14560 (pid 31891, openat, tid 100917) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff80c26216 at _vn_lock+0x66 #5 0xffffffff80c145b8 at vget+0x98 #6 0xffffffff80c06521 at vfs_hash_get+0xd1 #7 0xffffffff80e45d0f at ffs_vgetf+0x3f #8 0xffffffff80e534b9 at ufs_lookup_ino+0x959 #9 0xffffffff81188757 at VOP_CACHEDLOOKUP_APV+0xf7 #10 0xffffffff80bfed56 at vfs_cache_lookup+0xd6 #11 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #12 0xffffffff82630390 at null_lookup+0xd0 #13 0xffffffff81188567 at VOP_LOOKUP_APV+0xf7 #14 0xffffffff80c084d2 at lookup+0x692 #15 0xffffffff80c07a1b at namei+0x53b #16 0xffffffff80c1f720 at kern_unlinkat+0x80 #17 0xffffffff810150db at amd64_syscall+0x7ab ino 564567, on dev gpt/tmp vnode 0xfffff80576026278: tag nullfs, type VDIR usecount 121, writecount 0, refcount 121 mountedhere 0 flags (VV_ROOT|VI_ACTIVE) v_object 0xfffff805900ded00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: SHARED (count 40) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c20198 at kern_statat+0x98 #10 0xffffffff80c208cf at sys_fstatat+0x2f #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80576026278, lowervp=0xfffff809b3158768 vnode 0xfffff806abc2b9e0: tag nullfs, type VDIR usecount 86, writecount 0, refcount 86 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8068b6b7200 ref 0 pages 6 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ed17560 (pid 31888, mkdir, tid 100684) with exclusive waiters pending with shared waiters pending #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b1649c at lockmgr_upgrade+0x11c #2 0xffffffff80b168e8 at __lockmgr_args+0x418 #3 0xffffffff80e4a45f at ffs_lock+0xaf #4 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #5 0xffffffff82630a13 at null_lock+0xe3 #6 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #7 0xffffffff80c26216 at _vn_lock+0x66 #8 0xffffffff80c083de at lookup+0x59e #9 0xffffffff80c07a1b at namei+0x53b #10 0xffffffff80c231ea at kern_mkdirat+0xaa #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806abc2b9e0, lowervp=0xfffff801388d2c58 vnode 0xfffff8045315f768: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80661d00900 ref 0 pages 176 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800270d4560 (pid 31875, link, tid 100235) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8045315f768, lowervp=0xfffff8028e05a768 vnode 0xfffff80686908000: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805902f0800 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206799000 (pid 31885, creat, tid 100912) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80686908000, lowervp=0xfffff8028e40e9e0 vnode 0xfffff806bd6374f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2977400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80003be8560 (pid 31862, openat, tid 100602) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806bd6374f0, lowervp=0xfffff80883dca768 vnode 0xfffff806446a04f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806602bf500 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ed5f560 (pid 31869, openat, tid 100595) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806446a04f0, lowervp=0xfffff80c5ba57000 vnode 0xfffff80b15747278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80660513a00 ref 0 pages 112 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206c0a560 (pid 31882, link, tid 100821) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80b15747278, lowervp=0xfffff806c57c49e0 vnode 0xfffff80948260c58: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806927ef800 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80995774000 (pid 31895, creat, tid 100920) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80948260c58, lowervp=0xfffff80dba251c58 vnode 0xfffff80dba2519e0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675b62300 ref 0 pages 152 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb4560 (pid 31896, link, tid 100628) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80dba2519e0, lowervp=0xfffff80c610284f0 vnode 0xfffff80c5e64b9e0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675f19700 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001aede560 (pid 31902, creat, tid 100759) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c5e64b9e0, lowervp=0xfffff8088351c278 vnode 0xfffff80576b0a278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2424200 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001aecc560 (pid 31908, creat, tid 100761) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80576b0a278, lowervp=0xfffff809b3f874f0 vnode 0xfffff80662973c58: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2118200 ref 0 pages 52 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014eccc560 (pid 31912, link, tid 100588) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80662973c58, lowervp=0xfffff80b15786c58 vnode 0xfffff806756c2000: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675c3a100 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801381a8000 (pid 31915, creat, tid 100651) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806756c2000, lowervp=0xfffff80644e5d000 vnode 0xfffff80fc3ed74f0: tag nullfs, type VDIR usecount 3, writecount 0, refcount 3 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806a2118400 ref 0 pages 83 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206141000 (pid 31919, link, tid 100678) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80fc3ed74f0, lowervp=0xfffff80e2b483c58 vnode 0xfffff806ce37e4f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80145548e00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001a970000 (pid 31906, openat, tid 100743) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c25914 at vn_open_cred+0xd4 #10 0xffffffff80c1e39c at kern_openat+0x20c #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806ce37e4f0, lowervp=0xfffff80368bcc000 vnode 0xfffff8078903d278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff802068d7b00 ref 0 pages 112 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb5560 (pid 31889, link, tid 100587) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8078903d278, lowervp=0xfffff80dcd6da9e0 vnode 0xfffff80d4c0fe000: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806611b9a00 ref 0 pages 176 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e2f1000 (pid 31936, link, tid 100749) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80d4c0fe000, lowervp=0xfffff8092c858000 vnode 0xfffff80c265764f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80675bb8400 ref 0 pages 112 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206140560 (pid 31923, link, tid 100726) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c265764f0, lowervp=0xfffff80ca1a91768 vnode 0xfffff80368e214f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff805903b8b00 ref 0 pages 85 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ef94560 (pid 31903, link, tid 100642) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80368e214f0, lowervp=0xfffff8095faa3278 vnode 0xfffff80c5b1b14f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806ab68f300 ref 0 pages 112 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802069b9560 (pid 31926, link, tid 100833) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c5b1b14f0, lowervp=0xfffff8014c19a4f0 vnode 0xfffff8095fa99278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff806aba74300 ref 0 pages 88 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206127000 (pid 31907, link, tid 100657) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8095fa99278, lowervp=0xfffff802eca4d4f0 vnode 0xfffff80789fa2278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801455ff100 ref 0 pages 58 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800274cc000 (pid 31940, link, tid 100591) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80789fa2278, lowervp=0xfffff80e2b481c58 vnode 0xfffff8078942b278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80661db2700 ref 0 pages 112 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195560 (pid 31956, link, tid 100668) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8078942b278, lowervp=0xfffff8064430a9e0 vnode 0xfffff8029c9c1000: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80692f95800 ref 0 pages 176 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e23f000 (pid 31944, link, tid 100528) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8029c9c1000, lowervp=0xfffff8014c2554f0 vnode 0xfffff80cab5159e0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80660ce8800 ref 0 pages 56 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020673c000 (pid 31948, link, tid 100747) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80cab5159e0, lowervp=0xfffff80576b0a4f0 vnode 0xfffff809b3bb5278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8001ab2e800 ref 0 pages 128 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206593560 (pid 31952, link, tid 100748) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff809b3bb5278, lowervp=0xfffff804530c9c58 vnode 0xfffff80bcd1cdc58: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80692f93300 ref 0 pages 86 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802064fa560 (pid 31932, link, tid 100754) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80bcd1cdc58, lowervp=0xfffff80118bd9c58 vnode 0xfffff8078903d4f0: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff801455ff500 ref 0 pages 56 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195000 (pid 31958, link, tid 100669) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8078903d4f0, lowervp=0xfffff8078903d768 vnode 0xfffff80ca1be2278: tag nullfs, type VDIR usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff80662e59800 ref 0 pages 58 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206194560 (pid 31960, link, tid 100670) #0 0xffffffff80b15f4b at lockmgr_slock_hard+0x32b #1 0xffffffff80b16a17 at __lockmgr_args+0x547 #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c07f54 at lookup+0x114 #8 0xffffffff80c07a1b at namei+0x53b #9 0xffffffff80c1ee2b at kern_linkat+0x13b #10 0xffffffff80c1ece8 at sys_link+0x28 #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80ca1be2278, lowervp=0xfffff80948262000 vnode 0xfffff80883dfe9e0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806c6e31200 ref 0 pages 18600 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802061bf560 (pid 31872, rw, tid 100679) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80883dfe9e0, lowervp=0xfffff80ee8756768 vnode 0xfffff80c59f8e4f0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806618b9b00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e2f1000 (pid 31936, link, tid 100749) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c59f8e4f0, lowervp=0xfffff80c59f8e000 vnode 0xfffff806bd48a278: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806bd823200 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800270d4560 (pid 31875, link, tid 100235) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806bd48a278, lowervp=0xfffff806bd48a4f0 vnode 0xfffff806830c99e0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80660513e00 ref 0 pages 33608 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff801381a8560 (pid 31867, rw, tid 100647) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806830c99e0, lowervp=0xfffff806764fb4f0 vnode 0xfffff80ab1b19768: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff801455ffa00 ref 0 pages 24016 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e27b560 (pid 31884, rw, tid 100557) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80ab1b19768, lowervp=0xfffff801fba19278 vnode 0xfffff80e2b1554f0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80206b48000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb4560 (pid 31896, link, tid 100628) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80e2b1554f0, lowervp=0xfffff80e2b155768 vnode 0xfffff801967b8c58: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80003927c00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e23f000 (pid 31944, link, tid 100528) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff801967b8c58, lowervp=0xfffff802eca61278 vnode 0xfffff80ab69b0278: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8014a976300 ref 0 pages 14888 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001ae56560 (pid 31938, rw, tid 100225) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80ab69b0278, lowervp=0xfffff80ab69b0000 vnode 0xfffff8014a08b000: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80145442a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206c0a560 (pid 31882, link, tid 100821) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8014a08b000, lowervp=0xfffff8014aec59e0 vnode 0xfffff8045311f9e0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806a2eb9a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206140560 (pid 31923, link, tid 100726) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8045311f9e0, lowervp=0xfffff805766da768 vnode 0xfffff80dcd9c6000: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806aba74400 ref 0 pages 27760 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80003aba560 (pid 31880, rw, tid 100674) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80dcd9c6000, lowervp=0xfffff8000373dc58 vnode 0xfffff803680cf000: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590351000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff800274cc000 (pid 31940, link, tid 100591) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff803680cf000, lowervp=0xfffff80b157359e0 vnode 0xfffff80789ed5000: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80660fb8000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195000 (pid 31958, link, tid 100669) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80789ed5000, lowervp=0xfffff806446f5768 vnode 0xfffff80196148278: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8067cebf400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206194560 (pid 31960, link, tid 100670) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80196148278, lowervp=0xfffff80d4ce724f0 vnode 0xfffff80138be0278: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806c630c500 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014eccc560 (pid 31912, link, tid 100588) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80138be0278, lowervp=0xfffff80c5e6564f0 vnode 0xfffff80ee8af89e0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80699a4ed00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020673c000 (pid 31948, link, tid 100747) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80ee8af89e0, lowervp=0xfffff809b37c14f0 vnode 0xfffff804532259e0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80692ded700 ref 0 pages 23498 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ed38000 (pid 31917, rw, tid 100594) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff804532259e0, lowervp=0xfffff8014a9ae278 vnode 0xfffff809b315e000: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8068b161400 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ef94560 (pid 31903, link, tid 100642) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff809b315e000, lowervp=0xfffff80c61596278 vnode 0xfffff8006112a768: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806ab129100 ref 0 pages 35376 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ed50560 (pid 31950, rw, tid 100682) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8006112a768, lowervp=0xfffff806bd633278 vnode 0xfffff8090ad72278: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8014aacf100 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206127000 (pid 31907, link, tid 100657) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8090ad72278, lowervp=0xfffff8099c718768 vnode 0xfffff808836f54f0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8068b37eb00 ref 0 pages 7655 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020607b560 (pid 31921, rw, tid 100661) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff808836f54f0, lowervp=0xfffff80c26290c58 vnode 0xfffff80196817000: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806a239bd00 ref 0 pages 31080 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8020697d560 (pid 31909, rw, tid 100795) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80196817000, lowervp=0xfffff8098f296000 vnode 0xfffff80ef0f1e4f0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80692588e00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206141000 (pid 31919, link, tid 100678) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80ef0f1e4f0, lowervp=0xfffff80368aa3768 vnode 0xfffff809b34954f0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80683096800 ref 0 pages 14496 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8092c2c8000 (pid 31892, rw, tid 100946) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff809b34954f0, lowervp=0xfffff807892c34f0 vnode 0xfffff8067577d4f0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80206e63000 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206195560 (pid 31956, link, tid 100668) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8067577d4f0, lowervp=0xfffff80c2626d4f0 vnode 0xfffff80576080c58: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80683224900 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802069b9560 (pid 31926, link, tid 100833) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80576080c58, lowervp=0xfffff800270474f0 vnode 0xfffff806a240a768: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590878b00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802064fa560 (pid 31932, link, tid 100754) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806a240a768, lowervp=0xfffff80883e42278 vnode 0xfffff80c99223000: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80206b66e00 ref 0 pages 7856 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001ac14560 (pid 31946, rw, tid 100303) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c99223000, lowervp=0xfffff80196817768 vnode 0xfffff807899e8278: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80590c95500 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014ecb5560 (pid 31889, link, tid 100587) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff807899e8278, lowervp=0xfffff806447a8000 vnode 0xfffff806ab4a2278: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806b4085700 ref 0 pages 4360 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff802064ca560 (pid 31900, rw, tid 100705) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff806ab4a2278, lowervp=0xfffff8014c3209e0 vnode 0xfffff802998ba4f0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8067ca1f300 ref 0 pages 4712 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8092c074000 (pid 31934, rw, tid 100896) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff802998ba4f0, lowervp=0xfffff80aeffa0278 vnode 0xfffff80644987768: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff806b4085900 ref 0 pages 7536 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8014e495000 (pid 31930, rw, tid 100681) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80644987768, lowervp=0xfffff801512519e0 vnode 0xfffff80990f70c58: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80145d8d700 ref 0 pages 20456 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80027b17560 (pid 31943, rw, tid 100307) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80990f70c58, lowervp=0xfffff809b33a4278 vnode 0xfffff80c5b4b29e0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff8066056e500 ref 0 pages 12752 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206bd6560 (pid 31890, rw, tid 100818) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff80c5b4b29e0, lowervp=0xfffff80c5b4b2c58 vnode 0xfffff809cb7d69e0: tag nullfs, type VREG usecount 1, writecount 1, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80692949e00 ref 0 pages 14192 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8001aa7c560 (pid 31925, rw, tid 100218) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c28dc4 at vn_write+0x194 #8 0xffffffff80c28863 at vn_io_fault_doio+0x43 #9 0xffffffff80c268b1 at vn_io_fault1+0x171 #10 0xffffffff80c24c65 at vn_io_fault+0x195 #11 0xffffffff80baeaf7 at dofilewrite+0xa7 #12 0xffffffff80bae6e8 at kern_writev+0x68 #13 0xffffffff80bae676 at sys_write+0x86 #14 0xffffffff810150db at amd64_syscall+0x7ab #15 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff809cb7d69e0, lowervp=0xfffff806abc21000 vnode 0xfffff8014cba59e0: tag nullfs, type VREG usecount 1, writecount 0, refcount 1 flags (VI_ACTIVE) v_object 0xfffff80675240a00 ref 0 pages 0 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff80206593560 (pid 31952, link, tid 100748) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff80e4a45f at ffs_lock+0xaf #3 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #4 0xffffffff82630a13 at null_lock+0xe3 #5 0xffffffff8118bb71 at VOP_LOCK1_APV+0xe1 #6 0xffffffff80c26216 at _vn_lock+0x66 #7 0xffffffff80c1ee73 at kern_linkat+0x183 #8 0xffffffff80c1ece8 at sys_link+0x28 #9 0xffffffff810150db at amd64_syscall+0x7ab #10 0xffffffff80fef8dd at fast_syscall_common+0x101 vp=0xfffff8014cba59e0, lowervp=0xfffff80c5b4b24f0 vnode 0xfffff80576079768: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff80206bd7000 (pid 31874, openat, tid 100882) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff801966dc768: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff8020618f560 (pid 31901, openat, tid 100658) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff8014ad29000: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff803a5f9e560 (pid 31887, openat, tid 100960) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff80789cf19e0: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff8007dbc7000 (pid 31894, openat, tid 100607) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff806ce44bc58: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff80995adc560 (pid 31861, openat, tid 100891) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff8029346e278: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff8014e257560 (pid 31865, openat, tid 100630) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff806679dac58: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff80995c14560 (pid 31891, openat, tid 100917) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 vnode 0xfffff8006112a4f0: tag nullfs, type VREG usecount 0, writecount 0, refcount 1 flags (VI_DOOMED|VI_ACTIVE|VI_DOINGINACT) lock type nullfs: EXCL by thread 0xfffff80206610560 (pid 31878, openat, tid 100815) #0 0xffffffff80b1635a at lockmgr_xlock_hard+0x3ba #1 0xffffffff80b169ea at __lockmgr_args+0x51a #2 0xffffffff82630860 at null_reclaim+0x60 #3 0xffffffff8118b9bd at VOP_RECLAIM_APV+0xfd #4 0xffffffff80c15d5c at vgonel+0x24c #5 0xffffffff80c1633c at vrecycle+0x5c #6 0xffffffff826307f7 at null_inactive+0x57 #7 0xffffffff8118b7fd at VOP_INACTIVE_APV+0xfd #8 0xffffffff80c14a16 at vinactive+0xe6 #9 0xffffffff80c15090 at vputx+0x320 #10 0xffffffff80c1f8ca at kern_unlinkat+0x22a #11 0xffffffff810150db at amd64_syscall+0x7ab #12 0xffffffff80fef8dd at fast_syscall_common+0x101 db:1:pho1> show allchains chain 1: thread 100589 (pid 34887, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 2: thread 100796 (pid 34885, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 3: thread 100798 (pid 34883, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 4: thread 100242 (pid 34881, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 5: thread 100243 (pid 34879, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 6: thread 100609 (pid 34877, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 7: thread 100532 (pid 34875, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 8: thread 100531 (pid 34873, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 9: thread 100732 (pid 34871, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 10: thread 100540 (pid 34869, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 11: thread 100545 (pid 34867, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 12: thread 100261 (pid 34865, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 13: thread 100621 (pid 34863, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 14: thread 100719 (pid 34861, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 15: thread 100650 (pid 34859, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 16: thread 100687 (pid 34857, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 17: thread 100856 (pid 34855, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 18: thread 100857 (pid 34853, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 19: thread 100827 (pid 34851, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 20: thread 100295 (pid 34849, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 21: thread 100533 (pid 34847, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 22: thread 100236 (pid 34845, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 23: thread 100610 (pid 34843, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 24: thread 100637 (pid 34841, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 25: thread 100723 (pid 34839, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 26: thread 100764 (pid 34837, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 27: thread 100258 (pid 34835, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 28: thread 100529 (pid 34833, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 29: thread 100522 (pid 34831, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 30: thread 100590 (pid 34829, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 31: thread 100581 (pid 34827, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 32: thread 100727 (pid 34825, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 33: thread 100506 (pid 34821, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 34: thread 100514 (pid 34819, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 35: thread 100305 (pid 34817, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 36: thread 100217 (pid 34815, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 37: thread 100228 (pid 34813, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 38: thread 100274 (pid 34811, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 39: thread 100308 (pid 34809, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 40: thread 100631 (pid 34789, ls) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 41: thread 100515 (pid 34760, ls) sleeping on 0xffffffff81a58880 "pfault" chain 42: thread 100296 (pid 34759, cron) sleeping on 0xffffffff81a58880 "pfault" chain 43: thread 100660 (pid 34757, sed) sleeping on 0xffffffff81a58880 "pfault" chain 44: thread 100936 (pid 32004, fts) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 45: thread 100935 (pid 32002, fts) sleeping on 0xffffffff81a58880 "pfault" chain 46: thread 100852 (pid 32000, fts) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 47: thread 100851 (pid 31998, fts) sleeping on 0xffffffff81a58880 "pfault" chain 48: thread 100820 (pid 31996, fts) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 49: thread 100720 (pid 31994, fts) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 50: thread 100717 (pid 31967, swap) sleeping on 0xffffffff81a58880 "pfault" chain 51: thread 100716 (pid 31965, swap) sleeping on 0xffffffff81a58880 "pfault" chain 52: thread 100714 (pid 31964, swap) sleeping on 0xffffffff81a58880 "pfault" chain 53: thread 100629 (pid 31963, swap) sleeping on 0xffffffff81a58880 "pfault" chain 54: thread 100626 (pid 31962, swap) sleeping on 0xffffffff81a58880 "pfault" chain 55: thread 100855 (pid 31961, swap) sleeping on 0xffffffff81a58880 "pfault" chain 56: thread 100670 (pid 31960, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 57: thread 100250 (pid 31959, lockf2) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 58: thread 100669 (pid 31958, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 59: thread 100680 (pid 31957, swap) sleeping on 0xffffffff81a58880 "pfault" chain 60: thread 100668 (pid 31956, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 61: thread 100677 (pid 31955, swap) sleeping on 0xffffffff81a58880 "pfault" chain 62: thread 100240 (pid 31954, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 63: thread 100672 (pid 31953, swap) sleeping on 0xffffffff81a58880 "pfault" chain 64: thread 100748 (pid 31952, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 65: thread 100880 (pid 31951, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 66: thread 100682 (pid 31950, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 67: thread 100837 (pid 31949, swap) sleeping on 0xffffffff81a58880 "pfault" chain 68: thread 100747 (pid 31948, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 69: thread 100503 (pid 31947, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 70: thread 100303 (pid 31946, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 71: thread 100836 (pid 31945, swap) sleeping on 0xffffffff81a58880 "pfault" chain 72: thread 100528 (pid 31944, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 73: thread 100307 (pid 31943, rw) blocked on lockmgr bufwaitEXCL thread 100303 (pid 31946, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 74: thread 100835 (pid 31942, swap) sleeping on 0xffffffff81a58880 "pfault" chain 75: thread 100266 (pid 31941, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 76: thread 100591 (pid 31940, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 77: thread 100225 (pid 31938, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 78: thread 100567 (pid 31937, swap) sleeping on 0xffffffff81a58880 "pfault" chain 79: thread 100749 (pid 31936, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 80: thread 100599 (pid 31935, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 81: thread 100896 (pid 31934, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 82: thread 100566 (pid 31933, swap) sleeping on 0xffffffff81a58880 "pfault" chain 83: thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 84: thread 100681 (pid 31930, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 85: thread 100304 (pid 31929, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 86: thread 100611 (pid 31928, swap) sleeping on 0xffffffff81a58880 "pfault" chain 87: thread 100833 (pid 31926, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 88: thread 100218 (pid 31925, rw) blocked on lockmgr bufwaitEXCL thread 100303 (pid 31946, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 89: thread 100299 (pid 31924, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 90: thread 100726 (pid 31923, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 91: thread 100826 (pid 31922, swap) sleeping on 0xffffffff81a58880 "pfault" chain 92: thread 100661 (pid 31921, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 93: thread 100579 (pid 31920, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 94: thread 100678 (pid 31919, link) sleeping on 0xffffffff81a58880 "vmwait" chain 95: thread 100928 (pid 31918, swap) sleeping on 0xffffffff81a58880 "pfault" chain 96: thread 100594 (pid 31917, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 97: thread 100713 (pid 31916, rename) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 98: thread 100651 (pid 31915, creat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 99: thread 100265 (pid 31914, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 100: thread 100525 (pid 31913, swap) sleeping on 0xffffffff81a58880 "pfault" chain 101: thread 100588 (pid 31912, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 102: thread 100711 (pid 31911, rename) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 103: thread 100521 (pid 31910, swap) sleeping on 0xffffffff81a58880 "pfault" chain 104: thread 100795 (pid 31909, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 105: thread 100761 (pid 31908, creat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 106: thread 100657 (pid 31907, link) sleeping on 0xffffffff81a58880 "vmwait" chain 107: thread 100743 (pid 31906, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 108: thread 100825 (pid 31905, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 109: thread 100730 (pid 31904, rename) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 110: thread 100642 (pid 31903, link) sleeping on 0xffffffff81a58880 "vmwait" chain 111: thread 100759 (pid 31902, creat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 112: thread 100658 (pid 31901, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 113: thread 100705 (pid 31900, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 114: thread 100801 (pid 31898, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 115: thread 100628 (pid 31896, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 116: thread 100920 (pid 31895, creat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 117: thread 100607 (pid 31894, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 118: thread 100906 (pid 31893, mkdir) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 119: thread 100946 (pid 31892, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 120: thread 100917 (pid 31891, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 121: thread 100818 (pid 31890, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 122: thread 100587 (pid 31889, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 123: thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 124: thread 100960 (pid 31887, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 125: thread 100800 (pid 31886, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 126: thread 100912 (pid 31885, creat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 127: thread 100557 (pid 31884, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 128: thread 100821 (pid 31882, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 129: thread 100255 (pid 31881, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 130: thread 100674 (pid 31880, rw) blocked on lockmgr bufwaitEXCL thread 100682 (pid 31950, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 131: thread 100815 (pid 31878, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 132: thread 100254 (pid 31876, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 133: thread 100235 (pid 31875, link) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 134: thread 100882 (pid 31874, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 135: thread 100679 (pid 31872, rw) blocked on lockmgr bufwaitEXCL thread 100303 (pid 31946, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 136: thread 100608 (pid 31871, lockf2) blocked on lockmgr ufsEXCL thread 100684 (pid 31888, mkdir) sleeping on 0xffffffff81a58880 "vmwait" chain 137: thread 100595 (pid 31869, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 138: thread 100647 (pid 31867, rw) blocked on lockmgr bufwaitEXCL thread 100303 (pid 31946, rw) sleeping on 0xffffffff81a58880 "vmwait" chain 139: thread 100604 (pid 31866, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 140: thread 100630 (pid 31865, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 141: thread 100592 (pid 31863, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 142: thread 100602 (pid 31862, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 143: thread 100891 (pid 31861, openat) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 144: thread 100916 (pid 31860, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 145: thread 100256 (pid 31859, lockf2) sleeping on 0xffffffff81a58880 "vmwait" chain 146: thread 100538 (pid 1739, sshd) sleeping on 0xffffffff81a58880 "pfault" chain 147: thread 100259 (pid 1695, inetd) sleeping on 0xfffff8001acf1ec0 "select" chain 148: thread 100516 (pid 1575, sshd) sleeping on 0xfffff8001aa78940 "select" chain 149: thread 100271 (pid 1411, watchdogd) sleeping on 0xffffffff81e05173 "nanslp" chain 150: thread 100294 (pid 1403, syslogd) sleeping on 0xffffffff81a58880 "vmwait" chain 151: thread 100209 (pid 44, syncer) sleeping on 0xffffffff81a58880 "vmwait" chain 152: thread 100208 (pid 43, vnlru) sleeping on 0xfffff8001a0e7000 "vlruwt" chain 153: thread 100205 (pid 42, bufdaemon) sleeping on 0xffffffff81fa6a30 "qsleep" chain 154: thread 100210 (pid 42, bufspacedaemon-0) sleeping on 0xffffffff81a1b1c0 "-" chain 155: thread 100211 (pid 42, bufspacedaemon-1) sleeping on 0xffffffff81a23480 "-" chain 156: thread 100212 (pid 42, bufspacedaemon-2) sleeping on 0xffffffff81a2b740 "-" chain 157: thread 100213 (pid 42, bufspacedaemon-3) sleeping on 0xffffffff81a33a00 "-" chain 158: thread 100214 (pid 42, bufspacedaemon-4) sleeping on 0xffffffff81a3bcc0 "-" chain 159: thread 100215 (pid 42, bufspacedaemon-5) sleeping on 0xffffffff81a43f80 "-" chain 160: thread 100216 (pid 42, bufspacedaemon-6) sleeping on 0xffffffff81a4c240 "-" chain 161: thread 100229 (pid 42, / worker) sleeping on 0xfffff8001afd44e8 "sdflush" chain 162: thread 100237 (pid 42, /tmp worker) blocked on lockmgr bufwaitEXCL thread 100754 (pid 31932, link) sleeping on 0xffffffff81a58880 "vmwait" chain 163: thread 100204 (pid 41, vmdaemon) sleeping on 0xffffffff81fb3300 "psleep" chain 164: thread 100203 (pid 40, dom0) sleeping on 0xffffffff81e03f17 "pwait" chain 165: thread 100206 (pid 40, laundry: dom0) sleeping on 0xfffff80fdba54c38 "grbmaw" chain 166: thread 100207 (pid 40, uma) sleeping on 0xffffffff80e686c0 "umarcl" chain 167: thread 100202 (pid 39, enc_daemon0) sleeping on 0xfffff80017fdd538 "idle" chain 168: thread 100199 (pid 38, rand_harvestq) sleeping on 0xffffffff81cd80a8 "-" chain 169: thread 100195 (pid 37, sctp_iterator) sleeping on 0xffffffff82021000 "waiting_for_work" chain 170: thread 100194 (pid 36, soaiod4) sleeping on 0xffffffff81fa642c "-" chain 171: thread 100193 (pid 35, soaiod3) sleeping on 0xffffffff81fa642c "-" chain 172: thread 100192 (pid 34, soaiod2) sleeping on 0xffffffff81fa642c "-" chain 173: thread 100191 (pid 33, soaiod1) sleeping on 0xffffffff81fa642c "-" chain 174: thread 100169 (pid 32, usbus0) sleeping on 0xfffffe00bc428d10 "-" chain 175: thread 100170 (pid 32, usbus0) sleeping on 0xfffffe00bc428d68 "-" chain 176: thread 100171 (pid 32, usbus0) sleeping on 0xfffffe00bc428dc0 "-" chain 177: thread 100172 (pid 32, usbus0) sleeping on 0xfffffe00bc428e18 "-" chain 178: thread 100173 (pid 32, usbus0) sleeping on 0xfffffe00bc428e70 "-" chain 179: thread 100176 (pid 32, usbus1) sleeping on 0xfffffe00bcb84460 "-" chain 180: thread 100177 (pid 32, usbus1) sleeping on 0xfffffe00bcb844b8 "-" chain 181: thread 100178 (pid 32, usbus1) sleeping on 0xfffffe00bcb84510 "-" chain 182: thread 100179 (pid 32, usbus1) sleeping on 0xfffffe00bcb84568 "-" chain 183: thread 100180 (pid 32, usbus1) sleeping on 0xfffffe00bcb845c0 "-" chain 184: thread 100182 (pid 32, usbus2) sleeping on 0xfffffe00bc84fd10 "-" chain 185: thread 100183 (pid 32, usbus2) sleeping on 0xfffffe00bc84fd68 "-" chain 186: thread 100184 (pid 32, usbus2) sleeping on 0xfffffe00bc84fdc0 "-" chain 187: thread 100185 (pid 32, usbus2) sleeping on 0xfffffe00bc84fe18 "-" chain 188: thread 100186 (pid 32, usbus2) sleeping on 0xfffffe00bc84fe70 "-" chain 189: thread 100161 (pid 31, doneq0) sleeping on 0xffffffff81bb32c0 "-" chain 190: thread 100162 (pid 31, doneq1) sleeping on 0xffffffff81bb3340 "-" chain 191: thread 100163 (pid 31, doneq2) sleeping on 0xffffffff81bb33c0 "-" chain 192: thread 100164 (pid 31, doneq3) sleeping on 0xffffffff81bb3440 "-" chain 193: thread 100165 (pid 31, doneq4) sleeping on 0xffffffff81bb34c0 "-" chain 194: thread 100201 (pid 31, scanner) sleeping on 0xffffffff81bb3188 "-" chain 195: thread 100160 (pid 30, crypto returns 23) sleeping on 0xfffff80003a8e8d0 "crypto_ret_wait" chain 196: thread 100159 (pid 29, crypto returns 22) sleeping on 0xfffff80003a8e870 "crypto_ret_wait" chain 197: thread 100158 (pid 28, crypto returns 21) sleeping on 0xfffff80003a8e810 "crypto_ret_wait" chain 198: thread 100157 (pid 27, crypto returns 20) sleeping on 0xfffff80003a8e7b0 "crypto_ret_wait" chain 199: thread 100156 (pid 26, crypto returns 19) sleeping on 0xfffff80003a8e750 "crypto_ret_wait" chain 200: thread 100155 (pid 25, crypto returns 18) sleeping on 0xfffff80003a8e6f0 "crypto_ret_wait" chain 201: thread 100154 (pid 24, crypto returns 17) sleeping on 0xfffff80003a8e690 "crypto_ret_wait" chain 202: thread 100153 (pid 23, crypto returns 16) sleeping on 0xfffff80003a8e630 "crypto_ret_wait" chain 203: thread 100152 (pid 22, crypto returns 15) sleeping on 0xfffff80003a8e5d0 "crypto_ret_wait" chain 204: thread 100151 (pid 21, crypto returns 14) sleeping on 0xfffff80003a8e570 "crypto_ret_wait" chain 205: thread 100150 (pid 20, crypto returns 13) sleeping on 0xfffff80003a8e510 "crypto_ret_wait" chain 206: thread 100149 (pid 19, crypto returns 12) sleeping on 0xfffff80003a8e4b0 "crypto_ret_wait" chain 207: thread 100148 (pid 18, crypto returns 11) sleeping on 0xfffff80003a8e450 "crypto_ret_wait" chain 208: thread 100147 (pid 17, crypto returns 10) sleeping on 0xfffff80003a8e3f0 "crypto_ret_wait" chain 209: thread 100146 (pid 16, crypto returns 9) sleeping on 0xfffff80003a8e390 "crypto_ret_wait" chain 210: thread 100145 (pid 15, crypto returns 8) sleeping on 0xfffff80003a8e330 "crypto_ret_wait" chain 211: thread 100144 (pid 14, crypto returns 7) sleeping on 0xfffff80003a8e2d0 "crypto_ret_wait" chain 212: thread 100143 (pid 9, crypto returns 6) sleeping on 0xfffff80003a8e270 "crypto_ret_wait" chain 213: thread 100142 (pid 8, crypto returns 5) sleeping on 0xfffff80003a8e210 "crypto_ret_wait" chain 214: thread 100141 (pid 7, crypto returns 4) sleeping on 0xfffff80003a8e1b0 "crypto_ret_wait" chain 215: thread 100140 (pid 6, crypto returns 3) sleeping on 0xfffff80003a8e150 "crypto_ret_wait" chain 216: thread 100139 (pid 5, crypto returns 2) sleeping on 0xfffff80003a8e0f0 "crypto_ret_wait" chain 217: thread 100138 (pid 4, crypto returns 1) sleeping on 0xfffff80003a8e090 "crypto_ret_wait" chain 218: thread 100137 (pid 3, crypto returns 0) sleeping on 0xfffff80003a8e030 "crypto_ret_wait" chain 219: thread 100136 (pid 2, crypto) sleeping on 0xffffffff81fad8e8 "crypto_wait" chain 220: thread 100108 (pid 13, g_event) sleeping on 0xffffffff81ffda50 "-" chain 221: thread 100109 (pid 13, g_up) sleeping on 0xffffffff81ffda58 "-" chain 222: thread 100110 (pid 13, g_down) sleeping on 0xffffffff81ffda60 "-" chain 223: thread 100002 (pid 1, init) sleeping on 0xfffff80003758538 "wait" chain 224: thread 100001 (pid 10, audit) sleeping on 0xffffffff82021ce8 "audit_worker_cv" chain 225: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81a58880 "vmwait" chain 226: thread 100029 (pid 0, thread taskq) sleeping on 0xfffff8000379fd00 "-" chain 227: thread 100031 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000379fb00 "-" chain 228: thread 100032 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000379fa00 "-" chain 229: thread 100033 (pid 0, softirq_0) sleeping on 0xfffff8000371fd00 "-" chain 230: thread 100034 (pid 0, softirq_1) sleeping on 0xfffff8000371fc00 "-" chain 231: thread 100035 (pid 0, softirq_2) sleeping on 0xfffff8000371fb00 "-" chain 232: thread 100036 (pid 0, softirq_3) sleeping on 0xfffff8000371fa00 "-" chain 233: thread 100037 (pid 0, softirq_4) sleeping on 0xfffff8000371f900 "-" chain 234: thread 100038 (pid 0, softirq_5) sleeping on 0xfffff8000371f800 "-" chain 235: thread 100039 (pid 0, softirq_6) sleeping on 0xfffff8000371f700 "-" chain 236: thread 100040 (pid 0, softirq_7) sleeping on 0xfffff8000371f600 "-" chain 237: thread 100041 (pid 0, softirq_8) sleeping on 0xfffff8000371f500 "-" chain 238: thread 100042 (pid 0, softirq_9) sleeping on 0xfffff8000371f400 "-" chain 239: thread 100043 (pid 0, softirq_10) sleeping on 0xfffff8000371f300 "-" chain 240: thread 100044 (pid 0, softirq_11) sleeping on 0xfffff8000371f200 "-" chain 241: thread 100045 (pid 0, softirq_12) sleeping on 0xfffff8000371f100 "-" chain 242: thread 100046 (pid 0, softirq_13) sleeping on 0xfffff8000371f000 "-" chain 243: thread 100047 (pid 0, softirq_14) sleeping on 0xfffff8000371ee00 "-" chain 244: thread 100048 (pid 0, softirq_15) sleeping on 0xfffff8000371ed00 "-" chain 245: thread 100049 (pid 0, softirq_16) sleeping on 0xfffff8000371ec00 "-" chain 246: thread 100050 (pid 0, softirq_17) sleeping on 0xfffff8000371eb00 "-" chain 247: thread 100051 (pid 0, softirq_18) sleeping on 0xfffff8000371ea00 "-" chain 248: thread 100052 (pid 0, softirq_19) sleeping on 0xfffff8000371e900 "-" chain 249: thread 100053 (pid 0, softirq_20) sleeping on 0xfffff8000371e800 "-" chain 250: thread 100054 (pid 0, softirq_21) sleeping on 0xfffff8000371e700 "-" chain 251: thread 100055 (pid 0, softirq_22) sleeping on 0xfffff8000371e600 "-" chain 252: thread 100056 (pid 0, softirq_23) sleeping on 0xfffff8000371e500 "-" chain 253: thread 100057 (pid 0, if_config_tqg_0) sleeping on 0xfffff8000371e400 "-" chain 254: thread 100058 (pid 0, if_io_tqg_0) sleeping on 0xfffff8000390f100 "-" chain 255: thread 100059 (pid 0, if_io_tqg_1) sleeping on 0xfffff8000390f000 "-" chain 256: thread 100060 (pid 0, if_io_tqg_2) sleeping on 0xfffff8000390ee00 "-" chain 257: thread 100061 (pid 0, if_io_tqg_3) sleeping on 0xfffff8000390ed00 "-" chain 258: thread 100062 (pid 0, if_io_tqg_4) sleeping on 0xfffff8000390ec00 "-" chain 259: thread 100063 (pid 0, if_io_tqg_5) sleeping on 0xfffff8000390eb00 "-" chain 260: thread 100064 (pid 0, if_io_tqg_6) sleeping on 0xfffff8000390ea00 "-" chain 261: thread 100065 (pid 0, if_io_tqg_7) sleeping on 0xfffff8000390e900 "-" chain 262: thread 100066 (pid 0, if_io_tqg_8) sleeping on 0xfffff8000390e800 "-" chain 263: thread 100067 (pid 0, if_io_tqg_9) sleeping on 0xfffff8000390e700 "-" chain 264: thread 100068 (pid 0, if_io_tqg_10) sleeping on 0xfffff8000390e600 "-" chain 265: thread 100069 (pid 0, if_io_tqg_11) sleeping on 0xfffff8000390e500 "-" chain 266: thread 100070 (pid 0, if_io_tqg_12) sleeping on 0xfffff8000390e400 "-" chain 267: thread 100071 (pid 0, if_io_tqg_13) sleeping on 0xfffff8000390e300 "-" chain 268: thread 100072 (pid 0, if_io_tqg_14) sleeping on 0xfffff8000390e200 "-" chain 269: thread 100073 (pid 0, if_io_tqg_15) sleeping on 0xfffff8000390e100 "-" chain 270: thread 100074 (pid 0, if_io_tqg_16) sleeping on 0xfffff8000390e000 "-" chain 271: thread 100075 (pid 0, if_io_tqg_17) sleeping on 0xfffff8000390de00 "-" chain 272: thread 100076 (pid 0, if_io_tqg_18) sleeping on 0xfffff8000390dd00 "-" chain 273: thread 100077 (pid 0, if_io_tqg_19) sleeping on 0xfffff8000390dc00 "-" chain 274: thread 100078 (pid 0, if_io_tqg_20) sleeping on 0xfffff8000390db00 "-" chain 275: thread 100079 (pid 0, if_io_tqg_21) sleeping on 0xfffff8000390da00 "-" chain 276: thread 100080 (pid 0, if_io_tqg_22) sleeping on 0xfffff8000390d900 "-" chain 277: thread 100081 (pid 0, if_io_tqg_23) sleeping on 0xfffff8000390d800 "-" chain 278: thread 100111 (pid 0, firmware taskq) sleeping on 0xfffff800039d0100 "-" chain 279: thread 100112 (pid 0, crypto_0) sleeping on 0xfffff800039cee00 "-" chain 280: thread 100113 (pid 0, crypto_1) sleeping on 0xfffff800039cee00 "-" chain 281: thread 100114 (pid 0, crypto_2) sleeping on 0xfffff800039cee00 "-" chain 282: thread 100115 (pid 0, crypto_3) sleeping on 0xfffff800039cee00 "-" chain 283: thread 100116 (pid 0, crypto_4) sleeping on 0xfffff800039cee00 "-" chain 284: thread 100117 (pid 0, crypto_5) sleeping on 0xfffff800039cee00 "-" chain 285: thread 100118 (pid 0, crypto_6) sleeping on 0xfffff800039cee00 "-" chain 286: thread 100119 (pid 0, crypto_7) sleeping on 0xfffff800039cee00 "-" chain 287: thread 100120 (pid 0, crypto_8) sleeping on 0xfffff800039cee00 "-" chain 288: thread 100121 (pid 0, crypto_9) sleeping on 0xfffff800039cee00 "-" chain 289: thread 100122 (pid 0, crypto_10) sleeping on 0xfffff800039cee00 "-" chain 290: thread 100123 (pid 0, crypto_11) sleeping on 0xfffff800039cee00 "-" chain 291: thread 100124 (pid 0, crypto_12) sleeping on 0xfffff800039cee00 "-" chain 292: thread 100125 (pid 0, crypto_13) sleeping on 0xfffff800039cee00 "-" chain 293: thread 100126 (pid 0, crypto_14) sleeping on 0xfffff800039cee00 "-" chain 294: thread 100127 (pid 0, crypto_15) sleeping on 0xfffff800039cee00 "-" chain 295: thread 100128 (pid 0, crypto_16) sleeping on 0xfffff800039cee00 "-" chain 296: thread 100129 (pid 0, crypto_17) sleeping on 0xfffff800039cee00 "-" chain 297: thread 100130 (pid 0, crypto_18) sleeping on 0xfffff800039cee00 "-" chain 298: thread 100131 (pid 0, crypto_19) sleeping on 0xfffff800039cee00 "-" chain 299: thread 100132 (pid 0, crypto_20) sleeping on 0xfffff800039cee00 "-" chain 300: thread 100133 (pid 0, crypto_21) sleeping on 0xfffff800039cee00 "-" chain 301: thread 100134 (pid 0, crypto_22) sleeping on 0xfffff800039cee00 "-" chain 302: thread 100135 (pid 0, crypto_23) sleeping on 0xfffff800039cee00 "-" chain 303: thread 100190 (pid 0, mca taskq) sleeping on 0xfffff80017020800 "-" chain 304: thread 100196 (pid 0, acpi_task_0) sleeping on 0xfffff8001a11da00 "-" chain 305: thread 100197 (pid 0, acpi_task_1) sleeping on 0xfffff8001a11da00 "-" chain 306: thread 100198 (pid 0, acpi_task_2) sleeping on 0xfffff8001a11da00 "-" chain 307: thread 100200 (pid 0, CAM taskq) sleeping on 0xfffff800039ceb00 "-" db:1:pho1> show mount 0xfffff8001a9ec000 /dev/gpt/root on / (ufs) 0xfffff8001a95a000 devfs on /dev (devfs) 0xfffff8002717b000 /dev/gpt/tmp on /tmp (ufs) 0xfffff800271d1000 procfs on /proc (procfs) 0xfffff802067f5000 /tmp/stressX on /mnt (nullfs) More info: show mount db:1:pho1> show bufqueues bqempty: 12404 Buf domain 0 freebufs 14871 lofreebufs 438 hifreebufs 658 bufspace 8171520 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 26 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 147 (4517888) dirtyq count 26 (737280) wakeup 0 lim 12 CPU 8, 7, 6, 0, 7, 1, 3, 2, 6, 3, 3, 3, 8, 1, 1, 1, 5, 9, 0, 1, 0, 6, 6, 2, Locked buffers: 4 space 122880 Total buffers: 7548 space 8171520 Buf domain 1 freebufs 7939 lofreebufs 438 hifreebufs 658 bufspace 235446272 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 16 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7056 (231038976) dirtyq count 16 (434176) wakeup 0 lim 12 CPU 4, 9, 5, 8, 1, 5, 6, 2, 5, 11, 1, 6, 1, 5, 5, 10, 6, 10, 8, 6, 3, 4, 0, 0, Locked buffers: 4 space 98304 Total buffers: 14500 space 235413504 Buf domain 2 freebufs 7942 lofreebufs 438 hifreebufs 658 bufspace 235421696 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 256 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 6751 (221216768) dirtyq count 256 (8278016) wakeup 0 lim 12 CPU 9, 8, 10, 6, 10, 7, 1, 2, 3, 8, 2, 4, 4, 10, 2, 5, 3, 6, 4, 5, 6, 0, 9, 8, Locked buffers: 59 space 1769472 Total buffers: 19798 space 235286528 Buf domain 3 freebufs 7937 lofreebufs 438 hifreebufs 658 bufspace 235433984 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 33 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7023 (230043648) dirtyq count 33 (843776) wakeup 0 lim 12 CPU 2, 9, 5, 9, 5, 6, 2, 4, 6, 11, 10, 6, 11, 3, 4, 3, 4, 8, 4, 2, 4, 5, 8, 6, Locked buffers: 9 space 159744 Total buffers: 15685 space 235335680 Buf domain 4 freebufs 12401 lofreebufs 438 hifreebufs 658 bufspace 89157632 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 10 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 2582 (84406272) dirtyq count 10 (212992) wakeup 0 lim 12 CPU 0, 7, 11, 2, 2, 11, 7, 4, 11, 10, 7, 9, 6, 6, 2, 7, 8, 2, 2, 2, 3, 6, 6, 9, Locked buffers: 3 space 98304 Total buffers: 10021 space 89157632 Buf domain 5 freebufs 7934 lofreebufs 438 hifreebufs 658 bufspace 235450368 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 20 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7054 (230830080) dirtyq count 20 (544768) wakeup 0 lim 12 CPU 3, 0, 4, 7, 10, 2, 0, 6, 7, 8, 4, 3, 4, 11, 5, 2, 5, 7, 3, 9, 3, 7, 1, 11, Locked buffers: 9 space 172032 Total buffers: 20406 space 235352064 Buf domain 6 freebufs 7936 lofreebufs 438 hifreebufs 658 bufspace 235425792 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 48 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 7036 (230412288) dirtyq count 48 (1310720) wakeup 0 lim 12 CPU 0, 1, 0, 3, 10, 5, 1, 6, 0, 7, 7, 8, 1, 5, 9, 0, 5, 11, 4, 0, 9, 7, 6, 6, Locked buffers: 9 space 192512 Total buffers: 17973 space 235360256 db:1:pho1> show page vm_cnt.v_free_count: 70158 vm_cnt.v_inactive_count: 801 vm_cnt.v_active_count: 7266554 vm_cnt.v_laundry_count: 8491009 vm_cnt.v_wire_count: 495061 vm_cnt.v_free_reserved: 21321 vm_cnt.v_free_min: 102940 vm_cnt.v_free_target: 347797 vm_cnt.v_inactive_target: 521695 db:1:pho1> show pageq pq_free 70158 dom 0 page_cnt 16324089 free 70158 pq_act 7266554 pq_inact 801 pq_laund 8491009 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000002 | 000000 07 (000512K) | 000003 | 000000 06 (000256K) | 000021 | 000000 05 (000128K) | 000092 | 000000 04 (000064K) | 000531 | 000072 03 (000032K) | 000939 | 000412 02 (000016K) | 001464 | 001440 01 (000008K) | 000294 | 007385 00 (000004K) | 000105 | 016413 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000000 | 000000 05 (000128K) | 000000 | 000000 04 (000064K) | 000000 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000000 | 000001 01 (000008K) | 000000 | 000001 00 (000004K) | 000000 | 000000 db:0:pho> acttrace Tracing command idle pid 11 tid 100003 td 0xfffff8000375c000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fb7630 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fb7650 trap() at trap+0x49/frame 0xffffffff81fb7760 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fb7760 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007895a900, rbp = 0xfffffe007895a910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000375b560 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b8e10 trap() at trap+0x49/frame 0xfffffe00071b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b8f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007895f900, rbp = 0xfffffe007895f910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007895f910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007895f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895f980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000375b000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c3e10 trap() at trap+0x49/frame 0xfffffe00071c3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c3f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078964900, rbp = 0xfffffe0078964910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078964910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078964960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078964980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000375a560 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071cedf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071cee10 trap() at trap+0x49/frame 0xfffffe00071cef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071cef20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078969900, rbp = 0xfffffe0078969910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000375a000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d9e10 trap() at trap+0x49/frame 0xfffffe00071d9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d9f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007896e900, rbp = 0xfffffe007896e910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007896e910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007896e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007896e980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003759560 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e4e10 trap() at trap+0x49/frame 0xfffffe00071e4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e4f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078973900, rbp = 0xfffffe0078973910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078973910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078973960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078973980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003759000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071efdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071efe10 trap() at trap+0x49/frame 0xfffffe00071eff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071eff20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078978900, rbp = 0xfffffe0078978910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078978910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078978960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078978980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003770560 (CPU 7) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003770000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cffe10 trap() at trap+0x49/frame 0xfffffe0000cfff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cfff20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078982900, rbp = 0xfffffe0078982910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078982910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078982960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078982980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000376f560 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d0adf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d0ae10 trap() at trap+0x49/frame 0xfffffe0000d0af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d0af20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078987900, rbp = 0xfffffe0078987910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078987910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078987960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078987980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000376f000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d15df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d15e10 trap() at trap+0x49/frame 0xfffffe0000d15f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d15f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007898c900, rbp = 0xfffffe007898c910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000376e560 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d20df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d20e10 trap() at trap+0x49/frame 0xfffffe0000d20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d20f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078991900, rbp = 0xfffffe0078991910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078991910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078991960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078991980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000376e000 (CPU 12) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d2bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d2be10 trap() at trap+0x49/frame 0xfffffe0000d2bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d2bf20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078996900, rbp = 0xfffffe0078996910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078996910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078996960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078996980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789969a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078996a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078996ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078996ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000376d560 (CPU 13) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d36df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d36e10 trap() at trap+0x49/frame 0xfffffe0000d36f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d36f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007899b900, rbp = 0xfffffe007899b910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007899b910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007899b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007899b980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007899b9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000376d000 (CPU 14) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d41df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d41e10 trap() at trap+0x49/frame 0xfffffe0000d41f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d41f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789a0900, rbp = 0xfffffe00789a0910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789a0910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789a0960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789a0980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789a09a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000375d560 (CPU 15) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d4cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d4ce10 trap() at trap+0x49/frame 0xfffffe0000d4cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d4cf20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789a5900, rbp = 0xfffffe00789a5910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789a5910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789a5960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789a5980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789a59a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff80003775000 (CPU 16) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d57df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d57e10 trap() at trap+0x49/frame 0xfffffe0000d57f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d57f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789aa900, rbp = 0xfffffe00789aa910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789aa910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789aa960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789aa980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789aa9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff80003774560 (CPU 17) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d62df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d62e10 trap() at trap+0x49/frame 0xfffffe0000d62f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d62f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789af900, rbp = 0xfffffe00789af910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789af910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789af960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789af980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789af9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff80003774000 (CPU 18) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d6ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d6de10 trap() at trap+0x49/frame 0xfffffe0000d6df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d6df20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789b4900, rbp = 0xfffffe00789b4910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789b4910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789b4960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789b4980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789b49a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff80003773560 (CPU 19) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d78df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d78e10 trap() at trap+0x49/frame 0xfffffe0000d78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d78f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789b9900, rbp = 0xfffffe00789b9910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789b9910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789b9960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789b9980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789b99a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff80003773000 (CPU 20) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d83df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d83e10 trap() at trap+0x49/frame 0xfffffe0000d83f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d83f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789be900, rbp = 0xfffffe00789be910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789be910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789be960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789be980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789be9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff80003772560 (CPU 21) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d8edf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d8ee10 trap() at trap+0x49/frame 0xfffffe0000d8ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d8ef20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789c3900, rbp = 0xfffffe00789c3910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789c3910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789c3960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789c3980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789c39a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff80003772000 (CPU 22) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d99df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d99e10 trap() at trap+0x49/frame 0xfffffe0000d99f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d99f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789c8900, rbp = 0xfffffe00789c8910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789c8910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789c8960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789c8980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789c89a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff80003771560 (CPU 23) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000da4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000da4e10 trap() at trap+0x49/frame 0xfffffe0000da4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000da4f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789cd900, rbp = 0xfffffe00789cd910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789cd910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789cd960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789cd980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789cd9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 34887 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34885 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34883 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34881 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34879 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34877 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34875 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34873 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34871 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34869 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34867 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34865 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34863 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34861 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34859 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34857 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34855 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34853 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34851 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34849 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34847 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34845 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34843 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34841 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34839 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34837 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34835 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34833 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34831 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34829 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34827 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34825 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34821 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34819 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34817 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34815 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34813 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34811 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34809 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34807 1 1 0 ?W init 34802 1 1 0 ?W init 34797 1 1 0 ?W init 34792 1 1 0 ?W init 34789 1 1411 0 D ufs 0xfffff801388d2cc0 ls 34785 1 1 0 ?W init 34780 1 1 0 ?W init 34775 1 1 0 ?W init 34770 1 1 0 ?W init 34765 1 1 0 ?W init 34760 1 1411 0 D pfault 0xffffffff81a58880 ls 34759 1585 1585 0 DW pfault 0xffffffff81a58880 cron 34757 34755 1740 1001 DW pfault 0xffffffff81a58880 sed 34755 1 1740 1001 ?W sh 32004 31992 3241 0 D+ ufs 0xfffff801388d2cc0 fts 32002 31992 3241 0 DW+ pfault 0xffffffff81a58880 fts 32000 31992 3241 0 D+ ufs 0xfffff801388d2cc0 fts 31998 31992 3241 0 DW+ pfault 0xffffffff81a58880 fts 31996 31992 3241 0 D+ ufs 0xfffff801388d2cc0 fts 31994 31992 3241 0 D+ ufs 0xfffff801388d2cc0 fts 31992 31848 3241 0 ?W+ fts 31967 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31965 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31964 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31963 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31962 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31961 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31960 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31959 31857 3241 0 D+ ufs 0xfffff801388d2cc0 lockf2 31958 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31957 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31956 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31955 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31954 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31953 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31952 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31951 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31950 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31949 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31948 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31947 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31946 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31945 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31944 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31943 31864 3241 0 D+ getblk 0xfffffe000215a250 rw 31942 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31941 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31940 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31938 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31937 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31936 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31935 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31934 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31933 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31932 31868 3241 0 D+ vmwait 0xffffffff81a58880 link 31930 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31929 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31928 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31926 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31925 31864 3241 0 D+ getblk 0xfffffe000215a250 rw 31924 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31923 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31922 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31921 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31920 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31919 31868 3241 0 D+ vmwait 0xffffffff81a58880 link 31918 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31917 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31916 31899 3241 0 D+ ufs 0xfffff801388d2cc0 rename 31915 31879 3241 0 D+ getblk 0xfffffe0004adf508 creat 31914 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31913 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31912 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31911 31899 3241 0 D+ ufs 0xfffff801388d2cc0 rename 31910 31897 3241 0 DW+ pfault 0xffffffff81a58880 swap 31909 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31908 31879 3241 0 D+ getblk 0xfffffe0004adf508 creat 31907 31868 3241 0 D+ vmwait 0xffffffff81a58880 link 31906 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31905 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31904 31899 3241 0 D+ ufs 0xfffff801388d2cc0 rename 31903 31868 3241 0 D+ vmwait 0xffffffff81a58880 link 31902 31879 3241 0 D+ getblk 0xfffffe0004adf508 creat 31901 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31900 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31899 31854 3241 0 ?W+ rename 31898 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31897 31855 3241 0 ?W+ swap 31896 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31895 31879 3241 0 D+ getblk 0xfffffe0004adf508 creat 31894 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31893 31883 3241 0 D+ ufs 0xfffff801388d2cc0 mkdir 31892 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31891 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31890 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31889 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31888 31883 3241 0 D+ vmwait 0xffffffff81a58880 mkdir 31887 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31886 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31885 31879 3241 0 D+ getblk 0xfffffe0004adf508 creat 31884 31864 3241 0 D+ vmwait 0xffffffff81a58880 rw 31883 31853 3241 0 ?W+ mkdir 31882 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31881 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31880 31864 3241 0 D+ getblk 0xfffffe00036b8c30 rw 31879 31852 3241 0 ?W+ creat 31878 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31876 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31875 31868 3241 0 D+ getblk 0xfffffe0004adf508 link 31874 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31872 31864 3241 0 D+ getblk 0xfffffe000215a250 rw 31871 31857 3241 0 D+ ufs 0xfffff801388d2cc0 lockf2 31869 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31868 31850 3241 0 ?W+ link 31867 31864 3241 0 D+ getblk 0xfffffe000215a250 rw 31866 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31865 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31864 31846 3241 0 ?W+ rw 31863 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31862 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31861 31858 3241 0 D+ getblk 0xfffffe0004adf508 openat 31860 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31859 31857 3241 0 D+ vmwait 0xffffffff81a58880 lockf2 31858 31844 3241 0 ?W+ openat 31857 31842 3241 0 ?W+ lockf2 31855 28482 3241 0 ?W+ swap 31854 28482 3241 0 ?W+ rename 31853 28482 3241 0 ?W+ mkdir 31852 28482 3241 0 ?W+ creat 31850 28482 3241 0 ?W+ link 31848 28482 3241 0 ?W+ fts 31846 28482 3241 0 ?W+ rw 31844 28482 3241 0 ?W+ openat 31842 28482 3241 0 ?W+ lockf2 28482 28481 3241 0 ?W+ run 28481 1 3241 0 ?W+ run 28462 28038 3241 0 ?W+ sh 28038 28036 3241 0 ?W+ sh 28036 6340 3241 0 ?W+ sh 6340 3241 3241 0 ?W+ sh 3241 3230 3241 0 ?W+ bash 3230 3228 3230 0 ?W+ bash 3228 3227 3228 0 ?W+ csh 3227 3220 3227 1001 ?W+ su 3220 1 3220 1001 ?Ws+ bash 1745 1740 1740 1001 ?W sh 1740 1 1740 1001 ?Ws sh 1739 1 1732 1001 DW pfault 0xffffffff81a58880 sshd 1695 1 1695 0 Ss select 0xfffff8001acf1ec0 inetd 1660 1 1660 0 ?Ws nfscbd 1585 1 1585 0 ?Ws cron 1581 1 1581 25 ?Ws sendmail 1575 1 1575 0 Ss select 0xfffff8001aa78940 sshd 1537 1532 1532 0 ?W saslauthd 1536 1532 1532 0 ?W saslauthd 1534 1532 1532 0 ?W saslauthd 1533 1532 1532 0 ?W saslauthd 1532 1 1532 0 ?Ws saslauthd 1456 1 1456 0 ?Ws nfsuserd 1411 1 1411 0 Ss nanslp 0xffffffff81e05173 watchdogd 1403 1 1403 0 Ds vmwait 0xffffffff81a58880 syslogd 126 1 126 0 ?Ws adjkerntz 44 0 0 0 DL vmwait 0xffffffff81a58880 [syncer] 43 0 0 0 DL vlruwt 0xfffff8001a0e7000 [vnlru] 42 0 0 0 DL (threaded) [bufdaemon] 100205 D qsleep 0xffffffff81fa6a30 [bufdaemon] 100210 D - 0xffffffff81a1b1c0 [bufspacedaemon-0] 100211 D - 0xffffffff81a23480 [bufspacedaemon-1] 100212 D - 0xffffffff81a2b740 [bufspacedaemon-2] 100213 D - 0xffffffff81a33a00 [bufspacedaemon-3] 100214 D - 0xffffffff81a3bcc0 [bufspacedaemon-4] 100215 D - 0xffffffff81a43f80 [bufspacedaemon-5] 100216 D - 0xffffffff81a4c240 [bufspacedaemon-6] 100229 D sdflush 0xfffff8001afd44e8 [/ worker] 100237 D getblk 0xfffffe0004adf508 [/tmp worker] 41 0 0 0 DL psleep 0xffffffff81fb3300 [vmdaemon] 40 0 0 0 DL (threaded) [pagedaemon] 100203 D pwait 0xffffffff81e03f17 [dom0] 100206 D grbmaw 0xfffff80fdba54c38 [laundry: dom0] 100207 D umarcl 0xffffffff80e686c0 [uma] 39 0 0 0 DL idle 0xfffff80017fdd538 [enc_daemon0] 38 0 0 0 DL - 0xffffffff81cd80a8 [rand_harvestq] 37 0 0 0 DL waiting 0xffffffff82021000 [sctp_iterator] 36 0 0 0 DL - 0xffffffff81fa642c [soaiod4] 35 0 0 0 DL - 0xffffffff81fa642c [soaiod3] 34 0 0 0 DL - 0xffffffff81fa642c [soaiod2] 33 0 0 0 DL - 0xffffffff81fa642c [soaiod1] 32 0 0 0 DL (threaded) [usb] 100169 D - 0xfffffe00bc428d10 [usbus0] 100170 D - 0xfffffe00bc428d68 [usbus0] 100171 D - 0xfffffe00bc428dc0 [usbus0] 100172 D - 0xfffffe00bc428e18 [usbus0] 100173 D - 0xfffffe00bc428e70 [usbus0] 100176 D - 0xfffffe00bcb84460 [usbus1] 100177 D - 0xfffffe00bcb844b8 [usbus1] 100178 D - 0xfffffe00bcb84510 [usbus1] 100179 D - 0xfffffe00bcb84568 [usbus1] 100180 D - 0xfffffe00bcb845c0 [usbus1] 100182 D - 0xfffffe00bc84fd10 [usbus2] 100183 D - 0xfffffe00bc84fd68 [usbus2] 100184 D - 0xfffffe00bc84fdc0 [usbus2] 100185 D - 0xfffffe00bc84fe18 [usbus2] 100186 D - 0xfffffe00bc84fe70 [usbus2] 31 0 0 0 DL (threaded) [cam] 100161 D - 0xffffffff81bb32c0 [doneq0] 100162 D - 0xffffffff81bb3340 [doneq1] 100163 D - 0xffffffff81bb33c0 [doneq2] 100164 D - 0xffffffff81bb3440 [doneq3] 100165 D - 0xffffffff81bb34c0 [doneq4] 100201 D - 0xffffffff81bb3188 [scanner] 30 0 0 0 DL crypto_ 0xfffff80003a8e8d0 [crypto returns 23] 29 0 0 0 DL crypto_ 0xfffff80003a8e870 [crypto returns 22] 28 0 0 0 DL crypto_ 0xfffff80003a8e810 [crypto returns 21] 27 0 0 0 DL crypto_ 0xfffff80003a8e7b0 [crypto returns 20] 26 0 0 0 DL crypto_ 0xfffff80003a8e750 [crypto returns 19] 25 0 0 0 DL crypto_ 0xfffff80003a8e6f0 [crypto returns 18] 24 0 0 0 DL crypto_ 0xfffff80003a8e690 [crypto returns 17] 23 0 0 0 DL crypto_ 0xfffff80003a8e630 [crypto returns 16] 22 0 0 0 DL crypto_ 0xfffff80003a8e5d0 [crypto returns 15] 21 0 0 0 DL crypto_ 0xfffff80003a8e570 [crypto returns 14] 20 0 0 0 DL crypto_ 0xfffff80003a8e510 [crypto returns 13] 19 0 0 0 DL crypto_ 0xfffff80003a8e4b0 [crypto returns 12] 18 0 0 0 DL crypto_ 0xfffff80003a8e450 [crypto returns 11] 17 0 0 0 DL crypto_ 0xfffff80003a8e3f0 [crypto returns 10] 16 0 0 0 DL crypto_ 0xfffff80003a8e390 [crypto returns 9] 15 0 0 0 DL crypto_ 0xfffff80003a8e330 [crypto returns 8] 14 0 0 0 DL crypto_ 0xfffff80003a8e2d0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003a8e270 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003a8e210 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003a8e1b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003a8e150 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003a8e0f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003a8e090 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003a8e030 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81fad8e8 [crypto] 13 0 0 0 DL (threaded) [geom] 100108 D - 0xffffffff81ffda50 [g_event] 100109 D - 0xffffffff81ffda58 [g_up] 100110 D - 0xffffffff81ffda60 [g_down] 12 0 0 0 WL (threaded) [intr] 100027 I [swi6: task queue] 100028 I [swi6: Giant taskq] 100030 I [swi5: fast taskq] 100082 I [swi4: clock (0)] 100083 I [swi4: clock (1)] 100084 I [swi4: clock (2)] 100085 I [swi4: clock (3)] 100086 I [swi4: clock (4)] 100087 I [swi4: clock (5)] 100088 I [swi4: clock (6)] 100089 I [swi4: clock (7)] 100090 I [swi4: clock (8)] 100091 I [swi4: clock (9)] 100092 I [swi4: clock (10)] 100093 I [swi4: clock (11)] 100094 I [swi4: clock (12)] 100095 I [swi4: clock (13)] 100096 I [swi4: clock (14)] 100097 I [swi4: clock (15)] 100098 I [swi4: clock (16)] 100099 I [swi4: clock (17)] 100100 I [swi4: clock (18)] 100101 I [swi4: clock (19)] 100102 I [swi4: clock (20)] 100103 I [swi4: clock (21)] 100104 I [swi4: clock (22)] 100105 I [swi4: clock (23)] 100106 I [swi3: vm] 100107 I [swi1: netisr 0] 100166 I [irq264: isci0] 100167 I [irq265: isci0] 100168 I [irq22: ehci0] 100174 I [irq266: hdac0] 100175 I [irq285: xhci0] 100181 I [irq20: ehci1] 100187 I [irq286: ahci0] 100188 I [irq287: hdac1] 100189 I [swi0: uart] 100277 I [irq288: ioat0] 100278 I [irq289: ioat1] 100279 I [irq290: ioat2] 100280 I [irq291: ioat3] 100281 I [irq292: ioat4] 100282 I [irq293: ioat5] 100283 I [irq294: ioat6] 100284 I [irq295: ioat7] 100285 I [irq296: ioat8] 100286 I [irq297: ioat9] 100287 I [irq298: ioat10] 100288 I [irq299: ioat11] 100289 I [irq300: ioat12] 100290 I [irq301: ioat13] 100291 I [irq302: ioat14] 100292 I [irq303: ioat15] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 100007 Run CPU 4 [idle: cpu4] 100008 Run CPU 5 [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 Run CPU 8 [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 Run CPU 11 [idle: cpu11] 100015 Run CPU 12 [idle: cpu12] 100016 Run CPU 13 [idle: cpu13] 100017 Run CPU 14 [idle: cpu14] 100018 Run CPU 15 [idle: cpu15] 100019 Run CPU 16 [idle: cpu16] 100020 Run CPU 17 [idle: cpu17] 100021 Run CPU 18 [idle: cpu18] 100022 Run CPU 19 [idle: cpu19] 100023 Run CPU 20 [idle: cpu20] 100024 Run CPU 21 [idle: cpu21] 100025 Run CPU 22 [idle: cpu22] 100026 Run CPU 23 [idle: cpu23] 1 0 1 0 SLs wait 0xfffff80003758538 [init] 10 0 0 0 DL audit_w 0xffffffff82021ce8 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D vmwait 0xffffffff81a58880 [swapper] 100029 D - 0xfffff8000379fd00 [thread taskq] 100031 D - 0xfffff8000379fb00 [aiod_kick taskq] 100032 D - 0xfffff8000379fa00 [kqueue_ctx taskq] 100033 D - 0xfffff8000371fd00 [softirq_0] 100034 D - 0xfffff8000371fc00 [softirq_1] 100035 D - 0xfffff8000371fb00 [softirq_2] 100036 D - 0xfffff8000371fa00 [softirq_3] 100037 D - 0xfffff8000371f900 [softirq_4] 100038 D - 0xfffff8000371f800 [softirq_5] 100039 D - 0xfffff8000371f700 [softirq_6] 100040 D - 0xfffff8000371f600 [softirq_7] 100041 D - 0xfffff8000371f500 [softirq_8] 100042 D - 0xfffff8000371f400 [softirq_9] 100043 D - 0xfffff8000371f300 [softirq_10] 100044 D - 0xfffff8000371f200 [softirq_11] 100045 D - 0xfffff8000371f100 [softirq_12] 100046 D - 0xfffff8000371f000 [softirq_13] 100047 D - 0xfffff8000371ee00 [softirq_14] 100048 D - 0xfffff8000371ed00 [softirq_15] 100049 D - 0xfffff8000371ec00 [softirq_16] 100050 D - 0xfffff8000371eb00 [softirq_17] 100051 D - 0xfffff8000371ea00 [softirq_18] 100052 D - 0xfffff8000371e900 [softirq_19] 100053 D - 0xfffff8000371e800 [softirq_20] 100054 D - 0xfffff8000371e700 [softirq_21] 100055 D - 0xfffff8000371e600 [softirq_22] 100056 D - 0xfffff8000371e500 [softirq_23] 100057 D - 0xfffff8000371e400 [if_config_tqg_0] 100058 D - 0xfffff8000390f100 [if_io_tqg_0] 100059 D - 0xfffff8000390f000 [if_io_tqg_1] 100060 D - 0xfffff8000390ee00 [if_io_tqg_2] 100061 D - 0xfffff8000390ed00 [if_io_tqg_3] 100062 D - 0xfffff8000390ec00 [if_io_tqg_4] 100063 D - 0xfffff8000390eb00 [if_io_tqg_5] 100064 D - 0xfffff8000390ea00 [if_io_tqg_6] 100065 D - 0xfffff8000390e900 [if_io_tqg_7] 100066 D - 0xfffff8000390e800 [if_io_tqg_8] 100067 D - 0xfffff8000390e700 [if_io_tqg_9] 100068 D - 0xfffff8000390e600 [if_io_tqg_10] 100069 D - 0xfffff8000390e500 [if_io_tqg_11] 100070 D - 0xfffff8000390e400 [if_io_tqg_12] 100071 D - 0xfffff8000390e300 [if_io_tqg_13] 100072 D - 0xfffff8000390e200 [if_io_tqg_14] 100073 D - 0xfffff8000390e100 [if_io_tqg_15] 100074 D - 0xfffff8000390e000 [if_io_tqg_16] 100075 D - 0xfffff8000390de00 [if_io_tqg_17] 100076 D - 0xfffff8000390dd00 [if_io_tqg_18] 100077 D - 0xfffff8000390dc00 [if_io_tqg_19] 100078 D - 0xfffff8000390db00 [if_io_tqg_20] 100079 D - 0xfffff8000390da00 [if_io_tqg_21] 100080 D - 0xfffff8000390d900 [if_io_tqg_22] 100081 D - 0xfffff8000390d800 [if_io_tqg_23] 100111 D - 0xfffff800039d0100 [firmware taskq] 100112 D - 0xfffff800039cee00 [crypto_0] 100113 D - 0xfffff800039cee00 [crypto_1] 100114 D - 0xfffff800039cee00 [crypto_2] 100115 D - 0xfffff800039cee00 [crypto_3] 100116 D - 0xfffff800039cee00 [crypto_4] 100117 D - 0xfffff800039cee00 [crypto_5] 100118 D - 0xfffff800039cee00 [crypto_6] 100119 D - 0xfffff800039cee00 [crypto_7] 100120 D - 0xfffff800039cee00 [crypto_8] 100121 D - 0xfffff800039cee00 [crypto_9] 100122 D - 0xfffff800039cee00 [crypto_10] 100123 D - 0xfffff800039cee00 [crypto_11] 100124 D - 0xfffff800039cee00 [crypto_12] 100125 D - 0xfffff800039cee00 [crypto_13] 100126 D - 0xfffff800039cee00 [crypto_14] 100127 D - 0xfffff800039cee00 [crypto_15] 100128 D - 0xfffff800039cee00 [crypto_16] 100129 D - 0xfffff800039cee00 [crypto_17] 100130 D - 0xfffff800039cee00 [crypto_18] 100131 D - 0xfffff800039cee00 [crypto_19] 100132 D - 0xfffff800039cee00 [crypto_20] 100133 D - 0xfffff800039cee00 [crypto_21] 100134 D - 0xfffff800039cee00 [crypto_22] 100135 D - 0xfffff800039cee00 [crypto_23] 100190 D - 0xfffff80017020800 [mca taskq] 100196 D - 0xfffff8001a11da00 [acpi_task_0] 100197 D - 0xfffff8001a11da00 [acpi_task_1] 100198 D - 0xfffff8001a11da00 [acpi_task_2] 100200 D - 0xfffff800039ceb00 [CAM taskq] 34733 1745 1740 1001 Z sh 1457 1456 1456 0 Z nfsuserd 1661 1660 1660 0 Z nfscbd: master 28480 28462 3241 0 Z+ run 28037 6340 3241 0 Z+ tee 1747 1740 1740 1001 Z sh 1746 1740 1740 1001 Z awk 1742 1739 1742 1001 Z+ top 31856 28482 3241 0 Z+ mkfifo 31851 28482 3241 0 Z+ lockf 31843 28482 3241 0 Z+ symlink db:0:pho> allt Tracing command ls pid 34887 tid 100589 td 0xfffff8014ed52560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ad5e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ad5e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ad5ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ad5f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6ad5f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6ad5fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6ad6080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6ad60d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6ad6100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6ad6170 vget() at vget+0x98/frame 0xfffffe00c6ad61b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6ad6200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6ad6290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6ad63a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6ad63d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6ad6430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6ad6460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6ad64e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6ad6510 lookup() at lookup+0x692/frame 0xfffffe00c6ad65b0 namei() at namei+0x53b/frame 0xfffffe00c6ad6670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6ad6880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6ad6980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ad6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ad6ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34885 tid 100796 td 0xfffff8020697d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c76e4e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c76e4e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c76e4ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c76e4f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c76e4f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c76e4fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c76e5080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c76e50d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c76e5100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c76e5170 vget() at vget+0x98/frame 0xfffffe00c76e51b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c76e5200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c76e5290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c76e53a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c76e53d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c76e5430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c76e5460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c76e54e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c76e5510 lookup() at lookup+0x692/frame 0xfffffe00c76e55b0 namei() at namei+0x53b/frame 0xfffffe00c76e5670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c76e5880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c76e5980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c76e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c76e5ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34883 tid 100798 td 0xfffff8020690e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c76eee60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c76eee90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c76eeed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c76eef00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c76eef60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c76eefe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c76ef080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c76ef0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c76ef100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c76ef170 vget() at vget+0x98/frame 0xfffffe00c76ef1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c76ef200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c76ef290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c76ef3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c76ef3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c76ef430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c76ef460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c76ef4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c76ef510 lookup() at lookup+0x692/frame 0xfffffe00c76ef5b0 namei() at namei+0x53b/frame 0xfffffe00c76ef670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c76ef880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c76ef980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c76efab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c76efab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34881 tid 100242 td 0xfffff800037c4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5408e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5408e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5408ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5408f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5408f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5408fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5409080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c54090d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5409100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5409170 vget() at vget+0x98/frame 0xfffffe00c54091b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5409200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5409290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c54093a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c54093d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5409430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5409460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c54094e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5409510 lookup() at lookup+0x692/frame 0xfffffe00c54095b0 namei() at namei+0x53b/frame 0xfffffe00c5409670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5409880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5409980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5409ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5409ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34879 tid 100243 td 0xfffff800037c4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c540de60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c540de90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c540ded0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c540df00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c540df60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c540dfe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c540e080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c540e0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c540e100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c540e170 vget() at vget+0x98/frame 0xfffffe00c540e1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c540e200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c540e290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c540e3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c540e3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c540e430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c540e460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c540e4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c540e510 lookup() at lookup+0x692/frame 0xfffffe00c540e5b0 namei() at namei+0x53b/frame 0xfffffe00c540e670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c540e880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c540e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c540eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c540eab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34877 tid 100609 td 0xfffff80027348560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b39e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b39e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b39ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b39f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b39f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6b39fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6b3a080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6b3a0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6b3a100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6b3a170 vget() at vget+0x98/frame 0xfffffe00c6b3a1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6b3a200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6b3a290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6b3a3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6b3a3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6b3a430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b3a460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6b3a4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b3a510 lookup() at lookup+0x692/frame 0xfffffe00c6b3a5b0 namei() at namei+0x53b/frame 0xfffffe00c6b3a670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6b3a880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6b3a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b3aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b3aab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34875 tid 100532 td 0xfffff8014e23e560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69b6e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69b6e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69b6ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69b6f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69b6f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69b6fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69b7080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69b70d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69b7100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69b7170 vget() at vget+0x98/frame 0xfffffe00c69b71b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69b7200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69b7290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69b73a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69b73d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69b7430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69b7460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69b74e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69b7510 lookup() at lookup+0x692/frame 0xfffffe00c69b75b0 namei() at namei+0x53b/frame 0xfffffe00c69b7670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69b7880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69b7980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69b7ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69b7ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34873 tid 100531 td 0xfffff80027083560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69b1e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69b1e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69b1ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69b1f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69b1f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69b1fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69b2080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69b20d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69b2100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69b2170 vget() at vget+0x98/frame 0xfffffe00c69b21b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69b2200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69b2290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69b23a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69b23d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69b2430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69b2460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69b24e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69b2510 lookup() at lookup+0x692/frame 0xfffffe00c69b25b0 namei() at namei+0x53b/frame 0xfffffe00c69b2670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69b2880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69b2980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69b2ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34871 tid 100732 td 0xfffff80027083000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6da2e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6da2e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6da2ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6da2f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6da2f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6da2fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6da3080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6da30d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6da3100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6da3170 vget() at vget+0x98/frame 0xfffffe00c6da31b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6da3200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6da3290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6da33a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6da33d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6da3430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6da3460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6da34e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6da3510 lookup() at lookup+0x692/frame 0xfffffe00c6da35b0 namei() at namei+0x53b/frame 0xfffffe00c6da3670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6da3880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6da3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6da3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6da3ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34869 tid 100540 td 0xfffff800277b6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69dee60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69dee90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69deed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69def00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69def60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69defe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69df080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69df0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69df100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69df170 vget() at vget+0x98/frame 0xfffffe00c69df1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69df200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69df290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69df3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69df3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69df430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69df460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69df4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69df510 lookup() at lookup+0x692/frame 0xfffffe00c69df5b0 namei() at namei+0x53b/frame 0xfffffe00c69df670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69df880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69df980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69dfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69dfab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34867 tid 100545 td 0xfffff800277aa560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69f7e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69f7e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69f7ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69f7f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69f7f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69f7fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69f8080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69f80d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69f8100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69f8170 vget() at vget+0x98/frame 0xfffffe00c69f81b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69f8200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69f8290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69f83a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69f83d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69f8430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69f8460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69f84e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69f8510 lookup() at lookup+0x692/frame 0xfffffe00c69f85b0 namei() at namei+0x53b/frame 0xfffffe00c69f8670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69f8880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69f8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69f8ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34865 tid 100261 td 0xfffff8001aefb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5467e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5467e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5467ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5467f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5467f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5467fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5468080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c54680d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5468100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5468170 vget() at vget+0x98/frame 0xfffffe00c54681b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5468200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5468290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c54683a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c54683d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5468430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5468460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c54684e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5468510 lookup() at lookup+0x692/frame 0xfffffe00c54685b0 namei() at namei+0x53b/frame 0xfffffe00c5468670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5468880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5468980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5468ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5468ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34863 tid 100621 td 0xfffff8001aefa000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b75e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b75e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b75ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b75f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b75f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6b75fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6b76080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6b760d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6b76100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6b76170 vget() at vget+0x98/frame 0xfffffe00c6b761b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6b76200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6b76290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6b763a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6b763d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6b76430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b76460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6b764e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b76510 lookup() at lookup+0x692/frame 0xfffffe00c6b765b0 namei() at namei+0x53b/frame 0xfffffe00c6b76670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6b76880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6b76980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b76ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b76ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34861 tid 100719 td 0xfffff802063e4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d61e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d61e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d61ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d61f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d61f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6d61fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6d62080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d620d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d62100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d62170 vget() at vget+0x98/frame 0xfffffe00c6d621b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6d62200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6d62290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6d623a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6d623d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6d62430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d62460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6d624e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d62510 lookup() at lookup+0x692/frame 0xfffffe00c6d625b0 namei() at namei+0x53b/frame 0xfffffe00c6d62670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6d62880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6d62980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d62ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d62ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34859 tid 100650 td 0xfffff80206127560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c08e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c08e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c08ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c08f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c08f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6c08fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6c09080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6c090d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6c09100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6c09170 vget() at vget+0x98/frame 0xfffffe00c6c091b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6c09200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6c09290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6c093a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6c093d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6c09430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6c09460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6c094e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6c09510 lookup() at lookup+0x692/frame 0xfffffe00c6c095b0 namei() at namei+0x53b/frame 0xfffffe00c6c09670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6c09880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6c09980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c09ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c09ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34857 tid 100687 td 0xfffff80206126560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6cc1e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6cc1e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6cc1ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6cc1f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6cc1f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6cc1fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6cc2080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6cc20d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6cc2100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6cc2170 vget() at vget+0x98/frame 0xfffffe00c6cc21b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6cc2200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6cc2290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6cc23a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6cc23d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6cc2430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6cc2460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6cc24e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6cc2510 lookup() at lookup+0x692/frame 0xfffffe00c6cc25b0 namei() at namei+0x53b/frame 0xfffffe00c6cc2670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6cc2880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6cc2980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6cc2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6cc2ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34855 tid 100856 td 0xfffff80590094000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c780de60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c780de90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c780ded0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c780df00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c780df60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c780dfe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c780e080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c780e0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c780e100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c780e170 vget() at vget+0x98/frame 0xfffffe00c780e1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c780e200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c780e290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c780e3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c780e3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c780e430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c780e460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c780e4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c780e510 lookup() at lookup+0x692/frame 0xfffffe00c780e5b0 namei() at namei+0x53b/frame 0xfffffe00c780e670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c780e880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c780e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c780eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c780eab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34853 tid 100857 td 0xfffff80206d12560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7812e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7812e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7812ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7812f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7812f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c7812fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c7813080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c78130d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c7813100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c7813170 vget() at vget+0x98/frame 0xfffffe00c78131b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c7813200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c7813290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c78133a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c78133d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c7813430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7813460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c78134e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7813510 lookup() at lookup+0x692/frame 0xfffffe00c78135b0 namei() at namei+0x53b/frame 0xfffffe00c7813670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c7813880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c7813980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7813ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7813ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34851 tid 100827 td 0xfffff802069e6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c777fe60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c777fe90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c777fed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c777ff00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c777ff60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c777ffe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c7780080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c77800d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c7780100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c7780170 vget() at vget+0x98/frame 0xfffffe00c77801b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c7780200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c7780290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c77803a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c77803d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c7780430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7780460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c77804e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7780510 lookup() at lookup+0x692/frame 0xfffffe00c77805b0 namei() at namei+0x53b/frame 0xfffffe00c7780670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c7780880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c7780980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7780ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7780ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34849 tid 100295 td 0xfffff8001a987000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5511e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5511e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5511ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5511f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5511f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5511fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5512080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c55120d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5512100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5512170 vget() at vget+0x98/frame 0xfffffe00c55121b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5512200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5512290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c55123a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c55123d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5512430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5512460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c55124e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5512510 lookup() at lookup+0x692/frame 0xfffffe00c55125b0 namei() at namei+0x53b/frame 0xfffffe00c5512670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5512880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5512980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5512ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5512ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34847 tid 100533 td 0xfffff8001a986000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69bbe60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69bbe90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69bbed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69bbf00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69bbf60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69bbfe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69bc080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69bc0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69bc100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69bc170 vget() at vget+0x98/frame 0xfffffe00c69bc1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69bc200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69bc290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69bc3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69bc3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69bc430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69bc460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69bc4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69bc510 lookup() at lookup+0x692/frame 0xfffffe00c69bc5b0 namei() at namei+0x53b/frame 0xfffffe00c69bc670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69bc880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69bc980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69bcab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69bcab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34845 tid 100236 td 0xfffff8002710c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3e8e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3e8e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3e8ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3e8f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc3e8f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00bc3e8fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00bc3e9080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00bc3e90d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00bc3e9100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00bc3e9170 vget() at vget+0x98/frame 0xfffffe00bc3e91b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00bc3e9200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00bc3e9290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00bc3e93a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00bc3e93d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00bc3e9430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc3e9460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00bc3e94e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc3e9510 lookup() at lookup+0x692/frame 0xfffffe00bc3e95b0 namei() at namei+0x53b/frame 0xfffffe00bc3e9670 kern_statat() at kern_statat+0x98/frame 0xfffffe00bc3e9880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00bc3e9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc3e9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc3e9ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34843 tid 100610 td 0xfffff80027085560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b3ee60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b3ee90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b3eed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b3ef00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b3ef60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6b3efe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6b3f080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6b3f0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6b3f100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6b3f170 vget() at vget+0x98/frame 0xfffffe00c6b3f1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6b3f200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6b3f290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6b3f3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6b3f3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6b3f430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b3f460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6b3f4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6b3f510 lookup() at lookup+0x692/frame 0xfffffe00c6b3f5b0 namei() at namei+0x53b/frame 0xfffffe00c6b3f670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6b3f880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6b3f980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b3fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b3fab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34841 tid 100637 td 0xfffff800270cd560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6bc5e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6bc5e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6bc5ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6bc5f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6bc5f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6bc5fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6bc6080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6bc60d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6bc6100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6bc6170 vget() at vget+0x98/frame 0xfffffe00c6bc61b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6bc6200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6bc6290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6bc63a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6bc63d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6bc6430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6bc6460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6bc64e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6bc6510 lookup() at lookup+0x692/frame 0xfffffe00c6bc65b0 namei() at namei+0x53b/frame 0xfffffe00c6bc6670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6bc6880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6bc6980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6bc6ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6bc6ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34839 tid 100723 td 0xfffff8014ecfb560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d75e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d75e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d75ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d75f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d75f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6d75fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6d76080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d760d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d76100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d76170 vget() at vget+0x98/frame 0xfffffe00c6d761b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6d76200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6d76290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6d763a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6d763d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6d76430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d76460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6d764e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d76510 lookup() at lookup+0x692/frame 0xfffffe00c6d765b0 namei() at namei+0x53b/frame 0xfffffe00c6d76670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6d76880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6d76980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d76ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d76ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34837 tid 100764 td 0xfffff8001a96c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7644e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7644e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7644ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7644f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7644f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c7644fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c7645080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c76450d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c7645100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c7645170 vget() at vget+0x98/frame 0xfffffe00c76451b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c7645200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c7645290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c76453a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c76453d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c7645430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7645460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c76454e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c7645510 lookup() at lookup+0x692/frame 0xfffffe00c76455b0 namei() at namei+0x53b/frame 0xfffffe00c7645670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c7645880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c7645980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7645ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7645ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34835 tid 100258 td 0xfffff8001aa7a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5458e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5458e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5458ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5458f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5458f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5458fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5459080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c54590d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5459100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5459170 vget() at vget+0x98/frame 0xfffffe00c54591b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5459200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5459290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c54593a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c54593d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5459430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5459460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c54594e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5459510 lookup() at lookup+0x692/frame 0xfffffe00c54595b0 namei() at namei+0x53b/frame 0xfffffe00c5459670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5459880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5459980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5459ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5459ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34833 tid 100529 td 0xfffff8001aa6a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69a7e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69a7e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69a7ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69a7f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69a7f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c69a7fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c69a8080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69a80d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c69a8100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c69a8170 vget() at vget+0x98/frame 0xfffffe00c69a81b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c69a8200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c69a8290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69a83a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69a83d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c69a8430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69a8460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69a84e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c69a8510 lookup() at lookup+0x692/frame 0xfffffe00c69a85b0 namei() at namei+0x53b/frame 0xfffffe00c69a8670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c69a8880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c69a8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69a8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69a8ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34831 tid 100522 td 0xfffff8007dfbd560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6984e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6984e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6984ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6984f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6984f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6984fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6985080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69850d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6985100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6985170 vget() at vget+0x98/frame 0xfffffe00c69851b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6985200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6985290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69853a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69853d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6985430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6985460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69854e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6985510 lookup() at lookup+0x692/frame 0xfffffe00c69855b0 namei() at namei+0x53b/frame 0xfffffe00c6985670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6985880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6985980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6985ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6985ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34829 tid 100590 td 0xfffff8014eccc000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6adae60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6adae90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6adaed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6adaf00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6adaf60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6adafe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6adb080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6adb0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6adb100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6adb170 vget() at vget+0x98/frame 0xfffffe00c6adb1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6adb200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6adb290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6adb3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6adb3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6adb430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6adb460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6adb4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6adb510 lookup() at lookup+0x692/frame 0xfffffe00c6adb5b0 namei() at namei+0x53b/frame 0xfffffe00c6adb670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6adb880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6adb980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6adbab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6adbab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34827 tid 100581 td 0xfffff8001acf3000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6aade60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6aade90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6aaded0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6aadf00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6aadf60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6aadfe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6aae080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6aae0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6aae100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6aae170 vget() at vget+0x98/frame 0xfffffe00c6aae1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6aae200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6aae290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6aae3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6aae3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6aae430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6aae460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6aae4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6aae510 lookup() at lookup+0x692/frame 0xfffffe00c6aae5b0 namei() at namei+0x53b/frame 0xfffffe00c6aae670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6aae880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6aae980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6aaeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6aaeab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34825 tid 100727 td 0xfffff80206140000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d89e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d89e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d89ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d89f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d89f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6d89fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6d8a080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d8a0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d8a100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d8a170 vget() at vget+0x98/frame 0xfffffe00c6d8a1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6d8a200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6d8a290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6d8a3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6d8a3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6d8a430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d8a460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6d8a4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6d8a510 lookup() at lookup+0x692/frame 0xfffffe00c6d8a5b0 namei() at namei+0x53b/frame 0xfffffe00c6d8a670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6d8a880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6d8a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d8aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d8aab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34821 tid 100506 td 0xfffff8007dbc9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6934e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6934e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6934ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6934f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6934f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6934fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6935080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c69350d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6935100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6935170 vget() at vget+0x98/frame 0xfffffe00c69351b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6935200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6935290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c69353a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c69353d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6935430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6935460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c69354e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6935510 lookup() at lookup+0x692/frame 0xfffffe00c69355b0 namei() at namei+0x53b/frame 0xfffffe00c6935670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6935880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6935980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6935ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6935ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34819 tid 100514 td 0xfffff8007dbc8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c695ce60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c695ce90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c695ced0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c695cf00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c695cf60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c695cfe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c695d080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c695d0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c695d100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c695d170 vget() at vget+0x98/frame 0xfffffe00c695d1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c695d200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c695d290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c695d3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c695d3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c695d430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c695d460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c695d4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c695d510 lookup() at lookup+0x692/frame 0xfffffe00c695d5b0 namei() at namei+0x53b/frame 0xfffffe00c695d670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c695d880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c695d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c695dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c695dab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34817 tid 100305 td 0xfffff80027055560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5543e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5543e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5543ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5543f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5543f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5543fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5544080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c55440d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5544100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5544170 vget() at vget+0x98/frame 0xfffffe00c55441b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5544200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5544290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c55443a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c55443d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5544430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5544460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c55444e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5544510 lookup() at lookup+0x692/frame 0xfffffe00c55445b0 namei() at namei+0x53b/frame 0xfffffe00c5544670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5544880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5544980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5544ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5544ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34815 tid 100217 td 0xfffff8001aa7d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc389e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc389e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc389ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc389f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc389f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00bc389fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00bc38a080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00bc38a0d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00bc38a100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00bc38a170 vget() at vget+0x98/frame 0xfffffe00bc38a1b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00bc38a200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00bc38a290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00bc38a3a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00bc38a3d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00bc38a430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc38a460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00bc38a4e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc38a510 lookup() at lookup+0x692/frame 0xfffffe00bc38a5b0 namei() at namei+0x53b/frame 0xfffffe00bc38a670 kern_statat() at kern_statat+0x98/frame 0xfffffe00bc38a880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00bc38a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc38aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc38aab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34813 tid 100228 td 0xfffff8001aa7c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3c0e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3c0e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3c0ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3c0f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc3c0f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00bc3c0fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00bc3c1080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00bc3c10d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00bc3c1100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00bc3c1170 vget() at vget+0x98/frame 0xfffffe00bc3c11b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00bc3c1200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00bc3c1290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00bc3c13a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00bc3c13d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00bc3c1430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc3c1460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00bc3c14e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00bc3c1510 lookup() at lookup+0x692/frame 0xfffffe00bc3c15b0 namei() at namei+0x53b/frame 0xfffffe00bc3c1670 kern_statat() at kern_statat+0x98/frame 0xfffffe00bc3c1880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00bc3c1980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc3c1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc3c1ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34811 tid 100274 td 0xfffff800037c3000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c54a8e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c54a8e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c54a8ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c54a8f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c54a8f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c54a8fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c54a9080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c54a90d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c54a9100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c54a9170 vget() at vget+0x98/frame 0xfffffe00c54a91b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c54a9200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c54a9290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c54a93a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c54a93d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c54a9430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c54a9460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c54a94e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c54a9510 lookup() at lookup+0x692/frame 0xfffffe00c54a95b0 namei() at namei+0x53b/frame 0xfffffe00c54a9670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c54a9880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c54a9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c54a9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c54a9ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command ls pid 34809 tid 100308 td 0xfffff800037c2560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5552e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5552e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5552ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5552f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c5552f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5552fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c5553080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c55530d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5553100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5553170 vget() at vget+0x98/frame 0xfffffe00c55531b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c5553200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c5553290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c55533a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c55533d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c5553430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5553460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c55534e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c5553510 lookup() at lookup+0x692/frame 0xfffffe00c55535b0 namei() at namei+0x53b/frame 0xfffffe00c5553670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c5553880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c5553980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5553ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5553ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command init pid 34807 tid 100300 td 0xfffff8002710a560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34802 tid 100547 td 0xfffff80145bbb560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34797 tid 100548 td 0xfffff80145bbb000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34792 tid 100549 td 0xfffff8014e3d5560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command ls pid 34789 tid 100631 td 0xfffff8014e257000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ba7e60 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ba7e90 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ba7ed0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ba7f00 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6ba7f60 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6ba7fe0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6ba8080 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6ba80d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6ba8100 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6ba8170 vget() at vget+0x98/frame 0xfffffe00c6ba81b0 vfs_hash_get() at vfs_hash_get+0xd1/frame 0xfffffe00c6ba8200 ffs_vgetf() at ffs_vgetf+0x3f/frame 0xfffffe00c6ba8290 ufs_lookup_ino() at ufs_lookup_ino+0xc9f/frame 0xfffffe00c6ba83a0 VOP_CACHEDLOOKUP_APV() at VOP_CACHEDLOOKUP_APV+0xf7/frame 0xfffffe00c6ba83d0 vfs_cache_lookup() at vfs_cache_lookup+0xd6/frame 0xfffffe00c6ba8430 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6ba8460 null_lookup() at null_lookup+0xd0/frame 0xfffffe00c6ba84e0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0xf7/frame 0xfffffe00c6ba8510 lookup() at lookup+0x692/frame 0xfffffe00c6ba85b0 namei() at namei+0x53b/frame 0xfffffe00c6ba8670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6ba8880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6ba8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ba8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ba8ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80048c08a, rsp = 0x7fffffffe328, rbp = 0x7fffffffe3e0 --- Tracing command init pid 34785 tid 100550 td 0xfffff8014e3d5000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34780 tid 100551 td 0xfffff8007df31560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34775 tid 100552 td 0xfffff8007df31000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34770 tid 100553 td 0xfffff801380a9560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 34765 tid 100554 td 0xfffff801380a9000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command ls pid 34760 tid 100515 td 0xfffff8007dbc8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6962670 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69626a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69626e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6962710 _sleep() at _sleep+0x367/frame 0xfffffe00c69627c0 vm_waitpfault() at vm_waitpfault+0x7a/frame 0xfffffe00c69627e0 vm_fault_hold() at vm_fault_hold+0xb47/frame 0xfffffe00c6962910 vm_fault() at vm_fault+0x75/frame 0xfffffe00c6962950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00c69629a0 trap() at trap+0x3be/frame 0xfffffe00c6962ab0 calltrap() at calltrap+0x8/frame 0xfffffe00c6962ab0 --- trap 0xc, rip = 0x800222961, rsp = 0x7fffffffdf80, rbp = 0x7fffffffe060 --- Tracing command cron pid 34759 tid 100296 td 0xfffff8001aefa560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sed pid 34757 tid 100660 td 0xfffff802060ff560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 34755 tid 100526 td 0xfffff801381ab000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 32004 tid 100936 td 0xfffff8092c910000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c797b170 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c797b1a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c797b1e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c797b210 sleeplk() at sleeplk+0x149/frame 0xfffffe00c797b270 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c797b2f0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c797b390 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c797b3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c797b410 null_lock() at null_lock+0xe3/frame 0xfffffe00c797b470 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c797b4a0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c797b510 lookup() at lookup+0x114/frame 0xfffffe00c797b5b0 namei() at namei+0x53b/frame 0xfffffe00c797b670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c797b880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c797b980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c797bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c797bab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80082608a, rsp = 0x7fffffffe148, rbp = 0x7fffffffe200 --- Tracing command fts pid 32002 tid 100935 td 0xfffff8092c910560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 32000 tid 100852 td 0xfffff80206d4f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c77f8170 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c77f81a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c77f81e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c77f8210 sleeplk() at sleeplk+0x149/frame 0xfffffe00c77f8270 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c77f82f0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c77f8390 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c77f83e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c77f8410 null_lock() at null_lock+0xe3/frame 0xfffffe00c77f8470 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c77f84a0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c77f8510 lookup() at lookup+0x114/frame 0xfffffe00c77f85b0 namei() at namei+0x53b/frame 0xfffffe00c77f8670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c77f8880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c77f8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c77f8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c77f8ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80082608a, rsp = 0x7fffffffe148, rbp = 0x7fffffffe200 --- Tracing command fts pid 31998 tid 100851 td 0xfffff80206d4f560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 31996 tid 100820 td 0xfffff80206ba6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c775d170 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c775d1a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c775d1e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c775d210 sleeplk() at sleeplk+0x149/frame 0xfffffe00c775d270 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c775d2f0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c775d390 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c775d3e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c775d410 null_lock() at null_lock+0xe3/frame 0xfffffe00c775d470 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c775d4a0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c775d510 lookup() at lookup+0x114/frame 0xfffffe00c775d5b0 namei() at namei+0x53b/frame 0xfffffe00c775d670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c775d880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c775d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c775dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c775dab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80082608a, rsp = 0x7fffffffe148, rbp = 0x7fffffffe200 --- Tracing command fts pid 31994 tid 100720 td 0xfffff8014e2f1560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d67170 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d671a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d671e0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d67210 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d67270 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6d672f0 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6d67390 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d673e0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d67410 null_lock() at null_lock+0xe3/frame 0xfffffe00c6d67470 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d674a0 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d67510 lookup() at lookup+0x114/frame 0xfffffe00c6d675b0 namei() at namei+0x53b/frame 0xfffffe00c6d67670 kern_statat() at kern_statat+0x98/frame 0xfffffe00c6d67880 sys_fstatat() at sys_fstatat+0x2f/frame 0xfffffe00c6d67980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d67ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d67ab0 --- syscall (552, FreeBSD ELF64, sys_fstatat), rip = 0x80082608a, rsp = 0x7fffffffe148, rbp = 0x7fffffffe200 --- Tracing command fts pid 31992 tid 100693 td 0xfffff802061bf000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31967 tid 100717 td 0xfffff802063ff000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31965 tid 100716 td 0xfffff802063ff560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31964 tid 100714 td 0xfffff802063ae000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31963 tid 100629 td 0xfffff8014ef95000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31962 tid 100626 td 0xfffff8014ef95560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31961 tid 100855 td 0xfffff8014ed38560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31960 tid 100670 td 0xfffff80206194560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c6cd30 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c6cd60 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c6cda0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c6cdd0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c6ce30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c6ceb0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c6cf50 getblk() at getblk+0x12d/frame 0xfffffe00c6c6cff0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c6d050 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c6d0c0 ffs_realloccg() at ffs_realloccg+0x38c/frame 0xfffffe00c6c6d1d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c6c6d380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6c6d450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6c6d5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6c6d5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c6d710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6c6d740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6c6d960 sys_link() at sys_link+0x28/frame 0xfffffe00c6c6d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c6dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c6dab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31959 tid 100250 td 0xfffff8002710b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c54311d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5431200 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5431240 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5431270 sleeplk() at sleeplk+0x149/frame 0xfffffe00c54312d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c5431350 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c54313f0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c5431440 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5431470 null_lock() at null_lock+0xe3/frame 0xfffffe00c54314d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c5431500 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c5431570 lookup() at lookup+0x114/frame 0xfffffe00c5431610 namei() at namei+0x53b/frame 0xfffffe00c54316d0 vn_open_cred() at vn_open_cred+0x207/frame 0xfffffe00c5431810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c5431980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5431ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5431ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe338, rbp = 0x7fffffffe420 --- Tracing command link pid 31958 tid 100669 td 0xfffff80206195000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c67d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c67d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c67d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c67db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c67e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c67e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c67f30 getblk() at getblk+0x12d/frame 0xfffffe00c6c67fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c68030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c680a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6c68120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6c68170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6c681e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xdb1/frame 0xfffffe00c6c68380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6c68450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6c685a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6c685d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c68710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6c68740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6c68960 sys_link() at sys_link+0x28/frame 0xfffffe00c6c68980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c68ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c68ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command swap pid 31957 tid 100680 td 0xfffff8020618d560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31956 tid 100668 td 0xfffff80206195560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c62d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c62d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c62d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c62db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c62e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c62e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c62f30 getblk() at getblk+0x12d/frame 0xfffffe00c6c62fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c63030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c630a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6c63120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6c63170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6c631e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6c63380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6c63450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6c635a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6c635d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c63710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6c63740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6c63960 sys_link() at sys_link+0x28/frame 0xfffffe00c6c63980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c63ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c63ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command swap pid 31955 tid 100677 td 0xfffff8020618e000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31954 tid 100240 td 0xfffff8002710b560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3fcf10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3fcf40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3fcf80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3fcfb0 _sleep() at _sleep+0x367/frame 0xfffffe00bc3fd060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00bc3fd0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00bc3fd0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00bc3fd130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00bc3fd1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00bc3fd200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00bc3fd230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00bc3fd2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00bc3fd310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00bc3fd350 zone_import() at zone_import+0x53/frame 0xfffffe00bc3fd3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00bc3fd400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00bc3fd470 malloc() at malloc+0x122/frame 0xfffffe00bc3fd4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00bc3fd570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00bc3fd5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00bc3fd6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00bc3fd6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00bc3fd830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00bc3fd860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00bc3fd910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00bc3fd980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc3fdab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc3fdab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command swap pid 31953 tid 100672 td 0xfffff8020618e560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31952 tid 100748 td 0xfffff80206593560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6df2d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6df2d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6df2d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6df2db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6df2e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6df2e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6df2f30 getblk() at getblk+0x12d/frame 0xfffffe00c6df2fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6df3030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6df30a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6df3120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6df3170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6df31e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6df3380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6df3450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6df35a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6df35d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6df3710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6df3740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6df3960 sys_link() at sys_link+0x28/frame 0xfffffe00c6df3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6df3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6df3ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31951 tid 100880 td 0xfffff80206b32000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7862f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7862f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7862f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7862fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c7863060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c78630a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c78630f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c7863130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c78631b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c7863200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c7863230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c78632a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c7863310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c7863350 zone_import() at zone_import+0x53/frame 0xfffffe00c78633c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c7863400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c7863470 malloc() at malloc+0x122/frame 0xfffffe00c78634c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c7863570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c78635c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c78636c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c78636f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c7863830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c7863860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c7863910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c7863980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7863ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7863ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command rw pid 31950 tid 100682 td 0xfffff8014ed50560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ca8860 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ca8890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ca88d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ca8900 _sleep() at _sleep+0x367/frame 0xfffffe00c6ca89b0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6ca89f0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6ca8a40 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6ca8a80 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6ca8b00 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6ca8b50 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6ca8b80 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c6ca8bf0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6ca8c60 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6ca8ca0 zone_import() at zone_import+0x53/frame 0xfffffe00c6ca8d10 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6ca8d50 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6ca8dc0 malloc() at malloc+0x122/frame 0xfffffe00c6ca8e10 newblk_lookup() at newblk_lookup+0x179/frame 0xfffffe00c6ca8e50 softdep_setup_blkmapdep() at softdep_setup_blkmapdep+0x121/frame 0xfffffe00c6ca8eb0 ffs_alloccgblk() at ffs_alloccgblk+0x299/frame 0xfffffe00c6ca8f20 ffs_alloccg() at ffs_alloccg+0x11b/frame 0xfffffe00c6ca8fa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6ca8ff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6ca9060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6ca9200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6ca92a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6ca93b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6ca94f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6ca9600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6ca9680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6ca96e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6ca9820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6ca9890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6ca98e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6ca9930 sys_write() at sys_write+0x86/frame 0xfffffe00c6ca9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ca9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ca9ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command swap pid 31949 tid 100837 td 0xfffff80206c2d000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31948 tid 100747 td 0xfffff8020673c000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6dedd10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6dedd40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6dedd80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6deddb0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6dede10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6dede90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6dedf30 getblk() at getblk+0x12d/frame 0xfffffe00c6dedfd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6dee030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6dee0a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6dee120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6dee170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6dee1e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xdb1/frame 0xfffffe00c6dee380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6dee450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6dee5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6dee5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6dee710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6dee740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6dee960 sys_link() at sys_link+0x28/frame 0xfffffe00c6dee980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6deeab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6deeab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31947 tid 100503 td 0xfffff8007d8a3560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6925f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6925f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6925f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6925fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6926060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c69260a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c69260f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6926130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c69261b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6926200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6926230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c69262a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6926310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6926350 zone_import() at zone_import+0x53/frame 0xfffffe00c69263c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6926400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6926470 malloc() at malloc+0x122/frame 0xfffffe00c69264c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c6926570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c69265c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c69266c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c69266f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6926830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c6926860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c6926910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c6926980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6926ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6926ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command rw pid 31946 tid 100303 td 0xfffff8001ac14560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5539860 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5539890 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c55398d0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5539900 _sleep() at _sleep+0x367/frame 0xfffffe00c55399b0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c55399f0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c5539a40 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c5539a80 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c5539b00 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c5539b50 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c5539b80 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c5539bf0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c5539c60 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c5539ca0 zone_import() at zone_import+0x53/frame 0xfffffe00c5539d10 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c5539d50 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c5539dc0 malloc() at malloc+0x122/frame 0xfffffe00c5539e10 newblk_lookup() at newblk_lookup+0x179/frame 0xfffffe00c5539e50 softdep_setup_blkmapdep() at softdep_setup_blkmapdep+0x121/frame 0xfffffe00c5539eb0 ffs_alloccgblk() at ffs_alloccgblk+0x299/frame 0xfffffe00c5539f20 ffs_alloccg() at ffs_alloccg+0x11b/frame 0xfffffe00c5539fa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c5539ff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c553a060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c553a200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c553a2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c553a3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c553a4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c553a600 vn_write() at vn_write+0x26b/frame 0xfffffe00c553a680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c553a6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c553a820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c553a890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c553a8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c553a930 sys_write() at sys_write+0x86/frame 0xfffffe00c553a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c553aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c553aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command swap pid 31945 tid 100836 td 0xfffff80206c2d560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31944 tid 100528 td 0xfffff8014e23f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69a2d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69a2d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c69a2d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c69a2db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c69a2e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c69a2e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c69a2f30 getblk() at getblk+0x12d/frame 0xfffffe00c69a2fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c69a3030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c69a30a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c69a3120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c69a3170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c69a31e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c69a3380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c69a3450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c69a35a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c69a35d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c69a3710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c69a3740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c69a3960 sys_link() at sys_link+0x28/frame 0xfffffe00c69a3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c69a3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c69a3ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31943 tid 100307 td 0xfffff80027b17560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c554db90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c554dbc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c554dc00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c554dc30 sleeplk() at sleeplk+0x149/frame 0xfffffe00c554dc90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c554dd10 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c554ddb0 getblk() at getblk+0x12d/frame 0xfffffe00c554de50 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c554deb0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c554df20 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c554dfa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c554dff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c554e060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c554e200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c554e2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c554e3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c554e4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c554e600 vn_write() at vn_write+0x26b/frame 0xfffffe00c554e680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c554e6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c554e820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c554e890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c554e8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c554e930 sys_write() at sys_write+0x86/frame 0xfffffe00c554e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c554eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c554eab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command swap pid 31942 tid 100835 td 0xfffff802069e6000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31941 tid 100266 td 0xfffff8001aecb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5480f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5480f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5480f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5480fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c5481060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c54810a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c54810f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c5481130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c54811b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c5481200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c5481230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c54812a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c5481310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c5481350 zone_import() at zone_import+0x53/frame 0xfffffe00c54813c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c5481400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c5481470 malloc() at malloc+0x122/frame 0xfffffe00c54814c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c5481570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c54815c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c54816c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c54816f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c5481830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c5481860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c5481910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c5481980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5481ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5481ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command link pid 31940 tid 100591 td 0xfffff800274cc000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6adfd30 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6adfd60 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6adfda0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6adfdd0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6adfe30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6adfeb0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6adff50 getblk() at getblk+0x12d/frame 0xfffffe00c6adfff0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6ae0050 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6ae00c0 ffs_realloccg() at ffs_realloccg+0x38c/frame 0xfffffe00c6ae01d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c6ae0380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6ae0450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6ae05a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6ae05d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6ae0710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6ae0740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6ae0960 sys_link() at sys_link+0x28/frame 0xfffffe00c6ae0980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ae0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ae0ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31938 tid 100225 td 0xfffff8001ae56560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3b1b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3b1bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3b1c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3b1c30 _sleep() at _sleep+0x367/frame 0xfffffe00bc3b1ce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00bc3b1d20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00bc3b1d70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00bc3b1db0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00bc3b1e30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00bc3b1ed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00bc3b1f70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00bc3b1fe0 getblk() at getblk+0x819/frame 0xfffffe00bc3b2070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00bc3b2200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00bc3b22a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00bc3b23b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00bc3b24f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00bc3b2600 vn_write() at vn_write+0x26b/frame 0xfffffe00bc3b2680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00bc3b26e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00bc3b2820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00bc3b2890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00bc3b28e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00bc3b2930 sys_write() at sys_write+0x86/frame 0xfffffe00bc3b2980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc3b2ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc3b2ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command swap pid 31937 tid 100567 td 0xfffff801381aa000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31936 tid 100749 td 0xfffff8014e2f1000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6df7d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6df7d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6df7d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6df7db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6df7e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6df7e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6df7f30 getblk() at getblk+0x12d/frame 0xfffffe00c6df7fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6df8030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6df80a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6df8120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6df8170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6df81e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6df8380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6df8450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6df85a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6df85d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6df8710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6df8740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6df8960 sys_link() at sys_link+0x28/frame 0xfffffe00c6df8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6df8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6df8ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31935 tid 100599 td 0xfffff8014ed5f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b07f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b07f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b07f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b07fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6b08060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6b080a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6b080f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6b08130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6b081b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6b08200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6b08230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c6b082a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6b08310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6b08350 zone_import() at zone_import+0x53/frame 0xfffffe00c6b083c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6b08400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6b08470 malloc() at malloc+0x122/frame 0xfffffe00c6b084c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c6b08570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c6b085c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c6b086c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c6b086f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6b08830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c6b08860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c6b08910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c6b08980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b08ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b08ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command rw pid 31934 tid 100896 td 0xfffff8092c074000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c78b2b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c78b2bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c78b2c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c78b2c30 _sleep() at _sleep+0x367/frame 0xfffffe00c78b2ce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c78b2d20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c78b2d70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c78b2db0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c78b2e30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c78b2ed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c78b2f70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c78b2fe0 getblk() at getblk+0x819/frame 0xfffffe00c78b3070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c78b3200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c78b32a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c78b33b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c78b34f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c78b3600 vn_write() at vn_write+0x26b/frame 0xfffffe00c78b3680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c78b36e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c78b3820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c78b3890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c78b38e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c78b3930 sys_write() at sys_write+0x86/frame 0xfffffe00c78b3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c78b3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c78b3ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command swap pid 31933 tid 100566 td 0xfffff801381aa560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31932 tid 100754 td 0xfffff802064fa560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7612a70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7612aa0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7612ae0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7612b10 _sleep() at _sleep+0x367/frame 0xfffffe00c7612bc0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c7612c00 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c7612c50 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c7612c90 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c7612d10 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c7612d60 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c7612d90 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c7612e00 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c7612e70 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c7612eb0 zone_import() at zone_import+0x53/frame 0xfffffe00c7612f20 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c7612f60 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c7612fd0 malloc() at malloc+0x122/frame 0xfffffe00c7613020 newblk_lookup() at newblk_lookup+0x179/frame 0xfffffe00c7613060 softdep_setup_blkmapdep() at softdep_setup_blkmapdep+0x121/frame 0xfffffe00c76130c0 ffs_realloccg() at ffs_realloccg+0x7c2/frame 0xfffffe00c76131d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c7613380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c7613450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c76135a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c76135d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c7613710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c7613740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c7613960 sys_link() at sys_link+0x28/frame 0xfffffe00c7613980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7613ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7613ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31930 tid 100681 td 0xfffff8014e495000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ca3b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ca3bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ca3c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ca3c30 _sleep() at _sleep+0x367/frame 0xfffffe00c6ca3ce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6ca3d20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6ca3d70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6ca3db0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6ca3e30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6ca3ed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6ca3f70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6ca3fe0 getblk() at getblk+0x819/frame 0xfffffe00c6ca4070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c6ca4200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6ca42a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6ca43b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6ca44f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6ca4600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6ca4680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6ca46e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6ca4820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6ca4890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6ca48e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6ca4930 sys_write() at sys_write+0x86/frame 0xfffffe00c6ca4980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ca4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ca4ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command lockf2 pid 31929 tid 100304 td 0xfffff800274ce560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c553ef10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c553ef40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c553ef80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c553efb0 _sleep() at _sleep+0x367/frame 0xfffffe00c553f060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c553f0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c553f0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c553f130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c553f1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c553f200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c553f230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c553f2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c553f310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c553f350 zone_import() at zone_import+0x53/frame 0xfffffe00c553f3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c553f400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c553f470 malloc() at malloc+0x122/frame 0xfffffe00c553f4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c553f570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c553f5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c553f6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c553f6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c553f830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c553f860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c553f910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c553f980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c553fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c553fab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command swap pid 31928 tid 100611 td 0xfffff8014e499560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31926 tid 100833 td 0xfffff802069b9560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c779dd10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c779dd40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c779dd80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c779ddb0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c779de10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c779de90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c779df30 getblk() at getblk+0x12d/frame 0xfffffe00c779dfd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c779e030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c779e0a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c779e120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c779e170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c779e1e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c779e380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c779e450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c779e5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c779e5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c779e710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c779e740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c779e960 sys_link() at sys_link+0x28/frame 0xfffffe00c779e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c779eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c779eab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31925 tid 100218 td 0xfffff8001aa7c560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc38eb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc38ebc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc38ec00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc38ec30 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc38ec90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00bc38ed10 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00bc38edb0 getblk() at getblk+0x12d/frame 0xfffffe00bc38ee50 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00bc38eeb0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00bc38ef20 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00bc38efa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00bc38eff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00bc38f060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00bc38f200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00bc38f2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00bc38f3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00bc38f4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00bc38f600 vn_write() at vn_write+0x26b/frame 0xfffffe00bc38f680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00bc38f6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00bc38f820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00bc38f890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00bc38f8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00bc38f930 sys_write() at sys_write+0x86/frame 0xfffffe00bc38f980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc38fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc38fab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command lockf2 pid 31924 tid 100299 td 0xfffff800274cf000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5525f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5525f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5525f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5525fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c5526060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c55260a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c55260f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c5526130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c55261b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c5526200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c5526230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c55262a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c5526310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c5526350 zone_import() at zone_import+0x53/frame 0xfffffe00c55263c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c5526400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c5526470 malloc() at malloc+0x122/frame 0xfffffe00c55264c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c5526570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c55265c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c55266c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c55266f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c5526830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c5526860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c5526910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c5526980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5526ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5526ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command link pid 31923 tid 100726 td 0xfffff80206140560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d84d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d84d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d84d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d84db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d84e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6d84e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6d84f30 getblk() at getblk+0x12d/frame 0xfffffe00c6d84fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6d85030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6d850a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6d85120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6d85170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6d851e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6d85380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6d85450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6d855a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6d855d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6d85710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6d85740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6d85960 sys_link() at sys_link+0x28/frame 0xfffffe00c6d85980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d85ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d85ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command swap pid 31922 tid 100826 td 0xfffff80206c90000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 31921 tid 100661 td 0xfffff8020607b560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c3fb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c3fbc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c3fc00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c3fc30 _sleep() at _sleep+0x367/frame 0xfffffe00c6c3fce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6c3fd20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6c3fd70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6c3fdb0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6c3fe30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6c3fed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6c3ff70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6c3ffe0 getblk() at getblk+0x819/frame 0xfffffe00c6c40070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c6c40200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6c402a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6c403b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c404f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6c40600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6c40680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6c406e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6c40820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6c40890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6c408e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6c40930 sys_write() at sys_write+0x86/frame 0xfffffe00c6c40980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c40ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c40ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command lockf2 pid 31920 tid 100579 td 0xfffff8014ecfa000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6aa3f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6aa3f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6aa3f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6aa3fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6aa4060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6aa40a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6aa40f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6aa4130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6aa41b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6aa4200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6aa4230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c6aa42a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6aa4310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6aa4350 zone_import() at zone_import+0x53/frame 0xfffffe00c6aa43c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6aa4400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6aa4470 malloc() at malloc+0x122/frame 0xfffffe00c6aa44c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c6aa4570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c6aa45c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c6aa46c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c6aa46f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6aa4830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c6aa4860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c6aa4910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c6aa4980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6aa4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6aa4ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command link pid 31919 tid 100678 td 0xfffff80206141000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c94c70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c94ca0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c94ce0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c94d10 _sleep() at _sleep+0x367/frame 0xfffffe00c6c94dc0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6c94e00 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6c94e50 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6c94e90 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6c94f10 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6c94fb0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6c95050 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6c950c0 ffs_realloccg() at ffs_realloccg+0x961/frame 0xfffffe00c6c951d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c6c95380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6c95450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6c955a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6c955d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c95710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6c95740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6c95960 sys_link() at sys_link+0x28/frame 0xfffffe00c6c95980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c95ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c95ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command swap pid 31918 tid 100928 td 0xfffff8099581b560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 31917 tid 100594 td 0xfffff8014ed38000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6aeeb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6aeebc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6aeec00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6aeec30 _sleep() at _sleep+0x367/frame 0xfffffe00c6aeece0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6aeed20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6aeed70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6aeedb0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6aeee30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6aeeed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6aeef70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6aeefe0 getblk() at getblk+0x819/frame 0xfffffe00c6aef070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c6aef200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6aef2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6aef3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6aef4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6aef600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6aef680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6aef6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6aef820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6aef890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6aef8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6aef930 sys_write() at sys_write+0x86/frame 0xfffffe00c6aef980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6aefab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6aefab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command rename pid 31916 tid 100713 td 0xfffff802063ae560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d441d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d44200 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d44240 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d44270 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d442d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6d44350 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6d443f0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d44440 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d44470 null_lock() at null_lock+0xe3/frame 0xfffffe00c6d444d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d44500 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d44570 lookup() at lookup+0x114/frame 0xfffffe00c6d44610 namei() at namei+0x53b/frame 0xfffffe00c6d446d0 vn_open_cred() at vn_open_cred+0xd4/frame 0xfffffe00c6d44810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6d44980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d44ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d44ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command creat pid 31915 tid 100651 td 0xfffff801381a8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c0de70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c0dea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c0dee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c0df10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c0df70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c0dff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c0e090 getblk() at getblk+0x12d/frame 0xfffffe00c6c0e130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c0e190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c0e200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c6c0e2a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6c0e2f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c6c0e380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c6c0e510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c6c0e530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c6c0e560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c0e6a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c6c0e6d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c6c0e810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6c0e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c0eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c0eab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31914 tid 100265 td 0xfffff8001acf4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c547bf10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c547bf40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c547bf80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c547bfb0 _sleep() at _sleep+0x367/frame 0xfffffe00c547c060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c547c0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c547c0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c547c130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c547c1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c547c200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c547c230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c547c2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c547c310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c547c350 zone_import() at zone_import+0x53/frame 0xfffffe00c547c3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c547c400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c547c470 malloc() at malloc+0x122/frame 0xfffffe00c547c4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c547c570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c547c5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c547c6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c547c6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c547c830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c547c860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c547c910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c547c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c547cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c547cab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command swap pid 31913 tid 100525 td 0xfffff8001ac07000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31912 tid 100588 td 0xfffff8014eccc560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ad0d30 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ad0d60 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ad0da0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ad0dd0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6ad0e30 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6ad0eb0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6ad0f50 getblk() at getblk+0x12d/frame 0xfffffe00c6ad0ff0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6ad1050 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6ad10c0 ffs_realloccg() at ffs_realloccg+0x38c/frame 0xfffffe00c6ad11d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c6ad1380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6ad1450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6ad15a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6ad15d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6ad1710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6ad1740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6ad1960 sys_link() at sys_link+0x28/frame 0xfffffe00c6ad1980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ad1ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ad1ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rename pid 31911 tid 100711 td 0xfffff802063af000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d3a180 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d3a1b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d3a1f0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d3a220 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d3a280 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6d3a300 lockmgr_upgrade() at lockmgr_upgrade+0x11c/frame 0xfffffe00c6d3a350 __lockmgr_args() at __lockmgr_args+0x418/frame 0xfffffe00c6d3a3f0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d3a440 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d3a470 null_lock() at null_lock+0xe3/frame 0xfffffe00c6d3a4d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d3a500 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d3a570 lookup() at lookup+0x59e/frame 0xfffffe00c6d3a610 namei() at namei+0x53b/frame 0xfffffe00c6d3a6d0 vn_open_cred() at vn_open_cred+0xd4/frame 0xfffffe00c6d3a810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6d3a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d3aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d3aab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command swap pid 31910 tid 100521 td 0xfffff8001aa7d560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 31909 tid 100795 td 0xfffff8020697d560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c76dfb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c76dfbc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c76dfc00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c76dfc30 _sleep() at _sleep+0x367/frame 0xfffffe00c76dfce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c76dfd20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c76dfd70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c76dfdb0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c76dfe30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c76dfed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c76dff70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c76dffe0 getblk() at getblk+0x819/frame 0xfffffe00c76e0070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c76e0200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c76e02a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c76e03b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c76e04f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c76e0600 vn_write() at vn_write+0x26b/frame 0xfffffe00c76e0680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c76e06e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c76e0820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c76e0890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c76e08e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c76e0930 sys_write() at sys_write+0x86/frame 0xfffffe00c76e0980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c76e0ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c76e0ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command creat pid 31908 tid 100761 td 0xfffff8001aecc560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7635e70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7635ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7635ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7635f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7635f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c7635ff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c7636090 getblk() at getblk+0x12d/frame 0xfffffe00c7636130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c7636190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c7636200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c76362a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c76362f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c7636380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c7636510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c7636530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c7636560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c76366a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c76366d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c7636810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c7636980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7636ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7636ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe450 --- Tracing command link pid 31907 tid 100657 td 0xfffff80206127000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c2bd10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c2bd40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c2bd80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c2bdb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6c2be60 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6c2bea0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6c2bef0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6c2bf30 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6c2bfb0 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6c2c050 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6c2c0f0 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6c2c160 getblk() at getblk+0x819/frame 0xfffffe00c6c2c1f0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xf89/frame 0xfffffe00c6c2c380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6c2c450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6c2c5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6c2c5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c2c710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6c2c740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6c2c960 sys_link() at sys_link+0x28/frame 0xfffffe00c6c2c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c2cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c2cab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command openat pid 31906 tid 100743 td 0xfffff8001a970000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6dd9e70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6dd9ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6dd9ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6dd9f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6dd9f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6dd9ff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6dda090 getblk() at getblk+0x12d/frame 0xfffffe00c6dda130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6dda190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6dda200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c6dda2a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6dda2f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c6dda380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c6dda510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c6dda530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c6dda560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6dda6a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c6dda6d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c6dda810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6dda980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ddaab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ddaab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b6c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command lockf2 pid 31905 tid 100825 td 0xfffff80206c90560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7775f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7775f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7775f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7775fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c7776060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c77760a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c77760f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c7776130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c77761b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c7776200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c7776230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c77762a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c7776310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c7776350 zone_import() at zone_import+0x53/frame 0xfffffe00c77763c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c7776400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c7776470 malloc() at malloc+0x122/frame 0xfffffe00c77764c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c7776570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c77765c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c77766c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c77766f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c7776830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c7776860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c7776910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c7776980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7776ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7776ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command rename pid 31904 tid 100730 td 0xfffff8020676d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d99180 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d991b0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d991f0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d99220 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6d99280 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6d99300 lockmgr_upgrade() at lockmgr_upgrade+0x11c/frame 0xfffffe00c6d99350 __lockmgr_args() at __lockmgr_args+0x418/frame 0xfffffe00c6d993f0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6d99440 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d99470 null_lock() at null_lock+0xe3/frame 0xfffffe00c6d994d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6d99500 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6d99570 lookup() at lookup+0x59e/frame 0xfffffe00c6d99610 namei() at namei+0x53b/frame 0xfffffe00c6d996d0 vn_open_cred() at vn_open_cred+0xd4/frame 0xfffffe00c6d99810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6d99980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d99ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d99ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command link pid 31903 tid 100642 td 0xfffff8014ef94560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6bdec70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6bdeca0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6bdece0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6bded10 _sleep() at _sleep+0x367/frame 0xfffffe00c6bdedc0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6bdee00 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6bdee50 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6bdee90 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6bdef10 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6bdefb0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6bdf050 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6bdf0c0 ffs_realloccg() at ffs_realloccg+0x961/frame 0xfffffe00c6bdf1d0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x53f/frame 0xfffffe00c6bdf380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6bdf450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6bdf5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6bdf5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6bdf710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6bdf740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6bdf960 sys_link() at sys_link+0x28/frame 0xfffffe00c6bdf980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6bdfab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6bdfab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command creat pid 31902 tid 100759 td 0xfffff8001aede560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c762be70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c762bea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c762bee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c762bf10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c762bf70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c762bff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c762c090 getblk() at getblk+0x12d/frame 0xfffffe00c762c130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c762c190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c762c200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c762c2a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c762c2f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c762c380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c762c510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c762c530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c762c560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c762c6a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c762c6d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c762c810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c762c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c762cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c762cab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe450 --- Tracing command openat pid 31901 tid 100658 td 0xfffff8020618f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c30f20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c30f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c30f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c30fc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c31020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c310a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c31140 getblk() at getblk+0x12d/frame 0xfffffe00c6c311e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c31240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c312b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c6c31330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c6c31370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c6c313f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c6c31400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c6c31440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6c31470 vinactive() at vinactive+0xe6/frame 0xfffffe00c6c314c0 vputx() at vputx+0x320/frame 0xfffffe00c6c31520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c6c31570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c6c315a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c6c31610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c6c31640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c6c31660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6c31690 vinactive() at vinactive+0xe6/frame 0xfffffe00c6c316e0 vputx() at vputx+0x320/frame 0xfffffe00c6c31740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c6c31980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c31ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c31ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31900 tid 100705 td 0xfffff802064ca560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6d1bb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6d1bbc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6d1bc00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6d1bc30 _sleep() at _sleep+0x367/frame 0xfffffe00c6d1bce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6d1bd20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6d1bd70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6d1bdb0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6d1be30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6d1bed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6d1bf70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6d1bfe0 getblk() at getblk+0x819/frame 0xfffffe00c6d1c070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c6d1c200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6d1c2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6d1c3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6d1c4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6d1c600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6d1c680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6d1c6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6d1c820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6d1c890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6d1c8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6d1c930 sys_write() at sys_write+0x86/frame 0xfffffe00c6d1c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6d1cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6d1cab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command rename pid 31899 tid 100785 td 0xfffff80206be8000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31898 tid 100801 td 0xfffff80206c8f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c76fdf10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c76fdf40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c76fdf80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c76fdfb0 _sleep() at _sleep+0x367/frame 0xfffffe00c76fe060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c76fe0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c76fe0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c76fe130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c76fe1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c76fe200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c76fe230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c76fe2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c76fe310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c76fe350 zone_import() at zone_import+0x53/frame 0xfffffe00c76fe3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c76fe400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c76fe470 malloc() at malloc+0x122/frame 0xfffffe00c76fe4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c76fe570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c76fe5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c76fe6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c76fe6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c76fe830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c76fe860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c76fe910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c76fe980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c76feab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c76feab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command swap pid 31897 tid 100275 td 0xfffff8001ab9a000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31896 tid 100628 td 0xfffff8014ecb4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b98d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b98d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b98d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b98db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b98e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6b98e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6b98f30 getblk() at getblk+0x12d/frame 0xfffffe00c6b98fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6b99030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6b990a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6b99120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6b99170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6b991e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6b99380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6b99450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6b995a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6b995d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6b99710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6b99740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6b99960 sys_link() at sys_link+0x28/frame 0xfffffe00c6b99980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b99ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b99ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command creat pid 31895 tid 100920 td 0xfffff80995774000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c792ae70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c792aea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c792aee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c792af10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c792af70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c792aff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c792b090 getblk() at getblk+0x12d/frame 0xfffffe00c792b130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c792b190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c792b200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c792b2a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c792b2f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c792b380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c792b510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c792b530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c792b560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c792b6a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c792b6d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c792b810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c792b980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c792bab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c792bab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe450 --- Tracing command openat pid 31894 tid 100607 td 0xfffff8007dbc7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b2ff20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b2ff50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b2ff90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b2ffc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b30020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6b300a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6b30140 getblk() at getblk+0x12d/frame 0xfffffe00c6b301e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6b30240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6b302b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c6b30330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c6b30370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c6b303f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c6b30400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c6b30440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6b30470 vinactive() at vinactive+0xe6/frame 0xfffffe00c6b304c0 vputx() at vputx+0x320/frame 0xfffffe00c6b30520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c6b30570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c6b305a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c6b30610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c6b30640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c6b30660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6b30690 vinactive() at vinactive+0xe6/frame 0xfffffe00c6b306e0 vputx() at vputx+0x320/frame 0xfffffe00c6b30740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c6b30980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b30ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b30ab0 --- syscall (503, FreeBSD ELF64, sys_unlinkat), rip = 0x8006ec06a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command mkdir pid 31893 tid 100906 td 0xfffff800271c2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c78e5210 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c78e5240 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c78e5280 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c78e52b0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c78e5310 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c78e5390 lockmgr_upgrade() at lockmgr_upgrade+0x11c/frame 0xfffffe00c78e53e0 __lockmgr_args() at __lockmgr_args+0x418/frame 0xfffffe00c78e5480 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c78e54d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c78e5500 null_lock() at null_lock+0xe3/frame 0xfffffe00c78e5560 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c78e5590 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c78e5600 lookup() at lookup+0x59e/frame 0xfffffe00c78e56a0 namei() at namei+0x53b/frame 0xfffffe00c78e5760 kern_mkdirat() at kern_mkdirat+0xaa/frame 0xfffffe00c78e5980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c78e5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c78e5ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082539a, rsp = 0x7fffffffdbf8, rbp = 0x7fffffffe020 --- Tracing command rw pid 31892 tid 100946 td 0xfffff8092c2c8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c79acb90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c79acbc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c79acc00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c79acc30 _sleep() at _sleep+0x367/frame 0xfffffe00c79acce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c79acd20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c79acd70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c79acdb0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c79ace30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c79aced0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c79acf70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c79acfe0 getblk() at getblk+0x819/frame 0xfffffe00c79ad070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c79ad200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c79ad2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c79ad3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c79ad4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c79ad600 vn_write() at vn_write+0x26b/frame 0xfffffe00c79ad680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c79ad6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c79ad820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c79ad890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c79ad8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c79ad930 sys_write() at sys_write+0x86/frame 0xfffffe00c79ad980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c79adab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c79adab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command openat pid 31891 tid 100917 td 0xfffff80995c14560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c791bf20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c791bf50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c791bf90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c791bfc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c791c020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c791c0a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c791c140 getblk() at getblk+0x12d/frame 0xfffffe00c791c1e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c791c240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c791c2b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c791c330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c791c370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c791c3f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c791c400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c791c440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c791c470 vinactive() at vinactive+0xe6/frame 0xfffffe00c791c4c0 vputx() at vputx+0x320/frame 0xfffffe00c791c520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c791c570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c791c5a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c791c610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c791c640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c791c660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c791c690 vinactive() at vinactive+0xe6/frame 0xfffffe00c791c6e0 vputx() at vputx+0x320/frame 0xfffffe00c791c740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c791c980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c791cab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c791cab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31890 tid 100818 td 0xfffff80206bd6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7752b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7752bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7752c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7752c30 _sleep() at _sleep+0x367/frame 0xfffffe00c7752ce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c7752d20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c7752d70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c7752db0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c7752e30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c7752ed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c7752f70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c7752fe0 getblk() at getblk+0x819/frame 0xfffffe00c7753070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c7753200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c77532a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c77533b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c77534f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c7753600 vn_write() at vn_write+0x26b/frame 0xfffffe00c7753680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c77536e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c7753820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c7753890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c77538e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c7753930 sys_write() at sys_write+0x86/frame 0xfffffe00c7753980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7753ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7753ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command link pid 31889 tid 100587 td 0xfffff8014ecb5560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6acbd10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6acbd40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6acbd80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6acbdb0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6acbe10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6acbe90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6acbf30 getblk() at getblk+0x12d/frame 0xfffffe00c6acbfd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6acc030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6acc0a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6acc120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6acc170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6acc1e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6acc380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c6acc450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c6acc5a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c6acc5d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6acc710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c6acc740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c6acc960 sys_link() at sys_link+0x28/frame 0xfffffe00c6acc980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6accab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6accab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command mkdir pid 31888 tid 100684 td 0xfffff8014ed17560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6cb2dd0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6cb2e00 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6cb2e40 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6cb2e70 _sleep() at _sleep+0x367/frame 0xfffffe00c6cb2f20 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6cb2f60 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6cb2fb0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6cb2ff0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6cb3070 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6cb3110 vm_page_alloc() at vm_page_alloc+0x75/frame 0xfffffe00c6cb3160 allocbuf() at allocbuf+0x5ab/frame 0xfffffe00c6cb31d0 getblk() at getblk+0x819/frame 0xfffffe00c6cb3260 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xddf/frame 0xfffffe00c6cb33f0 ufs_mkdir() at ufs_mkdir+0x71b/frame 0xfffffe00c6cb35c0 VOP_MKDIR_APV() at VOP_MKDIR_APV+0xfd/frame 0xfffffe00c6cb35f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6cb3730 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x102/frame 0xfffffe00c6cb3760 kern_mkdirat() at kern_mkdirat+0x1d6/frame 0xfffffe00c6cb3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6cb3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6cb3ab0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x80082539a, rsp = 0x7fffffffdbf8, rbp = 0x7fffffffe020 --- Tracing command openat pid 31887 tid 100960 td 0xfffff803a5f9e560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c79f2f20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c79f2f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c79f2f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c79f2fc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c79f3020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c79f30a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c79f3140 getblk() at getblk+0x12d/frame 0xfffffe00c79f31e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c79f3240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c79f32b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c79f3330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c79f3370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c79f33f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c79f3400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c79f3440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c79f3470 vinactive() at vinactive+0xe6/frame 0xfffffe00c79f34c0 vputx() at vputx+0x320/frame 0xfffffe00c79f3520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c79f3570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c79f35a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c79f3610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c79f3640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c79f3660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c79f3690 vinactive() at vinactive+0xe6/frame 0xfffffe00c79f36e0 vputx() at vputx+0x320/frame 0xfffffe00c79f3740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c79f3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c79f3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c79f3ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31886 tid 100800 td 0xfffff802065b5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c76f8f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c76f8f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c76f8f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c76f8fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c76f9060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c76f90a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c76f90f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c76f9130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c76f91b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c76f9200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c76f9230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c76f92a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c76f9310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c76f9350 zone_import() at zone_import+0x53/frame 0xfffffe00c76f93c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c76f9400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c76f9470 malloc() at malloc+0x122/frame 0xfffffe00c76f94c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c76f9570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c76f95c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c76f96c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c76f96f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c76f9830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c76f9860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c76f9910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c76f9980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c76f9ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c76f9ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command creat pid 31885 tid 100912 td 0xfffff80206799000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7902e70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7902ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7902ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7902f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7902f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c7902ff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c7903090 getblk() at getblk+0x12d/frame 0xfffffe00c7903130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c7903190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c7903200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c79032a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c79032f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c7903380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c7903510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c7903530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c7903560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c79036a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c79036d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c7903810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c7903980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7903ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7903ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe450 --- Tracing command rw pid 31884 tid 100557 td 0xfffff8014e27b560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6a35b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6a35bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6a35c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6a35c30 _sleep() at _sleep+0x367/frame 0xfffffe00c6a35ce0 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6a35d20 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6a35d70 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6a35db0 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6a35e30 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00c6a35ed0 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00c6a35f70 allocbuf() at allocbuf+0x34e/frame 0xfffffe00c6a35fe0 getblk() at getblk+0x819/frame 0xfffffe00c6a36070 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x15b6/frame 0xfffffe00c6a36200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6a362a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6a363b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6a364f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6a36600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6a36680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6a366e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6a36820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6a36890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6a368e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6a36930 sys_write() at sys_write+0x86/frame 0xfffffe00c6a36980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6a36ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6a36ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command mkdir pid 31883 tid 100733 td 0xfffff80027082560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31882 tid 100821 td 0xfffff80206c0a560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7761d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7761d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7761d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7761db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7761e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c7761e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c7761f30 getblk() at getblk+0x12d/frame 0xfffffe00c7761fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c7762030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c77620a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c7762120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c7762170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c77621e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c7762380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00c7762450 ufs_link() at ufs_link+0x178/frame 0xfffffe00c77625a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00c77625d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c7762710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00c7762740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00c7762960 sys_link() at sys_link+0x28/frame 0xfffffe00c7762980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7762ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7762ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31881 tid 100255 td 0xfffff80003be9560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5449f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5449f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5449f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5449fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c544a060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c544a0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c544a0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c544a130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c544a1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c544a200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c544a230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c544a2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c544a310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c544a350 zone_import() at zone_import+0x53/frame 0xfffffe00c544a3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c544a400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c544a470 malloc() at malloc+0x122/frame 0xfffffe00c544a4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c544a570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c544a5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c544a6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c544a6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c544a830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c544a860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c544a910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c544a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c544aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c544aab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command rw pid 31880 tid 100674 td 0xfffff80003aba560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c80b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c80bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c80c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c80c30 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c80c90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c80d10 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c80db0 getblk() at getblk+0x12d/frame 0xfffffe00c6c80e50 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c80eb0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c80f20 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6c80fa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6c80ff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6c81060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6c81200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6c812a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6c813b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c814f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6c81600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6c81680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6c816e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6c81820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6c81890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6c818e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6c81930 sys_write() at sys_write+0x86/frame 0xfffffe00c6c81980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c81ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c81ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command creat pid 31879 tid 100546 td 0xfffff800277aa000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command openat pid 31878 tid 100815 td 0xfffff80206610560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7743f20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7743f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7743f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7743fc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c7744020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c77440a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c7744140 getblk() at getblk+0x12d/frame 0xfffffe00c77441e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c7744240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c77442b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c7744330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c7744370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c77443f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c7744400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c7744440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c7744470 vinactive() at vinactive+0xe6/frame 0xfffffe00c77444c0 vputx() at vputx+0x320/frame 0xfffffe00c7744520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c7744570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c77445a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c7744610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c7744640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c7744660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c7744690 vinactive() at vinactive+0xe6/frame 0xfffffe00c77446e0 vputx() at vputx+0x320/frame 0xfffffe00c7744740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c7744980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7744ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7744ab0 --- syscall (503, FreeBSD ELF64, sys_unlinkat), rip = 0x8006ec06a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31876 tid 100254 td 0xfffff80003bea000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c5444f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c5444f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c5444f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c5444fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c5445060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c54450a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c54450f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c5445130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c54451b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c5445200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c5445230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c54452a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c5445310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c5445350 zone_import() at zone_import+0x53/frame 0xfffffe00c54453c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c5445400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c5445470 malloc() at malloc+0x122/frame 0xfffffe00c54454c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c5445570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c54455c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c54456c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c54456f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c5445830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c5445860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c5445910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c5445980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c5445ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c5445ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command link pid 31875 tid 100235 td 0xfffff800270d4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3e3d10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3e3d40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3e3d80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3e3db0 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc3e3e10 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00bc3e3e90 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00bc3e3f30 getblk() at getblk+0x12d/frame 0xfffffe00bc3e3fd0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00bc3e4030 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00bc3e40a0 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00bc3e4120 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00bc3e4170 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00bc3e41e0 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00bc3e4380 ufs_direnter() at ufs_direnter+0x235/frame 0xfffffe00bc3e4450 ufs_link() at ufs_link+0x178/frame 0xfffffe00bc3e45a0 VOP_LINK_APV() at VOP_LINK_APV+0x11d/frame 0xfffffe00bc3e45d0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00bc3e4710 VOP_LINK_APV() at VOP_LINK_APV+0x122/frame 0xfffffe00bc3e4740 kern_linkat() at kern_linkat+0x3d1/frame 0xfffffe00bc3e4960 sys_link() at sys_link+0x28/frame 0xfffffe00bc3e4980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00bc3e4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00bc3e4ab0 --- syscall (9, FreeBSD ELF64, sys_link), rip = 0x8006ec94a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command openat pid 31874 tid 100882 td 0xfffff80206bd7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c786cf20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c786cf50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c786cf90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c786cfc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c786d020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c786d0a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c786d140 getblk() at getblk+0x12d/frame 0xfffffe00c786d1e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c786d240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c786d2b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c786d330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c786d370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c786d3f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c786d400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c786d440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c786d470 vinactive() at vinactive+0xe6/frame 0xfffffe00c786d4c0 vputx() at vputx+0x320/frame 0xfffffe00c786d520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c786d570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c786d5a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c786d610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c786d640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c786d660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c786d690 vinactive() at vinactive+0xe6/frame 0xfffffe00c786d6e0 vputx() at vputx+0x320/frame 0xfffffe00c786d740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c786d980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c786dab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c786dab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31872 tid 100679 td 0xfffff802061bf560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6c99b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6c99bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6c99c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6c99c30 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6c99c90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6c99d10 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6c99db0 getblk() at getblk+0x12d/frame 0xfffffe00c6c99e50 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6c99eb0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6c99f20 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6c99fa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6c99ff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6c9a060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6c9a200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6c9a2a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6c9a3b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6c9a4f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6c9a600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6c9a680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6c9a6e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6c9a820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6c9a890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6c9a8e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6c9a930 sys_write() at sys_write+0x86/frame 0xfffffe00c6c9a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6c9aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6c9aab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command lockf2 pid 31871 tid 100608 td 0xfffff80027049000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b351d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b35200 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b35240 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b35270 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b352d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x2d4/frame 0xfffffe00c6b35350 __lockmgr_args() at __lockmgr_args+0x547/frame 0xfffffe00c6b353f0 ffs_lock() at ffs_lock+0xaf/frame 0xfffffe00c6b35440 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6b35470 null_lock() at null_lock+0xe3/frame 0xfffffe00c6b354d0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xe1/frame 0xfffffe00c6b35500 _vn_lock() at _vn_lock+0x66/frame 0xfffffe00c6b35570 lookup() at lookup+0x114/frame 0xfffffe00c6b35610 namei() at namei+0x53b/frame 0xfffffe00c6b356d0 vn_open_cred() at vn_open_cred+0x207/frame 0xfffffe00c6b35810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6b35980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b35ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b35ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b5c3a, rsp = 0x7fffffffe338, rbp = 0x7fffffffe420 --- Tracing command openat pid 31869 tid 100595 td 0xfffff8014ed5f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6af3e70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6af3ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6af3ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6af3f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6af3f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6af3ff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6af4090 getblk() at getblk+0x12d/frame 0xfffffe00c6af4130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6af4190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6af4200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c6af42a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6af42f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c6af4380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c6af4510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c6af4530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c6af4560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6af46a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c6af46d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c6af4810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6af4980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6af4ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6af4ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b6c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command link pid 31868 tid 100782 td 0xfffff80206c17560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 31867 tid 100647 td 0xfffff801381a8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6bf7b90 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6bf7bc0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6bf7c00 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6bf7c30 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6bf7c90 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6bf7d10 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6bf7db0 getblk() at getblk+0x12d/frame 0xfffffe00c6bf7e50 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6bf7eb0 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6bf7f20 ffs_alloccg() at ffs_alloccg+0x94/frame 0xfffffe00c6bf7fa0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6bf7ff0 ffs_alloc() at ffs_alloc+0x1ee/frame 0xfffffe00c6bf8060 ffs_balloc_ufs2() at ffs_balloc_ufs2+0xc39/frame 0xfffffe00c6bf8200 ffs_write() at ffs_write+0x20f/frame 0xfffffe00c6bf82a0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00c6bf83b0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6bf84f0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17f/frame 0xfffffe00c6bf8600 vn_write() at vn_write+0x26b/frame 0xfffffe00c6bf8680 vn_io_fault_doio() at vn_io_fault_doio+0x43/frame 0xfffffe00c6bf86e0 vn_io_fault1() at vn_io_fault1+0x171/frame 0xfffffe00c6bf8820 vn_io_fault() at vn_io_fault+0x195/frame 0xfffffe00c6bf8890 dofilewrite() at dofilewrite+0xa7/frame 0xfffffe00c6bf88e0 kern_writev() at kern_writev+0x68/frame 0xfffffe00c6bf8930 sys_write() at sys_write+0x86/frame 0xfffffe00c6bf8980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6bf8ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6bf8ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800829aaa, rsp = 0x7fffffffd3a8, rbp = 0x7fffffffe460 --- Tracing command lockf2 pid 31866 tid 100604 td 0xfffff80027049560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b20f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b20f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b20f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b20fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6b21060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6b210a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6b210f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6b21130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6b211b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6b21200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6b21230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c6b212a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6b21310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6b21350 zone_import() at zone_import+0x53/frame 0xfffffe00c6b213c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6b21400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6b21470 malloc() at malloc+0x122/frame 0xfffffe00c6b214c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c6b21570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c6b215c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c6b216c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c6b216f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6b21830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c6b21860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c6b21910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c6b21980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b21ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b21ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command openat pid 31865 tid 100630 td 0xfffff8014e257560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ba2f20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ba2f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ba2f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ba2fc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6ba3020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6ba30a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6ba3140 getblk() at getblk+0x12d/frame 0xfffffe00c6ba31e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6ba3240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6ba32b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c6ba3330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c6ba3370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c6ba33f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c6ba3400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c6ba3440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6ba3470 vinactive() at vinactive+0xe6/frame 0xfffffe00c6ba34c0 vputx() at vputx+0x320/frame 0xfffffe00c6ba3520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c6ba3570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c6ba35a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c6ba3610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c6ba3640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c6ba3660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c6ba3690 vinactive() at vinactive+0xe6/frame 0xfffffe00c6ba36e0 vputx() at vputx+0x320/frame 0xfffffe00c6ba3740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c6ba3980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ba3ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ba3ab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command rw pid 31864 tid 100919 td 0xfffff80995774560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31863 tid 100592 td 0xfffff8007dbc7560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6ae4f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6ae4f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6ae4f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6ae4fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c6ae5060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c6ae50a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c6ae50f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c6ae5130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c6ae51b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c6ae5200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c6ae5230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c6ae52a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c6ae5310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c6ae5350 zone_import() at zone_import+0x53/frame 0xfffffe00c6ae53c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c6ae5400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c6ae5470 malloc() at malloc+0x122/frame 0xfffffe00c6ae54c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c6ae5570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c6ae55c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c6ae56c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c6ae56f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6ae5830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c6ae5860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c6ae5910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c6ae5980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6ae5ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6ae5ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command openat pid 31862 tid 100602 td 0xfffff80003be8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c6b16e70 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c6b16ea0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6b16ee0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c6b16f10 sleeplk() at sleeplk+0x149/frame 0xfffffe00c6b16f70 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c6b16ff0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c6b17090 getblk() at getblk+0x12d/frame 0xfffffe00c6b17130 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c6b17190 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c6b17200 ffs_nodealloccg() at ffs_nodealloccg+0xa0/frame 0xfffffe00c6b172a0 ffs_hashalloc() at ffs_hashalloc+0x79/frame 0xfffffe00c6b172f0 ffs_valloc() at ffs_valloc+0x454/frame 0xfffffe00c6b17380 ufs_makeinode() at ufs_makeinode+0xb2/frame 0xfffffe00c6b17510 ufs_create() at ufs_create+0x34/frame 0xfffffe00c6b17530 VOP_CREATE_APV() at VOP_CREATE_APV+0xf7/frame 0xfffffe00c6b17560 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c6b176a0 VOP_CREATE_APV() at VOP_CREATE_APV+0xfc/frame 0xfffffe00c6b176d0 vn_open_cred() at vn_open_cred+0x29c/frame 0xfffffe00c6b17810 kern_openat() at kern_openat+0x20c/frame 0xfffffe00c6b17980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6b17ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6b17ab0 --- syscall (499, FreeBSD ELF64, sys_openat), rip = 0x8007b6c3a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe310 --- Tracing command openat pid 31861 tid 100891 td 0xfffff80995adc560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7899f20 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7899f50 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7899f90 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7899fc0 sleeplk() at sleeplk+0x149/frame 0xfffffe00c789a020 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00c789a0a0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00c789a140 getblk() at getblk+0x12d/frame 0xfffffe00c789a1e0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00c789a240 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00c789a2b0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00c789a330 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00c789a370 softdep_freefile() at softdep_freefile+0x566/frame 0xfffffe00c789a3f0 ffs_vfree() at ffs_vfree+0x2a/frame 0xfffffe00c789a400 ufs_inactive() at ufs_inactive+0x36b/frame 0xfffffe00c789a440 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c789a470 vinactive() at vinactive+0xe6/frame 0xfffffe00c789a4c0 vputx() at vputx+0x320/frame 0xfffffe00c789a520 null_reclaim() at null_reclaim+0xe9/frame 0xfffffe00c789a570 VOP_RECLAIM_APV() at VOP_RECLAIM_APV+0xfd/frame 0xfffffe00c789a5a0 vgonel() at vgonel+0x24c/frame 0xfffffe00c789a610 vrecycle() at vrecycle+0x5c/frame 0xfffffe00c789a640 null_inactive() at null_inactive+0x57/frame 0xfffffe00c789a660 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0xfd/frame 0xfffffe00c789a690 vinactive() at vinactive+0xe6/frame 0xfffffe00c789a6e0 vputx() at vputx+0x320/frame 0xfffffe00c789a740 kern_unlinkat() at kern_unlinkat+0x22a/frame 0xfffffe00c789a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c789aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c789aab0 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80082273a, rsp = 0x7fffffffe318, rbp = 0x7fffffffe450 --- Tracing command lockf2 pid 31860 tid 100916 td 0xfffff80995c15000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c7916f10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c7916f40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c7916f80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c7916fb0 _sleep() at _sleep+0x367/frame 0xfffffe00c7917060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c79170a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c79170f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c7917130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c79171b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c7917200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c7917230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c79172a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c7917310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c7917350 zone_import() at zone_import+0x53/frame 0xfffffe00c79173c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c7917400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c7917470 malloc() at malloc+0x122/frame 0xfffffe00c79174c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c7917570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c79175c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c79176c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c79176f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c7917830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c7917860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c7917910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c7917980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c7917ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c7917ab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command lockf2 pid 31859 tid 100256 td 0xfffff8001ac15560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c544ef10 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c544ef40 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c544ef80 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c544efb0 _sleep() at _sleep+0x367/frame 0xfffffe00c544f060 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c544f0a0 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00c544f0f0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00c544f130 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00c544f1b0 vm_page_alloc_domain() at vm_page_alloc_domain+0x81/frame 0xfffffe00c544f200 uma_small_alloc() at uma_small_alloc+0x74/frame 0xfffffe00c544f230 keg_alloc_slab() at keg_alloc_slab+0xfb/frame 0xfffffe00c544f2a0 keg_fetch_slab() at keg_fetch_slab+0x11a/frame 0xfffffe00c544f310 zone_fetch_slab() at zone_fetch_slab+0x5a/frame 0xfffffe00c544f350 zone_import() at zone_import+0x53/frame 0xfffffe00c544f3c0 zone_alloc_item() at zone_alloc_item+0x3b/frame 0xfffffe00c544f400 uma_zalloc_arg() at uma_zalloc_arg+0x6a6/frame 0xfffffe00c544f470 malloc() at malloc+0x122/frame 0xfffffe00c544f4c0 lf_advlockasync() at lf_advlockasync+0x32c/frame 0xfffffe00c544f570 lf_advlock() at lf_advlock+0x45/frame 0xfffffe00c544f5c0 vop_stdadvlock() at vop_stdadvlock+0xc9/frame 0xfffffe00c544f6c0 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0xfd/frame 0xfffffe00c544f6f0 null_bypass() at null_bypass+0x10c/frame 0xfffffe00c544f830 VOP_ADVLOCK_APV() at VOP_ADVLOCK_APV+0x102/frame 0xfffffe00c544f860 kern_fcntl() at kern_fcntl+0xcb9/frame 0xfffffe00c544f910 kern_fcntl_freebsd() at kern_fcntl_freebsd+0xa5/frame 0xfffffe00c544f980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c544fab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c544fab0 --- syscall (92, FreeBSD ELF64, sys_fcntl), rip = 0x80081a78a, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe420 --- Tracing command openat pid 31858 tid 100710 td 0xfffff8014ed17000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31857 tid 100907 td 0xfffff8020655c560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command swap pid 31855 tid 100565 td 0xfffff8014e498560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rename pid 31854 tid 100765 td 0xfffff8014e23c560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command mkdir pid 31853 tid 100806 td 0xfffff80206d31000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command creat pid 31852 tid 100527 td 0xfffff8014e23f560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command link pid 31850 tid 100725 td 0xfffff802063cd000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command fts pid 31848 tid 100722 td 0xfffff802063cd560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rw pid 31846 tid 100502 td 0xfffff800037c2000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command openat pid 31844 tid 100638 td 0xfffff800270cd000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command lockf2 pid 31842 tid 100922 td 0xfffff80995cbe560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command run pid 28482 tid 100741 td 0xfffff8020673e560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command run pid 28481 tid 100790 td 0xfffff80206bca560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 28462 tid 100568 td 0xfffff8001acf3560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 28038 tid 100746 td 0xfffff8001a96c560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 28036 tid 100879 td 0xfffff80206b32560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 6340 tid 100573 td 0xfffff80027109000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 3241 tid 100583 td 0xfffff8001ace7000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 3230 tid 100585 td 0xfffff800274cc560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command csh pid 3228 tid 100555 td 0xfffff8014e499000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command su pid 3227 tid 100563 td 0xfffff8014eccf560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bash pid 3220 tid 100511 td 0xfffff8001ae89560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 1745 tid 100560 td 0xfffff8007dfbd000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 1740 tid 100219 td 0xfffff8001ab9b560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 1739 tid 100538 td 0xfffff8007d8a2560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command inetd pid 1695 tid 100259 td 0xfffff8001aa6a560 sched_switch() at sched_switch+0x942/frame 0xfffffe00c545e5b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c545e5e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c545e620 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00c545e680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00c545e6b0 _cv_wait_sig() at _cv_wait_sig+0x1fe/frame 0xfffffe00c545e710 seltdwait() at seltdwait+0x8d/frame 0xfffffe00c545e750 kern_select() at kern_select+0x886/frame 0xfffffe00c545e940 sys_select() at sys_select+0x56/frame 0xfffffe00c545e980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c545eab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c545eab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800448aca, rsp = 0x7fffffffde38, rbp = 0x7fffffffecd0 --- Tracing command nfscbd pid 1660 tid 100518 td 0xfffff8001ab8d560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cron pid 1585 tid 100245 td 0xfffff8001ab9a560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sendmail pid 1581 tid 100513 td 0xfffff80027109560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sshd pid 1575 tid 100516 td 0xfffff8001ab99000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c69675b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c69675e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c6967620 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00c6967680 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00c69676b0 _cv_wait_sig() at _cv_wait_sig+0x1fe/frame 0xfffffe00c6967710 seltdwait() at seltdwait+0x8d/frame 0xfffffe00c6967750 kern_select() at kern_select+0x886/frame 0xfffffe00c6967940 sys_select() at sys_select+0x56/frame 0xfffffe00c6967980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c6967ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c6967ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800874aca, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6d0 --- Tracing command saslauthd pid 1537 tid 100510 td 0xfffff8001aec9000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command saslauthd pid 1536 tid 100509 td 0xfffff8001aec9560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command saslauthd pid 1534 tid 100508 td 0xfffff8001aeca000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command saslauthd pid 1533 tid 100267 td 0xfffff8001aeca560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command saslauthd pid 1532 tid 100273 td 0xfffff800270d4000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command nfsuserd pid 1456 tid 100298 td 0xfffff8001ab99560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command watchdogd pid 1411 tid 100271 td 0xfffff8001ae56000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c549a6f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c549a720 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c549a760 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe00c549a7c0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x14/frame 0xfffffe00c549a800 _sleep() at _sleep+0x2f4/frame 0xfffffe00c549a8b0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1b7/frame 0xfffffe00c549a940 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00c549a980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe00c549aab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00c549aab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003b5c5a, rsp = 0x7fffffffeab8, rbp = 0x7fffffffeb00 --- Tracing command syslogd pid 1403 tid 100294 td 0xfffff8001acf4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00c550d500 mi_switch() at mi_switch+0x18c/frame 0xfffffe00c550d530 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00c550d570 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00c550d5a0 _sleep() at _sleep+0x367/frame 0xfffffe00c550d650 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00c550d690 vm_wait() at vm_wait+0x53/frame 0xfffffe00c550d6b0 _pmap_allocpte() at _pmap_allocpte+0x1e5/frame 0xfffffe00c550d720 pmap_enter() at pmap_enter+0x532/frame 0xfffffe00c550d7e0 vm_fault_hold() at vm_fault_hold+0x1c74/frame 0xfffffe00c550d910 vm_fault() at vm_fault+0x75/frame 0xfffffe00c550d950 trap_pfault() at trap_pfault+0x171/frame 0xfffffe00c550d9a0 trap() at trap+0x3be/frame 0xfffffe00c550dab0 calltrap() at calltrap+0x8/frame 0xfffffe00c550dab0 --- trap 0xc, rip = 0x207140, rsp = 0x7fffffffe128, rbp = 0x7fffffffece0 --- Tracing command adjkerntz pid 126 tid 100247 td 0xfffff800037c3560 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe007897cf40 kdb_reenter() at kdb_reenter+0x2f/frame 0xfffffe007897cf50 trap() at trap+0x5c/frame 0xfffffe007897d060 calltrap() at calltrap+0x8/frame 0xfffffe007897d060 --- trap 0xc, rip = 0xffffffff80fedc56, rsp = 0xfffffe007897d130, rbp = 0xfffffe007897d140 --- db_trace_thread() at db_trace_thread+0x26/frame 0xfffffe007897d140 _db_stack_trace_all() at _db_stack_trace_all+0xf4/frame 0xfffffe007897d1e0 db_command() at db_command+0x279/frame 0xfffffe007897d2b0 db_script_exec() at db_script_exec+0x188/frame 0xfffffe007897d350 db_command() at db_command+0x279/frame 0xfffffe007897d420 db_command_loop() at db_command_loop+0x64/frame 0xfffffe007897d430 db_trap() at db_trap+0xef/frame 0xfffffe007897d4c0 kdb_trap() at kdb_trap+0x1c3/frame 0xfffffe007897d530 trap() at trap+0x328/frame 0xfffffe007897d640 calltrap() at calltrap+0x8/frame 0xfffffe007897d640 --- trap 0x3, rip = 0xffffffff80b861cb, rsp = 0xfffffe007897d710, rbp = 0xfffffe007897d720 --- kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 44 tid 100209 td 0xfffff8001a970560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3623e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc362410 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc362450 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc362480 _sleep() at _sleep+0x367/frame 0xfffffe00bc362530 vm_wait_doms() at vm_wait_doms+0x171/frame 0xfffffe00bc362570 vm_wait_domain() at vm_wait_domain+0x18f/frame 0xfffffe00bc3625c0 vm_domain_alloc_fail() at vm_domain_alloc_fail+0xbc/frame 0xfffffe00bc362600 vm_page_alloc_domain_after() at vm_page_alloc_domain_after+0x3a0/frame 0xfffffe00bc362680 vm_page_alloc_after() at vm_page_alloc_after+0x65/frame 0xfffffe00bc362720 vm_page_grab_pages() at vm_page_grab_pages+0x4b0/frame 0xfffffe00bc3627c0 allocbuf() at allocbuf+0x34e/frame 0xfffffe00bc362830 getblk() at getblk+0x819/frame 0xfffffe00bc3628c0 ffs_sync() at ffs_sync+0x5d2/frame 0xfffffe00bc362970 sync_fsync() at sync_fsync+0xff/frame 0xfffffe00bc3629b0 VOP_FSYNC_APV() at VOP_FSYNC_APV+0xfd/frame 0xfffffe00bc3629e0 sched_sync() at sched_sync+0x284/frame 0xfffffe00bc362a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc362ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc362ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 43 tid 100208 td 0xfffff8001a974000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc35d870 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc35d8a0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc35d8e0 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc35d920 _sleep() at _sleep+0x307/frame 0xfffffe00bc35d9d0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe00bc35da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc35dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc35dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100205 td 0xfffff8001a974560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc34e8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc34e8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc34e930 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc34e970 _sleep() at _sleep+0x307/frame 0xfffffe00bc34ea20 buf_daemon() at buf_daemon+0xe8/frame 0xfffffe00bc34ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc34eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc34eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100210 td 0xfffff8001a9b7560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3678b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3678e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc367920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc367960 _sleep() at _sleep+0x307/frame 0xfffffe00bc367a10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc367a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc367ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc367ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100211 td 0xfffff8001a9b7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc36c8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc36c8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc36c920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc36c960 _sleep() at _sleep+0x307/frame 0xfffffe00bc36ca10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc36ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc36cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc36cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100212 td 0xfffff8001a9b6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3718b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3718e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc371920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc371960 _sleep() at _sleep+0x307/frame 0xfffffe00bc371a10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc371a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc371ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc371ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100213 td 0xfffff8001a9b6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3768b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3768e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc376920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc376960 _sleep() at _sleep+0x307/frame 0xfffffe00bc376a10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc376a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc376ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc376ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100214 td 0xfffff8001a9b5560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc37b8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc37b8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc37b920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc37b960 _sleep() at _sleep+0x307/frame 0xfffffe00bc37ba10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc37ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc37bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc37bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100215 td 0xfffff8001a9b5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3808b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3808e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc380920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc380960 _sleep() at _sleep+0x307/frame 0xfffffe00bc380a10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc380a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc380ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc380ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100216 td 0xfffff8001a9a8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3858b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3858e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc385920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc385960 _sleep() at _sleep+0x307/frame 0xfffffe00bc385a10 bufspace_daemon() at bufspace_daemon+0x2db/frame 0xfffffe00bc385a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc385ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc385ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100229 td 0xfffff8001aecb560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3c68e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3c6910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3c6950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc3c6990 _sleep() at _sleep+0x307/frame 0xfffffe00bc3c6a40 softdep_flush() at softdep_flush+0x17f/frame 0xfffffe00bc3c6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc3c6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc3c6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 42 tid 100237 td 0xfffff800271c4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3ee540 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3ee570 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc3ee5b0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3ee5e0 sleeplk() at sleeplk+0x149/frame 0xfffffe00bc3ee640 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x307/frame 0xfffffe00bc3ee6c0 __lockmgr_args() at __lockmgr_args+0x51a/frame 0xfffffe00bc3ee760 getblk() at getblk+0x12d/frame 0xfffffe00bc3ee800 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00bc3ee860 ffs_getcg() at ffs_getcg+0xd8/frame 0xfffffe00bc3ee8d0 ffs_freefile() at ffs_freefile+0x91/frame 0xfffffe00bc3ee950 handle_workitem_freefile() at handle_workitem_freefile+0x161/frame 0xfffffe00bc3ee990 process_worklist_item() at process_worklist_item+0x280/frame 0xfffffe00bc3eea00 softdep_process_worklist() at softdep_process_worklist+0xb2/frame 0xfffffe00bc3eea40 softdep_flush() at softdep_flush+0xef/frame 0xfffffe00bc3eea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc3eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc3eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 41 tid 100204 td 0xfffff8001a0ed000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3497d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc349800 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc349840 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc349870 _sleep() at _sleep+0x367/frame 0xfffffe00bc349920 vm_daemon() at vm_daemon+0x9f/frame 0xfffffe00bc349a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc349ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc349ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100203 td 0xfffff8001a0ed560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3447d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc344800 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc344840 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc344880 _sleep() at _sleep+0x307/frame 0xfffffe00bc344930 pause_sbt() at pause_sbt+0x144/frame 0xfffffe00bc344980 vm_pageout_worker() at vm_pageout_worker+0x168/frame 0xfffffe00bc3449f0 vm_pageout() at vm_pageout+0x23b/frame 0xfffffe00bc344a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc344ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc344ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100206 td 0xfffff8001a988000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3529a0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3529d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc352a10 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc352a40 _sleep() at _sleep+0x367/frame 0xfffffe00bc352af0 vm_page_busy_sleep() at vm_page_busy_sleep+0x14a/frame 0xfffffe00bc352b50 vm_page_grab_pages() at vm_page_grab_pages+0x306/frame 0xfffffe00bc352bf0 allocbuf() at allocbuf+0x34e/frame 0xfffffe00bc352c60 getblk() at getblk+0x819/frame 0xfffffe00bc352cf0 breadn_flags() at breadn_flags+0x34/frame 0xfffffe00bc352d50 ffs_balloc_ufs2() at ffs_balloc_ufs2+0x707/frame 0xfffffe00bc352f00 ffs_write() at ffs_write+0x20f/frame 0xfffffe00bc352fa0 VOP_WRITE_APV() at VOP_WRITE_APV+0x17a/frame 0xfffffe00bc3530b0 vnode_pager_generic_putpages() at vnode_pager_generic_putpages+0x581/frame 0xfffffe00bc3531a0 VOP_PUTPAGES_APV() at VOP_PUTPAGES_APV+0xfd/frame 0xfffffe00bc3531d0 vnode_pager_putpages() at vnode_pager_putpages+0x7d/frame 0xfffffe00bc353240 vm_pager_put_pages() at vm_pager_put_pages+0x7a/frame 0xfffffe00bc353280 vm_pageout_flush() at vm_pageout_flush+0x201/frame 0xfffffe00bc353350 vm_pageout_cluster() at vm_pageout_cluster+0x5e5/frame 0xfffffe00bc353610 vm_pageout_clean() at vm_pageout_clean+0x3a1/frame 0xfffffe00bc3536b0 vm_pageout_launder() at vm_pageout_launder+0xd4b/frame 0xfffffe00bc353980 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0x3ae/frame 0xfffffe00bc353a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc353ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc353ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 40 tid 100207 td 0xfffff8001a987560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3588e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc358910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc358950 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc358990 _sleep() at _sleep+0x307/frame 0xfffffe00bc358a40 uma_reclaim_worker() at uma_reclaim_worker+0xda/frame 0xfffffe00bc358a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc358ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc358ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 39 tid 100202 td 0xfffff80017fef560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc33f8a0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc33f8d0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc33f910 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc33f940 _sleep() at _sleep+0x367/frame 0xfffffe00bc33f9f0 enc_daemon() at enc_daemon+0x1ca/frame 0xfffffe00bc33fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc33fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc33fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 38 tid 100199 td 0xfffff8001a0f6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3308b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc3308e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc330920 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc330960 _sleep() at _sleep+0x307/frame 0xfffffe00bc330a10 random_kthread() at random_kthread+0x57/frame 0xfffffe00bc330a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc330ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc330ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 37 tid 100195 td 0xfffff8001a0f8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc31c900 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc31c930 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc31c970 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc31c9a0 _sleep() at _sleep+0x367/frame 0xfffffe00bc31ca50 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe00bc31ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc31cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc31cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 36 tid 100194 td 0xfffff80017ff0000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3178d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc317900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc317940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc317980 _sleep() at _sleep+0x307/frame 0xfffffe00bc317a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe00bc317a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc317ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc317ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 35 tid 100193 td 0xfffff80017ff0560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3128d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc312900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc312940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc312980 _sleep() at _sleep+0x307/frame 0xfffffe00bc312a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe00bc312a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc312ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc312ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 34 tid 100192 td 0xfffff80017ff1000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc30d8d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc30d900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc30d940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc30d980 _sleep() at _sleep+0x307/frame 0xfffffe00bc30da30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe00bc30da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc30dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc30dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 33 tid 100191 td 0xfffff80017ff1560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3088d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc308900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc308940 sleepq_timedwait() at sleepq_timedwait+0x50/frame 0xfffffe00bc308980 _sleep() at _sleep+0x307/frame 0xfffffe00bc308a30 soaio_kproc_loop() at soaio_kproc_loop+0x196/frame 0xfffffe00bc308a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc308ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc308ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100169 td 0xfffff800050ea560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc29a930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc29a960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc29a9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc29a9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc29aa30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc29aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc29aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc29aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100170 td 0xfffff800050ea000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc29f930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc29f960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc29f9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc29f9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc29fa30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc29fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc29fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc29fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100171 td 0xfffff800050e9560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2a4930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2a4960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2a49a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2a49d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2a4a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2a4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100172 td 0xfffff800050e9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2a9930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2a9960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2a99a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2a99d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2a9a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2a9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2a9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2a9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100173 td 0xfffff800050e1560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2ae930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2ae960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2ae9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2ae9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2aea30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100176 td 0xfffff80005520000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2bd930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2bd960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2bd9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2bd9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2bda30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100177 td 0xfffff8000551f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2c2930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2c2960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2c29a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2c29d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2c2a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100178 td 0xfffff8000551f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2c7930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2c7960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2c79a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2c79d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2c7a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100179 td 0xfffff8000551e560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2cc930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2cc960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2cc9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2cc9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2cca30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100180 td 0xfffff8000551e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2d1930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2d1960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2d19a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2d19d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2d1a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2d1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2d1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100182 td 0xfffff80005516000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2db930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2db960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2db9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2db9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2dba30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2dba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100183 td 0xfffff800050ec560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2e0930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2e0960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2e09a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2e09d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2e0a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100184 td 0xfffff80005824000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2e5930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2e5960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2e59a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2e59d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2e5a30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2e5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2e5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2e5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100185 td 0xfffff80005823560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2ea930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2ea960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2ea9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2ea9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2eaa30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2eaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2eaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 32 tid 100186 td 0xfffff80005823000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2ef930 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2ef960 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc2ef9a0 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc2ef9d0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe00bc2efa30 usb_process() at usb_process+0x12b/frame 0xfffffe00bc2efa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2efab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2efab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100161 td 0xfffff80003ab6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2728d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc272900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc272940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc272970 _sleep() at _sleep+0x367/frame 0xfffffe00bc272a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00bc272a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc272ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc272ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100162 td 0xfffff80003ab6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2778d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc277900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc277940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc277970 _sleep() at _sleep+0x367/frame 0xfffffe00bc277a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00bc277a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc277ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc277ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100163 td 0xfffff80003beb560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc27c8d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc27c900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc27c940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc27c970 _sleep() at _sleep+0x367/frame 0xfffffe00bc27ca20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00bc27ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc27cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc27cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100164 td 0xfffff80003beb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2818d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc281900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc281940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc281970 _sleep() at _sleep+0x367/frame 0xfffffe00bc281a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00bc281a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc281ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc281ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100165 td 0xfffff80003bea560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2868d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc286900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc286940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc286970 _sleep() at _sleep+0x367/frame 0xfffffe00bc286a20 xpt_done_td() at xpt_done_td+0x7b/frame 0xfffffe00bc286a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc286ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc286ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 31 tid 100201 td 0xfffff8001a0f5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc33a8c0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc33a8f0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc33a930 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc33a960 _sleep() at _sleep+0x367/frame 0xfffffe00bc33aa10 xpt_scanner_thread() at xpt_scanner_thread+0x93/frame 0xfffffe00bc33aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc33aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc33aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 23 pid 30 tid 100160 td 0xfffff80003ab7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc26d8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc26d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc26d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc26d950 _sleep() at _sleep+0x367/frame 0xfffffe00bc26da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc26da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc26dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc26dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 22 pid 29 tid 100159 td 0xfffff80003ab7560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2688b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2688e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc268920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc268950 _sleep() at _sleep+0x367/frame 0xfffffe00bc268a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc268a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc268ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc268ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 21 pid 28 tid 100158 td 0xfffff80003ab8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2638b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2638e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc263920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc263950 _sleep() at _sleep+0x367/frame 0xfffffe00bc263a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc263a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc263ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc263ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 20 pid 27 tid 100157 td 0xfffff80003ab8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc25e8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc25e8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc25e920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc25e950 _sleep() at _sleep+0x367/frame 0xfffffe00bc25ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc25ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc25eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc25eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 19 pid 26 tid 100156 td 0xfffff80003ab9000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2598b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2598e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc259920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc259950 _sleep() at _sleep+0x367/frame 0xfffffe00bc259a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc259a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc259ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc259ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 18 pid 25 tid 100155 td 0xfffff80003ab9560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2548b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2548e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc254920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc254950 _sleep() at _sleep+0x367/frame 0xfffffe00bc254a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc254a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc254ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc254ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 17 pid 24 tid 100154 td 0xfffff80003aba000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc24f8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc24f8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc24f920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc24f950 _sleep() at _sleep+0x367/frame 0xfffffe00bc24fa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc24fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc24fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc24fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 16 pid 23 tid 100153 td 0xfffff80003a88560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc24a8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc24a8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc24a920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc24a950 _sleep() at _sleep+0x367/frame 0xfffffe00bc24aa00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc24aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc24aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc24aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 15 pid 22 tid 100152 td 0xfffff80003aa2000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2458b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2458e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc245920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc245950 _sleep() at _sleep+0x367/frame 0xfffffe00bc245a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc245a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc245ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc245ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 14 pid 21 tid 100151 td 0xfffff80003aa2560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2408b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2408e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc240920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc240950 _sleep() at _sleep+0x367/frame 0xfffffe00bc240a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc240a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc240ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc240ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 13 pid 20 tid 100150 td 0xfffff80003aa3000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc23b8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc23b8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc23b920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc23b950 _sleep() at _sleep+0x367/frame 0xfffffe00bc23ba00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc23ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc23bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc23bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 12 pid 19 tid 100149 td 0xfffff80003aa3560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2368b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2368e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc236920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc236950 _sleep() at _sleep+0x367/frame 0xfffffe00bc236a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc236a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc236ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc236ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 18 tid 100148 td 0xfffff80003aa4000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2318b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2318e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc231920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc231950 _sleep() at _sleep+0x367/frame 0xfffffe00bc231a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc231a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc231ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc231ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 17 tid 100147 td 0xfffff80003aa4560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc22c8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc22c8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc22c920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc22c950 _sleep() at _sleep+0x367/frame 0xfffffe00bc22ca00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc22ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc22cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc22cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 16 tid 100146 td 0xfffff80003aa5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2278b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2278e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc227920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc227950 _sleep() at _sleep+0x367/frame 0xfffffe00bc227a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc227a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc227ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc227ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 15 tid 100145 td 0xfffff80003aa5560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2228b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2228e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc222920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc222950 _sleep() at _sleep+0x367/frame 0xfffffe00bc222a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc222a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc222ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc222ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 14 tid 100144 td 0xfffff80003a81000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc21d8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc21d8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc21d920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc21d950 _sleep() at _sleep+0x367/frame 0xfffffe00bc21da00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc21da70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc21dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc21dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100143 td 0xfffff80003a81560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2188b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2188e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc218920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc218950 _sleep() at _sleep+0x367/frame 0xfffffe00bc218a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc218a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc218ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc218ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100142 td 0xfffff80003a82000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2138b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2138e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc213920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc213950 _sleep() at _sleep+0x367/frame 0xfffffe00bc213a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc213a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc213ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc213ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100141 td 0xfffff80003a82560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc20e8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc20e8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc20e920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc20e950 _sleep() at _sleep+0x367/frame 0xfffffe00bc20ea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc20ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc20eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc20eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100140 td 0xfffff80003a83000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2098b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2098e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc209920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc209950 _sleep() at _sleep+0x367/frame 0xfffffe00bc209a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc209a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc209ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc209ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100139 td 0xfffff80003a83560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2048b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2048e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc204920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc204950 _sleep() at _sleep+0x367/frame 0xfffffe00bc204a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00bc204a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc204ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc204ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100138 td 0xfffff80003a84000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005fe8b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005fe8e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005fe920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005fe950 _sleep() at _sleep+0x367/frame 0xfffffe00005fea00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005fea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005feab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005feab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100137 td 0xfffff80003a84560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f98b0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005f98e0 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f9920 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f9950 _sleep() at _sleep+0x367/frame 0xfffffe00005f9a00 crypto_ret_proc() at crypto_ret_proc+0x238/frame 0xfffffe00005f9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100136 td 0xfffff80003a88000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005f48e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005f4910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005f4950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005f4980 _sleep() at _sleep+0x367/frame 0xfffffe00005f4a30 crypto_proc() at crypto_proc+0x2d4/frame 0xfffffe00005f4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005f4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005f4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100108 td 0xfffff80003972000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005688e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000568910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000568950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000568980 _sleep() at _sleep+0x367/frame 0xfffffe0000568a30 g_run_events() at g_run_events+0x4f/frame 0xfffffe0000568a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000568ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000568ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100109 td 0xfffff800039be560 sched_switch() at sched_switch+0x942/frame 0xfffffe000056d8e0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000056d910 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000056d950 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000056d980 _sleep() at _sleep+0x367/frame 0xfffffe000056da30 g_io_schedule_up() at g_io_schedule_up+0xa5/frame 0xfffffe000056da60 g_up_procbody() at g_up_procbody+0x6d/frame 0xfffffe000056da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000056dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000056dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100110 td 0xfffff800039be000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005728d0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000572900 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000572940 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000572970 _sleep() at _sleep+0x367/frame 0xfffffe0000572a20 g_io_schedule_down() at g_io_schedule_down+0x14c/frame 0xfffffe0000572a60 g_down_procbody() at g_down_procbody+0x6d/frame 0xfffffe0000572a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000572ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000572ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100027 td 0xfffff80003771000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d29f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789d2a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00789d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100028 td 0xfffff800037a8560 sched_switch() at sched_switch+0x942/frame 0xfffffe00789d79f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789d7a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00789d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100030 td 0xfffff800037a7560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100082 td 0xfffff8000395e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e69f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004e6a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00004e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100083 td 0xfffff8000395d560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100084 td 0xfffff8000395d000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100085 td 0xfffff8000395c560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100086 td 0xfffff8000395c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100087 td 0xfffff8000395b560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100088 td 0xfffff8000395b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100089 td 0xfffff8000394f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100090 td 0xfffff8000394f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100091 td 0xfffff8000396c560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100092 td 0xfffff8000396c000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100093 td 0xfffff8000396b560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffff8000396b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100095 td 0xfffff8000396a560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100096 td 0xfffff8000396a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100097 td 0xfffff80003969560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100098 td 0xfffff80003969000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100099 td 0xfffff8000395e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100100 td 0xfffff80003976000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100101 td 0xfffff80003975560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100102 td 0xfffff80003975000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100103 td 0xfffff80003974560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100104 td 0xfffff80003974000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100105 td 0xfffff80003973560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100106 td 0xfffff80003973000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100107 td 0xfffff80003972560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005639f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000563a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe0000563a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000563ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000563ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100166 td 0xfffff800050ec000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc28b9f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc28ba20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc28ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc28bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc28bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100167 td 0xfffff800050eb560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100168 td 0xfffff800050eb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2959f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc295a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc295a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc295ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc295ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100174 td 0xfffff800050e1000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2b39f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2b3a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc2b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100175 td 0xfffff80005520560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffff80005516560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2d69f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2d6a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc2d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100187 td 0xfffff80005822560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2f49f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2f4a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc2f4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2f4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2f4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100188 td 0xfffff80005822000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2f99f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2f9a20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc2f9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2f9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2f9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100189 td 0xfffff80005821560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc2fe9f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc2fea20 ithread_loop() at ithread_loop+0x1f1/frame 0xfffffe00bc2fea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc2feab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc2feab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100277 td 0xfffff8001ad2f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100278 td 0xfffff8001ad2f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100279 td 0xfffff8001acbb560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100280 td 0xfffff8001acbb000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100281 td 0xfffff80027a51560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100282 td 0xfffff80027a51000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100283 td 0xfffff80027a50560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100284 td 0xfffff80027a50000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100285 td 0xfffff80027a4f560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100286 td 0xfffff80027a4f000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100287 td 0xfffff80027a4e560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100288 td 0xfffff80027a4e000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100289 td 0xfffff800277b9560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100290 td 0xfffff80027b19000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100291 td 0xfffff80027b18560 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100292 td 0xfffff80027b18000 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffff8000375c000 (CPU 0) cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81fb7630 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xffffffff81fb7650 trap() at trap+0x49/frame 0xffffffff81fb7760 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81fb7760 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007895a900, rbp = 0xfffffe007895a910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007895a910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007895a960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895a980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007895a9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffff8000375b560 (CPU 1) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071b8df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071b8e10 trap() at trap+0x49/frame 0xfffffe00071b8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071b8f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007895f900, rbp = 0xfffffe007895f910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007895f910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007895f960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007895f980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007895f9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007895fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe007895fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007895fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff8000375b000 (CPU 2) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071c3df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071c3e10 trap() at trap+0x49/frame 0xfffffe00071c3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071c3f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078964900, rbp = 0xfffffe0078964910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078964910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078964960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078964980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789649a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078964a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078964ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078964ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff8000375a560 (CPU 3) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071cedf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071cee10 trap() at trap+0x49/frame 0xfffffe00071cef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071cef20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078969900, rbp = 0xfffffe0078969910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078969910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078969960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078969980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789699a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078969a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078969ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078969ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff8000375a000 (CPU 4) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071d9df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071d9e10 trap() at trap+0x49/frame 0xfffffe00071d9f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071d9f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007896e900, rbp = 0xfffffe007896e910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007896e910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007896e960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007896e980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007896e9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007896ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe007896eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007896eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffff80003759560 (CPU 5) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071e4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071e4e10 trap() at trap+0x49/frame 0xfffffe00071e4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071e4f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078973900, rbp = 0xfffffe0078973910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078973910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078973960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078973980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789739a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078973a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078973ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078973ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffff80003759000 (CPU 6) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe00071efdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe00071efe10 trap() at trap+0x49/frame 0xfffffe00071eff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe00071eff20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078978900, rbp = 0xfffffe0078978910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078978910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078978960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078978980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789789a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078978a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078978ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078978ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffff80003770560 (CPU 7) kdb_enter() at kdb_enter+0x3b/frame 0xfffffe007897d720 hardclock_cnt() at hardclock_cnt+0x24a/frame 0xfffffe007897d780 handleevents() at handleevents+0xc9/frame 0xfffffe007897d7c0 timercb() at timercb+0x254/frame 0xfffffe007897d810 lapic_handle_timer() at lapic_handle_timer+0xa7/frame 0xfffffe007897d850 timerint_u() at timerint_u+0x96/frame 0xfffffe007897d960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007897d980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007897d9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007897da70 fork_exit() at fork_exit+0x84/frame 0xfffffe007897dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007897dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffff80003770000 (CPU 8) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000cffdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000cffe10 trap() at trap+0x49/frame 0xfffffe0000cfff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000cfff20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078982900, rbp = 0xfffffe0078982910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078982910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078982960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078982980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789829a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078982a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078982ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078982ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffff8000376f560 (CPU 9) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d0adf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d0ae10 trap() at trap+0x49/frame 0xfffffe0000d0af20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d0af20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078987900, rbp = 0xfffffe0078987910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078987910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078987960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078987980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789879a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078987a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078987ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078987ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffff8000376f000 (CPU 10) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d15df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d15e10 trap() at trap+0x49/frame 0xfffffe0000d15f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d15f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007898c900, rbp = 0xfffffe007898c910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007898c910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007898c960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007898c980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007898c9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007898ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe007898cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007898cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffff8000376e560 (CPU 11) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d20df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d20e10 trap() at trap+0x49/frame 0xfffffe0000d20f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d20f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078991900, rbp = 0xfffffe0078991910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078991910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078991960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078991980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789919a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078991a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078991ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078991ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100015 td 0xfffff8000376e000 (CPU 12) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d2bdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d2be10 trap() at trap+0x49/frame 0xfffffe0000d2bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d2bf20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe0078996900, rbp = 0xfffffe0078996910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe0078996910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe0078996960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe0078996980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789969a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe0078996a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078996ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078996ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100016 td 0xfffff8000376d560 (CPU 13) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d36df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d36e10 trap() at trap+0x49/frame 0xfffffe0000d36f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d36f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe007899b900, rbp = 0xfffffe007899b910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe007899b910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe007899b960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe007899b980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe007899b9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe007899ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe007899bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe007899bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100017 td 0xfffff8000376d000 (CPU 14) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d41df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d41e10 trap() at trap+0x49/frame 0xfffffe0000d41f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d41f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789a0900, rbp = 0xfffffe00789a0910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789a0910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789a0960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789a0980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789a09a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100018 td 0xfffff8000375d560 (CPU 15) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d4cdf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d4ce10 trap() at trap+0x49/frame 0xfffffe0000d4cf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d4cf20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789a5900, rbp = 0xfffffe00789a5910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789a5910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789a5960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789a5980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789a59a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100019 td 0xfffff80003775000 (CPU 16) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d57df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d57e10 trap() at trap+0x49/frame 0xfffffe0000d57f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d57f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789aa900, rbp = 0xfffffe00789aa910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789aa910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789aa960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789aa980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789aa9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100020 td 0xfffff80003774560 (CPU 17) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d62df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d62e10 trap() at trap+0x49/frame 0xfffffe0000d62f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d62f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789af900, rbp = 0xfffffe00789af910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789af910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789af960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789af980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789af9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100021 td 0xfffff80003774000 (CPU 18) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d6ddf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d6de10 trap() at trap+0x49/frame 0xfffffe0000d6df20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d6df20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789b4900, rbp = 0xfffffe00789b4910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789b4910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789b4960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789b4980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789b49a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100022 td 0xfffff80003773560 (CPU 19) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d78df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d78e10 trap() at trap+0x49/frame 0xfffffe0000d78f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d78f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789b9900, rbp = 0xfffffe00789b9910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789b9910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789b9960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789b9980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789b99a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100023 td 0xfffff80003773000 (CPU 20) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d83df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d83e10 trap() at trap+0x49/frame 0xfffffe0000d83f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d83f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789be900, rbp = 0xfffffe00789be910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789be910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789be960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789be980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789be9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100024 td 0xfffff80003772560 (CPU 21) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d8edf0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d8ee10 trap() at trap+0x49/frame 0xfffffe0000d8ef20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d8ef20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789c3900, rbp = 0xfffffe00789c3910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789c3910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789c3960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789c3980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789c39a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100025 td 0xfffff80003772000 (CPU 22) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000d99df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000d99e10 trap() at trap+0x49/frame 0xfffffe0000d99f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000d99f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789c8900, rbp = 0xfffffe00789c8910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789c8910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789c8960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789c8980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789c89a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100026 td 0xfffff80003771560 (CPU 23) cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0000da4df0 ipi_nmi_handler() at ipi_nmi_handler+0x44/frame 0xfffffe0000da4e10 trap() at trap+0x49/frame 0xfffffe0000da4f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0000da4f20 --- trap 0x13, rip = 0xffffffff8116fd04, rsp = 0xfffffe00789cd900, rbp = 0xfffffe00789cd910 --- acpi_cpu_idle_mwait() at acpi_cpu_idle_mwait+0x44/frame 0xfffffe00789cd910 acpi_cpu_idle() at acpi_cpu_idle+0x19a/frame 0xfffffe00789cd960 cpu_idle_acpi() at cpu_idle_acpi+0x3f/frame 0xfffffe00789cd980 cpu_idle() at cpu_idle+0x8f/frame 0xfffffe00789cd9a0 sched_idletd() at sched_idletd+0x517/frame 0xfffffe00789cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff8000375c560 sched_switch() at sched_switch+0x942/frame 0xfffffe0078955550 mi_switch() at mi_switch+0x18c/frame 0xfffffe0078955580 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789555c0 sleepq_catch_signals() at sleepq_catch_signals+0x300/frame 0xfffffe0078955620 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0078955650 _sleep() at _sleep+0x359/frame 0xfffffe0078955700 kern_wait6() at kern_wait6+0x4c4/frame 0xfffffe0078955790 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0078955980 amd64_syscall() at amd64_syscall+0x7ab/frame 0xfffffe0078955ab0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0078955ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2a70aa, rsp = 0x7fffffffe788, rbp = 0x7fffffffe7f0 --- Tracing command audit pid 10 tid 100001 td 0xfffff8000375d000 sched_switch() at sched_switch+0x942/frame 0xfffffe0078950910 mi_switch() at mi_switch+0x18c/frame 0xfffffe0078950940 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0078950980 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789509b0 _cv_wait() at _cv_wait+0x203/frame 0xfffffe0078950a10 audit_worker() at audit_worker+0x93/frame 0xfffffe0078950a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0078950ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0078950ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81ffdfc0 sched_switch() at sched_switch+0x942/frame 0xffffffff82402960 mi_switch() at mi_switch+0x18c/frame 0xffffffff82402990 sleepq_switch() at sleepq_switch+0x10d/frame 0xffffffff824029d0 sleepq_wait() at sleepq_wait+0x43/frame 0xffffffff82402a00 _sleep() at _sleep+0x367/frame 0xffffffff82402ab0 vm_wait_min() at vm_wait_min+0x7a/frame 0xffffffff82402ad0 swapper() at swapper+0x1e/frame 0xffffffff82402b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100029 td 0xfffff800037a8000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789dc8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789dc920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789dc960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789dc990 _sleep() at _sleep+0x367/frame 0xfffffe00789dca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffff800037a7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789e68f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789e6920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789e6960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789e6990 _sleep() at _sleep+0x367/frame 0xfffffe00789e6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789e6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789e6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789e6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffff800037a6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00789eb8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789eb920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789eb960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789eb990 _sleep() at _sleep+0x367/frame 0xfffffe00789eba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00789eba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ebab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ebab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff800037a6000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f0920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789f0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00789f0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800037a5560 sched_switch() at sched_switch+0x942/frame 0xfffffe00789f5920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789f5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789f5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789f59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00789f5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789f5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789f5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789f5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffff800037a5000 sched_switch() at sched_switch+0x942/frame 0xfffffe00789fa920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789fa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789fa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789fa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00789faa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789faa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789faab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789faab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffff80003775560 sched_switch() at sched_switch+0x942/frame 0xfffffe00789ff920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00789ff950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00789ff990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00789ff9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00789ffa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00789ffa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00789ffab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00789ffab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffff800037b5000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000405920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000405950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000405990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004059c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000405a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000405a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000405ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000405ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffff800037b4560 sched_switch() at sched_switch+0x942/frame 0xfffffe000040a920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000040a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000040aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff800037b4000 sched_switch() at sched_switch+0x942/frame 0xfffffe000040f920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000040f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000040f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000040f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000040fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000040fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000040fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000040fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffff800037b3560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000414920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000414950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000414990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004149c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000414a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000414a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000414ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000414ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800037b3000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000419920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000419950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000419990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004199c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000419a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000419a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000419ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000419ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffff800037b2560 sched_switch() at sched_switch+0x942/frame 0xfffffe000041e920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000041e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000041e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000041e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000041ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000041ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000041eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000041eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffff800037b2000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000423920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000423950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000423990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004239c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000423a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000423a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000423ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000423ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffff800037b1560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000428920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000428950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000428990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004289c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000428a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000428a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000428ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000428ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffff800037b1000 sched_switch() at sched_switch+0x942/frame 0xfffffe000042d920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000042d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000042d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000042d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000042da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000042da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000042dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000042dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffff800037bd560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000432920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000432950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000432990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004329c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000432a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000432a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000432ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000432ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100047 td 0xfffff800037bd000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000437920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000437950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000437990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004379c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000437a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000437a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000437ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000437ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100048 td 0xfffff800037bc560 sched_switch() at sched_switch+0x942/frame 0xfffffe000043c920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000043c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000043c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000043c9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000043ca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000043ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000043cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000043cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100049 td 0xfffff800037bc000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000441920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000441950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000441990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004419c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000441a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000441a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000441ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000441ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100050 td 0xfffff800037bb560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000446920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000446950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000446990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004469c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000446a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000446a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000446ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000446ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100051 td 0xfffff800037bb000 sched_switch() at sched_switch+0x942/frame 0xfffffe000044b920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000044b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000044b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000044b9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000044ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000044ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000044bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000044bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100052 td 0xfffff800037ba560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000450920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000450950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000450990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004509c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000450a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000450a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000450ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000450ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100053 td 0xfffff800037ba000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000455920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000455950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000455990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004559c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000455a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000455a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000455ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000455ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xfffff800037b5560 sched_switch() at sched_switch+0x942/frame 0xfffffe000045a920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000045a950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000045a990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000045a9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000045aa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000045aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000045aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000045aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100055 td 0xfffff800037cd000 sched_switch() at sched_switch+0x942/frame 0xfffffe000045f920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000045f950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000045f990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000045f9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000045fa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000045fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000045fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000045fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100056 td 0xfffff800037c5560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000464920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000464950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000464990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004649c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000464a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000464a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000464ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000464ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100057 td 0xfffff800037c5000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000469920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000469950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000469990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004699c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000469a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000469a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000469ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000469ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100058 td 0xfffff80003922560 sched_switch() at sched_switch+0x942/frame 0xfffffe000046e920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000046e950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000046e990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000046e9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000046ea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000046ea70 fork_exit() at fork_exit+0x84/frame 0xfffffe000046eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000046eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100059 td 0xfffff80003922000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000473920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000473950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000473990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004739c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000473a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000473a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000473ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000473ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100060 td 0xfffff80003921560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000478920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000478950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000478990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004789c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000478a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000478a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000478ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000478ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffff80003921000 sched_switch() at sched_switch+0x942/frame 0xfffffe000047d920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000047d950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000047d990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000047d9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000047da40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000047da70 fork_exit() at fork_exit+0x84/frame 0xfffffe000047dab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000047dab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xfffff80003920560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000482920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000482950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000482990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004829c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000482a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000482a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000482ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000482ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100063 td 0xfffff80003920000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000487920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000487950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000487990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004879c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000487a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000487a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000487ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000487ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100064 td 0xfffff80003914560 sched_switch() at sched_switch+0x942/frame 0xfffffe000048c920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000048c950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000048c990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000048c9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000048ca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000048ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000048cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000048cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100065 td 0xfffff80003914000 sched_switch() at sched_switch+0x942/frame 0xfffffe0000491920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000491950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000491990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004919c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000491a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000491a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000491ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000491ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffff800037cd560 sched_switch() at sched_switch+0x942/frame 0xfffffe0000496920 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000496950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000496990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004969c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe0000496a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe0000496a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000496ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000496ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffff80003931000 sched_switch() at sched_switch+0x942/frame 0xfffffe000049b920 mi_switch() at mi_switch+0x18c/frame 0xfffffe000049b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000049b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000049b9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe000049ba40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe000049ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000049bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000049bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffff80003930560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a0920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004a0950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a0990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a09c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004a0a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffff80003930000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004a5920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004a5950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004a5990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004a59c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004a5a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004a5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004a5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004a5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffff8000392f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004aa920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004aa950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004aa990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004aa9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004aaa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004aaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004aaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004aaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffff8000392f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004af920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004af950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004af990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004af9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004afa40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004afa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004afab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004afab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffff8000392e560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b4920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004b4950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b4990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b49c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004b4a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffff8000392e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004b9920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004b9950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004b9990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004b99c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004b9a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004b9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004b9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004b9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffff8000392d560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004be920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004be950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004be990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004be9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004bea40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004bea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004beab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004beab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffff8000392d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c3920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004c3950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c3990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c39c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004c3a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffff80003935560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004c8920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004c8950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004c8990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004c89c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004c8a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004c8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004c8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004c8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffff80003935000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004cd920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004cd950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004cd990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004cd9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004cda40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004cda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004cdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004cdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100078 td 0xfffff80003934560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d2920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004d2950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d2990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d29c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004d2a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100079 td 0xfffff80003934000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004d7920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004d7950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004d7990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004d79c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004d7a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004d7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004d7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004d7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100080 td 0xfffff80003933560 sched_switch() at sched_switch+0x942/frame 0xfffffe00004dc920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004dc950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004dc990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004dc9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004dca40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004dca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004dcab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004dcab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100081 td 0xfffff80003933000 sched_switch() at sched_switch+0x942/frame 0xfffffe00004e1920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00004e1950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00004e1990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00004e19c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00004e1a40 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xb1/frame 0xfffffe00004e1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00004e1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00004e1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100111 td 0xfffff800039bd560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005778f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000577920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000577960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000577990 _sleep() at _sleep+0x367/frame 0xfffffe0000577a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000577a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000577ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000577ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100112 td 0xfffff800039bd000 sched_switch() at sched_switch+0x942/frame 0xfffffe000057c8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000057c920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000057c960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000057c990 _sleep() at _sleep+0x367/frame 0xfffffe000057ca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000057ca70 fork_exit() at fork_exit+0x84/frame 0xfffffe000057cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000057cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100113 td 0xfffff800039bc560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005818f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000581920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000581960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000581990 _sleep() at _sleep+0x367/frame 0xfffffe0000581a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000581a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000581ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000581ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffff800039bc000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005868f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000586920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000586960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000586990 _sleep() at _sleep+0x367/frame 0xfffffe0000586a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000586a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000586ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000586ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100115 td 0xfffff800039bb560 sched_switch() at sched_switch+0x942/frame 0xfffffe000058b8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000058b920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000058b960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000058b990 _sleep() at _sleep+0x367/frame 0xfffffe000058ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000058ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe000058bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000058bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100116 td 0xfffff800039bb000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005908f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000590920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000590960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000590990 _sleep() at _sleep+0x367/frame 0xfffffe0000590a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000590a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000590ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000590ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100117 td 0xfffff80003976560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005958f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe0000595920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe0000595960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe0000595990 _sleep() at _sleep+0x367/frame 0xfffffe0000595a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe0000595a70 fork_exit() at fork_exit+0x84/frame 0xfffffe0000595ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000595ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100118 td 0xfffff80003a7c000 sched_switch() at sched_switch+0x942/frame 0xfffffe000059a8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000059a920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059a960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059a990 _sleep() at _sleep+0x367/frame 0xfffffe000059aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000059aa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100119 td 0xfffff80003a7b560 sched_switch() at sched_switch+0x942/frame 0xfffffe000059f8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe000059f920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe000059f960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe000059f990 _sleep() at _sleep+0x367/frame 0xfffffe000059fa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe000059fa70 fork_exit() at fork_exit+0x84/frame 0xfffffe000059fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000059fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffff80003a7b000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a48f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005a4920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a4960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a4990 _sleep() at _sleep+0x367/frame 0xfffffe00005a4a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a4a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffff80003a7a560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005a98f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005a9920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005a9960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005a9990 _sleep() at _sleep+0x367/frame 0xfffffe00005a9a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005a9a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005a9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005a9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffff80003a7a000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ae8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005ae920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ae960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ae990 _sleep() at _sleep+0x367/frame 0xfffffe00005aea40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005aea70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005aeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005aeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100123 td 0xfffff80003a79560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b38f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005b3920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b3960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b3990 _sleep() at _sleep+0x367/frame 0xfffffe00005b3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b3a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffff80003a79000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005b88f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005b8920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005b8960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005b8990 _sleep() at _sleep+0x367/frame 0xfffffe00005b8a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005b8a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005b8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005b8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100125 td 0xfffff80003a78560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005bd8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005bd920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005bd960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005bd990 _sleep() at _sleep+0x367/frame 0xfffffe00005bda40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005bda70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100126 td 0xfffff80003a78000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c28f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005c2920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c2960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c2990 _sleep() at _sleep+0x367/frame 0xfffffe00005c2a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c2a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c2ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c2ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100127 td 0xfffff80003a80560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005c78f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005c7920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005c7960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005c7990 _sleep() at _sleep+0x367/frame 0xfffffe00005c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005c7a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100128 td 0xfffff80003a80000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005cc8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005cc920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005cc960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005cc990 _sleep() at _sleep+0x367/frame 0xfffffe00005cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005cca70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100129 td 0xfffff80003a7f560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d18f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005d1920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d1960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d1990 _sleep() at _sleep+0x367/frame 0xfffffe00005d1a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d1a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100130 td 0xfffff80003a7f000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005d68f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005d6920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005d6960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005d6990 _sleep() at _sleep+0x367/frame 0xfffffe00005d6a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005d6a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100131 td 0xfffff80003a7e560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005db8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005db920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005db960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005db990 _sleep() at _sleep+0x367/frame 0xfffffe00005dba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005dba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100132 td 0xfffff80003a7e000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e08f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005e0920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e0960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e0990 _sleep() at _sleep+0x367/frame 0xfffffe00005e0a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e0a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100133 td 0xfffff80003a7d560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005e58f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005e5920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005e5960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005e5990 _sleep() at _sleep+0x367/frame 0xfffffe00005e5a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005e5a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005e5ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005e5ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100134 td 0xfffff80003a7d000 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ea8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005ea920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ea960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ea990 _sleep() at _sleep+0x367/frame 0xfffffe00005eaa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005eaa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005eaab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005eaab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100135 td 0xfffff80003a7c560 sched_switch() at sched_switch+0x942/frame 0xfffffe00005ef8f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00005ef920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00005ef960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00005ef990 _sleep() at _sleep+0x367/frame 0xfffffe00005efa40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00005efa70 fork_exit() at fork_exit+0x84/frame 0xfffffe00005efab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00005efab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100190 td 0xfffff80005821000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc303920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc303950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc303990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3039c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00bc303a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00bc303a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc303ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc303ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100196 td 0xfffff8001a0f7560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc321920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc321950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc321990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3219c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00bc321a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00bc321a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc321ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc321ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100197 td 0xfffff8001a0f7000 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc326920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc326950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc326990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc3269c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00bc326a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00bc326a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc326ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc326ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100198 td 0xfffff8001a0f6560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc32b920 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc32b950 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc32b990 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc32b9c0 msleep_spin_sbt() at msleep_spin_sbt+0x1eb/frame 0xfffffe00bc32ba40 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00bc32ba70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc32bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc32bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100200 td 0xfffff8001a0f5560 sched_switch() at sched_switch+0x942/frame 0xfffffe00bc3358f0 mi_switch() at mi_switch+0x18c/frame 0xfffffe00bc335920 sleepq_switch() at sleepq_switch+0x10d/frame 0xfffffe00bc335960 sleepq_wait() at sleepq_wait+0x43/frame 0xfffffe00bc335990 _sleep() at _sleep+0x367/frame 0xfffffe00bc335a40 taskqueue_thread_loop() at taskqueue_thread_loop+0xe1/frame 0xfffffe00bc335a70 fork_exit() at fork_exit+0x84/frame 0xfffffe00bc335ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00bc335ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> dump Dumping 2430 out of 65423 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 7 (kgdb) tid 100206 [Switching to thread 232 (Thread 100206)]#0 sched_switch (td=0xfffff8001a988000, newtd=0xfffff8000375a000, flags=) at ../../../kern/sched_ule.c:2115 2115 cpuid = PCPU_GET(cpuid); (kgdb) bt #0 sched_switch (td=0xfffff8001a988000, newtd=0xfffff8000375a000, flags=) at ../../../kern/sched_ule.c:2115 #1 0xffffffff80b4c03c in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:437 #2 0xffffffff80b9538d in sleepq_switch (wchan=0xfffff80fdba54c38, pri=0x54) at ../../../kern/subr_sleepqueue.c:613 #3 0xffffffff80b95233 in sleepq_wait (wchan=0xfffff80fdba54c38, pri=0x54) at ../../../kern/subr_sleepqueue.c:692 #4 0xffffffff80b4b887 in _sleep (ident=0xfffff80fdba54c38, lock=, priority=0x254, wmesg=0xffffffff815f82bd "grbmaw", sbt=0x0, pr=0x0, flags=0x100) at ../../../kern/kern_synch.c:216 #5 0xffffffff80e8490a in vm_page_busy_sleep (m=0xfffff80fdba54c38, wmesg=0xffffffff815f82bd "grbmaw", nonshared=0x1) at ../../../vm/vm_page.c:936 #6 0xffffffff80e8c8d6 in vm_page_grab_pages (object=0xfffff8001acab900, pindex=0x0, allocflags=0x1222, ma=0xfffffe0003180e40, count=0x8) at ../../../vm/vm_page.c:3920 #7 0xffffffff80bf43ae in allocbuf (bp=0xfffffe0003180c98, size=) at ../../../kern/vfs_bio.c:3069 #8 0xffffffff80bf22a9 in getblk (vp=, blkno=, size=, slpflag=, slptimeo=0x0, flags=0x8) at ../../../kern/vfs_bio.c:4100 #9 0xffffffff80bf1884 in breadn_flags (vp=0xfffff80027178278, blkno=, size=, rablkno=0x0, rabsize=0x0, cnt=0x0, cred=0x0, flags=0x8, ckhashfunc=0, bpp=0xfffffe00bc352ed0) at ../../../kern/vfs_bio.c:2144 #10 0xffffffff80e1eab7 in ffs_balloc_ufs2 (vp=0xfffff80027178278, startoffset=, size=, cred=0xfffff800036f6d00, flags=, bpp=0xfffffe00bc352f60) at ../../../ufs/ffs/ffs_balloc.c:758 #11 0xffffffff80e49eaf in ffs_write (ap=0xfffffe00bc3530c8) at ../../../ufs/ffs/ffs_vnops.c:754 #12 0xffffffff81189dca in VOP_WRITE_APV (vop=, a=0xfffffe00bc3530c8) at vnode_if.c:1000 #13 0xffffffff80ea5171 in vnode_pager_generic_putpages (vp=0xfffff80027178278, ma=0xfffffe00bc353450, bytecount=, flags=, rtvals=0xfffffe00bc353290) at vnode_if.h:413 #14 0xffffffff8118d19d in VOP_PUTPAGES_APV (vop=, a=0xfffffe00bc3531e8) at vnode_if.c:2930 #15 0xffffffff80ea2b0d in vnode_pager_putpages (object=, m=0xfffffe00bc353450, count=, flags=0x5, rtvals=0xfffffe00bc353290) at vnode_if.h:1224 #16 0xffffffff80e8f08a in vm_pager_put_pages (object=0xfffff8001acab900, m=0xfffffe00bc353450, count=0x4, flags=0x4, rtvals=0xfffffe00bc353290) at vm_pager.h:131 #17 0xffffffff80e8ec01 in vm_pageout_flush (mc=0xfffffe00bc353450, count=0x4, flags=0x4, mreq=0x0, prunlen=0x0, eio=0x0) at ../../../vm/vm_pageout.c:541 #18 0xffffffff80e93195 in vm_pageout_cluster (m=0xfffff80fd9b1f050) at ../../../vm/vm_pageout.c:492 #19 0xffffffff80e92661 in vm_pageout_clean (m=0xfffff80fd9b1f050, numpagedout=0xfffffe00bc353784) at ../../../vm/vm_pageout.c:738 #20 0xffffffff80e91c3b in vm_pageout_launder (vmd=0xffffffff820222c0, launder=0x339, in_shortfall=0x0) at ../../../vm/vm_pageout.c:960 #21 0xffffffff80e9092e in vm_pageout_laundry_worker (arg=0x0) at ../../../vm/vm_pageout.c:1148 #22 0xffffffff80b01754 in fork_exit (callout=0xffffffff80e90580 , arg=0x0, frame=0xfffffe00bc353ac0) at ../../../kern/kern_fork.c:1039 #23 0xffffffff80fefdae in fork_trampoline () at ../../../amd64/amd64/exception.S:842 #24 0x0000000000000000 in ?? () (kgdb) f 5 #5 0xffffffff80e8490a in vm_page_busy_sleep (m=0xfffff80fdba54c38, wmesg=0xffffffff815f82bd "grbmaw", nonshared=0x1) at ../../../vm/vm_page.c:936 936 msleep(m, vm_page_lockptr(m), PVM | PDROP, wmesg, 0); (kgdb) l 931 ((x & VPB_BIT_WAITERS) == 0 && 932 !atomic_cmpset_int(&m->busy_lock, x, x | VPB_BIT_WAITERS))) { 933 vm_page_unlock(m); 934 return; 935 } 936 msleep(m, vm_page_lockptr(m), PVM | PDROP, wmesg, 0); 937 } 938 939 /* 940 * vm_page_trysbusy: (kgdb) p *m $1 = {plinks = {q = {tqe_next = 0xfffff80fda530c70, tqe_prev = 0xfffff80fdd753890}, s = {ss = {sle_next = 0xfffff80fda530c70}, pv = 0xfffff80fdd753890}, memguard = { p = 0xfffff80fda530c70, v = 0xfffff80fdd753890}}, listq = {tqe_next = 0xfffff80fd9b1c2d0, tqe_prev = 0xfffff80fd978af48}, object = 0xfffff8001acab900, pindex = 0x7, phys_addr = 0x73af3000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xfffff80fdba54c70}, pv_gen = 0x68, pat_mode = 0x6}, wire_count = 0x0, busy_lock = 0x6, hold_count = 0x0, flags = 0x0, aflags = 0x8, oflags = 0x0, queue = 0x1, psind = 0x0, segind = 0x3, order = 0xd, pool = 0x0, act_count = 0x24, valid = 0xff, dirty = 0xff} (kgdb) f 6 #6 0xffffffff80e8c8d6 in vm_page_grab_pages (object=0xfffff8001acab900, pindex=0x0, allocflags=0x1222, ma=0xfffffe0003180e40, count=0x8) at ../../../vm/vm_page.c:3920 3920 vm_page_busy_sleep(m, "grbmaw", (allocflags & (kgdb) l 3915 * likely to reclaim it. 3916 */ 3917 vm_page_aflag_set(m, PGA_REFERENCED); 3918 vm_page_lock(m); 3919 VM_OBJECT_WUNLOCK(object); 3920 vm_page_busy_sleep(m, "grbmaw", (allocflags & 3921 VM_ALLOC_IGN_SBUSY) != 0); 3922 VM_OBJECT_WLOCK(object); 3923 goto retrylookup; 3924 } (kgdb) p *object $2 = {lock = {lock_object = {lo_name = 0xffffffff815f7106 "vm object", lo_flags = 0x25630000, lo_data = 0x0, lo_witness = 0xfffff8103fd69680}, rw_lock = 0x1}, object_list = { tqe_next = 0xfffff8001acaba00, tqe_prev = 0xfffff8001acab820}, shadow_head = {lh_first = 0xfffff80017ff6700}, shadow_list = {le_next = 0x0, le_prev = 0xfffff80003a97830}, memq = { tqh_first = 0xfffff80fd9b20640, tqh_last = 0xfffff80fdf622598}, rtree = {rt_root = 0xfffff8001a9cdc60}, size = 0xf, domain = {dr_policy = 0x0, dr_iterator = 0x0}, generation = 0x1, ref_count = 0x5, shadow_count = 0x1, memattr = 0x6, type = 0x2, flags = 0x1000, pg_color = 0x0, paging_in_progress = 0x5, resident_page_count = 0xd, backing_object = 0x0, backing_object_offset = 0x0, pager_object_list = {tqe_next = 0x0, tqe_prev = 0x0}, rvq = {lh_first = 0x0}, handle = 0xfffff80027178278, un_pager = {vnp = {vnp_size = 0xebe0, writemappings = 0x0}, devp = {devp_pglist = {tqh_first = 0xebe0, tqh_last = 0x0}, ops = 0x0, dev = 0x0}, sgp = {sgp_pglist = {tqh_first = 0xebe0, tqh_last = 0x0}}, swp = { swp_tmpfs = 0xebe0, swp_blks = {pt_root = 0x0}}}, cred = 0x0, charge = 0x0, umtx_data = 0x0} (kgdb) info loc m = 0xfffff80fdba54c38 mpred = 0xfffff80fd978af38 pflags = 0x232 i = 0x7 sleep = 0x1 (kgdb) $ svnlite diff -x -p /usr/src/sys Index: /usr/src/sys/amd64/include/vmparam.h =================================================================== --- /usr/src/sys/amd64/include/vmparam.h (revision 332641) +++ /usr/src/sys/amd64/include/vmparam.h (working copy) @@ -227,4 +227,10 @@ #define ZERO_REGION_SIZE (2 * 1024 * 1024) /* 2MB */ +/* + * Use a fairly large batch size since we expect amd64 systems to have lots of + * memory. + */ +#define VM_BATCHQUEUE_SIZE 31 + #endif /* _MACHINE_VMPARAM_H_ */ Index: /usr/src/sys/kern/subr_witness.c =================================================================== --- /usr/src/sys/kern/subr_witness.c (revision 332641) +++ /usr/src/sys/kern/subr_witness.c (working copy) @@ -603,7 +603,6 @@ static struct witness_order_list_entry order_lists * CDEV */ { "vm map (system)", &lock_class_mtx_sleep }, - { "vm pagequeue", &lock_class_mtx_sleep }, { "vnode interlock", &lock_class_mtx_sleep }, { "cdev", &lock_class_mtx_sleep }, { NULL, NULL }, @@ -613,11 +612,11 @@ static struct witness_order_list_entry order_lists { "vm map (user)", &lock_class_sx }, { "vm object", &lock_class_rw }, { "vm page", &lock_class_mtx_sleep }, - { "vm pagequeue", &lock_class_mtx_sleep }, { "pmap pv global", &lock_class_rw }, { "pmap", &lock_class_mtx_sleep }, { "pmap pv list", &lock_class_rw }, { "vm page free queue", &lock_class_mtx_sleep }, + { "vm pagequeue", &lock_class_mtx_sleep }, { NULL, NULL }, /* * kqueue/VFS interaction Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 332641) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -720,14 +720,11 @@ static void vm_object_terminate_pages(vm_object_t object) { vm_page_t p, p_next; - struct mtx *mtx, *mtx1; - struct vm_pagequeue *pq, *pq1; - int dequeued; + struct mtx *mtx; VM_OBJECT_ASSERT_WLOCKED(object); mtx = NULL; - pq = NULL; /* * Free any remaining pageable pages. This also removes them from the @@ -737,60 +734,21 @@ vm_object_terminate_pages(vm_object_t object) */ TAILQ_FOREACH_SAFE(p, &object->memq, listq, p_next) { vm_page_assert_unbusied(p); - if ((object->flags & OBJ_UNMANAGED) == 0) { + if ((object->flags & OBJ_UNMANAGED) == 0) /* * vm_page_free_prep() only needs the page * lock for managed pages. */ - mtx1 = vm_page_lockptr(p); - if (mtx1 != mtx) { - if (mtx != NULL) - mtx_unlock(mtx); - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - pq = NULL; - } - mtx = mtx1; - mtx_lock(mtx); - } - } + vm_page_change_lock(p, &mtx); p->object = NULL; if (p->wire_count != 0) - goto unlist; + continue; VM_CNT_INC(v_pfree); - p->flags &= ~PG_ZERO; - if (p->queue != PQ_NONE) { - KASSERT(p->queue < PQ_COUNT, ("vm_object_terminate: " - "page %p is not queued", p)); - pq1 = vm_page_pagequeue(p); - if (pq != pq1) { - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - } - pq = pq1; - vm_pagequeue_lock(pq); - dequeued = 0; - } - p->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, p, plinks.q); - dequeued--; - } - if (vm_page_free_prep(p, true)) - continue; -unlist: - TAILQ_REMOVE(&object->memq, p, listq); + vm_page_free(p); } - if (pq != NULL) { - vm_pagequeue_cnt_add(pq, dequeued); - vm_pagequeue_unlock(pq); - } if (mtx != NULL) mtx_unlock(mtx); - vm_page_free_phys_pglist(&object->memq); - /* * If the object contained any pages, then reset it to an empty state. * None of the object's fields, including "resident_page_count", were @@ -1973,7 +1931,6 @@ vm_object_page_remove(vm_object_t object, vm_pinde { vm_page_t p, next; struct mtx *mtx; - struct pglist pgl; VM_OBJECT_ASSERT_WLOCKED(object); KASSERT((object->flags & OBJ_UNMANAGED) == 0 || @@ -1982,7 +1939,6 @@ vm_object_page_remove(vm_object_t object, vm_pinde if (object->resident_page_count == 0) return; vm_object_pip_add(object, 1); - TAILQ_INIT(&pgl); again: p = vm_page_find_least(object, start); mtx = NULL; @@ -2036,13 +1992,10 @@ again: } if ((options & OBJPR_NOTMAPPED) == 0 && object->ref_count != 0) pmap_remove_all(p); - p->flags &= ~PG_ZERO; - if (vm_page_free_prep(p, false)) - TAILQ_INSERT_TAIL(&pgl, p, listq); + vm_page_free(p); } if (mtx != NULL) mtx_unlock(mtx); - vm_page_free_phys_pglist(&pgl); vm_object_pip_wakeup(object); } Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 332641) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -102,6 +102,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -131,13 +132,10 @@ extern int uma_startup_count(int); extern void uma_startup(void *, int); extern int vmem_startup_count(void); -/* - * Associated with page of user-allocatable memory is a - * page structure. - */ - struct vm_domain vm_dom[MAXMEMDOM]; +static DPCPU_DEFINE(struct vm_batchqueue, pqbatch[MAXMEMDOM][PQ_COUNT]); + struct mtx_padalign __exclusive_cache_line pa_lock[PA_LOCK_COUNT]; struct mtx_padalign __exclusive_cache_line vm_domainset_lock; @@ -176,7 +174,8 @@ static uma_zone_t fakepg_zone; static void vm_page_alloc_check(vm_page_t m); static void vm_page_clear_dirty_mask(vm_page_t m, vm_page_bits_t pagebits); -static void vm_page_enqueue(uint8_t queue, vm_page_t m); +static void vm_page_dequeue_complete(vm_page_t m); +static void vm_page_enqueue(vm_page_t m, uint8_t queue); static void vm_page_init(void *dummy); static int vm_page_insert_after(vm_page_t m, vm_object_t object, vm_pindex_t pindex, vm_page_t mpred); @@ -1826,6 +1825,7 @@ again: KASSERT(m != NULL, ("missing page")); found: + vm_page_dequeue(m); vm_page_alloc_check(m); /* @@ -2022,8 +2022,10 @@ again: #if VM_NRESERVLEVEL > 0 found: #endif - for (m = m_ret; m < &m_ret[npages]; m++) + for (m = m_ret; m < &m_ret[npages]; m++) { + vm_page_dequeue(m); vm_page_alloc_check(m); + } /* * Initialize the pages. Only the PG_ZERO flag is inherited. @@ -2167,6 +2169,7 @@ again: goto again; return (NULL); } + vm_page_dequeue(m); vm_page_alloc_check(m); /* @@ -2360,7 +2363,7 @@ retry: vm_reserv_size(level)) - pa); #endif } else if (object->memattr == VM_MEMATTR_DEFAULT && - m->queue != PQ_NONE && !vm_page_busied(m)) { + vm_page_enqueued(m) && !vm_page_busied(m)) { /* * The page is allocated but eligible for * relocation. Extend the current run by one @@ -2511,7 +2514,7 @@ retry: error = EINVAL; else if (object->memattr != VM_MEMATTR_DEFAULT) error = EINVAL; - else if (m->queue != PQ_NONE && !vm_page_busied(m)) { + else if (vm_page_enqueued(m) && !vm_page_busied(m)) { KASSERT(pmap_page_get_memattr(m) == VM_MEMATTR_DEFAULT, ("page %p has an unexpected memattr", m)); @@ -2571,7 +2574,8 @@ retry: */ if (object->ref_count != 0) pmap_remove_all(m); - m_new->aflags = m->aflags; + m_new->aflags = m->aflags & + ~PGA_QUEUE_STATE_MASK; KASSERT(m_new->oflags == VPO_UNMANAGED, ("page %p is managed", m_new)); m_new->oflags = m->oflags & VPO_NOSYNC; @@ -2583,7 +2587,7 @@ retry: vm_page_remque(m); vm_page_replace_checked(m_new, object, m->pindex, m); - if (vm_page_free_prep(m, false)) + if (vm_page_free_prep(m)) SLIST_INSERT_HEAD(&free, m, plinks.s.ss); @@ -2597,7 +2601,7 @@ retry: m->flags &= ~PG_ZERO; vm_page_remque(m); vm_page_remove(m); - if (vm_page_free_prep(m, false)) + if (vm_page_free_prep(m)) SLIST_INSERT_HEAD(&free, m, plinks.s.ss); KASSERT(m->dirty == 0, @@ -3040,35 +3044,209 @@ vm_page_pagequeue(vm_page_t m) return (&vm_pagequeue_domain(m)->vmd_pagequeues[m->queue]); } +static struct mtx * +vm_page_pagequeue_lockptr(vm_page_t m) +{ + + if (m->queue == PQ_NONE) + return (NULL); + return (&vm_page_pagequeue(m)->pq_mutex); +} + +static inline void +vm_pqbatch_process_page(struct vm_pagequeue *pq, vm_page_t m) +{ + struct vm_domain *vmd; + uint8_t aflags; + + vm_pagequeue_assert_locked(pq); + KASSERT(pq == vm_page_pagequeue(m), + ("page %p doesn't belong to %p", m, pq)); + + aflags = m->aflags; + if ((aflags & PGA_DEQUEUE) != 0) { + if (__predict_true((aflags & PGA_ENQUEUED) != 0)) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_pagequeue_cnt_dec(pq); + } + vm_page_dequeue_complete(m); + } else if ((aflags & (PGA_REQUEUE | PGA_REQUEUE_HEAD)) != 0) { + if ((aflags & PGA_ENQUEUED) != 0) + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + else { + vm_pagequeue_cnt_inc(pq); + vm_page_aflag_set(m, PGA_ENQUEUED); + } + if ((aflags & PGA_REQUEUE_HEAD) != 0) { + KASSERT(m->queue == PQ_INACTIVE, + ("head enqueue not supported for page %p", m)); + vmd = vm_pagequeue_domain(m); + TAILQ_INSERT_BEFORE(&vmd->vmd_inacthead, m, plinks.q); + } else + TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); + + /* + * PGA_REQUEUE and PGA_REQUEUE_HEAD must be cleared after + * setting PGA_ENQUEUED in order to synchronize with the + * page daemon. + */ + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } +} + +static void +vm_pqbatch_process(struct vm_pagequeue *pq, struct vm_batchqueue *bq, + uint8_t queue) +{ + vm_page_t m; + int i; + + for (i = 0; i < bq->bq_cnt; i++) { + m = bq->bq_pa[i]; + if (__predict_false(m->queue != queue)) + continue; + vm_pqbatch_process_page(pq, m); + } + vm_batchqueue_init(bq); +} + +static void +vm_pqbatch_submit_page(vm_page_t m, uint8_t queue) +{ + struct vm_batchqueue *bq; + struct vm_pagequeue *pq; + int domain; + + vm_page_assert_locked(m); + KASSERT(queue < PQ_COUNT, ("invalid queue %d", queue)); + + domain = vm_phys_domain(m); + pq = &vm_pagequeue_domain(m)->vmd_pagequeues[queue]; + + critical_enter(); + bq = DPCPU_PTR(pqbatch[domain][queue]); + if (vm_batchqueue_insert(bq, m)) { + critical_exit(); + return; + } + if (!vm_pagequeue_trylock(pq)) { + critical_exit(); + vm_pagequeue_lock(pq); + critical_enter(); + bq = DPCPU_PTR(pqbatch[domain][queue]); + } + vm_pqbatch_process(pq, bq, queue); + + /* + * The page may have been logically dequeued before we acquired the + * page queue lock. In this case, the page lock prevents the page + * from being logically enqueued elsewhere. + */ + if (__predict_true(m->queue == queue)) + vm_pqbatch_process_page(pq, m); + else { + KASSERT(m->queue == PQ_NONE, + ("invalid queue transition for page %p", m)); + KASSERT((m->aflags & PGA_ENQUEUED) == 0, + ("page %p is enqueued with invalid queue index", m)); + vm_page_aflag_clear(m, PGA_QUEUE_STATE_MASK); + } + vm_pagequeue_unlock(pq); + critical_exit(); +} + /* - * vm_page_dequeue: + * vm_page_drain_pqbatch: [ internal use only ] * - * Remove the given page from its current page queue. + * Force all per-CPU page queue batch queues to be drained. This is + * intended for use in severe memory shortages, to ensure that pages + * do not remain stuck in the batch queues. + */ +void +vm_page_drain_pqbatch(void) +{ + struct thread *td; + struct vm_domain *vmd; + struct vm_pagequeue *pq; + int domain, i, queue; + + td = curthread; + CPU_FOREACH(i) { + thread_lock(td); + sched_bind(td, i); + thread_unlock(td); + + for (domain = 0; domain < vm_ndomains; domain++) { + vmd = VM_DOMAIN(domain); + for (queue = 0; queue < PQ_COUNT; queue++) { + pq = &vmd->vmd_pagequeues[queue]; + vm_pagequeue_lock(pq); + critical_enter(); + vm_pqbatch_process(pq, + DPCPU_PTR(pqbatch[domain][queue]), queue); + critical_exit(); + vm_pagequeue_unlock(pq); + } + } + } + thread_lock(td); + sched_unbind(td); + thread_unlock(td); +} + +/* + * Complete the logical removal of a page from a page queue. We must be + * careful to synchronize with the page daemon, which may be concurrently + * examining the page with only the page lock held. The page must not be + * in a state where it appears to be logically enqueued. + */ +static void +vm_page_dequeue_complete(vm_page_t m) +{ + + m->queue = PQ_NONE; + atomic_thread_fence_rel(); + vm_page_aflag_clear(m, PGA_QUEUE_STATE_MASK); +} + +/* + * vm_page_dequeue_deferred: [ internal use only ] * + * Request removal of the given page from its current page + * queue. Physical removal from the queue may be deferred + * indefinitely. + * * The page must be locked. */ void -vm_page_dequeue(vm_page_t m) +vm_page_dequeue_deferred(vm_page_t m) { - struct vm_pagequeue *pq; + int queue; vm_page_assert_locked(m); - KASSERT(m->queue < PQ_COUNT, ("vm_page_dequeue: page %p is not queued", - m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_lock(pq); - m->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_dec(pq); - vm_pagequeue_unlock(pq); + + queue = m->queue; + if (queue == PQ_NONE) { + KASSERT((m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("page %p has queue state", m)); + return; + } + if ((m->aflags & PGA_DEQUEUE) == 0) + vm_page_aflag_set(m, PGA_DEQUEUE); + vm_pqbatch_submit_page(m, queue); } /* * vm_page_dequeue_locked: * - * Remove the given page from its current page queue. + * Remove the page from its page queue, which must be locked. + * If the page lock is not held, there is no guarantee that the + * page will not be enqueued by another thread before this function + * returns. In this case, it is up to the caller to ensure that + * no other threads hold a reference to the page. * - * The page and page queue must be locked. + * The page queue lock must be held. If the page is not already + * logically dequeued, the page lock must be held as well. */ void vm_page_dequeue_locked(vm_page_t m) @@ -3075,78 +3253,88 @@ vm_page_dequeue_locked(vm_page_t m) { struct vm_pagequeue *pq; - vm_page_lock_assert(m, MA_OWNED); pq = vm_page_pagequeue(m); + + KASSERT(m->queue != PQ_NONE, + ("%s: page %p queue field is PQ_NONE", __func__, m)); vm_pagequeue_assert_locked(pq); - m->queue = PQ_NONE; - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_dec(pq); + KASSERT((m->aflags & PGA_DEQUEUE) != 0 || + mtx_owned(vm_page_lockptr(m)), + ("%s: queued unlocked page %p", __func__, m)); + + if ((m->aflags & PGA_ENQUEUED) != 0) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_pagequeue_cnt_dec(pq); + } + vm_page_dequeue_complete(m); } /* - * vm_page_enqueue: + * vm_page_dequeue: * - * Add the given page to the specified page queue. - * - * The page must be locked. + * Remove the page from whichever page queue it's in, if any. + * If the page lock is not held, there is no guarantee that the + * page will not be enqueued by another thread before this function + * returns. In this case, it is up to the caller to ensure that + * no other threads hold a reference to the page. */ -static void -vm_page_enqueue(uint8_t queue, vm_page_t m) +void +vm_page_dequeue(vm_page_t m) { - struct vm_pagequeue *pq; + struct mtx *lock, *lock1; - vm_page_lock_assert(m, MA_OWNED); - KASSERT(queue < PQ_COUNT, - ("vm_page_enqueue: invalid queue %u request for page %p", - queue, m)); - pq = &vm_pagequeue_domain(m)->vmd_pagequeues[queue]; - vm_pagequeue_lock(pq); - m->queue = queue; - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - vm_pagequeue_unlock(pq); + lock = vm_page_pagequeue_lockptr(m); + for (;;) { + if (lock == NULL) + return; + mtx_lock(lock); + if ((lock1 = vm_page_pagequeue_lockptr(m)) == lock) + break; + mtx_unlock(lock); + lock = lock1; + } + KASSERT(lock == vm_page_pagequeue_lockptr(m), + ("%s: page %p migrated directly between queues", __func__, m)); + vm_page_dequeue_locked(m); + mtx_unlock(lock); } /* - * vm_page_requeue: - * - * Move the given page to the tail of its current page queue. - * - * The page must be locked. + * Schedule the given page for insertion into the specified page queue. + * Physical insertion of the page may be deferred indefinitely. */ -void -vm_page_requeue(vm_page_t m) +static void +vm_page_enqueue(vm_page_t m, uint8_t queue) { - struct vm_pagequeue *pq; - vm_page_lock_assert(m, MA_OWNED); - KASSERT(m->queue != PQ_NONE, - ("vm_page_requeue: page %p is not queued", m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_lock(pq); - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_unlock(pq); + vm_page_assert_locked(m); + KASSERT(m->queue == PQ_NONE && (m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("%s: page %p is already enqueued", __func__, m)); + + m->queue = queue; + if ((m->aflags & PGA_REQUEUE) == 0) + vm_page_aflag_set(m, PGA_REQUEUE); + vm_pqbatch_submit_page(m, queue); } /* - * vm_page_requeue_locked: + * vm_page_requeue: [ internal use only ] * - * Move the given page to the tail of its current page queue. + * Schedule a requeue of the given page. * - * The page queue must be locked. + * The page must be locked. */ void -vm_page_requeue_locked(vm_page_t m) +vm_page_requeue(vm_page_t m) { - struct vm_pagequeue *pq; + vm_page_assert_locked(m); KASSERT(m->queue != PQ_NONE, - ("vm_page_requeue_locked: page %p is not queued", m)); - pq = vm_page_pagequeue(m); - vm_pagequeue_assert_locked(pq); - TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); + ("%s: page %p is not logically enqueued", __func__, m)); + + if ((m->aflags & PGA_REQUEUE) == 0) + vm_page_aflag_set(m, PGA_REQUEUE); + vm_pqbatch_submit_page(m, m->queue); } /* @@ -3164,18 +3352,18 @@ vm_page_activate(vm_page_t m) int queue; vm_page_lock_assert(m, MA_OWNED); - if ((queue = m->queue) != PQ_ACTIVE) { - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - if (m->act_count < ACT_INIT) - m->act_count = ACT_INIT; - if (queue != PQ_NONE) - vm_page_dequeue(m); - vm_page_enqueue(PQ_ACTIVE, m); - } - } else { - if (m->act_count < ACT_INIT) + + if ((queue = m->queue) == PQ_ACTIVE || m->wire_count > 0 || + (m->oflags & VPO_UNMANAGED) != 0) { + if (queue == PQ_ACTIVE && m->act_count < ACT_INIT) m->act_count = ACT_INIT; + return; } + + vm_page_remque(m); + if (m->act_count < ACT_INIT) + m->act_count = ACT_INIT; + vm_page_enqueue(m, PQ_ACTIVE); } /* @@ -3186,11 +3374,10 @@ vm_page_activate(vm_page_t m) * the page to the free list only if this function returns true. * * The object must be locked. The page must be locked if it is - * managed. For a queued managed page, the pagequeue_locked - * argument specifies whether the page queue is already locked. + * managed. */ bool -vm_page_free_prep(vm_page_t m, bool pagequeue_locked) +vm_page_free_prep(vm_page_t m) { #if defined(DIAGNOSTIC) && defined(PHYS_TO_DMAP) @@ -3206,14 +3393,14 @@ bool if ((m->oflags & VPO_UNMANAGED) == 0) { vm_page_lock_assert(m, MA_OWNED); KASSERT(!pmap_page_is_mapped(m), - ("vm_page_free_toq: freeing mapped page %p", m)); + ("vm_page_free_prep: freeing mapped page %p", m)); } else KASSERT(m->queue == PQ_NONE, - ("vm_page_free_toq: unmanaged page %p is queued", m)); + ("vm_page_free_prep: unmanaged page %p is queued", m)); VM_CNT_INC(v_tfree); if (vm_page_sbusied(m)) - panic("vm_page_free: freeing busy page %p", m); + panic("vm_page_free_prep: freeing busy page %p", m); vm_page_remove(m); @@ -3229,21 +3416,23 @@ bool return (false); } - if (m->queue != PQ_NONE) { - if (pagequeue_locked) - vm_page_dequeue_locked(m); - else - vm_page_dequeue(m); - } + /* + * Pages need not be dequeued before they are returned to the physical + * memory allocator, but they must at least be marked for a deferred + * dequeue. + */ + if ((m->oflags & VPO_UNMANAGED) == 0) + vm_page_dequeue_deferred(m); + m->valid = 0; vm_page_undirty(m); if (m->wire_count != 0) - panic("vm_page_free: freeing wired page %p", m); + panic("vm_page_free_prep: freeing wired page %p", m); if (m->hold_count != 0) { m->flags &= ~PG_ZERO; KASSERT((m->flags & PG_UNHOLDFREE) == 0, - ("vm_page_free: freeing PG_UNHOLDFREE page %p", m)); + ("vm_page_free_prep: freeing PG_UNHOLDFREE page %p", m)); m->flags |= PG_UNHOLDFREE; return (false); } @@ -3262,36 +3451,6 @@ bool return (true); } -void -vm_page_free_phys_pglist(struct pglist *tq) -{ - struct vm_domain *vmd; - vm_page_t m; - int cnt; - - if (TAILQ_EMPTY(tq)) - return; - vmd = NULL; - cnt = 0; - TAILQ_FOREACH(m, tq, listq) { - if (vmd != vm_pagequeue_domain(m)) { - if (vmd != NULL) { - vm_domain_free_unlock(vmd); - vm_domain_freecnt_inc(vmd, cnt); - cnt = 0; - } - vmd = vm_pagequeue_domain(m); - vm_domain_free_lock(vmd); - } - vm_phys_free_pages(m, 0); - cnt++; - } - if (vmd != NULL) { - vm_domain_free_unlock(vmd); - vm_domain_freecnt_inc(vmd, cnt); - } -} - /* * vm_page_free_toq: * @@ -3306,7 +3465,7 @@ vm_page_free_toq(vm_page_t m) { struct vm_domain *vmd; - if (!vm_page_free_prep(m, false)) + if (!vm_page_free_prep(m)) return; vmd = vm_pagequeue_domain(m); @@ -3404,22 +3563,25 @@ vm_page_unwire(vm_page_t m, uint8_t queue) KASSERT(queue < PQ_COUNT || queue == PQ_NONE, ("vm_page_unwire: invalid queue %u request for page %p", queue, m)); + if ((m->oflags & VPO_UNMANAGED) == 0) + vm_page_assert_locked(m); unwired = vm_page_unwire_noq(m); - if (unwired && (m->oflags & VPO_UNMANAGED) == 0 && m->object != NULL) { - if (m->queue == queue) { + if (!unwired || (m->oflags & VPO_UNMANAGED) != 0 || m->object == NULL) + return (unwired); + + if (m->queue == queue) { + if (queue == PQ_ACTIVE) + vm_page_reference(m); + else if (queue != PQ_NONE) + vm_page_requeue(m); + } else { + vm_page_dequeue(m); + if (queue != PQ_NONE) { + vm_page_enqueue(m, queue); if (queue == PQ_ACTIVE) - vm_page_reference(m); - else if (queue != PQ_NONE) - vm_page_requeue(m); - } else { - vm_page_remque(m); - if (queue != PQ_NONE) { - vm_page_enqueue(queue, m); - if (queue == PQ_ACTIVE) - /* Initialize act_count. */ - vm_page_activate(m); - } + /* Initialize act_count. */ + vm_page_activate(m); } } return (unwired); @@ -3455,65 +3617,32 @@ vm_page_unwire_noq(vm_page_t m) } /* - * Move the specified page to the inactive queue, or requeue the page if it is - * already in the inactive queue. + * Move the specified page to the tail of the inactive queue, or requeue + * the page if it is already in the inactive queue. * - * Normally, "noreuse" is FALSE, resulting in LRU ordering of the inactive - * queue. However, setting "noreuse" to TRUE will accelerate the specified - * page's reclamation, but it will not unmap the page from any address space. - * This is implemented by inserting the page near the head of the inactive - * queue, using a marker page to guide FIFO insertion ordering. - * * The page must be locked. */ -static inline void -_vm_page_deactivate(vm_page_t m, boolean_t noreuse) +void +vm_page_deactivate(vm_page_t m) { - struct vm_pagequeue *pq; - int queue; vm_page_assert_locked(m); - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - pq = &vm_pagequeue_domain(m)->vmd_pagequeues[PQ_INACTIVE]; - /* Avoid multiple acquisitions of the inactive queue lock. */ - queue = m->queue; - if (queue == PQ_INACTIVE) { - vm_pagequeue_lock(pq); - vm_page_dequeue_locked(m); - } else { - if (queue != PQ_NONE) - vm_page_dequeue(m); - vm_pagequeue_lock(pq); - } - m->queue = PQ_INACTIVE; - if (noreuse) - TAILQ_INSERT_BEFORE( - &vm_pagequeue_domain(m)->vmd_inacthead, m, - plinks.q); - else - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - vm_pagequeue_unlock(pq); - } -} + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; -/* - * Move the specified page to the inactive queue, or requeue the page if it is - * already in the inactive queue. - * - * The page must be locked. - */ -void -vm_page_deactivate(vm_page_t m) -{ - - _vm_page_deactivate(m, FALSE); + if (!vm_page_inactive(m)) { + vm_page_remque(m); + vm_page_enqueue(m, PQ_INACTIVE); + } else + vm_page_requeue(m); } /* - * Move the specified page to the inactive queue with the expectation - * that it is unlikely to be reused. + * Move the specified page close to the head of the inactive queue, + * bypassing LRU. A marker page is used to maintain FIFO ordering. + * As with regular enqueues, we use a per-CPU batch queue to reduce + * contention on the page queue lock. * * The page must be locked. */ @@ -3521,7 +3650,17 @@ void vm_page_deactivate_noreuse(vm_page_t m) { - _vm_page_deactivate(m, TRUE); + vm_page_assert_locked(m); + + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; + + if (!vm_page_inactive(m)) + vm_page_remque(m); + m->queue = PQ_INACTIVE; + if ((m->aflags & PGA_REQUEUE_HEAD) == 0) + vm_page_aflag_set(m, PGA_REQUEUE_HEAD); + vm_pqbatch_submit_page(m, PQ_INACTIVE); } /* @@ -3534,13 +3673,14 @@ vm_page_launder(vm_page_t m) { vm_page_assert_locked(m); - if (m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0) { - if (m->queue == PQ_LAUNDRY) - vm_page_requeue(m); - else { - vm_page_remque(m); - vm_page_enqueue(PQ_LAUNDRY, m); - } + if (m->wire_count > 0 || (m->oflags & VPO_UNMANAGED) != 0) + return; + + if (m->queue == PQ_LAUNDRY) + vm_page_requeue(m); + else { + vm_page_remque(m); + vm_page_enqueue(m, PQ_LAUNDRY); } } @@ -3556,9 +3696,9 @@ vm_page_unswappable(vm_page_t m) vm_page_assert_locked(m); KASSERT(m->wire_count == 0 && (m->oflags & VPO_UNMANAGED) == 0, ("page %p already unswappable", m)); - if (m->queue != PQ_NONE) - vm_page_dequeue(m); - vm_page_enqueue(PQ_UNSWAPPABLE, m); + + vm_page_remque(m); + vm_page_enqueue(m, PQ_UNSWAPPABLE); } /* Index: /usr/src/sys/vm/vm_page.h =================================================================== --- /usr/src/sys/vm/vm_page.h (revision 332641) +++ /usr/src/sys/vm/vm_page.h (working copy) @@ -94,7 +94,9 @@ * In general, operations on this structure's mutable fields are * synchronized using either one of or a combination of the lock on the * object that the page belongs to (O), the pool lock for the page (P), - * or the lock for either the free or paging queue (Q). If a field is + * the per-domain lock for the free queues (F), or the page's queue + * lock (Q). The queue lock for a page depends on the value of its + * queue field and described in detail below. If a field is * annotated below with two of these locks, then holding either lock is * sufficient for read access, but both locks are required for write * access. An annotation of (C) indicates that the field is immutable. @@ -143,6 +145,28 @@ * causing the thread to block. vm_page_sleep_if_busy() can be used to * sleep until the page's busy state changes, after which the caller * must re-lookup the page and re-evaluate its state. + * + * The queue field is the index of the page queue containing the + * page, or PQ_NONE if the page is not enqueued. The queue lock of a + * page is the page queue lock corresponding to the page queue index, + * or the page lock (P) for the page. To modify the queue field, the + * queue lock for the old value of the field must be held. It is + * invalid for a page's queue field to transition between two distinct + * page queue indices. That is, when updating the queue field, either + * the new value or the old value must be PQ_NONE. + * + * To avoid contention on page queue locks, page queue operations + * (enqueue, dequeue, requeue) are batched using per-CPU queues. + * A deferred operation is requested by inserting an entry into a + * batch queue; the entry is simply a pointer to the page, and the + * request type is encoded in the page's aflags field using the values + * in PGA_QUEUE_STATE_MASK. The type-stability of struct vm_pages is + * crucial to this scheme since the processing of entries in a given + * batch queue may be deferred indefinitely. In particular, a page + * may be freed before its pending batch queue entries have been + * processed. The page lock (P) must be held to schedule a batched + * queue operation, and the page queue lock must be held in order to + * process batch queue entries for the page queue. */ #if PAGE_SIZE == 4096 @@ -174,7 +198,7 @@ struct vm_page { TAILQ_ENTRY(vm_page) listq; /* pages in same object (O) */ vm_object_t object; /* which object am I in (O,P) */ vm_pindex_t pindex; /* offset into object (O,P) */ - vm_paddr_t phys_addr; /* physical address of page */ + vm_paddr_t phys_addr; /* physical address of page (C) */ struct md_page md; /* machine dependent stuff */ u_int wire_count; /* wired down maps refs (P) */ volatile u_int busy_lock; /* busy owners lock */ @@ -182,11 +206,11 @@ struct vm_page { uint16_t flags; /* page PG_* flags (P) */ uint8_t aflags; /* access is atomic */ uint8_t oflags; /* page VPO_* flags (O) */ - uint8_t queue; /* page queue index (P,Q) */ + uint8_t queue; /* page queue index (Q) */ int8_t psind; /* pagesizes[] index (O) */ int8_t segind; /* vm_phys segment index (C) */ - uint8_t order; /* index of the buddy queue */ - uint8_t pool; /* vm_phys freepool index (Q) */ + uint8_t order; /* index of the buddy queue (F) */ + uint8_t pool; /* vm_phys freepool index (F) */ u_char act_count; /* page usage count (P) */ /* NOTE that these must support one bit per DEV_BSIZE in a page */ /* so, on normal X86 kernels, they must be at least 8 bits wide */ @@ -314,11 +338,39 @@ extern struct mtx_padalign pa_lock[]; * * PGA_EXECUTABLE may be set by pmap routines, and indicates that a page has * at least one executable mapping. It is not consumed by the MI VM layer. + * + * PGA_ENQUEUED is set and cleared when a page is inserted into or removed + * from a page queue, respectively. It determines whether the plinks.q field + * of the page is valid. To set or clear this flag, the queue lock for the + * page must be held: the page queue lock corresponding to the page's "queue" + * field if its value is not PQ_NONE, and the page lock otherwise. + * + * PGA_DEQUEUE is set when the page is scheduled to be dequeued from a page + * queue, and cleared when the dequeue request is processed. A page may + * have PGA_DEQUEUE set and PGA_ENQUEUED cleared, for instance if a dequeue + * is requested after the page is scheduled to be enqueued but before it is + * actually inserted into the page queue. The page lock must be held to set + * this flag, and the queue lock for the page must be held to clear it. + * + * PGA_REQUEUE is set when the page is scheduled to be enqueued or requeued + * in its page queue. The page lock must be held to set this flag, and the + * queue lock for the page must be held to clear it. + * + * PGA_REQUEUE_HEAD is a special flag for enqueuing pages near the head of + * the inactive queue, thus bypassing LRU. The page lock must be held to + * set this flag, and the queue lock for the page must be held to clear it. */ #define PGA_WRITEABLE 0x01 /* page may be mapped writeable */ #define PGA_REFERENCED 0x02 /* page has been referenced */ #define PGA_EXECUTABLE 0x04 /* page may be mapped executable */ +#define PGA_ENQUEUED 0x08 /* page is enqueued in a page queue */ +#define PGA_DEQUEUE 0x10 /* page is due to be dequeued */ +#define PGA_REQUEUE 0x20 /* page is due to be requeued */ +#define PGA_REQUEUE_HEAD 0x40 /* page requeue should bypass LRU */ +#define PGA_QUEUE_STATE_MASK (PGA_ENQUEUED | PGA_DEQUEUE | PGA_REQUEUE | \ + PGA_REQUEUE_HEAD) + /* * Page flags. If changed at any other time than page allocation or * freeing, the modification must be protected by the vm_page lock. @@ -484,10 +536,11 @@ int vm_page_grab_pages(vm_object_t object, vm_pind void vm_page_deactivate(vm_page_t); void vm_page_deactivate_noreuse(vm_page_t); void vm_page_dequeue(vm_page_t m); +void vm_page_dequeue_deferred(vm_page_t m); void vm_page_dequeue_locked(vm_page_t m); +void vm_page_drain_pqbatch(void); vm_page_t vm_page_find_least(vm_object_t, vm_pindex_t); -void vm_page_free_phys_pglist(struct pglist *tq); -bool vm_page_free_prep(vm_page_t m, bool pagequeue_locked); +bool vm_page_free_prep(vm_page_t m); vm_page_t vm_page_getfake(vm_paddr_t paddr, vm_memattr_t memattr); void vm_page_initfake(vm_page_t m, vm_paddr_t paddr, vm_memattr_t memattr); int vm_page_insert (vm_page_t, vm_object_t, vm_pindex_t); @@ -752,6 +805,24 @@ vm_page_in_laundry(vm_page_t m) } /* + * vm_page_enqueued: + * + * Return true if the page is logically enqueued and no deferred + * dequeue is pending. + */ +static inline bool +vm_page_enqueued(vm_page_t m) +{ + + vm_page_assert_locked(m); + + if ((m->aflags & PGA_DEQUEUE) != 0) + return (false); + atomic_thread_fence_acq(); + return (m->queue != PQ_NONE); +} + +/* * vm_page_held: * * Return true if a reference prevents the page from being reclaimable. Index: /usr/src/sys/vm/vm_pageout.c =================================================================== --- /usr/src/sys/vm/vm_pageout.c (revision 332641) +++ /usr/src/sys/vm/vm_pageout.c (working copy) @@ -201,12 +201,18 @@ SYSCTL_INT(_vm, OID_AUTO, max_wired, CTLFLAG_RW, &vm_page_max_wired, 0, "System-wide limit to wired page count"); static u_int isqrt(u_int num); -static boolean_t vm_pageout_fallback_object_lock(vm_page_t, vm_page_t *); static int vm_pageout_launder(struct vm_domain *vmd, int launder, bool in_shortfall); static void vm_pageout_laundry_worker(void *arg); -static boolean_t vm_pageout_page_lock(vm_page_t, vm_page_t *); +struct scan_state { + struct vm_batchqueue bq; + struct vm_pagequeue *pq; + vm_page_t marker; + int maxscan; + int scanned; +}; + /* * Initialize a dummy page for marking the caller's place in the specified * paging queue. In principle, this function only needs to set the flag @@ -214,11 +220,12 @@ static void vm_pageout_laundry_worker(void *arg); * to one as safety precautions. */ static void -vm_pageout_init_marker(vm_page_t marker, u_short queue) +vm_pageout_init_marker(vm_page_t marker, u_short queue, uint8_t aflags) { bzero(marker, sizeof(*marker)); marker->flags = PG_MARKER; + marker->aflags = aflags; marker->busy_lock = VPB_SINGLE_EXCLUSIVER; marker->queue = queue; marker->hold_count = 1; @@ -225,98 +232,160 @@ static void } /* - * vm_pageout_fallback_object_lock: - * - * Lock vm object currently associated with `m'. VM_OBJECT_TRYWLOCK is - * known to have failed and page queue must be either PQ_ACTIVE or - * PQ_INACTIVE. To avoid lock order violation, unlock the page queue - * while locking the vm object. Use marker page to detect page queue - * changes and maintain notion of next page on page queue. Return - * TRUE if no changes were detected, FALSE otherwise. vm object is - * locked on return. - * - * This function depends on both the lock portion of struct vm_object - * and normal struct vm_page being type stable. + * Initialize and enqueue static queue markers. */ -static boolean_t -vm_pageout_fallback_object_lock(vm_page_t m, vm_page_t *next) +static void +vm_pageout_insert_markers(struct vm_domain *vmd) { - struct vm_page marker; struct vm_pagequeue *pq; - boolean_t unchanged; - u_short queue; - vm_object_t object; + vm_page_t marker; + int i; - queue = m->queue; - vm_pageout_init_marker(&marker, queue); - pq = vm_page_pagequeue(m); - object = m->object; - - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &marker, plinks.q); - vm_pagequeue_unlock(pq); - vm_page_unlock(m); - VM_OBJECT_WLOCK(object); - vm_page_lock(m); - vm_pagequeue_lock(pq); + /* + * inacthead is used to provide FIFO ordering for LRU-bypassing + * insertions. + */ + marker = &vmd->vmd_inacthead; + pq = &vmd->vmd_pagequeues[PQ_INACTIVE]; + vm_pageout_init_marker(marker, PQ_INACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); /* - * The page's object might have changed, and/or the page might - * have moved from its original position in the queue. If the - * page's object has changed, then the caller should abandon - * processing the page because the wrong object lock was - * acquired. Use the marker's plinks.q, not the page's, to - * determine if the page has been moved. The state of the - * page's plinks.q can be indeterminate; whereas, the marker's - * plinks.q must be valid. + * The clock pages are used to implement active queue scanning without + * requeues. Scans start at clock[0], which is advanced after the scan + * ends. When the two clock hands meet, they are reset and scanning + * resumes from the head of the queue. */ - *next = TAILQ_NEXT(&marker, plinks.q); - unchanged = m->object == object && - m == TAILQ_PREV(&marker, pglist, plinks.q); - KASSERT(!unchanged || m->queue == queue, - ("page %p queue %d %d", m, queue, m->queue)); - TAILQ_REMOVE(&pq->pq_pl, &marker, plinks.q); - return (unchanged); + marker = &vmd->vmd_clock[0]; + pq = &vmd->vmd_pagequeues[PQ_ACTIVE]; + vm_pageout_init_marker(marker, PQ_ACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); + marker = &vmd->vmd_clock[1]; + vm_pageout_init_marker(marker, PQ_ACTIVE, PGA_ENQUEUED); + TAILQ_INSERT_TAIL(&pq->pq_pl, marker, plinks.q); + + for (i = 0; i < PQ_COUNT; i++) + vm_pageout_init_marker(&vmd->vmd_markers[i], i, 0); } +static void +vm_pageout_init_scan(struct scan_state *ss, struct vm_pagequeue *pq, + vm_page_t marker, vm_page_t after, int maxscan) +{ + + vm_pagequeue_assert_locked(pq); + KASSERT((marker->aflags & PGA_ENQUEUED) == 0, + ("marker %p already enqueued", marker)); + + if (after == NULL) + TAILQ_INSERT_HEAD(&pq->pq_pl, marker, plinks.q); + else + TAILQ_INSERT_AFTER(&pq->pq_pl, after, marker, plinks.q); + vm_page_aflag_set(marker, PGA_ENQUEUED); + + vm_batchqueue_init(&ss->bq); + ss->pq = pq; + ss->marker = marker; + ss->maxscan = maxscan; + ss->scanned = 0; + vm_pagequeue_unlock(pq); +} + +static void +vm_pageout_end_scan(struct scan_state *ss) +{ + struct vm_pagequeue *pq; + + pq = ss->pq; + vm_pagequeue_assert_locked(pq); + KASSERT((ss->marker->aflags & PGA_ENQUEUED) != 0, + ("marker %p not enqueued", ss->marker)); + + TAILQ_REMOVE(&pq->pq_pl, ss->marker, plinks.q); + vm_page_aflag_clear(ss->marker, PGA_ENQUEUED); + VM_CNT_ADD(v_pdpages, ss->scanned); +} + /* - * Lock the page while holding the page queue lock. Use marker page - * to detect page queue changes and maintain notion of next page on - * page queue. Return TRUE if no changes were detected, FALSE - * otherwise. The page is locked on return. The page queue lock might - * be dropped and reacquired. + * Ensure that the page has not been dequeued after a pageout batch was + * collected. See vm_page_dequeue_complete(). + */ +static inline bool +vm_pageout_page_queued(vm_page_t m, int queue) +{ + + vm_page_assert_locked(m); + + if ((m->aflags & PGA_DEQUEUE) != 0) + return (false); + atomic_thread_fence_acq(); + return (m->queue == queue); +} + +/* + * Add a small number of queued pages to a batch queue for later processing + * without the corresponding queue lock held. The caller must have enqueued a + * marker page at the desired start point for the scan. Pages will be + * physically dequeued if the caller so requests. Otherwise, the returned + * batch may contain marker pages, and it is up to the caller to handle them. * - * This function depends on normal struct vm_page being type stable. + * When processing the batch queue, vm_pageout_page_queued() must be used to + * determine whether the page was logically dequeued by another thread. Once + * this check is performed, the page lock guarantees that the page will not be + * disassociated from the queue. */ -static boolean_t -vm_pageout_page_lock(vm_page_t m, vm_page_t *next) +static __always_inline void +vm_pageout_collect_batch(struct scan_state *ss, const bool dequeue) { - struct vm_page marker; struct vm_pagequeue *pq; - boolean_t unchanged; - u_short queue; + vm_page_t m, marker; - vm_page_lock_assert(m, MA_NOTOWNED); - if (vm_page_trylock(m)) - return (TRUE); + marker = ss->marker; + pq = ss->pq; - queue = m->queue; - vm_pageout_init_marker(&marker, queue); - pq = vm_page_pagequeue(m); + KASSERT((marker->aflags & PGA_ENQUEUED) != 0, + ("marker %p not enqueued", ss->marker)); - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &marker, plinks.q); - vm_pagequeue_unlock(pq); - vm_page_lock(m); vm_pagequeue_lock(pq); + for (m = TAILQ_NEXT(marker, plinks.q); m != NULL && + ss->scanned < ss->maxscan && ss->bq.bq_cnt < VM_BATCHQUEUE_SIZE; + m = TAILQ_NEXT(m, plinks.q), ss->scanned++) { + if ((m->flags & PG_MARKER) == 0) { + KASSERT((m->aflags & PGA_ENQUEUED) != 0, + ("page %p not enqueued", m)); + KASSERT((m->flags & PG_FICTITIOUS) == 0, + ("Fictitious page %p cannot be in page queue", m)); + KASSERT((m->oflags & VPO_UNMANAGED) == 0, + ("Unmanaged page %p cannot be in page queue", m)); + } else if (dequeue) + continue; - /* Page queue might have changed. */ - *next = TAILQ_NEXT(&marker, plinks.q); - unchanged = m == TAILQ_PREV(&marker, pglist, plinks.q); - KASSERT(!unchanged || m->queue == queue, - ("page %p queue %d %d", m, queue, m->queue)); - TAILQ_REMOVE(&pq->pq_pl, &marker, plinks.q); - return (unchanged); + (void)vm_batchqueue_insert(&ss->bq, m); + if (dequeue) { + TAILQ_REMOVE(&pq->pq_pl, m, plinks.q); + vm_page_aflag_clear(m, PGA_ENQUEUED); + } + } + TAILQ_REMOVE(&pq->pq_pl, marker, plinks.q); + if (__predict_true(m != NULL)) + TAILQ_INSERT_BEFORE(m, marker, plinks.q); + else + TAILQ_INSERT_TAIL(&pq->pq_pl, marker, plinks.q); + if (dequeue) + vm_pagequeue_cnt_add(pq, -ss->bq.bq_cnt); + vm_pagequeue_unlock(pq); } +/* Return the next page to be scanned, or NULL if the scan is complete. */ +static __always_inline vm_page_t +vm_pageout_next(struct scan_state *ss, const bool dequeue) +{ + + if (ss->bq.bq_cnt == 0) + vm_pageout_collect_batch(ss, dequeue); + return (vm_batchqueue_pop(&ss->bq)); +} + /* * Scan for pages at adjacent offsets within the given page's object that are * eligible for laundering, form a cluster of these pages and the given page, @@ -370,12 +439,12 @@ more: break; } vm_page_test_dirty(p); - if (p->dirty == 0) { + if (p->dirty == 0 || !vm_page_in_laundry(p)) { ib = 0; break; } vm_page_lock(p); - if (!vm_page_in_laundry(p) || vm_page_held(p)) { + if (vm_page_held(p)) { vm_page_unlock(p); ib = 0; break; @@ -398,10 +467,10 @@ more: if ((p = vm_page_next(ps)) == NULL || vm_page_busied(p)) break; vm_page_test_dirty(p); - if (p->dirty == 0) + if (p->dirty == 0 || !vm_page_in_laundry(p)) break; vm_page_lock(p); - if (!vm_page_in_laundry(p) || vm_page_held(p)) { + if (vm_page_held(p)) { vm_page_unlock(p); break; } @@ -692,13 +761,18 @@ unlock_mp: static int vm_pageout_launder(struct vm_domain *vmd, int launder, bool in_shortfall) { + struct scan_state ss; struct vm_pagequeue *pq; + struct mtx *mtx; vm_object_t object; - vm_page_t m, next; - int act_delta, error, maxscan, numpagedout, starting_target; + vm_page_t m, marker; + int act_delta, error, numpagedout, queue, starting_target; int vnodes_skipped; - bool pageout_ok, queue_locked; + bool obj_locked, pageout_ok; + mtx = NULL; + obj_locked = false; + object = NULL; starting_target = launder; vnodes_skipped = 0; @@ -708,64 +782,77 @@ vm_pageout_launder(struct vm_domain *vmd, int laun * we've reached the end of the queue. A single iteration of this loop * may cause more than one page to be laundered because of clustering. * - * maxscan ensures that we don't re-examine requeued pages. Any - * additional pages written as part of a cluster are subtracted from - * maxscan since they must be taken from the laundry queue. - * * As an optimization, we avoid laundering from PQ_UNSWAPPABLE when no * swap devices are configured. */ if (atomic_load_acq_int(&swapdev_enabled)) - pq = &vmd->vmd_pagequeues[PQ_UNSWAPPABLE]; + queue = PQ_UNSWAPPABLE; else - pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; + queue = PQ_LAUNDRY; + marker = &vmd->vmd_markers[queue]; + pq = &vmd->vmd_pagequeues[queue]; scan: vm_pagequeue_lock(pq); - maxscan = pq->pq_cnt; - queue_locked = true; - for (m = TAILQ_FIRST(&pq->pq_pl); - m != NULL && maxscan-- > 0 && launder > 0; - m = next) { - vm_pagequeue_assert_locked(pq); - KASSERT(queue_locked, ("unlocked laundry queue")); - KASSERT(vm_page_in_laundry(m), - ("page %p has an inconsistent queue", m)); - next = TAILQ_NEXT(m, plinks.q); - if ((m->flags & PG_MARKER) != 0) + vm_pageout_init_scan(&ss, pq, marker, NULL, pq->pq_cnt); + while (launder > 0 && (m = vm_pageout_next(&ss, false)) != NULL) { + if (__predict_false((m->flags & PG_MARKER) != 0)) continue; - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("PG_FICTITIOUS page %p cannot be in laundry queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("VPO_UNMANAGED page %p cannot be in laundry queue", m)); - if (!vm_pageout_page_lock(m, &next) || m->hold_count != 0) { - vm_page_unlock(m); + + vm_page_change_lock(m, &mtx); + +recheck: + /* + * The page may have been disassociated from the queue + * while locks were dropped. + */ + if (!vm_pageout_page_queued(m, queue)) continue; + + /* + * A requeue was requested, so this page gets a second + * chance. + */ + if ((m->aflags & PGA_REQUEUE) != 0) { + vm_page_requeue(m); + continue; } + + /* + * Held pages are essentially stuck in the queue. + * + * Wired pages may not be freed. Complete their removal + * from the queue now to avoid needless revisits during + * future scans. + */ + if (m->hold_count != 0) + continue; if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - vm_page_unlock(m); + vm_page_dequeue_deferred(m); continue; } - object = m->object; - if ((!VM_OBJECT_TRYWLOCK(object) && - (!vm_pageout_fallback_object_lock(m, &next) || - vm_page_held(m))) || vm_page_busied(m)) { - VM_OBJECT_WUNLOCK(object); - if (m->wire_count != 0 && vm_page_pagequeue(m) == pq) - vm_page_dequeue_locked(m); - vm_page_unlock(m); - continue; + + if (object != m->object) { + if (obj_locked) { + VM_OBJECT_WUNLOCK(object); + obj_locked = false; + } + object = m->object; } + if (!obj_locked) { + if (!VM_OBJECT_TRYWLOCK(object)) { + mtx_unlock(mtx); + /* Depends on type-stability. */ + VM_OBJECT_WLOCK(object); + obj_locked = true; + mtx_lock(mtx); + goto recheck; + } else + obj_locked = true; + } - /* - * Unlock the laundry queue, invalidating the 'next' pointer. - * Use a marker to remember our place in the laundry queue. - */ - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &vmd->vmd_laundry_marker, - plinks.q); - vm_pagequeue_unlock(pq); - queue_locked = false; + if (vm_page_busied(m)) + continue; /* * Invalid pages can be easily freed. They cannot be @@ -814,9 +901,11 @@ scan: */ if (!in_shortfall) launder--; - goto drop_page; - } else if ((object->flags & OBJ_DEAD) == 0) - goto requeue_page; + continue; + } else if ((object->flags & OBJ_DEAD) == 0) { + vm_page_requeue(m); + continue; + } } /* @@ -851,11 +940,8 @@ free_page: else pageout_ok = true; if (!pageout_ok) { -requeue_page: - vm_pagequeue_lock(pq); - queue_locked = true; - vm_page_requeue_locked(m); - goto drop_page; + vm_page_requeue(m); + continue; } /* @@ -874,28 +960,31 @@ free_page: error = vm_pageout_clean(m, &numpagedout); if (error == 0) { launder -= numpagedout; - maxscan -= numpagedout - 1; + ss.scanned += numpagedout; } else if (error == EDEADLK) { pageout_lock_miss++; vnodes_skipped++; } - goto relock_queue; + mtx = NULL; + obj_locked = false; } -drop_page: - vm_page_unlock(m); + } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + if (obj_locked) { VM_OBJECT_WUNLOCK(object); -relock_queue: - if (!queue_locked) { - vm_pagequeue_lock(pq); - queue_locked = true; - } - next = TAILQ_NEXT(&vmd->vmd_laundry_marker, plinks.q); - TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_laundry_marker, plinks.q); + obj_locked = false; } + vm_pagequeue_lock(pq); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); - if (launder > 0 && pq == &vmd->vmd_pagequeues[PQ_UNSWAPPABLE]) { - pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; + if (launder > 0 && queue == PQ_UNSWAPPABLE) { + queue = PQ_LAUNDRY; + marker = &vmd->vmd_markers[queue]; + pq = &vmd->vmd_pagequeues[queue]; goto scan; } @@ -951,7 +1040,6 @@ vm_pageout_laundry_worker(void *arg) vmd = VM_DOMAIN(domain); pq = &vmd->vmd_pagequeues[PQ_LAUNDRY]; KASSERT(vmd->vmd_segs != 0, ("domain without segments")); - vm_pageout_init_marker(&vmd->vmd_laundry_marker, PQ_LAUNDRY); shortfall = 0; in_shortfall = false; @@ -1093,7 +1181,57 @@ dolaundry: } } +static int +vm_pageout_reinsert_inactive_page(struct scan_state *ss, vm_page_t m) +{ + struct vm_domain *vmd; + + if (!vm_page_inactive(m) || (m->aflags & PGA_ENQUEUED) != 0) + return (0); + vm_page_aflag_set(m, PGA_ENQUEUED); + if ((m->aflags & PGA_REQUEUE_HEAD) != 0) { + vmd = vm_pagequeue_domain(m); + TAILQ_INSERT_BEFORE(&vmd->vmd_inacthead, m, plinks.q); + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } else if ((m->aflags & PGA_REQUEUE) != 0) { + TAILQ_INSERT_TAIL(&ss->pq->pq_pl, m, plinks.q); + vm_page_aflag_clear(m, PGA_REQUEUE | PGA_REQUEUE_HEAD); + } else + TAILQ_INSERT_BEFORE(ss->marker, m, plinks.q); + return (1); +} + /* + * Re-add stuck pages to the inactive queue. We will examine them again + * during the next scan. If the queue state of a page has changed since + * it was physically removed from the page queue in + * vm_pageout_collect_batch(), don't do anything with that page. + */ +static void +vm_pageout_reinsert_inactive(struct scan_state *ss, struct vm_batchqueue *bq, + vm_page_t m) +{ + struct vm_pagequeue *pq; + int delta; + + delta = 0; + pq = ss->pq; + + if (m != NULL) { + if (vm_batchqueue_insert(bq, m)) + return; + vm_pagequeue_lock(pq); + delta += vm_pageout_reinsert_inactive_page(ss, m); + } else + vm_pagequeue_lock(pq); + while ((m = vm_batchqueue_pop(bq)) != NULL) + delta += vm_pageout_reinsert_inactive_page(ss, m); + vm_pagequeue_cnt_add(pq, delta); + vm_pagequeue_unlock(pq); + vm_batchqueue_init(bq); +} + +/* * vm_pageout_scan does the dirty work for the pageout daemon. * * pass == 0: Update active LRU/deactivate pages @@ -1105,13 +1243,16 @@ dolaundry: static bool vm_pageout_scan(struct vm_domain *vmd, int pass, int shortage) { - vm_page_t m, next; + struct scan_state ss; + struct vm_batchqueue rq; + struct mtx *mtx; + vm_page_t m, marker; struct vm_pagequeue *pq; vm_object_t object; long min_scan; - int act_delta, addl_page_shortage, deficit, inactq_shortage, maxscan; - int page_shortage, scan_tick, scanned, starting_page_shortage; - boolean_t queue_locked; + int act_delta, addl_page_shortage, deficit, inactq_shortage; + int page_shortage, scan_tick, starting_page_shortage; + bool obj_locked; /* * If we need to reclaim memory ask kernel caches to return @@ -1152,6 +1293,11 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i page_shortage = deficit = 0; starting_page_shortage = page_shortage; + mtx = NULL; + obj_locked = false; + object = NULL; + vm_batchqueue_init(&rq); + /* * Start scanning the inactive queue for pages that we can free. The * scan will stop when we reach the target or we have scanned the @@ -1158,72 +1304,74 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * entire queue. (Note that m->act_count is not used to make * decisions for the inactive queue, only for the active queue.) */ + marker = &vmd->vmd_markers[PQ_INACTIVE]; pq = &vmd->vmd_pagequeues[PQ_INACTIVE]; - maxscan = pq->pq_cnt; vm_pagequeue_lock(pq); - queue_locked = TRUE; - for (m = TAILQ_FIRST(&pq->pq_pl); - m != NULL && maxscan-- > 0 && page_shortage > 0; - m = next) { - vm_pagequeue_assert_locked(pq); - KASSERT(queue_locked, ("unlocked inactive queue")); - KASSERT(vm_page_inactive(m), ("Inactive queue %p", m)); + vm_pageout_init_scan(&ss, pq, marker, NULL, pq->pq_cnt); + while (page_shortage > 0 && (m = vm_pageout_next(&ss, true)) != NULL) { + KASSERT((m->flags & PG_MARKER) == 0, + ("marker page %p was dequeued", m)); - VM_CNT_INC(v_pdpages); - next = TAILQ_NEXT(m, plinks.q); + vm_page_change_lock(m, &mtx); +recheck: /* - * skip marker pages + * The page may have been disassociated from the queue + * while locks were dropped. */ - if (m->flags & PG_MARKER) + if (!vm_pageout_page_queued(m, PQ_INACTIVE)) { + addl_page_shortage++; continue; + } - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("Fictitious page %p cannot be in inactive queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("Unmanaged page %p cannot be in inactive queue", m)); + /* + * The page was re-enqueued after the page queue lock was + * dropped, or a requeue was requested. This page gets a second + * chance. + */ + if ((m->aflags & (PGA_ENQUEUED | PGA_REQUEUE | + PGA_REQUEUE_HEAD)) != 0) + goto reinsert; /* - * The page or object lock acquisitions fail if the - * page was removed from the queue or moved to a - * different position within the queue. In either - * case, addl_page_shortage should not be incremented. + * Held pages are essentially stuck in the queue. So, + * they ought to be discounted from the inactive count. + * See the calculation of inactq_shortage before the + * loop over the active queue below. + * + * Wired pages may not be freed. Complete their removal + * from the queue now to avoid needless revisits during + * future scans. */ - if (!vm_pageout_page_lock(m, &next)) - goto unlock_page; - else if (m->wire_count != 0) { - /* - * Wired pages may not be freed, and unwiring a queued - * page will cause it to be requeued. Thus, remove them - * from the queue now to avoid unnecessary revisits. - */ - vm_page_dequeue_locked(m); + if (m->hold_count != 0) { addl_page_shortage++; - goto unlock_page; - } else if (m->hold_count != 0) { - /* - * Held pages are essentially stuck in the - * queue. So, they ought to be discounted - * from the inactive count. See the - * calculation of inactq_shortage before the - * loop over the active queue below. - */ + goto reinsert; + } + if (m->wire_count != 0) { addl_page_shortage++; - goto unlock_page; + vm_page_dequeue_deferred(m); + continue; } - object = m->object; - if (!VM_OBJECT_TRYWLOCK(object)) { - if (!vm_pageout_fallback_object_lock(m, &next)) - goto unlock_object; - else if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - addl_page_shortage++; - goto unlock_object; - } else if (m->hold_count != 0) { - addl_page_shortage++; - goto unlock_object; + + if (object != m->object) { + if (obj_locked) { + VM_OBJECT_WUNLOCK(object); + obj_locked = false; } + object = m->object; } + if (!obj_locked) { + if (!VM_OBJECT_TRYWLOCK(object)) { + mtx_unlock(mtx); + /* Depends on type-stability. */ + VM_OBJECT_WLOCK(object); + obj_locked = true; + mtx_lock(mtx); + goto recheck; + } else + obj_locked = true; + } + if (vm_page_busied(m)) { /* * Don't mess with busy pages. Leave them at @@ -1234,28 +1382,10 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * inactive count. */ addl_page_shortage++; -unlock_object: - VM_OBJECT_WUNLOCK(object); -unlock_page: - vm_page_unlock(m); - continue; + goto reinsert; } - KASSERT(!vm_page_held(m), ("Held page %p", m)); /* - * Dequeue the inactive page and unlock the inactive page - * queue, invalidating the 'next' pointer. Dequeueing the - * page here avoids a later reacquisition (and release) of - * the inactive page queue lock when vm_page_activate(), - * vm_page_free(), or vm_page_launder() is called. Use a - * marker to remember our place in the inactive queue. - */ - TAILQ_INSERT_AFTER(&pq->pq_pl, m, &vmd->vmd_marker, plinks.q); - vm_page_dequeue_locked(m); - vm_pagequeue_unlock(pq); - queue_locked = FALSE; - - /* * Invalid pages can be easily freed. They cannot be * mapped, vm_page_free() asserts this. */ @@ -1291,14 +1421,10 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i * queue. */ m->act_count += act_delta + ACT_ADVANCE; - goto drop_page; + continue; } else if ((object->flags & OBJ_DEAD) == 0) { - vm_pagequeue_lock(pq); - queue_locked = TRUE; - m->queue = PQ_INACTIVE; - TAILQ_INSERT_TAIL(&pq->pq_pl, m, plinks.q); - vm_pagequeue_cnt_inc(pq); - goto drop_page; + vm_page_aflag_set(m, PGA_REQUEUE); + goto reinsert; } } @@ -1324,23 +1450,39 @@ vm_pageout_scan(struct vm_domain *vmd, int pass, i */ if (m->dirty == 0) { free_page: + /* + * Because we dequeued the page and have already + * checked for concurrent dequeue and enqueue + * requests, we can safely disassociate the page + * from the inactive queue. + */ + KASSERT((m->aflags & PGA_QUEUE_STATE_MASK) == 0, + ("page %p has queue state", m)); + m->queue = PQ_NONE; vm_page_free(m); - VM_CNT_INC(v_dfree); - --page_shortage; + page_shortage--; } else if ((object->flags & OBJ_DEAD) == 0) vm_page_launder(m); -drop_page: - vm_page_unlock(m); + continue; +reinsert: + vm_pageout_reinsert_inactive(&ss, &rq, m); + } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + if (obj_locked) { VM_OBJECT_WUNLOCK(object); - if (!queue_locked) { - vm_pagequeue_lock(pq); - queue_locked = TRUE; - } - next = TAILQ_NEXT(&vmd->vmd_marker, plinks.q); - TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_marker, plinks.q); + obj_locked = false; } + vm_pageout_reinsert_inactive(&ss, &rq, NULL); + vm_pageout_reinsert_inactive(&ss, &ss.bq, NULL); + vm_pagequeue_lock(pq); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); + VM_CNT_ADD(v_dfree, starting_page_shortage - page_shortage); + /* * Wake up the laundry thread so that it can perform any needed * laundering. If we didn't meet our target, we're in shortfall and @@ -1401,9 +1543,9 @@ free_page: vm_paging_target(vmd) + deficit + addl_page_shortage; inactq_shortage *= act_scan_laundry_weight; + marker = &vmd->vmd_markers[PQ_ACTIVE]; pq = &vmd->vmd_pagequeues[PQ_ACTIVE]; vm_pagequeue_lock(pq); - maxscan = pq->pq_cnt; /* * If we're just idle polling attempt to visit every @@ -1416,7 +1558,7 @@ free_page: min_scan /= hz * vm_pageout_update_period; } else min_scan = 0; - if (min_scan > 0 || (inactq_shortage > 0 && maxscan > 0)) + if (min_scan > 0 || (inactq_shortage > 0 && pq->pq_cnt > 0)) vmd->vmd_last_active_scan = scan_tick; /* @@ -1423,36 +1565,47 @@ free_page: * Scan the active queue for pages that can be deactivated. Update * the per-page activity counter and use it to identify deactivation * candidates. Held pages may be deactivated. + * + * To avoid requeuing each page that remains in the active queue, we + * implement the CLOCK algorithm. To maintain consistency in the + * generic page queue code, pages are inserted at the tail of the + * active queue. We thus use two hands, represented by marker pages: + * scans begin at the first hand, which precedes the second hand in + * the queue. When the two hands meet, they are moved back to the + * head and tail of the queue, respectively, and scanning resumes. */ - for (m = TAILQ_FIRST(&pq->pq_pl), scanned = 0; m != NULL && (scanned < - min_scan || (inactq_shortage > 0 && scanned < maxscan)); m = next, - scanned++) { - KASSERT(m->queue == PQ_ACTIVE, - ("vm_pageout_scan: page %p isn't active", m)); - next = TAILQ_NEXT(m, plinks.q); - if ((m->flags & PG_MARKER) != 0) +act_scan: + vm_pageout_init_scan(&ss, pq, marker, &vmd->vmd_clock[0], + inactq_shortage > 0 ? pq->pq_cnt : min_scan); + while ((m = vm_pageout_next(&ss, false)) != NULL) { + if (__predict_false(m == &vmd->vmd_clock[1])) { + vm_pagequeue_lock(pq); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[0], plinks.q); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[1], plinks.q); + TAILQ_INSERT_HEAD(&pq->pq_pl, &vmd->vmd_clock[0], + plinks.q); + TAILQ_INSERT_TAIL(&pq->pq_pl, &vmd->vmd_clock[1], + plinks.q); + vm_pageout_end_scan(&ss); + goto act_scan; + } + if (__predict_false((m->flags & PG_MARKER) != 0)) continue; - KASSERT((m->flags & PG_FICTITIOUS) == 0, - ("Fictitious page %p cannot be in active queue", m)); - KASSERT((m->oflags & VPO_UNMANAGED) == 0, - ("Unmanaged page %p cannot be in active queue", m)); - if (!vm_pageout_page_lock(m, &next)) { - vm_page_unlock(m); - continue; - } + vm_page_change_lock(m, &mtx); + /* - * The count for page daemon pages is updated after checking - * the page for eligibility. + * The page may have been disassociated from the queue + * while locks were dropped. */ - VM_CNT_INC(v_pdpages); + if (!vm_pageout_page_queued(m, PQ_ACTIVE)) + continue; /* * Wired pages are dequeued lazily. */ if (m->wire_count != 0) { - vm_page_dequeue_locked(m); - vm_page_unlock(m); + vm_page_dequeue_deferred(m); continue; } @@ -1491,14 +1644,7 @@ free_page: } else m->act_count -= min(m->act_count, ACT_DECLINE); - /* - * Move this page to the tail of the active, inactive or laundry - * queue depending on usage. - */ if (m->act_count == 0) { - /* Dequeue to avoid later lock recursion. */ - vm_page_dequeue_locked(m); - /* * When not short for inactive pages, let dirty pages go * through the inactive queue before moving to the @@ -1530,11 +1676,18 @@ free_page: inactq_shortage--; } } - } else - vm_page_requeue_locked(m); - vm_page_unlock(m); + } } + if (mtx != NULL) { + mtx_unlock(mtx); + mtx = NULL; + } + vm_pagequeue_lock(pq); + TAILQ_REMOVE(&pq->pq_pl, &vmd->vmd_clock[0], plinks.q); + TAILQ_INSERT_AFTER(&pq->pq_pl, marker, &vmd->vmd_clock[0], plinks.q); + vm_pageout_end_scan(&ss); vm_pagequeue_unlock(pq); + if (pass > 0) vm_swapout_run_idle(); return (page_shortage <= 0); @@ -1781,11 +1934,9 @@ vm_pageout_worker(void *arg) KASSERT(vmd->vmd_segs != 0, ("domain without segments")); vmd->vmd_last_active_scan = ticks; - vm_pageout_init_marker(&vmd->vmd_marker, PQ_INACTIVE); - vm_pageout_init_marker(&vmd->vmd_inacthead, PQ_INACTIVE); - TAILQ_INSERT_HEAD(&vmd->vmd_pagequeues[PQ_INACTIVE].pq_pl, - &vmd->vmd_inacthead, plinks.q); + vm_pageout_insert_markers(vmd); + /* * The pageout daemon worker is never done, so loop forever. */ Index: /usr/src/sys/vm/vm_pagequeue.h =================================================================== --- /usr/src/sys/vm/vm_pagequeue.h (revision 332641) +++ /usr/src/sys/vm/vm_pagequeue.h (working copy) @@ -73,8 +73,17 @@ struct vm_pagequeue { const char * const pq_name; } __aligned(CACHE_LINE_SIZE); +#ifndef VM_BATCHQUEUE_SIZE +#define VM_BATCHQUEUE_SIZE 7 +#endif + +struct vm_batchqueue { + vm_page_t bq_pa[VM_BATCHQUEUE_SIZE]; + int bq_cnt; +} __aligned(CACHE_LINE_SIZE); + +#include #include -#include struct sysctl_oid; /* @@ -82,12 +91,12 @@ struct sysctl_oid; * and accounting. * * Lock Key: - * f vmd_free_mtx - * p vmd_pageout_mtx - * d vm_domainset_lock - * a atomic - * c const after boot - * q page queue lock + * f vmd_free_mtx + * p vmd_pageout_mtx + * d vm_domainset_lock + * a atomic + * c const after boot + * q page queue lock */ struct vm_domain { struct vm_pagequeue vmd_pagequeues[PQ_COUNT]; @@ -107,9 +116,9 @@ struct vm_domain { boolean_t vmd_oom; int vmd_oom_seq; int vmd_last_active_scan; - struct vm_page vmd_laundry_marker; - struct vm_page vmd_marker; /* marker for pagedaemon private use */ + struct vm_page vmd_markers[PQ_COUNT]; /* (q) for page daemon use */ struct vm_page vmd_inacthead; /* marker for LRU-defeating insertions */ + struct vm_page vmd_clock[2]; /* markers for active queue scan */ int vmd_pageout_wanted; /* (a, p) pageout daemon wait channel */ int vmd_pageout_pages_needed; /* (d) page daemon waiting for pages? */ @@ -145,6 +154,7 @@ extern struct vm_domain vm_dom[MAXMEMDOM]; #define vm_pagequeue_assert_locked(pq) mtx_assert(&(pq)->pq_mutex, MA_OWNED) #define vm_pagequeue_lock(pq) mtx_lock(&(pq)->pq_mutex) #define vm_pagequeue_lockptr(pq) (&(pq)->pq_mutex) +#define vm_pagequeue_trylock(pq) mtx_trylock(&(pq)->pq_mutex) #define vm_pagequeue_unlock(pq) mtx_unlock(&(pq)->pq_mutex) #define vm_domain_free_assert_locked(n) \ @@ -155,6 +165,8 @@ extern struct vm_domain vm_dom[MAXMEMDOM]; mtx_lock(vm_domain_free_lockptr((d))) #define vm_domain_free_lockptr(d) \ (&(d)->vmd_free_mtx) +#define vm_domain_free_trylock(d) \ + mtx_trylock(vm_domain_free_lockptr((d))) #define vm_domain_free_unlock(d) \ mtx_unlock(vm_domain_free_lockptr((d))) @@ -173,14 +185,39 @@ static __inline void vm_pagequeue_cnt_add(struct vm_pagequeue *pq, int addend) { -#ifdef notyet vm_pagequeue_assert_locked(pq); -#endif pq->pq_cnt += addend; } #define vm_pagequeue_cnt_inc(pq) vm_pagequeue_cnt_add((pq), 1) #define vm_pagequeue_cnt_dec(pq) vm_pagequeue_cnt_add((pq), -1) +static inline void +vm_batchqueue_init(struct vm_batchqueue *bq) +{ + + bq->bq_cnt = 0; +} + +static inline bool +vm_batchqueue_insert(struct vm_batchqueue *bq, vm_page_t m) +{ + + if (bq->bq_cnt < nitems(bq->bq_pa)) { + bq->bq_pa[bq->bq_cnt++] = m; + return (true); + } + return (false); +} + +static inline vm_page_t +vm_batchqueue_pop(struct vm_batchqueue *bq) +{ + + if (bq->bq_cnt == 0) + return (NULL); + return (bq->bq_pa[--bq->bq_cnt]); +} + void vm_domain_set(struct vm_domain *vmd); void vm_domain_clear(struct vm_domain *vmd); int vm_domain_allocate(struct vm_domain *vmd, int req, int npages); Index: /usr/src/sys/vm/vm_phys.c =================================================================== --- /usr/src/sys/vm/vm_phys.c (revision 332641) +++ /usr/src/sys/vm/vm_phys.c (working copy) @@ -354,9 +354,9 @@ vm_freelist_add(struct vm_freelist *fl, vm_page_t m->order = order; if (tail) - TAILQ_INSERT_TAIL(&fl[order].pl, m, plinks.q); + TAILQ_INSERT_TAIL(&fl[order].pl, m, listq); else - TAILQ_INSERT_HEAD(&fl[order].pl, m, plinks.q); + TAILQ_INSERT_HEAD(&fl[order].pl, m, listq); fl[order].lcnt++; } @@ -364,7 +364,7 @@ static void vm_freelist_rem(struct vm_freelist *fl, vm_page_t m, int order) { - TAILQ_REMOVE(&fl[order].pl, m, plinks.q); + TAILQ_REMOVE(&fl[order].pl, m, listq); fl[order].lcnt--; m->order = VM_NFREEORDER; } @@ -1196,7 +1196,7 @@ vm_phys_alloc_seg_contig(struct vm_phys_seg *seg, oind++) { for (pind = 0; pind < VM_NFREEPOOL; pind++) { fl = (*seg->free_queues)[pind]; - TAILQ_FOREACH(m_ret, &fl[oind].pl, plinks.q) { + TAILQ_FOREACH(m_ret, &fl[oind].pl, listq) { /* * Is the size of this allocation request * larger than the largest block size? Index: /usr/src/sys/vm/vm_swapout.c =================================================================== --- /usr/src/sys/vm/vm_swapout.c (revision 332641) +++ /usr/src/sys/vm/vm_swapout.c (working copy) @@ -399,8 +399,15 @@ vm_daemon(void) swapout_flags = vm_pageout_req_swapout; vm_pageout_req_swapout = 0; mtx_unlock(&vm_daemon_mtx); - if (swapout_flags) + if (swapout_flags != 0) { + /* + * Drain the per-CPU page queue batches as a deadlock + * avoidance measure. + */ + if ((swapout_flags & VM_SWAP_NORMAL) != 0) + vm_page_drain_pqbatch(); swapout_procs(swapout_flags); + } /* * scan the processes for exceeding their rlimits or if -- Test scenario: misc/nullfs2.sh