panic: journal_jremref: Lost inodedep, vmcore.165 KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2020 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #1 r357884M: Thu Feb 13 22:56:34 CET 2020 pho@mercat1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO amd64 FreeBSD clang version 9.0.1 (git@github.com:llvm/llvm-project.git c1a0a213378a458fbea1a5c77b315c7dce08fd05) (based on LLVM 9.0.1) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz (3500.07-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xbfebfbff Features2=0x7ffefbff AMD Features=0x2c100800 AMD Features2=0x21 Structured Extended Features=0x37ab XSAVE Features=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr TSC: P-state invariant, performance statistics real memory = 34359738368 (32768 MB) avail memory = 33164111872 (31627 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 irqs 0-23 ioapic1 irqs 24-47 Launching APs: 1 5 11 8 7 6 10 2 4 3 9 Timecounter "TSC-low" frequency 1750033180 Hz quality 1000 random: entropy device external interface WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 13.0. kbd1 at kbdmux0 000.000055 [4341] netmap_init netmap: loaded module [ath_hal] loaded nexus0 vtvga0: cryptosoft0: acpi0: acpi0: Power Button (fixed) cpu0: on acpi0 atrtc0: port 0x70-0x71,0x74-0x77 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 340 Event timer "HPET2" frequency 14318180 Hz quality 340 Event timer "HPET3" frequency 14318180 Hz quality 340 Event timer "HPET4" frequency 14318180 Hz quality 340 Event timer "HPET5" frequency 14318180 Hz quality 340 Event timer "HPET6" frequency 14318180 Hz quality 340 Event timer "HPET7" frequency 14318180 Hz quality 340 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: on acpi0 pci0: on pcib0 pci0: at device 11.1 (no driver attached) pci0: at device 11.2 (no driver attached) pci0: at device 16.1 (no driver attached) pci0: at device 16.6 (no driver attached) pci0: at device 18.1 (no driver attached) acpi_syscontainer0: on acpi0 acpi_syscontainer1: on acpi0 acpi_syscontainer2: on acpi0 acpi_syscontainer3: on acpi0 pcib1: port 0xcf8-0xcff on acpi0 pci1: on pcib1 pcib2: irq 26 at device 1.0 on pci1 pci2: on pcib2 pcib3: irq 32 at device 2.0 on pci1 pci3: on pcib3 pci3: at device 0.0 (no driver attached) pci3: at device 0.1 (no driver attached) pcib4: irq 40 at device 3.0 on pci1 pci4: on pcib4 pci1: at device 17.0 (no driver attached) ahci0: port 0xf110-0xf117,0xf100-0xf103,0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf020-0xf03f mem 0xfb438000-0xfb4387ff irq 16 at device 17.4 on pci1 ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 xhci0: mem 0xfb400000-0xfb40ffff irq 19 at device 20.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pci1: at device 22.0 (no driver attached) pci1: at device 22.1 (no driver attached) ehci0: mem 0xfb434000-0xfb4343ff irq 18 at device 26.0 on pci1 usbus1: EHCI version 1.0 usbus1 on ehci0 usbus1: 480Mbps High Speed USB v2.0 pcib5: irq 16 at device 28.0 on pci1 pci5: on pcib5 pcib6: irq 18 at device 28.2 on pci1 pci6: on pcib6 pcib7: at device 0.0 on pci6 pci7: on pcib7 vgapci0: port 0xe000-0xe07f mem 0xfa000000-0xfaffffff,0xfb000000-0xfb01ffff irq 18 at device 0.0 on pci7 vgapci0: Boot video device pcib8: irq 16 at device 28.4 on pci1 pci8: on pcib8 igb0: port 0xd020-0xd03f mem 0xfb320000-0xfb33ffff,0xfb344000-0xfb347fff irq 16 at device 0.0 on pci8 igb0: Using 1024 TX descriptors and 1024 RX descriptors igb0: queue equality override not set, Autoloading module: ioat.ko ioat0: mem 0xfb42c000-0xfb42ffff irq 31 at device 4.0 on pci1 ioat0: Capabilities: 2f7 ioat1: mem 0xfb428000-0xfb42bfff irq 39 at device 4.1 on pci1 ioat1: Capabilities: 2f7 ioat2: mem 0xfb424000-0xfb427fff irq 31 at device 4.2 on pci1 ioat2: Capabilities: f7 ioat3: mem 0xfb420000-0xfb423fff irq 39 at device 4.3 on pci1 ioat3: Capabilities: f7 ioat4: mem 0xfb41c000-0xfb41ffff irq 31 at device 4.4 on pci1 ioat4: Capabilities: f7 ioat5: mem 0xfb418000-0xfb41bfff irq 39 at device 4.5 on pci1 ioat5: Capabilities: f7 ioat6: mem 0xfb414000-0xfb417fff irq 31 at device 4.6 on pci1 ioat6: Capabilities: f7 ioat7: mem 0xfb410000-0xfb413fff irq 39 at device 4.7 on pci1 ioat7: Capabilities: f7 Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Autoloading module: ioat.ko Starting Network: igb1. igb1: flags=8822 metric 0 mtu 1500 options=4e507bb ether 0c:c4:7a:a8:cd:db media: Ethernet autoselect status: no carrier nd6 options=29 Autoloading module: uhid.ko Autoloading module: ums.ko ums0 on uhub3 ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=0 Starting dhclient. DHCPREQUEST on igb0 to 255.255.255.255 port 67 DHCPACK from 192if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 .168.5.1 bound to 192.168.5.171 -- renewal in 300 seconds. add host 127.0.0.1: gateway lo0 fib 0: route already in table add host ::1: gateway lo0 fib 0: route already in table add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. Setting date via ntp. 13 Feb 23:04:13 ntpdate[2044]: step time server 192.168.5.1 offset -0.773431 sec Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Clearing /tmp (X related). Starting statd. Starting lockd. Recovering vi editor sessions:. fscklock order reversal: 1st 0xfffff800205be568 ufs (ufs) @ kern/vfs_mount.c:1628 2nd 0xfffff80020703a68 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1404 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b328 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ee6c33 at ffs_flushfiles+0xa3 #6 0xffffffff80ec8a7d at softdep_flushfiles+0xad #7 0xffffffff80ee9477 at ffs_unmount+0xd7 #8 0xffffffff80c9b0aa at dounmount+0x42a #9 0xffffffff80c9ac29 at kern_unmount+0x2b9 #10 0xffffffff81073afe at amd64_syscall+0x2ee #11 0xffffffff81049e70 at fast_syscall_common+0x101 ** /dev/gpt/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 295 files, 5960 used, 1259447 free (127 frags, 157415 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** Updating motd:. Mounting late filesystems:. Security policy loaded: MAC/ntpd (mac_ntpd) Starting ntpd. Starting powerd. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. Thu Feb 13 23:04 FreeBSD/amd64 (mercat1.netperf.freebsd.org) (ttyu1) login: root Feb 13 23:06:15 mercat1 login[2330]: ROOT LOGIN (root) ON ttyu1 Last login: Thu Feb 13 22:55:07 on ttyu1 FreeBSD 13.0-CURRENT (PHO) #1 r357884M: Thu Feb 13 22:56:34 CET 2020 root@mercat1:~ # Feb 13 23:06:31 mercat1 su[2352]: pho to root on /dev/pts/0 20200213 23:07:49 all (1/696): 1st.sh 20200213 23:07:51 all (2/696): 256m.sh 20200213 23:07:52 all (3/696): audit.sh 20200213 23:07:53 all (4/696): beneath3.sh 20200213 23:08:11 all (5/696): buildworld.sh 20200213 23:08:13 all (6/696): buildworld2.sh 20200213 23:08:14 all (7/696): cluster.sh newblk leak: 10301/10329. 20200213 23:20:01 all (8/696): cpuset.sh 20200213 23:20:03 all (9/696): crossmp2.sh 20200213 23:20:04 all (10/696): crossmp6.sh 20200213 23:20:06 all (11/696): datagram2.sh 20200213 23:20:08 all (12/696): datagram3.sh 20200213 23:20:09 all (13/696): datamove.sh freework leak: 17/42. 20200213 23:20:11 all (14/696): datamove3.sh 20200213 23:20:13 all (15/696): devfs2.sh 20200213 23:20:15 all (16/696): devfs5.sh 20200213 23:20:16 all (17/696): dtrace_fault.sh 20200213 23:20:18 all (18/696): dumpfs.sh 20200213 23:20:20 all (19/696): dup2.sh 20200213 23:20:21 all (20/696): execi386.sh 20200213 23:20:24 all (21/696): extattr_set_fd.sh 20200213 23:20:25 all (22/696): extattrctl.sh lock order reversal: 1st 0xfffff80020c24c38 ufs_extattr_sx (ufs_extattr_sx) @ ufs/ufs/ufs_extattr.c:119 2nd 0xfffff807202c42e8 ufs (ufs) @ ufs/ffs/ffs_vfsops.c:1737 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b90e at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9c50c at __lockmgr_args+0x62c #4 0xffffffff80ee6e91 at ffs_vgetf+0x161 #5 0xffffffff80ef9eeb at ufs_root+0x1b #6 0xffffffff80ca85d3 at vfs_cache_root_fallback+0x143 #7 0xffffffff80ca8306 at vfs_cache_root+0x1f6 #8 0xffffffff80ef225f at ufs_extattr_autostart+0x5f #9 0xffffffff80ee926e at ffs_mount+0x1c3e #10 0xffffffff80c99df7 at vfs_domount+0x847 #11 0xffffffff80c987a1 at vfs_donmount+0x911 #12 0xffffffff80c97e59 at sys_nmount+0x69 #13 0xffffffff81073afe at amd64_syscall+0x2ee #14 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:20:27 all (23/696): fcntl3.sh 20200213 23:20:29 all (24/696): fexecve.sh 20200213 23:20:30 all (25/696): fifo.sh 20200213 23:20:32 all (26/696): forkbomb.sh 20200213 23:20:34 all (27/696): fsck2.sh 20200213 23:20:36 all (28/696): fsck3.sh 20200213 23:20:38 all (29/696): fsck4.sh 20200213 23:20:40 all (30/696): getrandom.sh 20200213 23:20:42 all (31/696): gnop3.sh 20200213 23:20:43 all (32/696): gnop5.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200213 23:20:46 all (33/696): holdcnt0.sh 20200213 23:20:47 all (34/696): holdcnt02.sh 20200213 23:20:49 all (35/696): holdcnt03.sh 20200213 23:20:51 all (36/696): holdcnt04.sh 20200213 23:20:52 all (37/696): holdcnt05.sh 20200213 23:20:54 all (38/696): isofs2.sh 20200213 23:20:56 all (39/696): jail.sh 20200213 23:20:58 all (40/696): jail2.sh 20200213 23:21:00 all (41/696): jail3.sh 20200213 23:21:02 all (42/696): jail4.sh 20200213 23:21:03 all (43/696): kern_umtx_inf_loop.sh 20200213 23:21:06 all (44/696): kevent10.sh 20200213 23:21:08 all (45/696): kevent3.sh 20200213 23:21:10 all (46/696): ldt.sh 20200213 23:21:11 all (47/696): ldt2.sh 20200213 23:21:13 all (48/696): libMicro.sh 20200213 23:21:15 all (49/696): linux.sh 20200213 23:21:16 all (50/696): lockd.sh 20200213 23:21:18 all (51/696): lockf.sh 20200213 23:21:20 all (52/696): lookup_shared.sh 20200213 23:21:21 all (53/696): mac.sh 20200213 23:21:23 all (54/696): mac_chkexec.sh 20200213 23:21:25 all (55/696): machipc.sh 20200213 23:21:26 all (56/696): machipc2.sh 20200213 23:21:28 all (57/696): maxmemdom.sh 20200213 23:21:30 all (58/696): maxproc.sh 20200213 23:21:32 all (59/696): md4.sh 20200213 23:21:34 all (60/696): md5.sh 20200213 23:21:36 all (61/696): md6.sh 20200213 23:21:37 all (62/696): mdconfig.sh 20200213 23:21:39 all (63/696): mdconfig3.sh 20200213 23:21:41 all (64/696): memguard4.sh 20200213 23:21:43 all (65/696): mkfifo5.sh 20200213 23:21:45 all (66/696): mkfifo7.sh 20200213 23:21:47 all (67/696): mlockall5.sh 20200213 23:21:48 all (68/696): mmap.sh 20200213 23:21:50 all (69/696): mmap12.sh 20200213 23:21:51 all (70/696): mmap16.sh 20200213 23:21:52 all (71/696): mmap17.sh 20200213 23:21:54 all (72/696): mmap20.sh 20200213 23:21:55 all (73/696): mmap24.sh 20200213 23:21:57 all (74/696): mmap30.sh 20200213 23:21:58 all (75/696): mmap33.sh 20200213 23:22:00 all (76/696): mmap35.sh 20200213 23:22:01 all (77/696): mmap36.sh 20200213 23:22:03 all (78/696): mount.sh 20200213 23:22:04 all (79/696): mountro3.sh 20200213 23:22:06 all (80/696): mprotect.sh 20200213 23:22:07 all (81/696): msdos2.sh 20200213 23:22:09 all (82/696): msdos3.sh 20200213 23:22:10 all (83/696): msdos7.sh lock order reversal: 1st 0xfffff802fd8a32e8 msdosfs (msdosfs) @ kern/vfs_syscalls.c:3431 2nd 0xfffff802c577d2e8 devfs (devfs) @ fs/msdosfs/msdosfs_vnops.c:853 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b328 at lockmgr_lock_fast_path+0x178 #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80a81c69 at msdosfs_fsync+0x49 #6 0xffffffff810efb79 at VOP_FSYNC_APV+0x59 #7 0xffffffff80cb4e96 at kern_fsync+0x196 #8 0xffffffff81073afe at amd64_syscall+0x2ee #9 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:22:12 all (84/696): msdos8.sh 20200213 23:22:13 all (85/696): msetdomain.sh 20200213 23:22:15 all (86/696): nanosleep.sh 20200213 23:22:16 all (87/696): nbufkv.sh 20200213 23:30:55 all (88/696): nfs.sh 20200213 23:30:56 all (89/696): nfs12.sh 20200213 23:30:58 all (90/696): nfs14.sh 20200213 23:30:59 all (91/696): nfs15.sh 20200213 23:31:01 all (92/696): nfs15lockd.sh 20200213 23:31:02 all (93/696): nfs15lockd3.sh 20200213 23:31:04 all (94/696): nfs3.sh 20200213 23:31:05 all (95/696): nfs4.sh 20200213 23:31:06 all (96/696): nfs7.sh 20200213 23:31:08 all (97/696): nfs8.sh 20200213 23:31:09 all (98/696): nfs9.sh 20200213 23:31:10 all (99/696): nfs_halfpage.sh 20200213 23:31:14 all (100/696): nfs_halfpage2.sh 20200213 23:31:15 all (101/696): nfsdelegation.sh 20200213 23:31:17 all (102/696): nfsdepth.sh 20200213 23:31:18 all (103/696): nfsrename.sh 20200213 23:31:20 all (104/696): nfssillyrename.sh 20200213 23:31:21 all (105/696): nullfs13.sh 20200213 23:31:23 all (106/696): nullfs14.sh 20200213 23:31:24 all (107/696): nullfs15.sh 20200213 23:31:26 all (108/696): nullfs21.sh 20200213 23:31:27 all (109/696): nullfs23.sh 20200213 23:31:29 all (110/696): nullfs4.sh 20200213 23:31:30 all (111/696): nullfs6.sh 20200213 23:31:31 all (112/696): nullfs7.sh 20200213 23:31:33 all (113/696): nullfs9.sh 20200213 23:31:34 all (114/696): numa.sh 20200213 23:31:36 all (115/696): oom.sh 20200213 23:31:37 all (116/696): open.sh 20200213 23:31:39 all (117/696): pagefault.sh 20200213 23:31:40 all (118/696): parallelmount2.sh 20200213 23:31:42 all (119/696): pathconf.sh 20200213 23:31:43 all (120/696): pathconf2.sh 20200213 23:31:44 all (121/696): pcatch.sh 20200213 23:31:46 all (122/696): pcatch2.sh 20200213 23:31:47 all (123/696): ping.sh 20200213 23:31:49 all (124/696): pkru.sh 20200213 23:31:50 all (125/696): pkru2.sh 20200213 23:31:51 all (126/696): pmc4.sh 20200213 23:31:53 all (127/696): pmc5.sh 20200213 23:31:55 all (128/696): pmc8.sh 20200213 23:31:56 all (129/696): poll.sh 20200213 23:31:57 all (130/696): posix_fadvise.sh 20200213 23:31:59 all (131/696): posix_fadvise2.sh 20200213 23:32:01 all (132/696): procfs5.sh 20200213 23:32:02 all (133/696): procfs6.sh 20200213 23:32:04 all (134/696): procstat.sh 20200213 23:32:05 all (135/696): pthread9.sh 20200213 23:32:07 all (136/696): ptrace.sh 20200213 23:32:08 all (137/696): ptrace3.sh 20200213 23:32:09 all (138/696): pts2.sh 20200213 23:32:11 all (139/696): quota5.sh 20200213 23:32:12 all (140/696): rename13.sh 20200213 23:32:14 all (141/696): rename4.sh 20200213 23:32:15 all (142/696): revoke.sh 20200213 23:32:17 all (143/696): routetbl.sh 20200213 23:32:18 all (144/696): ruby.sh 20200213 23:32:20 all (145/696): rwlock_ronly.sh 20200213 23:32:21 all (146/696): schedfuzz.sh 20200213 23:32:23 all (147/696): seekdir.sh 20200213 23:32:24 all (148/696): segnp.sh 20200213 23:32:26 all (149/696): segregs.sh 20200213 23:32:27 all (150/696): select3.sh 20200213 23:32:29 all (151/696): sendfile.sh lock order reversal: 1st 0xfffffe00e38ed600 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:390 2nd 0xfffff802fd9cbce8 ufs (ufs) @ kern/kern_sendfile.c:767 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b4cd at lockmgr_slock_hard+0x6d #3 0xffffffff80b9c678 at __lockmgr_args+0x798 #4 0xffffffff80eeb61c at ffs_lock+0x7c #5 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #6 0xffffffff80cb9174 at _vn_lock+0x54 #7 0xffffffff80bc68e1 at vn_sendfile+0x6b1 #8 0xffffffff80bc83e7 at sendfile+0x127 #9 0xffffffff81073afe at amd64_syscall+0x2ee #10 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:32:31 all (152/696): sendfile2.sh lock order reversal: 1st 0xfffffe00e637a040 filedesc structure (filedesc structure) @ kern/sys_generic.c:1556 2nd 0xfffff804232c3ce8 ufs (ufs) @ kern/vfs_vnops.c:1553 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b90e at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9c50c at __lockmgr_args+0x62c #4 0xffffffff80eeb61c at ffs_lock+0x7c #5 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #6 0xffffffff80cb9174 at _vn_lock+0x54 #7 0xffffffff80cb7a4a at vn_poll+0x3a #8 0xffffffff80c3cca9 at kern_poll+0x419 #9 0xffffffff80c3c880 at sys_poll+0x50 #10 0xffffffff81073afe at amd64_syscall+0x2ee #11 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:32:58 all (153/696): sendfile4.sh 20200213 23:33:00 all (154/696): sendfile6.sh 20200213 23:33:02 all (155/696): setuid.sh 20200213 23:33:03 all (156/696): shm_super.sh 20200213 23:33:05 all (157/696): sigaltstack.sh 20200213 23:33:06 all (158/696): sigreturn.sh 20200213 23:33:08 all (159/696): sigstop.sh 20200213 23:33:10 all (160/696): snap.sh lock order reversal: 1st 0xfffffe0037fe0428 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:302 2nd 0xfffff80003a95b30 snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2327 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b90e at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9c50c at __lockmgr_args+0x62c #4 0xffffffff80ec7866 at ffs_copyonwrite+0x166 #5 0xffffffff80eea64c at ffs_geom_strategy+0x8c #6 0xffffffff80efe003 at ufs_strategy+0x83 #7 0xffffffff810f1351 at VOP_STRATEGY_APV+0x61 #8 0xffffffff80c7e31e at bufstrategy+0x3e #9 0xffffffff80c7e1ba at bufwrite+0x24a #10 0xffffffff80eec59d at ffs_syncvnode+0x2bd #11 0xffffffff80eeb4c2 at ffs_fsync+0x22 #12 0xffffffff810efb79 at VOP_FSYNC_APV+0x59 #13 0xffffffff80efbd38 at ufs_remove+0xd8 #14 0xffffffff810efd29 at VOP_REMOVE_APV+0x79 #15 0xffffffff80cb1baa at kern_funlinkat+0x2ba #16 0xffffffff80cb18e8 at sys_unlink+0x28 #17 0xffffffff81073afe at amd64_syscall+0x2ee lock order reversal: 1st 0xfffff80003a95b30 snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:918 2nd 0xfffff80423b97a68 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1650 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9b90e at lockmgr_xlock_hard+0x6e #3 0xffffffff80b9c50c at __lockmgr_args+0x62c #4 0xffffffff80ec5ddd at ffs_snapremove+0xed #5 0xffffffff80ec052f at ffs_truncate+0x25f #6 0xffffffff80ef404f at ufs_inactive+0x1cf #7 0xffffffff810f0a79 at VOP_INACTIVE_APV+0x59 #8 0xffffffff80ca4957 at vinactivef+0x107 #9 0xffffffff80ca3c7d at vput_final+0x28d #10 0xffffffff80cb1c00 at kern_funlinkat+0x310 #11 0xffffffff80cb18e8 at sys_unlink+0x28 #12 0xffffffff81073afe at amd64_syscall+0x2ee #13 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:33:12 all (161/696): snap12.sh 20200213 23:33:13 all (162/696): snap2-1.sh 20200213 23:33:15 all (163/696): snap2.sh 20200213 23:33:16 all (164/696): sndstat.sh 20200213 23:33:18 all (165/696): socketpair.sh 20200213 23:33:19 all (166/696): socketpair2.sh 20200213 23:33:20 all (167/696): suj32.sh 20200213 23:33:22 all (168/696): suj7.sh Failed to find journal. Use tunefs to create one Failed to start journal: 2 20200213 23:33:24 all (169/696): suj8.sh Feb 13 23:33:25 mercat1 kernel: pid 80111 (dd), uid 0 inumber 4 on /mnt: filesystem full Feb 13 23:33:25 mercat1 kernel: pid 80127 (dd), uid 0 inumber 5 on /mnt: filesystem full 20200213 23:33:25 all (170/696): syzkaller1.sh 20200213 23:33:27 all (171/696): syzkaller2.sh 20200213 23:33:28 all (172/696): syzkaller3.sh 20200213 23:33:30 all (173/696): tar.sh freework leak: 204867/204909. 20200213 23:39:25 all (174/696): temp.sh 20200213 23:39:28 all (175/696): tmpfs15.sh 20200213 23:39:31 all (176/696): tmpfs4.sh 20200213 23:39:32 all (177/696): tmpfs6.sh 20200213 23:39:34 all (178/696): tmpfs7.sh lock order reversal: 1st 0xfffffe00dd1d77a8 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:390 2nd 0xfffff805d01c5068 tmpfs (tmpfs) @ kern/kern_sendfile.c:767 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9cede at lockmgr_slock+0x5e #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80bc68e1 at vn_sendfile+0x6b1 #6 0xffffffff80bc83e7 at sendfile+0x127 #7 0xffffffff81073afe at amd64_syscall+0x2ee #8 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:39:36 all (179/696): trim2.sh 20200213 23:39:38 all (180/696): trim5.sh 20200213 23:39:39 all (181/696): trim6.sh 20200213 23:39:41 all (182/696): trim7.sh 20200213 23:39:42 all (183/696): trim8.sh 20200213 23:39:43 all (184/696): truncate4.sh 20200213 23:39:45 all (185/696): truncate6.sh 20200213 23:39:47 all (186/696): tvnlru.sh 20200213 23:39:48 all (187/696): ufssuspend.sh 20200213 23:39:50 all (188/696): uma_zalloc_arg.sh 20200213 23:39:51 all (189/696): unlink.sh 20200213 23:39:53 all (190/696): unload.sh 20200213 23:39:54 all (191/696): unload2.sh 20200213 23:39:55 all (192/696): vfork.sh 20200213 23:39:57 all (193/696): vmio.sh 20200213 23:39:59 all (194/696): watchman.sh 20200213 23:40:00 all (195/696): write.sh newblk leak: 306311/316640. 20200213 23:55:07 all (196/696): beneath2.sh 20200213 23:55:17 all (197/696): suj35.sh Feb 13 23:55:20 mercat1 kernel: pid 20931 (mkdir), uid 0 inumber 255 on /mnt: out of inodes 20200213 23:55:20 all (198/696): contigmalloc3.sh 20200213 23:55:29 all (199/696): datagram.sh 20200213 23:55:31 all (200/696): ext2fs3.sh 20200213 23:55:34 all (201/696): extattr.sh 20200213 23:55:36 all (202/696): fcntl.sh 20200213 23:55:39 all (203/696): fpclone2.sh 20200213 23:55:41 all (204/696): geomleak.sh 20200213 23:55:42 all (205/696): isofs.sh 20200213 23:55:45 all (206/696): kevent2.sh 20200213 23:55:48 all (207/696): killpg.sh 20200213 23:55:50 all (208/696): md9.sh lock order reversal: 1st 0xfffff800204ed080 bufwait (bufwait) @ vm/vm_pager.c:391 2nd 0xfffff8072f263a68 tmpfs (tmpfs) @ dev/md/md.c:987 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80b9d065 at lockmgr_xlock+0x55 #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff806eca72 at mdstart_vnode+0x462 #6 0xffffffff806ea80c at md_kthread+0x20c #7 0xffffffff80b86a90 at fork_exit+0x80 #8 0xffffffff8104a58e at fork_trampoline+0xe 20200213 23:55:52 all (209/696): mmap25.sh 20200213 23:55:55 all (210/696): mmap26.sh 20200213 23:55:58 all (211/696): mmap28.sh Feb 13 23:55:59 mercat1 kernel: Failed to fully fault in a core file segment at VA 0x800e00000 with size 0x180b000 to be written at offset 0x86b000 for process mmap28 20200213 23:55:59 all (212/696): mmap8.sh 20200213 23:56:02 all (213/696): mmap9.sh 20200213 23:56:05 all (214/696): mountro2.sh 20200213 23:56:06 all (215/696): msdos9.sh 20200213 23:56:09 all (216/696): newfs5.sh 20200213 23:56:12 all (217/696): nullfs10.sh 20200213 23:56:14 all (218/696): nullfs12.sh 20200213 23:56:16 all (219/696): nullfs16.sh 20200213 23:56:18 all (220/696): nullfs3.sh 20200213 23:56:21 all (221/696): openlock.sh 20200213 23:56:24 all (222/696): ptrace11.sh 20200213 23:56:26 all (223/696): ptrace8.sh 20200213 23:56:29 all (224/696): quota9.sh lock order reversal: 1st 0xfffff80542091e88 FFS (FFS Lock) @ ufs/ufs/ufs_quota.c:759 2nd 0xfffffe00e63d8700 struct mount mtx (struct mount mtx) @ ufs/ufs/ufs_quota.c:765 stack backtrace: #0 0xffffffff80c365f1 at witness_debugger+0x71 #1 0xffffffff80c36366 at witness_checkorder+0xad6 #2 0xffffffff80ba7744 at __mtx_lock_flags+0x94 #3 0xffffffff80ef8a9d at quotaoff_inchange+0xbd #4 0xffffffff80ee6cb6 at ffs_flushfiles+0x126 #5 0xffffffff80ec8a7d at softdep_flushfiles+0xad #6 0xffffffff80ee9477 at ffs_unmount+0xd7 #7 0xffffffff80c9b0aa at dounmount+0x42a #8 0xffffffff80c9ac29 at kern_unmount+0x2b9 #9 0xffffffff81073afe at amd64_syscall+0x2ee #10 0xffffffff81049e70 at fast_syscall_common+0x101 20200213 23:56:31 all (225/696): random.sh 20200213 23:56:33 all (226/696): rename6.sh 20200213 23:56:36 all (227/696): scp.sh 20200213 23:56:38 all (228/696): snap10.sh 20200213 23:56:40 all (229/696): spin.sh 20200213 23:56:43 all (230/696): suj2.sh 20200213 23:56:45 all (231/696): umtx_suspend.sh 20200213 23:56:47 all (232/696): vm_fault_dontneed.sh 20200213 23:56:49 all (233/696): contigmalloc2.sh 20200213 23:56:51 all (234/696): datamove4.sh 20200213 23:56:54 all (235/696): devfd.sh 20200213 23:56:58 all (236/696): dup.sh 20200213 23:57:02 all (237/696): extattr3.sh 20200213 23:57:05 all (238/696): mlockall7.sh 20200213 23:57:09 all (239/696): mmap23.sh 20200213 23:57:13 all (240/696): procfs2.sh 20200213 23:57:15 all (241/696): pthread.sh 20200213 23:57:19 all (242/696): rename11.sh 20200213 23:57:23 all (243/696): tmpfs5.sh 20200213 23:57:27 all (244/696): truncate5.sh 20200213 23:57:30 all (245/696): udp.sh 20200213 23:57:33 all (246/696): unix_socket.sh 20200213 23:57:37 all (247/696): kevent8.sh 20200213 23:57:41 all (248/696): linger3.sh 20200213 23:57:45 all (249/696): mkfifo6.sh 20200213 23:57:50 all (250/696): mmap13.sh 20200213 23:57:54 all (251/696): mountro4.sh 20200213 23:57:59 all (252/696): procfs.sh 20200213 23:58:04 all (253/696): procfs3.sh 20200213 23:58:08 all (254/696): ptrace2.sh 20200213 23:58:13 all (255/696): symlink4.sh 20200213 23:58:18 all (256/696): tmpfs10.sh 20200213 23:58:23 all (257/696): truncate7.sh 20200213 23:58:28 all (258/696): datamove5.sh 20200213 23:58:33 all (259/696): growfs.sh g_access(1003): provider ufsid/5e45d49ad568f8b7 has error 6 set g_access(1003): provider ufsid/5e45d49ad568f8b7 has error 6 set g_access(1003): provider ufsid/5e45d49ad568f8b7 has error 6 set g_access(1003): provider gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda has error 6 set g_access(1003): provider gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda has error 6 set g_dev_taste: make_dev_p() failed (gp->name=gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e45d49ad568f8b7, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e45d49ad568f8b7, error=17) g_dev_taste: make_dev_p() failed (gp->name=gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda, error=17) g_dev_taste: make_dev_p() failed (gp->name=ufsid/5e45d49ad568f8b7, error=17) GEOM leak: 14/87 20200213 23:58:38 all (260/696): lockf3.sh Expensive timeout(9) function: 0xffffffff809e8600(0xfffffe00d2d84428) 0.011065527 s GEOM leak: 29/116 20200214 00:18:55 all (261/696): marcus.sh Feb 14 00:19:07 mercat1 kernel: pid 95044 (rw), uid 2007 inumber 100471 on /mnt: filesystem full Feb 14 00:19:43 mercat1 kernel: pid 95019 (symlink), uid 2007 inumber 98345 on /mnt: out of inodes Feb 14 00:20:09 mercat1 kernel: pid 95127 (mkdir), uid 2007 inumber 131041 on /mnt: out of inodes Feb 14 00:20:21 mercat1 kernel: pid 95114 (mkdir), uid 2007 inumber 1842 on /mnt: out of inodes Feb 14 00:30:05 mercat1 kernel: pid 7423 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:31:39 mercat1 kernel: pid 8773 (link), uid 2007 inumber 98385 on /mnt: filesystem full Feb 14 00:31:50 mercat1 kernel: pid 8772 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:32:00 mercat1 kernel: pid 8758 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:32:13 mercat1 kernel: pid 8840 (creat), uid 2007 inumber 98431 on /mnt: out of inodes Feb 14 00:32:18 mercat1 kernel: pid 8739 (creat), uid 2007 inumber 98350 on /mnt: out of inodes Feb 14 00:32:28 mercat1 kernel: pid 8821 (creat), uid 2007 inumber 98408 on /mnt: out of inodes Feb 14 00:32:33 mercat1 kernel: pid 8794 (creat), uid 2007 inumber 98406 on /mnt: out of inodes Feb 14 00:32:39 mercat1 kernel: pid 8840 (creat), uid 2007 inumber 98431 on /mnt: out of inodes Feb 14 00:32:46 mercat1 kernel: pid 8817 (creat), uid 2007 inumber 98416 on /mnt: out of inodes Feb 14 00:32:50 mercat1 kernel: pid 8764 (creat), uid 2007 inumber 98407 on /mnt: out of inodes Feb 14 00:32:58 mercat1 kernel: pid 8785 (creat), uid 2007 inumber 98400 on /mnt: out of inodes Feb 14 00:33:05 mercat1 kernel: pid 8753 (creat), uid 2007 inumber 98360 on /mnt: out of inodes Feb 14 00:33:11 mercat1 kernel: pid 8785 (creat), uid 2007 inumber 98400 on /mnt: out of inodes Feb 14 00:33:17 mercat1 kernel: pid 8835 (creat), uid 2007 inumber 98425 on /mnt: out of inodes Feb 14 00:33:23 mercat1 kernel: pid 8800 (creat), uid 2007 inumber 98405 on /mnt: out of inodes Feb 14 00:33:37 mercat1 kernel: pid 11846 (mkfifo), uid 2007 inumber 98304 on /mnt: out of inodes Feb 14 00:34:04 mercat1 kernel: pid 11839 (mkdir), uid 2007 inumber 45406 on /mnt: out of inodes Feb 14 00:34:18 mercat1 kernel: pid 11830 (openat), uid 2007 inumber 41101 on /mnt: out of inodes Feb 14 00:34:38 mercat1 kernel: pid 11807 (creat), uid 2007 inumber 41095 on /mnt: out of inodes Feb 14 00:34:49 mercat1 syslogd: last message repeated 1 times Feb 14 00:35:07 mercat1 kernel: pid 11843 (creat), uid 2007 inumber 41105 on /mnt: out of inodes Feb 14 00:35:23 mercat1 syslogd: last message repeated 1 times 20200214 00:39:44 all (262/696): pshared.sh 20200214 00:39:51 all (263/696): truncate3.sh 20200214 00:39:56 all (264/696): fork.sh 20200214 00:40:03 all (265/696): linger2.sh Feb 14 00:40:06 mercat1 kernel: pid 28570 (linger2), uid 2007 inumber 886 on /mnt: filesystem full 20200214 00:40:10 all (266/696): linger4.sh Feb 14 00:40:15 mercat1 kernel: pid 29632 (linger4), uid 2007 inumber 234511 on /mnt: out of inodes 20200214 00:40:17 all (267/696): mlockall4.sh 20200214 00:40:24 all (268/696): ptrace9.sh 20200214 00:40:30 all (269/696): quota11.sh 20200214 00:40:37 all (270/696): gbde.sh Feb 14 00:41:09 mercat1 kernel: pid 37157 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:41:48 mercat1 kernel: pid 37219 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:43:28 mercat1 kernel: pid 38439 (rw), uid 2007 inumber 103684 on /mnt: filesystem full Feb 14 00:46:07 mercat1 kernel: pid 41067 (rw), uid 2007 inumber 5884 on /mnt: filesystem full Feb 14 00:47:54 mercat1 kernel: pid 44848 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:51:52 mercat1 kernel: pid 50662 (creat), uid 2007 inumber 95698 on /mnt: out of inodes Feb 14 00:52:21 mercat1 kernel: pid 50643 (openat), uid 2007 inumber 95694 on /mnt: out of inodes Feb 14 00:52:52 mercat1 kernel: pid 50678 (mkfifo), uid 2007 inumber 95616 on /mnt: out of inodes Feb 14 00:54:00 mercat1 kernel: pid 65874 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:54:22 mercat1 kernel: pid 65878 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 00:54:56 mercat1 kernel: pid 65802 (rw), uid 2007 inumber 55482 on /mnt: filesystem full Feb 14 00:55:55 mercat1 kernel: pid 67531 (symlink), uid 2007 inumber 31883 on /mnt: out of inodes Feb 14 00:56:01 mercat1 kernel: pid 67542 (creat), uid 2007 inumber 31891 on /mnt: out of inodes Feb 14 00:56:03 mercat1 kernel: pid 67488 (openat), uid 2007 inumber 31920 on /mnt: out of inodes Feb 14 00:56:15 mercat1 kernel: pid 67504 (mkdir), uid 2007 inumber 89558 on /mnt: out of inodes Feb 14 00:57:57 mercat1 kernel: pid 70203 (rw), uid 2007 inumber 53432 on /mnt: filesystem full 20200214 01:02:01 all (271/696): sparse.sh 20200214 01:02:10 all (272/696): symlink2.sh 20200214 01:02:20 all (273/696): sysctl.sh 20200214 01:02:27 all (274/696): tmpfs8.sh 20200214 01:02:36 all (275/696): ffs_blkfree.sh 20200214 01:02:46 all (276/696): md8.sh 20200214 01:02:57 all (277/696): rename8.sh 20200214 01:03:08 all (278/696): compare.sh 20200214 01:03:17 all (279/696): fsck5.sh 20200214 01:03:28 all (280/696): thr.sh witness_lock_list_get: witness exhausted 20200214 01:03:38 all (281/696): umountf4.sh 20200214 01:03:48 all (282/696): mmap4.sh vnode_pager_putpages: I/O error 28 0xfffff806012f3280: type VREG usecount 0, writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8074adf1420 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe0138d06700 (pid 21636, mmap4, tid 101873) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca3b13 at vput_final+0x123 #6 0xffffffff80f1924d at vm_map_process_deferred+0xad #7 0xffffffff80f20f0b at vm_map_remove+0xeb #8 0xffffffff80f18af5 at vmspace_exit+0xd5 #9 0xffffffff80b81522 at exit1+0x5a2 #10 0xffffffff80b80f7d at sys_sys_exit+0xd #11 0xffffffff81073afe at amd64_syscall+0x2ee #12 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=4b97ca76, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: residual I/O 32768 at 9760 0xfffff806012f3280: type VREG usecount 0, Feb 14 01:03:49 writecount 0, refcount 3203 flags (VI_DOINGINACT|VMP_LAZYLIST) v_object 0xfffff8074adf1420 ref 0 pages 25608 cleanbuf 3200 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe0138d06700 (pid 21636, mmap4, tid 101873) mercat1 kernel: #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a pid 21636 (mmap4#1 0xffffffff80b9c50c at __lockmgr_args+0x62c ), uid 0 inumber#2 0xffffffff80eeb61c at ffs_lock+0x7c 4 on /mnt: file#3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 system full #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca3b13 at vput_final+0x123 #6 0xffffffff80f1924d at vm_map_process_deferred+0xad #7 0xffffffff80f20f0b at vm_map_remove+0xeb #8 0xffffffff80f18af5 at vmspace_exit+0xd5 #9 0xffffffff80b81522 at exit1+0x5a2 #10 0xffffffff80b80f7d at sys_sys_exit+0xd #11 0xffffffff81073afe at amd64_syscall+0x2ee #12 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=4b97ca76, uid=0, gid=0, flags=0x0 ino 4, on dev md10a vnode_pager_putpages: zero-length write at 40075264 resid 131072 0xfffff806012f3280: type VREG usecount 1, writecount 0, refcount 3203 flags (VMP_LAZYLIST) v_object 0xfffff8074adf1420 ref 0 pages 25608 cleanbuf 3201 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe00e785d000 (pid 21644, umount, tid 101577) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca2d19 at vget_finish+0x79 #6 0xffffffff80ca664d at vfs_periodic_msync_inactive+0x1bd #7 0xffffffff80c9b039 at dounmount+0x3b9 #8 0xffffffff80c9ac29 at kern_unmount+0x2b9 #9 0xffffffff81073afe at amd64_syscall+0x2ee #10 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=1, effnlink=1, size=104857600, extsize 0 generation=4b97ca76, uid=0, gid=0, flags=0x0 ino 4, on dev md10a Feb 14 01:03:51 mercat1 kernel: pid 21644 (umount), uid 0 inumber 4 on /mnt: filesystem full 20200214 01:03:51 all (283/696): execve.sh 20200214 01:04:11 all (284/696): nfs15lockd2.sh 20200214 01:04:22 all (285/696): posix_fadvise3.sh 20200214 01:04:34 all (286/696): proccontrol.sh 20200214 01:04:44 all (287/696): rdgsbase.sh 20200214 01:04:56 all (288/696): mprotect2.sh 20200214 01:05:07 all (289/696): pmc7.sh 20200214 01:05:19 all (290/696): rename9.sh 20200214 01:05:33 all (291/696): shm_open.sh 20200214 01:05:45 all (292/696): tmpfs14.sh 20200214 01:05:57 all (293/696): umountf6.sh 20200214 01:06:09 all (294/696): pipe2.sh 20200214 01:06:21 all (295/696): umountf11.sh 20200214 01:06:35 all (296/696): umountf12.sh 20200214 01:06:49 all (297/696): rdwr.sh 20200214 01:07:04 all (298/696): smrstress.sh Completed 10000000 loops with 0 failures 20200214 01:07:17 all (299/696): suj14.sh Feb 14 01:07:30 mercat1 kernel: pid 81242 (cp), uid 0 inumber 238554 on /mnt: filesystem full Feb 14 01:07:31 mercat1 kernel: pid 81269 (mkdir), uid 0 inumber 106935 on /mnt: filesystem full Feb 14 01:07:32 mercat1 kernel: pid 81307 (mkdir), uid 0 inumber 106935 on /mnt: filesystem full 20200214 01:07:34 all (300/696): suj10.sh 20200214 01:07:49 all (301/696): mountu.sh 20200214 01:08:06 all (302/696): tmpfs19.sh 20200214 01:09:19 all (303/696): sem.sh 20200214 01:09:38 all (304/696): rename7.sh 20200214 01:09:57 all (305/696): sendfile_shm.sh 20200214 01:10:45 all (306/696): radix.sh Feb 14 01:10:55 mercat1 kernel: pid 25225 (radix), jid 0, uid 0, was killed: out of swap space 20200214 01:11:00 all (307/696): kevent6.sh 20200214 01:11:16 all (308/696): tmpfs2.sh 20200214 01:11:36 all (309/696): recursiveflushes.sh 20200214 01:11:56 all (310/696): f_offset.sh 20200214 01:12:14 all (311/696): mkfifo3.sh 20200214 01:12:36 all (312/696): mmap7.sh 20200214 01:12:59 all (313/696): mountro6.sh 20200214 01:13:20 all (314/696): multicast.sh 20200214 01:13:42 all (315/696): pdfork.sh if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 20200214 01:14:04 all (316/696): core4.sh Feb 14 01:14:06 mercat1 kernel: Failed to write core file for process core4 (error 5) 20200214 01:14:25 all (317/696): mmap5.sh 20200214 01:14:47 all (318/696): pread.sh Feb 14 01:14:25 mercat1 syslogd: last message repeated 59 times 20200214 01:15:11 all (319/696): sendmsg2.sh 20200214 01:15:34 all (320/696): suj33.sh 20200214 01:15:56 all (321/696): nullfs22.sh 20200214 01:16:20 all (322/696): rename3.sh 20200214 01:16:48 all (323/696): namecache2.sh 20200214 01:17:14 all (324/696): core2.sh 20200214 01:17:41 all (325/696): msdos5.sh 20200214 01:18:11 all (326/696): sendfile5.sh 20200214 01:18:37 all (327/696): sendfile3.sh 20200214 01:19:07 all (328/696): mmap37.sh 20200214 01:19:38 all (329/696): credleak.sh 20200214 01:20:02 all (330/696): pthread5.sh 20200214 01:20:34 all (331/696): fifo3.sh 20200214 01:21:06 all (332/696): vnodes.sh 20200214 01:21:40 all (333/696): umountf.sh 20200214 01:22:30 all (334/696): split.sh 20200214 01:23:06 all (335/696): beneath.sh 20200214 01:23:44 all (336/696): ufsbench.sh 20200214 01:24:26 all (337/696): crossmp7.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20200214 01:25:09 all (338/696): umountf5.sh Feb 14 01:25:26 mercat1 kernel: pid 26429 (creat), uid 0 inumber 384 on /mnt: out of inodes 20200214 01:25:44 all (339/696): quota8.sh 20200214 01:26:35 all (340/696): bench.sh 20200214 01:27:29 all (341/696): fpu.sh 20200214 01:28:21 all (342/696): suj5.sh 20200214 01:28:29 all (343/696): suj6.sh 20200214 01:29:29 all (344/696): exlock.sh 20200214 01:30:21 all (345/696): jumbo.sh 20200214 01:31:20 all (346/696): nullfs11.sh 20200214 01:32:10 all (347/696): posix_openpt.sh 20200214 01:33:11 all (348/696): advlock.sh 20200214 01:34:13 all (349/696): flock.sh 20200214 01:35:14 all (350/696): fsck.sh 20200214 01:36:16 all (351/696): fsgs.sh 20200214 01:37:17 all (352/696): fts2.sh 20200214 01:38:18 all (353/696): mdconfig2.sh 20200214 01:39:19 all (354/696): midi2.sh 20200214 01:40:20 all (355/696): mkfifo8.sh 20200214 01:41:21 all (356/696): mknod.sh 20200214 01:42:22 all (357/696): mmap29.sh 20200214 01:43:24 all (358/696): pts3.sh 20200214 01:44:28 all (359/696): sem_wait.sh 20200214 01:45:29 all (360/696): sendfile8.sh 20200214 01:46:30 all (361/696): sendfile9.sh 20200214 01:47:31 all (362/696): shm.sh 20200214 01:48:32 all (363/696): sigstop2.sh 20200214 01:49:33 all (364/696): socketpair3.sh 20200214 01:50:34 all (365/696): crossmp8.sh 20200214 01:51:41 all (366/696): fullpath.sh 20200214 01:52:45 all (367/696): swapoff4a.sh 20200214 01:54:07 all (368/696): crossmp5.sh 20200214 01:55:06 all (369/696): tcp3.sh Feb 14 01:55:50 mercat1 kernel: pid 47533 (swap), jid 0, uid 0, was killed: out of swap space 20200214 01:56:33 all (370/696): tmpfs21.sh 20200214 01:57:42 all (371/696): rename10.sh 20200214 01:58:50 all (372/696): stack_guard_page.sh 20200214 01:59:58 all (373/696): vmstat.sh 20200214 02:01:07 all (374/696): gnop2.sh GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. GEOM_NOP: Device md10.nop created. GEOM_NOP: Device md10.nop removed. 20200214 02:02:17 all (375/696): truss2.sh 20200214 02:03:20 all (376/696): crossmp.sh 20200214 02:04:34 all (377/696): mountro5.sh 20200214 02:05:53 all (378/696): zfs6.sh ZFS filesystem version: 5 ZFS storage pool version: features support (5000) 20200214 02:07:14 all (379/696): mmap21.sh Feb 14 02:08:09 mercat1 kernel: pid 50463 (mmap21), uid 2007 inumber 228 on /tmp: filesystem full Feb 14 02:08:09 mercat1 kernel: Failed to write core file for process mmap21 (error 28) 20200214 02:08:10 all (380/696): mmap18.sh Feb 14 02:08:09 mercat1 syslogd: last message repeated 1 times 20200214 02:09:31 all (381/696): pthread2.sh 20200214 02:10:57 all (382/696): tmpfs12.sh Feb 14 02:11:15 mercat1 kernel: pid 94613 (swap), jid 0, uid 0, was killed: out of swap space 20200214 02:12:23 all (383/696): pthread7.sh 20200214 02:13:53 all (384/696): multicast2.sh Feb 14 02:13:56 mercat1 mDNSResponder[2531]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) starting Feb 14 02:13:56 mercat1 mDNSResponder[2531]: mDNS_AddDNSServer: Lock not held! mDNS_busy (0) mDNS_reentrancy (0) Feb 14 02:13:56 mercat1 mDNSResponder[2531]: mDNSPlatformSourceAddrForDest: connect 1.1.1.1 fif_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet inailed errno 51 (stance 0xfffff800041c3800 Network is unreachable) if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff80683b52000 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 Feb 14 02:14:16 mercat1 mDNSResponder[2531]: mDNSResponder (Engineering Build) (Jan 9 2020 04:51:18) stopping if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 if_delmulti_locked: detaching ifnet instance 0xfffff800041c3800 20200214 02:14:19 all (385/696): rename12.sh 20200214 02:15:43 all (386/696): quota4.sh 20200214 02:18:01 all (387/696): pmc6.sh 20200214 02:19:43 all (388/696): pthread3.sh 20200214 02:21:30 all (389/696): ptrace10.sh 20200214 02:23:18 all (390/696): msdos10.sh 20200214 02:25:12 all (391/696): callout_reset_on.sh Expensive timeout(9) function: 0xffffffff80be26a0(0xfffff8043d186a60) 0.011937191 s 20200214 02:27:36 all (392/696): fifo2.sh 20200214 02:29:37 all (393/696): kevent.sh 20200214 02:31:39 all (394/696): kevent14.sh 20200214 02:33:40 all (395/696): kpti.sh 20200214 02:35:41 all (396/696): midi.sh 20200214 02:37:42 all (397/696): overflow3.sh 20200214 02:39:44 all (398/696): sendfile10.sh 20200214 02:41:45 all (399/696): ftruncate3.sh 20200214 02:43:47 all (400/696): snap11.sh 20200214 02:45:52 all (401/696): tmpfs22.sh 20200214 02:47:58 all (402/696): setsockopt2.sh Feb 14 02:48:57 mercat1 kernel: pid 97065 (swap), jid 0, uid 0, was killed: out of swap space 20200214 02:50:16 all (403/696): mmap27.sh 20200214 02:52:20 all (404/696): poll2.sh 20200214 02:54:27 all (405/696): umount4.sh 20200214 02:56:30 all (406/696): vm_map.sh 20200214 02:58:33 all (407/696): fts3.sh 20200214 03:00:36 all (408/696): graid1_3.sh g_access(1003): provider ufsid/5e45d49ad568f8b7 has error 6 set g_access(1003): provider gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda has error 6 set 20200214 03:02:41 all (409/696): fifo4.sh Feb 14 03:05:21 mercat1 kernel: pid 93461 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:05:33 all (410/696): fpclone.sh 20200214 03:07:48 all (411/696): contigmalloc.sh 20200214 03:09:52 all (412/696): graid1_10.sh g_access(1003): provider ufsid/5e45d49ad568f8b7 has error 6 set g_access(1003): provider gptid/5cbd7c10-4eb4-11ea-abb3-0cc47aa8cdda has error 6 set 20200214 03:11:58 all (413/696): shm2.sh 20200214 03:14:03 all (414/696): tmpfs13.sh 20200214 03:16:12 all (415/696): truncate9.sh 20200214 03:18:15 all (416/696): nullfs18.sh 20200214 03:20:21 all (417/696): mmap31.sh 20200214 03:22:39 all (418/696): swappedout.sh 20200214 03:24:46 all (419/696): racct.sh Feb 14 03:25:49 mercat1 kernel: pid 84602 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:26:52 all (420/696): arp.sh Feb 14 03:27:46 mercat1 kernel: pid 67274 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:29:01 all (421/696): syscall4.sh WARNING pid 89249 (calls): ioctl sign-extension ioctl 339a6bf6fb06 WARNING pid 89318 (calls): ioctl sign-extension ioctl b999a203878 Feb 14 03:29:46 mercat1 kernel: pid 89125 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:33:46 all (422/696): truncate2.sh 20200214 03:36:00 all (423/696): kevent4.sh Expensive timeout(9) function: 0xffffffff80e08a60(0xfffff801e3f41000) 0.036814270 s 20200214 03:38:07 all (424/696): pthread4.sh 20200214 03:40:21 all (425/696): vmstat2.sh Feb 14 03:41:26 mercat1 kernel: pid 16081 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:42:29 all (426/696): namecache.sh 20200214 03:44:55 all (427/696): tmpfs9.sh Feb 14 03:45:36 mercat1 kernel: pid 36479 (swap), jid 0, uid 0, was killed: out of swap space Feb 14 03:48:57 mercat1 kernel: pid 82885 (swap), jid 0, uid 0, was killed: out of swap space Feb 14 03:49:27 mercat1 kernel: pid 82891 (swap), jid 0, uid 0, was killed: out of swap space 20200214 03:49:35 all (428/696): umountf2.sh 20200214 03:51:55 all (429/696): nullfs19.sh 20200214 03:53:57 all (430/696): mmap32.sh 20200214 03:56:18 all (431/696): flock_open_close.sh 20200214 03:58:24 all (432/696): link2.sh Feb 14 04:00:36 mercat1 kernel: pid 47007 (swap), jid 0, uid 0, was killed: out of swap space 20200214 04:02:41 all (433/696): umountf8.sh Feb 14 04:03:08 mercat1 kernel: pid 57519 (rw), uid 2007 inumber 49292 on /mnt: filesystem full 20200214 04:05:13 all (434/696): zz-combo03.sh 20200214 04:08:04 all (435/696): swapoff.sh Feb 14 04:08:34 mercat1 kernel: pid 16528 (swap), jid 0, uid 2007, was killed: out of swap space Feb 14 04:09:31 mercat1 kernel: pid 16527 (symlink), uid 2007 inumber 32798 on /mnt: out of inodes 20200214 04:10:42 all (436/696): suj23.sh 20200214 04:13:29 all (437/696): sched.sh 20200214 04:16:26 all (438/696): core.sh 20200214 04:20:01 all (439/696): db.sh 20200214 04:23:03 all (440/696): ftruncate.sh 20200214 04:26:04 all (441/696): mlockall3.sh 20200214 04:29:05 all (442/696): msync.sh 20200214 04:32:07 all (443/696): pthread8.sh 20200214 04:35:09 all (444/696): pty2.sh 20200214 04:38:10 all (445/696): sysctl4.sh 20200214 04:41:11 all (446/696): thr3.sh 20200214 04:44:12 all (447/696): tmpfs16.sh 20200214 04:47:14 all (448/696): truncate8.sh 20200214 04:50:15 all (449/696): mmap14.sh 20200214 04:51:20 all (450/696): fcntl2.sh 20200214 04:54:21 all (451/696): lockf4.sh 20200214 04:57:01 all (452/696): rename14.sh panic: journal_jremref: Lost inodedep cpuid = 8 time = 1581652743 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe03447763c0 vpanic() at vpanic+0x185/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- KDB: enter: panic [ thread pid 76039 tid 100665 ] Stopped at kdb_enter+0x37: movq $0,0x1085c86(%rip) db> run pho db:0:pho> set $lines 20000 db:0:pho> run pho1 db:1:pho1> dump Dumping 3159 out of 32626 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% Dump complete db:1:pho1> bt Tracing pid 76039 tid 100665 td 0xfffffe0130f61300 kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- db:1:pho1> show allpcpu Current CPU: 8 cpuid = 0 dynamic pcpu = 0x975d80 curthread = 0xfffffe003e3e4300: pid 11 tid 100003 critnest 0 "idle: cpu0" curpcb = 0xfffffe003e3e4800 fpcurthread = none idlethread = 0xfffffe003e3e4300: tid 100003 "idle: cpu0" self = 0xffffffff82410000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82410384 rsp0 = 0xfffffe00add72cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x380a3a6e gs32p = 0xffffffff82410404 ldt = 0xffffffff82410444 tss = 0xffffffff82410434 tlb gen = 420477215 curvnet = 0 spin locks held: cpuid = 1 dynamic pcpu = 0xfffffe00bc7f6d80 curthread = 0xfffffe003e3e3c00: pid 11 tid 100004 critnest 0 "idle: cpu1" curpcb = 0xfffffe003e3e4100 fpcurthread = none idlethread = 0xfffffe003e3e3c00: tid 100004 "idle: cpu1" self = 0xffffffff82411000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82411384 rsp0 = 0xfffffe00add77cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x621bbd936 gs32p = 0xffffffff82411404 ldt = 0xffffffff82411444 tss = 0xffffffff82411434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 2 dynamic pcpu = 0xfffffe00bc802d80 curthread = 0xfffffe003e3e3500: pid 11 tid 100005 critnest 0 "idle: cpu2" curpcb = 0xfffffe003e3e3a00 fpcurthread = none idlethread = 0xfffffe003e3e3500: tid 100005 "idle: cpu2" self = 0xffffffff82412000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82412384 rsp0 = 0xfffffe00add7ccc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x6a9b86cca gs32p = 0xffffffff82412404 ldt = 0xffffffff82412444 tss = 0xffffffff82412434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 3 dynamic pcpu = 0xfffffe00bc80ed80 curthread = 0xfffffe0175b99100: pid 32 tid 100587 critnest 0 "/mnt worker" curpcb = 0xfffffe0175b99600 fpcurthread = none idlethread = 0xfffffe003e3e2e00: tid 100006 "idle: cpu3" self = 0xffffffff82413000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82413384 rsp0 = 0xfffffe034a758cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x621bbdc16 gs32p = 0xffffffff82413404 ldt = 0xffffffff82413444 tss = 0xffffffff82413434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 4 dynamic pcpu = 0xfffffe00bc81ad80 curthread = 0xfffffe0130f5e100: pid 76041 tid 100658 critnest 0 "rename14" curpcb = 0xfffffe0130f5e600 fpcurthread = 0xfffffe0130f5e100: pid 76041 "rename14" idlethread = 0xfffffe003e3e2700: tid 100007 "idle: cpu4" self = 0xffffffff82414000 curpmap = 0xfffffe00d6fa2b08 tssp = 0xffffffff82414384 rsp0 = 0xfffffe0339fd0cc0 kcr3 = 0x8000000585fce42d ucr3 = 0x8000000400509c2d scr3 = 0x736b83c24 gs32p = 0xffffffff82414404 ldt = 0xffffffff82414444 tss = 0xffffffff82414434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 5 dynamic pcpu = 0xfffffe00bc826d80 curthread = 0xfffffe0130ca6500: pid 76036 tid 100668 critnest 0 "rename14" curpcb = 0xfffffe0130ca6a00 fpcurthread = 0xfffffe0130ca6500: pid 76036 "rename14" idlethread = 0xfffffe003e3e2000: tid 100008 "idle: cpu5" self = 0xffffffff82415000 curpmap = 0xfffffe012384ab08 tssp = 0xffffffff82415384 rsp0 = 0xfffffe03446fecc0 kcr3 = 0x8000000253f63138 ucr3 = 0x8000000621bbd938 scr3 = 0x6a9b8693b gs32p = 0xffffffff82415404 ldt = 0xffffffff82415444 tss = 0xffffffff82415434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 6 dynamic pcpu = 0xfffffe00bc832d80 curthread = 0xfffffe003e3eca00: pid 11 tid 100009 critnest 0 "idle: cpu6" curpcb = 0xfffffe003e3ecf00 fpcurthread = none idlethread = 0xfffffe003e3eca00: tid 100009 "idle: cpu6" self = 0xffffffff82416000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82416384 rsp0 = 0xfffffe00add90cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x400509af1 gs32p = 0xffffffff82416404 ldt = 0xffffffff82416444 tss = 0xffffffff82416434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 7 dynamic pcpu = 0xfffffe00bc83ed80 curthread = 0xfffffe003e3ec300: pid 11 tid 100010 critnest 0 "idle: cpu7" curpcb = 0xfffffe003e3ec800 fpcurthread = none idlethread = 0xfffffe003e3ec300: tid 100010 "idle: cpu7" self = 0xffffffff82417000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82417384 rsp0 = 0xfffffe00add95cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x83733496d gs32p = 0xffffffff82417404 ldt = 0xffffffff82417444 tss = 0xffffffff82417434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 8 dynamic pcpu = 0xfffffe00bc84ad80 curthread = 0xfffffe0130f61300: pid 76039 tid 100665 critnest 1 "rename14" curpcb = 0xfffffe0130f61800 fpcurthread = 0xfffffe0130f61300: pid 76039 "rename14" idlethread = 0xfffffe003e3ebc00: tid 100011 "idle: cpu8" self = 0xffffffff82418000 curpmap = 0xfffffe016eb86120 tssp = 0xffffffff82418384 rsp0 = 0xfffffe0344776cc0 kcr3 = 0x80000005c7eff752 ucr3 = 0x8000000837334f52 scr3 = 0x5d3133f56 gs32p = 0xffffffff82418404 ldt = 0xffffffff82418444 tss = 0xffffffff82418434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 9 dynamic pcpu = 0xfffffe00bc856d80 curthread = 0xfffffe003e3eb500: pid 11 tid 100012 critnest 0 "idle: cpu9" curpcb = 0xfffffe003e3eba00 fpcurthread = none idlethread = 0xfffffe003e3eb500: tid 100012 "idle: cpu9" self = 0xffffffff82419000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff82419384 rsp0 = 0xfffffe00add9fcc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x81a74d9e2 gs32p = 0xffffffff82419404 ldt = 0xffffffff82419444 tss = 0xffffffff82419434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 10 dynamic pcpu = 0xfffffe00bc862d80 curthread = 0xfffffe003e3eae00: pid 11 tid 100013 critnest 0 "idle: cpu10" curpcb = 0xfffffe003e3eb300 fpcurthread = none idlethread = 0xfffffe003e3eae00: tid 100013 "idle: cpu10" self = 0xffffffff8241a000 curpmap = 0xffffffff81d9ea00 tssp = 0xffffffff8241a384 rsp0 = 0xfffffe00adda4cc0 kcr3 = 0x8000000002306002 ucr3 = 0xffffffffffffffff scr3 = 0x2f5497bac gs32p = 0xffffffff8241a404 ldt = 0xffffffff8241a444 tss = 0xffffffff8241a434 tlb gen = 420477217 curvnet = 0 spin locks held: cpuid = 11 dynamic pcpu = 0xfffffe00bc86ed80 curthread = 0xfffffe0137cc9c00: pid 76034 tid 100667 critnest 0 "rename14" curpcb = 0xfffffe0137cca100 fpcurthread = 0xfffffe0137cc9c00: pid 76034 "rename14" idlethread = 0xfffffe003e3ea700: tid 100014 "idle: cpu11" self = 0xffffffff8241b000 curpmap = 0xfffffe0137706b08 tssp = 0xffffffff8241b384 rsp0 = 0xfffffe0344717cc0 kcr3 = 0x800000042f21d197 ucr3 = 0x80000003fff7b997 scr3 = 0x3fff7b997 gs32p = 0xffffffff8241b404 ldt = 0xffffffff8241b444 tss = 0xffffffff8241b434 tlb gen = 420477217 curvnet = 0 spin locks held: db:1:pho1> show alllocks db:1:pho1> show lockedvnods Locked vnodes vnode 0xfffff80515ba9780: type VDIR usecount 22, writecount 0, refcount 6 mountedhere 0 flags (VV_ROOT|VMP_LAZYLIST) v_object 0xfffff801d5180630 ref 0 pages 1 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0130f61300 (pid 76039, rename14, tid 100665) with exclusive waiters pending with shared waiters pending #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80efc0c9 at ufs_rename+0x139 #6 0xffffffff810f0090 at VOP_RENAME_APV+0x40 #7 0xffffffff80cb52f0 at kern_renameat+0x350 #8 0xffffffff81073afe at amd64_syscall+0x2ee #9 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=41, effnlink=41, size=1024, extsize 0 generation=c3fe2c7d, uid=0, gid=0, flags=0x0 ino 2, on dev md10 vnode 0xfffff80356bb5780: type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80462690630 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0130f5e100 (pid 76041, rename14, tid 100658) #0 0xffffffff80b9b7b4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9c678 at __lockmgr_args+0x798 #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca2d19 at vget_finish+0x79 #6 0xffffffff80c93cff at vfs_hash_get+0xbf #7 0xffffffff80ee6d89 at ffs_vgetf+0x59 #8 0xffffffff80ef4f04 at ufs_lookup_ino+0xbe4 #9 0xffffffff810edfe6 at VOP_CACHEDLOOKUP_APV+0x56 #10 0xffffffff80c8be18 at vfs_cache_lookup+0xa8 #11 0xffffffff810ede36 at VOP_LOOKUP_APV+0x56 #12 0xffffffff80c96321 at lookup+0x611 #13 0xffffffff80c95789 at namei+0x579 #14 0xffffffff80cb54e2 at kern_mkdirat+0x92 #15 0xffffffff81073afe at amd64_syscall+0x2ee #16 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=4, effnlink=3, size=512, extsize 0 generation=72305cea, uid=0, gid=0, flags=0x0 ino 131855, on dev md10 vnode 0xfffff80421709500: type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff80508f4fc60 ref 0 pages 0 cleanbuf 0 dirtybuf 1 lock type ufs: EXCL by thread 0xfffffe0130f61300 (pid 76039, rename14, tid 100665) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80efc150 at ufs_rename+0x1c0 #6 0xffffffff810f0090 at VOP_RENAME_APV+0x40 #7 0xffffffff80cb52f0 at kern_renameat+0x350 #8 0xffffffff81073afe at amd64_syscall+0x2ee #9 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=ce0c959a, uid=0, gid=0, flags=0x0 ino 66193, on dev md10 vnode 0xfffff80340c1c780: type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) v_object 0xfffff804c5f40b58 ref 0 pages 0 cleanbuf 1 dirtybuf 0 lock type ufs: EXCL by thread 0xfffffe0137cc9c00 (pid 76034, rename14, tid 100667) #0 0xffffffff80b9b7b4 at lockmgr_slock_hard+0x354 #1 0xffffffff80b9c678 at __lockmgr_args+0x798 #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca2d19 at vget_finish+0x79 #6 0xffffffff80c93cff at vfs_hash_get+0xbf #7 0xffffffff80ee6d89 at ffs_vgetf+0x59 #8 0xffffffff80ef4f04 at ufs_lookup_ino+0xbe4 #9 0xffffffff810edfe6 at VOP_CACHEDLOOKUP_APV+0x56 #10 0xffffffff80c8be18 at vfs_cache_lookup+0xa8 #11 0xffffffff810ede36 at VOP_LOOKUP_APV+0x56 #12 0xffffffff80c96321 at lookup+0x611 #13 0xffffffff80c95789 at namei+0x579 #14 0xffffffff80cb54e2 at kern_mkdirat+0x92 #15 0xffffffff81073afe at amd64_syscall+0x2ee #16 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=6e5ab411, uid=0, gid=0, flags=0x0 ino 131857, on dev md10 vnode 0xfffff8005e573500: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe0130f61300 (pid 76039, rename14, tid 100665) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca2d19 at vget_finish+0x79 #6 0xffffffff80c93cff at vfs_hash_get+0xbf #7 0xffffffff80ee6d89 at ffs_vgetf+0x59 #8 0xffffffff80efc39d at ufs_rename+0x40d #9 0xffffffff810f0090 at VOP_RENAME_APV+0x40 #10 0xffffffff80cb52f0 at kern_renameat+0x350 #11 0xffffffff81073afe at amd64_syscall+0x2ee #12 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=2, effnlink=0, size=512, extsize 0 generation=67147126, uid=0, gid=0, flags=0x0 ino 65687, on dev md10 vnode 0xfffff804029c2c80: type VDIR usecount 1, writecount 0, refcount 3 mountedhere 0 flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe0130f61300 (pid 76039, rename14, tid 100665) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80eeb61c at ffs_lock+0x7c #3 0xffffffff810f0ee0 at VOP_LOCK1_APV+0x40 #4 0xffffffff80cb9174 at _vn_lock+0x54 #5 0xffffffff80ca2d19 at vget_finish+0x79 #6 0xffffffff80c93cff at vfs_hash_get+0xbf #7 0xffffffff80ee6d89 at ffs_vgetf+0x59 #8 0xffffffff80efc19e at ufs_rename+0x20e #9 0xffffffff810f0090 at VOP_RENAME_APV+0x40 #10 0xffffffff80cb52f0 at kern_renameat+0x350 #11 0xffffffff81073afe at amd64_syscall+0x2ee #12 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=3, effnlink=3, size=512, extsize 0 generation=795c68f, uid=0, gid=0, flags=0x0 ino 65692, on dev md10 vnode 0xfffff806c1c32500: type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe0137cc9c00 (pid 76034, rename14, tid 100667) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80ee6e91 at ffs_vgetf+0x161 #3 0xffffffff80eb90f1 at ffs_valloc+0x591 #4 0xffffffff80efd2dc at ufs_mkdir+0xcc #5 0xffffffff810f0209 at VOP_MKDIR_APV+0x59 #6 0xffffffff80cb5603 at kern_mkdirat+0x1b3 #7 0xffffffff81073afe at amd64_syscall+0x2ee #8 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=7998eea, uid=0, gid=0, flags=0x0 ino 196992, on dev md10 vnode 0xfffff807551b8a00: type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VMP_LAZYLIST) lock type ufs: EXCL by thread 0xfffffe0130f5e100 (pid 76041, rename14, tid 100658) #0 0xffffffff80b9bcaa at lockmgr_xlock_hard+0x40a #1 0xffffffff80b9c50c at __lockmgr_args+0x62c #2 0xffffffff80ee6e91 at ffs_vgetf+0x161 #3 0xffffffff80eb90f1 at ffs_valloc+0x591 #4 0xffffffff80efd2dc at ufs_mkdir+0xcc #5 0xffffffff810f0209 at VOP_MKDIR_APV+0x59 #6 0xffffffff80cb5603 at kern_mkdirat+0x1b3 #7 0xffffffff81073afe at amd64_syscall+0x2ee #8 0xffffffff81049e70 at fast_syscall_common+0x101 nlink=2, effnlink=2, size=512, extsize 0 generation=323b74d9, uid=0, gid=0, flags=0x0 ino 5, on dev md10 db:1:pho1> show mount 0xfffffe00d3def700 /dev/gpt/work on / (ufs) 0xfffffe00d3df0280 devfs on /dev (devfs) 0xfffffe00e42a8280 /dev/gpt/tmp on /tmp (ufs) 0xfffffe00e67e7700 procfs on /proc (procfs) 0xfffffe00e63d1000 /dev/md10 on /mnt (ufs) More info: show mount db:1:pho1> show bufqueues bqempty: 75234 Buf domain 0 freebufs 14969 lofreebufs 219 hifreebufs 329 bufspace 4243456 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 0 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 103 (2506752) dirtyq count 0 (0) wakeup 0 lim 25 CPU 11, 1, 19, 4, 8, 1, 6, 2, 1, 7, 1, 0, Locked buffers: 0 space 0 Total buffers: 10581 space 4243456 Buf domain 1 freebufs 15052 lofreebufs 219 hifreebufs 329 bufspace 1388544 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 59 (1126400) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 2, 3, 0, 3, 3, 0, 1, 0, 0, 1, 5, 3, Locked buffers: 2 space 8192 Total buffers: 13150 space 1388544 Buf domain 2 freebufs 15055 lofreebufs 219 hifreebufs 329 bufspace 1966080 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 9 (65536) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 8, 14, 10, 9, 9, 7, 0, 2, 2, 5, 1, 0, Locked buffers: 1 space 4096 Total buffers: 20491 space 1966080 Buf domain 3 freebufs 15088 lofreebufs 219 hifreebufs 329 bufspace 667648 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 21 (258048) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 1, 5, 0, 0, 3, 2, 0, 2, 1, 2, 0, 7, Locked buffers: 0 space 0 Total buffers: 8424 space 667648 Buf domain 4 freebufs 15016 lofreebufs 219 hifreebufs 329 bufspace 2482176 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 11 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 71 (1339392) dirtyq count 11 (319488) wakeup 0 lim 25 CPU 7, 3, 3, 0, 3, 2, 4, 1, 0, 1, 7, 4, Locked buffers: 2 space 61440 Total buffers: 27753 space 2482176 Buf domain 5 freebufs 15038 lofreebufs 219 hifreebufs 329 bufspace 1941504 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 1 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 81 (1830912) dirtyq count 1 (4096) wakeup 0 lim 25 CPU 0, 3, 3, 0, 1, 2, 0, 1, 0, 0, 3, 0, Locked buffers: 0 space 0 Total buffers: 9130 space 1941504 Buf domain 6 freebufs 15053 lofreebufs 219 hifreebufs 329 bufspace 1404928 maxbufspace 247939072 hibufspace 247845449 lobufspace 235453176 bufspacethresh 241649312 numdirtybuffers 2 lodirtybuffers 1893 hidirtybuffers 3786 dirtybufthresh 3407 cleanq count 46 (716800) dirtyq count 2 (8192) wakeup 0 lim 25 CPU 4, 4, 1, 8, 3, 1, 0, 4, 1, 1, 4, 0, Locked buffers: 1 space 4096 Total buffers: 16402 space 1404928 db:1:pho1> show page vm_cnt.v_free_count: 7441027 vm_cnt.v_inactive_count: 89282 vm_cnt.v_active_count: 5266 vm_cnt.v_laundry_count: 8959 vm_cnt.v_wire_count: 574867 vm_cnt.v_free_reserved: 10644 vm_cnt.v_free_min: 51264 vm_cnt.v_free_target: 173124 vm_cnt.v_inactive_target: 259686 db:1:pho1> show pageq pq_free 7441027 dom 0 page_cnt 8124099 free 7441027 pq_act 5266 pq_inact 89282 pq_laund 8959 pq_unsw 0 db:0:pho> show freepages DOMAIN: 0 FREE LIST 0: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000002 | 000000 11 (008192K) | 000359 | 000000 10 (004096K) | 001321 | 000000 09 (002048K) | 002262 | 000000 08 (001024K) | 003974 | 000000 07 (000512K) | 007079 | 000000 06 (000256K) | 011155 | 000000 05 (000128K) | 014251 | 000002 04 (000064K) | 019561 | 000009 03 (000032K) | 034688 | 000192 02 (000016K) | 061132 | 001751 01 (000008K) | 066812 | 007566 00 (000004K) | 015258 | 008199 FREE LIST 1: ORDER (SIZE) | NUMBER | POOL 0 | POOL 1 -- -- -- -- -- -- 12 (016384K) | 000000 | 000000 11 (008192K) | 000000 | 000000 10 (004096K) | 000000 | 000000 09 (002048K) | 000000 | 000000 08 (001024K) | 000000 | 000000 07 (000512K) | 000000 | 000000 06 (000256K) | 000001 | 000000 05 (000128K) | 000001 | 000000 04 (000064K) | 000002 | 000000 03 (000032K) | 000000 | 000000 02 (000016K) | 000001 | 000000 01 (000008K) | 000000 | 000000 00 (000004K) | 000001 | 000000 db:0:pho> show uma Zone Size Used Free Requests Sleeps Bucket Total Mem XFree socket 904 49 939749 6721379 0 16 849577392 0 VM OBJECT 264 9441 594144 242799251 0 31 159346440 0 VNODE 640 2005 117287 149711191 0 18 76346880 0 RADIX NODE 144 37261 486021 294725078 0 65 75352608 0 Files 80 121 941529 580802885 0 126 75332000 0 512 512 46 130322 67889807 0 31 66748416 0 256 256 923 222427 178550759 0 62 57177600 0 FFS2 dinode 256 1888 138647 69420785 0 62 35976960 0 mbuf_cluster 2048 17131 63 187043 0 8 35213312 0 THREAD 1776 7092 12690 146063240 0 26 35132832 0 128 128 41197 228255 57452334 0 126 34489856 0 128 128 14468 197882 132280078 0 126 27180800 0 FFS inode 160 1888 143437 69422208 0 62 23252000 0 swblk 136 0 123743 1432340 0 62 16829048 0 BUF TRIE 144 140 105812 54891390 0 62 15257088 0 VMSPACE 2536 52 5387 15049217 0 4 13793304 0 vmem btag 56 162694 81580 10652312 0 254 13679344 0 128 Bucket 1024 6342 3546 15789176 0 254 10125312 0 128 128 67462 5884 27945144 0 126 9388288 0 PROC 1328 91 6851 14863860 0 8 9218976 0 128 128 65372 3510 5109762 0 126 8816896 0 256 256 30 29145 19204027 0 62 7468800 0 S VFS Cache 108 7275 56085 58932658 0 126 6842880 0 fakepg 104 0 64896 2201441 0 126 6749184 0 256 256 374 21976 217055056 0 63 5721600 0 mbuf 256 16493 4849 525004438 0 254 5463552 0 64 Bucket 512 8246 522 8295457 0 30 4489216 0 256 Bucket 2048 706 1420 21943646 0 64 4354048 0 UMA Slabs 0 112 33836 16 758579 0 126 3791424 0 128 128 11152 18174 980250292 0 126 3753728 0 512 512 7056 64 42420 0 30 3645440 0 TURNSTILE 136 19783 440 19783 0 62 2750328 0 16 16 163406 844 7482964 0 254 2628000 0 32 32 70892 4330 323606276 0 254 2407104 0 g_bio 408 0 5680 240471938 0 75 2317440 0 4096 4096 150 403 15009560 0 2 2265088 0 32768 32768 24 39 669662 0 1 2064384 0 32 Bucket 256 4172 3687 10146171 0 62 2011904 0 32768 32768 10 46 1465512 0 1 1835008 0 SLEEPQUEUE 88 19783 313 19783 0 126 1768448 0 4096 4096 346 21 1051652 0 2 1503232 0 DIRHASH 1024 79 1353 1222425 0 16 1466368 0 MAP ENTRY 96 1908 12330 746872398 0 127 1366848 0 65536 65536 3 17 155281 0 1 1310720 0 swpctrie 144 0 8988 119248 0 62 1294272 0 mbuf_packet 256 26 4822 24902013 0 254 1241088 0 16384 16384 20 51 480153 0 1 1163264 0 ksiginfo 112 6916 2300 4690306 0 126 1032192 0 256 256 120 3420 23876224 0 62 906240 0 256 256 505 3020 11313263 0 62 902400 0 256 256 37 3338 37833301 0 62 864000 0 64 64 9296 3367 728131565 0 254 810432 0 64 64 9028 3572 12877715 0 254 806400 0 8192 8192 98 0 383468 0 1 802816 0 128 128 713 4960 22062358 0 126 726144 0 filedesc0 1104 91 539 14863861 0 9 695520 0 pbuf 984 0 651 0 0 0 640584 0 16 Bucket 144 360 3951 4367675 0 62 620784 0 16384 16384 37 0 37 0 1 606208 0 64 64 3249 3744 68875201 0 254 447552 0 64 64 3590 3340 594583871 0 254 443520 0 1024 1024 158 274 3876412 0 16 442368 0 8192 8192 24 29 770039 0 1 434176 0 rl_entry 40 7621 2782 7621 0 254 416120 0 2048 2048 88 104 435092 0 8 393216 0 Mountpoints 2944 5 123 59832 0 4 376832 0 2048 2048 27 155 22454236 0 8 372736 0 1024 1024 40 304 6470285 0 16 352256 0 32 32 7129 3077 678163 0 254 326592 0 NAMEI 1024 14 290 1185578595 0 16 311296 0 512 512 165 435 324884 0 30 307200 0 8192 8192 4 33 45225 0 2 303104 0 256 256 113 1057 3039383 0 62 299520 0 16384 16384 0 18 2724468 0 1 294912 0 256 256 232 878 3336130 0 62 284160 0 16 16 14299 3201 257785 0 254 280000 0 1024 1024 34 226 12492463 0 16 266240 0 1024 1024 50 210 35023 0 16 266240 0 4 Bucket 48 857 4687 2849531 0 254 266112 0 65536 65536 4 0 16 0 1 262144 0 65536 65536 4 0 43 0 1 262144 0 pipe 760 9 326 31249332 0 16 254600 0 64 64 215 3564 2091856 0 254 241856 0 64 64 204 3450 25197474 0 254 233856 0 4096 4096 21 34 4485965 0 2 225280 0 512 512 77 363 4664696 0 30 225280 0 selfd 64 895 2570 119573193 0 254 221760 0 UMA Zones 2176 94 2 357 0 4 208896 0 8 Bucket 80 147 2352 2767413 0 126 199920 0 512 512 15 361 2379959 0 30 192512 0 udp_inpcb 488 20 364 100786 0 30 187392 0 1024 1024 17 163 27696 0 16 184320 0 unpcb 256 17 688 6155848 0 62 180480 0 128 128 111 1284 56938 0 126 178560 0 32768 32768 5 0 12 0 1 163840 0 TMPFS node 232 0 697 66213596 0 62 161704 0 8192 8192 19 0 37 0 1 155648 0 umtx pi 96 0 1512 49278100 0 126 145152 0 1024 1024 11 129 5375 0 16 143360 0 512 512 0 272 31165 0 30 139264 0 65536 65536 2 0 2 0 1 131072 0 16384 16384 8 0 16 0 1 131072 0 2 Bucket 32 492 3540 32291564 0 254 129024 0 64 64 273 1680 450150 0 254 124992 0 128 128 50 911 28267 0 126 123008 0 32 32 185 3595 8726750 0 254 120960 0 2048 2048 2 56 6138 0 8 118784 0 32 32 574 3080 15880874 0 254 116928 0 16384 16384 7 0 55890 0 1 114688 0 4096 4096 28 0 66 0 2 114688 0 2048 2048 47 7 357 0 8 110592 0 32 32 236 3166 212641 0 254 108864 0 32 32 147 3129 2227823 0 254 104832 0 4096 4096 1 24 506669 0 2 102400 0 ttyinq 160 330 270 22844476 0 62 96000 0 udpcb 32 20 2878 100786 0 254 92736 0 ttyoutq 256 173 157 12183715 0 62 84480 0 KMAP ENTRY 96 72 723 120 0 126 76320 0 L VFS Cache 328 4 212 198340 0 30 70848 0 TMPFS dirent 64 0 1071 89026149 0 254 68544 0 65536 65536 1 0 1 0 1 65536 0 65536 65536 1 0 2 0 1 65536 0 65536 65536 1 0 1 0 1 65536 0 32768 32768 2 0 2 0 1 65536 0 1024 1024 0 64 217 0 16 65536 0 clpbuf 984 0 66 7473392 0 4 64944 0 16 16 471 3529 138028023 0 254 64000 0 swrbuf 984 0 62 424020 0 4 61008 0 512 512 33 79 35 0 30 57344 0 16 16 464 3036 9643625 0 254 56000 0 16 16 435 3065 2030753 0 254 56000 0 4096 4096 1 12 1239128 0 2 53248 0 mt_stats_zone 64 446 386 456 0 254 53248 0 16 16 18 3232 19226 0 254 52000 0 4096 4096 12 0 12 0 2 49152 0 64 pcpu 8 3151 1969 4463 0 254 40960 0 rentr 24 0 1670 13119090 0 254 40080 0 mt_zone 24 446 1224 456 0 254 40080 0 cpuset 104 27 345 58 0 126 38688 0 32 32 9 1125 30777 0 254 36288 0 8192 8192 4 0 4 0 1 32768 0 UMA Kegs 384 83 2 346 0 30 32640 0 swwbuf 984 0 33 949660 0 2 32472 0 rtentry 208 12 140 18 0 62 31616 0 32 32 20 862 29 0 254 28224 0 16 16 170 1330 186 0 254 24000 0 64 64 9 306 100278 0 254 20160 0 tcpcb 1008 9 7 135166 0 16 16128 0 ripcb 488 1 31 120459 0 30 15616 0 MAP 216 2 69 2 0 62 15336 0 2048 2048 3 3 6 0 8 12288 0 1024 1024 8 4 22 0 16 12288 0 int pcpu 4 514 2558 41280 0 254 12288 0 tcp_inpcb 488 9 15 135166 0 30 11712 0 8192 8192 1 0 2 0 1 8192 0 8192 8192 0 1 6 0 1 8192 0 2048 2048 2 2 99038 0 8 8192 0 procdesc 136 2 56 1265135 0 62 7888 0 epoch_record pcpu 256 4 12 4 0 62 4096 0 4096 4096 1 0 4 0 2 4096 0 2048 2048 2 0 2 0 8 4096 0 2048 2048 1 1 22697520 0 8 4096 0 hostcache 96 0 42 3 0 126 4032 0 AIOP 32 4 122 4 0 254 4032 0 VNODEPOLL 120 1 32 283 0 126 3960 0 AIO 208 0 19 46 0 62 3952 0 AIOCB 752 0 5 57 0 16 3760 0 mqnode 416 3 6 3 0 30 3744 0 UMA Slabs 1 176 14 7 18 0 62 3696 0 vmem 1856 0 1 0 0 8 1856 0 SMR CPU 24 1 31 1 0 254 768 0 SMR SHARED 16 1 31 1 0 254 512 0 mqnotifier 216 0 0 0 0 62 0 0 mvdata 64 0 0 0 0 254 0 0 mqueue 264 0 0 0 0 30 0 0 taskq_zone 48 0 0 0 0 254 0 0 dtrace_state_cache 16384 0 0 0 0 1 0 0 FFS1 dinode 128 0 0 11 0 126 0 0 IPsec SA lft_c 16 0 0 0 0 254 0 0 udplite_inpcb 488 0 0 0 0 30 0 0 sctp_asconf_ack 48 0 0 0 0 254 0 0 sctp_asconf 40 0 0 0 0 254 0 0 sctp_stream_msg_out 112 0 0 0 0 126 0 0 sctp_readq 152 0 0 0 0 62 0 0 sctp_chunk 152 0 0 0 0 62 0 0 sctp_raddr 736 0 0 0 0 16 0 0 sctp_laddr 48 0 0 6 0 254 0 0 sctp_asoc 2288 0 0 0 0 4 0 0 sctp_ep 1280 0 0 99036 0 8 0 0 tcp_log_node 120 0 0 0 0 126 0 0 tcp_log_bucket 184 0 0 0 0 62 0 0 tcp_log 408 0 0 0 0 30 0 0 tcpreass 48 0 0 6961 0 254 0 0 tfo_ccache_entries 80 0 0 0 0 126 0 0 tfo 4 0 0 0 0 254 0 0 sackhole 32 0 0 9199 0 254 0 0 syncache 168 0 0 9214 0 62 0 0 tcptw 88 0 0 1331 0 126 0 0 ipq 56 0 0 0 0 254 0 0 KNOTE 160 0 0 77669984 0 62 0 0 itimer 352 0 0 1 0 30 0 0 AIOLIO 280 0 0 0 0 30 0 0 NCLNODE 744 0 0 84 0 16 0 0 LTS VFS Cache 368 0 0 45 0 30 0 0 STS VFS Cache 148 0 0 1200 0 62 0 0 vtnet_tx_hdr 24 0 0 0 0 254 0 0 crypto_session 24 0 0 0 0 254 0 0 cryptodesc 120 0 0 0 0 126 0 0 cryptop 128 0 0 0 0 126 0 0 nvme_request 128 0 0 0 0 126 0 0 FPU_save_area 832 0 0 0 0 16 0 0 DMAR_MAP_ENTRY 128 0 0 0 0 126 0 0 mbuf_extpgs 256 0 0 0 0 62 0 0 mbuf_jumbo_16k 16384 0 0 0 0 1 0 0 mbuf_jumbo_9k 9216 0 0 0 0 1 0 0 mbuf_jumbo_page 4096 0 0 74704602 0 2 0 0 audit_record 1280 0 0 0 0 8 0 0 domainset 40 0 0 12 0 254 0 0 MAC labels 40 0 0 0 0 254 0 0 vnpbuf 984 0 0 2484 0 16 0 0 mdpbuf 984 0 0 300633 0 0 0 0 nfspbuf 984 0 0 0 0 4 0 0 umtx_shm 88 0 0 35 0 126 0 0 rangeset pctrie nodes 144 0 0 0 0 62 0 0 65536 65536 0 0 11 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 0 0 1 0 0 32768 32768 0 0 55772 0 1 0 0 32768 32768 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 0 0 1 0 0 16384 16384 0 0 2533079 0 1 0 0 8192 8192 0 0 0 0 1 0 0 512 512 0 0 0 0 30 0 0 16 16 0 0 83259 0 254 0 0 UMA Hash 256 0 0 0 0 62 0 0 db:0:pho> show umacache Zone Size Used Free Requests Bucket debugnet_mbuf_packet 2048 0 0 0 0 debugnet_mbuf_cluster 2048 -6144 0 0 0 debugnet_mbuf 256 -10240 0 0 0 kstack_cache 16384 6965 11 146063111 2 vm pgcache 4096 215593 410 334494509 26 vm pgcache 4096 197655 3946 1131591973 171 buf free cache 984 660 30037 69171574 31 buffer arena-65 65536 0 0 41192 1 buffer arena-61 61440 0 0 0 1 buffer arena-57 57344 0 0 0 1 buffer arena-53 53248 0 0 0 1 buffer arena-49 49152 0 0 0 1 buffer arena-45 45056 0 0 0 1 buffer arena-40 40960 0 0 0 1 buffer arena-36 36864 0 0 0 1 buffer arena-32 32768 244 2652 19983575 4 buffer arena-28 28672 0 0 0 1 buffer arena-24 24576 0 0 0 1 buffer arena-20 20480 0 0 0 1 buffer arena-16 16384 5 30147 7093022 30 buffer arena-12 12288 0 0 0 1 buffer arena-81 8192 0 0 0 1 buffer arena-40 4096 0 0 38 2 db:0:pho> acttrace Tracing command rename14 pid 76041 tid 100658 td 0xfffffe0130f5e100 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80c15482, rsp = 0xfffffe0339fd0400, rbp = 0xfffffe0339fd0410 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0339fd0410 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe0339fd04e0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe0339fd0520 workitem_alloc() at workitem_alloc+0xa6/frame 0xfffffe0339fd0550 softdep_setup_directory_add() at softdep_setup_directory_add+0x1f4/frame 0xfffffe0339fd0620 ufs_direnter() at ufs_direnter+0x4df/frame 0xfffffe0339fd06e0 ufs_mkdir() at ufs_mkdir+0x8e5/frame 0xfffffe0339fd0880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x59/frame 0xfffffe0339fd08a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe0339fd0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0339fd0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0339fd0bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800441c0a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76039 tid 100665 td 0xfffffe0130f61300 (CPU 8) kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76036 tid 100668 td 0xfffffe0130ca6500 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x56/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81073ac6, rsp = 0xfffffe03446fead0, rbp = 0xfffffe03446febf0 --- amd64_syscall() at amd64_syscall+0x2b6/frame 0xfffffe03446febf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03446febf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76034 tid 100667 td 0xfffffe0137cc9c00 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff80c15482, rsp = 0xfffffe0344717510, rbp = 0xfffffe0344717520 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0344717520 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe03447175f0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe0344717630 softdep_update_inodeblock() at softdep_update_inodeblock+0xbc/frame 0xfffffe0344717680 ffs_update() at ffs_update+0x1f6/frame 0xfffffe03447176e0 ufs_mkdir() at ufs_mkdir+0x820/frame 0xfffffe0344717880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x59/frame 0xfffffe03447178a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe0344717ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344717bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344717bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800441c0a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command bufdaemon pid 32 tid 100587 td 0xfffffe0175b99100 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80c15480, rsp = 0xfffffe034a758880, rbp = 0xfffffe034a758890 --- lock_delay() at lock_delay+0x30/frame 0xfffffe034a758890 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe034a758960 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe034a7589a0 softdep_setup_inofree() at softdep_setup_inofree+0x54/frame 0xfffffe034a7589e0 ffs_freefile() at ffs_freefile+0x21c/frame 0xfffffe034a758a70 handle_workitem_freefile() at handle_workitem_freefile+0x138/frame 0xfffffe034a758ab0 process_worklist_item() at process_worklist_item+0x2aa/frame 0xfffffe034a758b40 softdep_process_worklist() at softdep_process_worklist+0xc7/frame 0xfffffe034a758b80 softdep_flush() at softdep_flush+0xff/frame 0xfffffe034a758bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034a758bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034a758bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d87450 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d87470 trap() at trap+0x56/frame 0xffffffff81d875a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d875a0 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add72ac0, rbp = 0xfffffe00add72ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add77ac0, rbp = 0xfffffe00add77ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3e3500 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add7cac0, rbp = 0xfffffe00add7cad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add90ac0, rbp = 0xfffffe00add90ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3ec300 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add95ac0, rbp = 0xfffffe00add95ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3eb500 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add9fac0, rbp = 0xfffffe00add9fad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00adda4ac0, rbp = 0xfffffe00adda4ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> ps pid ppid pgrp uid state wmesg wchan cmd 76041 62552 2367 0 R+ (threaded) rename14 100678 S uwait 0xfffff805e81ba780 rename14 100602 S nanslp 0xffffffff81c82719 rename14 100658 Run CPU 4 rename14 76040 62552 2367 0 D+ (threaded) rename14 107225 S uwait 0xfffff806e3700200 rename14 100651 S nanslp 0xffffffff81c82717 rename14 100666 D ufs 0xfffff80515ba97e8 rename14 76039 62552 2367 0 R+ (threaded) rename14 104624 S uwait 0xfffff8065fdb9800 rename14 100649 S nanslp 0xffffffff81c8271a rename14 100665 Run CPU 8 rename14 76038 62552 2367 0 D+ (threaded) rename14 106208 S uwait 0xfffff8014bdb3800 rename14 100653 S nanslp 0xffffffff81c82712 rename14 100670 D ufs 0xfffff80515ba97e8 rename14 76037 62552 2367 0 D+ (threaded) rename14 105144 S uwait 0xfffff806d091e880 rename14 100661 S nanslp 0xffffffff81c82710 rename14 100672 D ufs 0xfffff80515ba97e8 rename14 76036 62552 2367 0 R+ (threaded) rename14 103765 S uwait 0xfffff8011c6f9180 rename14 100659 S nanslp 0xffffffff81c82718 rename14 100668 Run CPU 5 rename14 76035 62552 2367 0 D+ (threaded) rename14 100329 S uwait 0xfffff8002072fa80 rename14 100660 S nanslp 0xffffffff81c82717 rename14 100669 D ufs 0xfffff80515ba97e8 rename14 76034 62552 2367 0 R+ (threaded) rename14 100357 S uwait 0xfffff802c1a8b580 rename14 100650 S nanslp 0xffffffff81c82711 rename14 100667 Run CPU 11 rename14 76033 62552 2367 0 D+ (threaded) rename14 102733 S uwait 0xfffff8065fd1f980 rename14 100143 S nanslp 0xffffffff81c82718 rename14 100654 D ufs 0xfffff80515ba97e8 rename14 76032 62552 2367 0 D+ (threaded) rename14 104173 S uwait 0xfffff80137882400 rename14 100664 S nanslp 0xffffffff81c82716 rename14 100671 D ufs 0xfffff80515ba97e8 rename14 76031 10271 10232 0 S nanslp 0xffffffff81c82718 sleep 62552 62408 2367 0 S+ wait 0xfffff8082aaf7a60 rename14 62517 0 0 0 DL mdwait 0xfffff807d48a3000 [md10] 62408 62406 2367 0 S+ wait 0xfffff8003ca40a60 sh 62407 2367 2367 0 S+ piperd 0xfffff807c556c5f0 tee 62406 2367 2367 0 S+ wait 0xfffff8043d37e530 sh 89141 0 0 0 DL aiordy 0xfffff806cc285a60 [aiod4] 89140 0 0 0 DL aiordy 0xfffff803f75b1a60 [aiod3] 89139 0 0 0 DL aiordy 0xfffff803f7f39000 [aiod2] 89138 0 0 0 DL aiordy 0xfffff80767138000 [aiod1] 36542 0 0 0 DL ftcl 0xffffffff82e1d4f4 [ftcleanup] 10274 10232 10232 0 S piperd 0xfffff800208ddbe0 sh 10272 10232 10232 0 S piperd 0xfffff80020773000 awk 10271 10232 10232 0 S wait 0xfffff8002083a000 sh 10232 1 10232 0 SWs wait 0xfffff80020c6b000 sh 2367 2355 2367 0 S+ wait 0xfffff80020706000 sh 2355 2352 2355 0 S+ select 0xfffff8002072e840 bash 2352 2351 2352 0 SW+ pause 0xfffff80004176b08 csh 2351 2345 2351 2006 SW+ wait 0xfffff80003893000 su 2345 2344 2345 2006 SWs+ wait 0xfffff800209a8000 bash 2344 2341 2341 2006 S select 0xfffff8002030ecc0 sshd 2341 2271 2341 0 Ss select 0xfffff8002030e5c0 sshd 2337 2330 2337 0 S+ ttyin 0xfffff80017036cb0 csh 2330 1 2330 0 SWs+ wait 0xfffff802c5adc000 login 2329 1 2329 0 Ss+ ttyin 0xfffff800170350b0 getty 2328 1 2328 0 Ss+ ttyin 0xfffff800201878b0 getty 2327 1 2327 0 Ss+ ttyin 0xfffff80020187cb0 getty 2326 1 2326 0 Ss+ ttyin 0xfffff800201860b0 getty 2325 1 2325 0 Ss+ ttyin 0xfffff800201864b0 getty 2324 1 2324 0 Ss+ ttyin 0xfffff800201868b0 getty 2323 1 2323 0 Ss+ ttyin 0xfffff80020186cb0 getty 2322 1 2322 0 Ss+ ttyin 0xfffff800201850b0 getty 2321 1 2321 0 Ss+ ttyin 0xfffff800201854b0 getty 2275 1 2275 0 Ss nanslp 0xffffffff81c8271b cron 2271 1 2271 0 Ss select 0xfffff80020547f40 sshd 2243 1 2243 0 Ss select 0xfffff8002014b2c0 powerd 2240 1 2240 123 Ss (threaded) ntpd 100201 S select 0xfffff80020248740 ntpd 2175 1 2175 0 Ss rpcsvc 0xfffff800207d3460 NLM: master 2172 1 2172 0 Ss select 0xfffff80020280dc0 rpc.statd 2126 1 2126 0 Ss nanslp 0xffffffff81c8271b watchdogd 2047 1 2047 0 Ss select 0xfffff800039e7e40 rpcbind 2037 1 2037 0 Ss select 0xfffff800039e7ec0 syslogd 1966 1 1966 0 Ss select 0xfffff8002072d340 devd 1961 1 1961 65 Ss select 0xfffff8002014b340 dhclient 1914 1 1914 0 Ss select 0xfffff800039f7e40 dhclient 1911 1 1911 0 Ss select 0xfffff8002030e640 dhclient 34 0 0 0 DL vlruwt 0xfffff80004148a60 [vnlru] 33 0 0 0 DL syncer 0xffffffff81d58b98 [syncer] 32 0 0 0 RL (threaded) [bufdaemon] 100130 D qsleep 0xffffffff81d58098 [bufdaemon] 100131 D - 0xffffffff8180a980 [bufspacedaemon-0] 100132 D - 0xffffffff81812c40 [bufspacedaemon-1] 100133 D - 0xffffffff8181af00 [bufspacedaemon-2] 100134 D - 0xffffffff818231c0 [bufspacedaemon-3] 100135 D - 0xffffffff8182b480 [bufspacedaemon-4] 100136 D - 0xffffffff81833740 [bufspacedaemon-5] 100139 D - 0xffffffff8183ba00 [bufspacedaemon-6] 100152 D sdflush 0xfffff80020a73ce8 [/ worker] 100199 D sdflush 0xfffff800170ca8e8 [/tmp worker] 100587 Run CPU 3 [/mnt worker] 31 0 0 0 DL psleep 0xffffffff81d73b08 [vmdaemon] 30 0 0 0 DL (threaded) [pagedaemon] 100128 D psleep 0xffffffff81d9fa98 [dom0] 100137 D launds 0xffffffff81d9faa4 [laundry: dom0] 100141 D umarcl 0xffffffff80f0d610 [uma] 29 0 0 0 DL idle 0xfffff80020233000 [enc_daemon1] 28 0 0 0 DL idle 0xfffff80020233530 [enc_daemon0] 27 0 0 0 DL - 0xffffffff81adcfb0 [rand_harvestq] 26 0 0 0 DL waiting 0xffffffff81de5060 [sctp_iterator] 25 0 0 0 DL - 0xffffffff81d57a9c [soaiod4] 24 0 0 0 DL - 0xffffffff81d57a9c [soaiod3] 23 0 0 0 DL - 0xffffffff81d57a9c [soaiod2] 22 0 0 0 DL - 0xffffffff81d57a9c [soaiod1] 21 0 0 0 DL (threaded) [usb] 100096 D - 0xfffffe00d2d84440 [usbus0] 100097 D - 0xfffffe00d2d84498 [usbus0] 100098 D - 0xfffffe00d2d844f0 [usbus0] 100099 D - 0xfffffe00d2d84548 [usbus0] 100100 D - 0xfffffe00d2d845a0 [usbus0] 100102 D - 0xfffffe003e4a1cf0 [usbus1] 100103 D - 0xfffffe003e4a1d48 [usbus1] 100104 D - 0xfffffe003e4a1da0 [usbus1] 100105 D - 0xfffffe003e4a1df8 [usbus1] 100106 D - 0xfffffe003e4a1e50 [usbus1] 100107 D - 0xfffffe00d2e2bcf0 [usbus2] 100108 D - 0xfffffe00d2e2bd48 [usbus2] 100109 D - 0xfffffe00d2e2bda0 [usbus2] 100110 D - 0xfffffe00d2e2bdf8 [usbus2] 100111 D - 0xfffffe00d2e2be50 [usbus2] 20 0 0 0 RL (threaded) [cam] 100091 D - 0xffffffff819b83c0 [doneq0] 100092 RunQ [doneq1] 100093 D - 0xffffffff819b84c0 [doneq2] 100125 D - 0xffffffff819b8288 [scanner] 19 0 0 0 DL crypto_ 0xfffff80003b12c50 [crypto returns 11] 18 0 0 0 DL crypto_ 0xfffff80003b12bf0 [crypto returns 10] 17 0 0 0 DL crypto_ 0xfffff80003b12b90 [crypto returns 9] 16 0 0 0 DL crypto_ 0xfffff80003b12b30 [crypto returns 8] 15 0 0 0 DL crypto_ 0xfffff80003b12ad0 [crypto returns 7] 9 0 0 0 DL crypto_ 0xfffff80003b12a70 [crypto returns 6] 8 0 0 0 DL crypto_ 0xfffff80003b12a10 [crypto returns 5] 7 0 0 0 DL crypto_ 0xfffff80003b129b0 [crypto returns 4] 6 0 0 0 DL crypto_ 0xfffff80003b12950 [crypto returns 3] 5 0 0 0 DL crypto_ 0xfffff80003b128f0 [crypto returns 2] 4 0 0 0 DL crypto_ 0xfffff80003b12890 [crypto returns 1] 3 0 0 0 DL crypto_ 0xfffff80003b12830 [crypto returns 0] 2 0 0 0 DL crypto_ 0xffffffff81d6db78 [crypto] 14 0 0 0 DL seqstat 0xfffff80003a75888 [sequencer 00] 13 0 0 0 DL (threaded) [geom] 100062 D - 0xffffffff81d9e0c8 [g_event] 100063 D - 0xffffffff81d9e0d8 [g_up] 100064 D - 0xffffffff81d9e0d0 [g_down] 12 0 0 0 WL (threaded) [intr] 100016 I [swi6: task queue] 100017 I [swi6: Giant taskq] 100019 I [swi5: fast taskq] 100047 I [swi1: netisr 0] 100048 I [swi4: clock (0)] 100049 I [swi4: clock (1)] 100050 I [swi4: clock (2)] 100051 I [swi4: clock (3)] 100052 I [swi4: clock (4)] 100053 I [swi4: clock (5)] 100054 I [swi4: clock (6)] 100055 I [swi4: clock (7)] 100056 I [swi4: clock (8)] 100057 I [swi4: clock (9)] 100058 I [swi4: clock (10)] 100059 I [swi4: clock (11)] 100060 I [swi3: vm] 100094 I [irq56: ahci0] 100095 I [irq19: xhci0] 100101 I [irq18: ehci0 ehci1] 100112 I [irq71: ahci1] 100113 I [swi0: uart uart] 100176 I [irq72: ioat0] 100177 I [irq73: ioat1] 100178 I [irq74: ioat2] 100179 I [irq75: ioat3] 100180 I [irq76: ioat4] 100181 I [irq77: ioat5] 100182 I [irq78: ioat6] 100183 I [irq79: ioat7] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 Run CPU 2 [idle: cpu2] 100006 CanRun [idle: cpu3] 100007 CanRun [idle: cpu4] 100008 CanRun [idle: cpu5] 100009 Run CPU 6 [idle: cpu6] 100010 Run CPU 7 [idle: cpu7] 100011 CanRun [idle: cpu8] 100012 Run CPU 9 [idle: cpu9] 100013 Run CPU 10 [idle: cpu10] 100014 CanRun [idle: cpu11] 1 0 1 0 SLs wait 0xfffff80003896000 [init] 10 0 0 0 DL audit_w 0xffffffff81de5cf0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81d8d688 [swapper] 100015 D - 0xfffff8000377f100 [aiod_kick taskq] 100018 D - 0xfffff8000377ea00 [thread taskq] 100020 D - 0xfffff80003777000 [config_0] 100021 D - 0xfffff8000377e500 [kqueue_ctx taskq] 100022 D - 0xfffff80003776e00 [if_io_tqg_0] 100023 D - 0xfffff80003776d00 [if_io_tqg_1] 100024 D - 0xfffff80003776c00 [if_io_tqg_2] 100025 D - 0xfffff80003776b00 [if_io_tqg_3] 100026 D - 0xfffff80003776a00 [if_io_tqg_4] 100027 D - 0xfffff80003776900 [if_io_tqg_5] 100028 D - 0xfffff80003776800 [if_io_tqg_6] 100029 D - 0xfffff80003776700 [if_io_tqg_7] 100030 D - 0xfffff80003776600 [if_io_tqg_8] 100031 D - 0xfffff80003776500 [if_io_tqg_9] 100032 D - 0xfffff80003776400 [if_io_tqg_10] 100033 D - 0xfffff80003776300 [if_io_tqg_11] 100034 D - 0xfffff80003776200 [if_config_tqg_0] 100035 D - 0xfffff80003776100 [softirq_0] 100036 D - 0xfffff80003776000 [softirq_1] 100037 D - 0xfffff80003775e00 [softirq_2] 100038 D - 0xfffff80003775d00 [softirq_3] 100039 D - 0xfffff80003775c00 [softirq_4] 100040 D - 0xfffff80003775b00 [softirq_5] 100041 D - 0xfffff80003775a00 [softirq_6] 100042 D - 0xfffff80003775900 [softirq_7] 100043 D - 0xfffff80003775800 [softirq_8] 100044 D - 0xfffff80003775700 [softirq_9] 100045 D - 0xfffff80003775600 [softirq_10] 100046 D - 0xfffff80003775500 [softirq_11] 100061 D - 0xfffff80003a12400 [firmware taskq] 100066 D - 0xfffff80003a13d00 [crypto_0] 100067 D - 0xfffff80003a13d00 [crypto_1] 100068 D - 0xfffff80003a13d00 [crypto_2] 100069 D - 0xfffff80003a13d00 [crypto_3] 100070 D - 0xfffff80003a13d00 [crypto_4] 100071 D - 0xfffff80003a13d00 [crypto_5] 100072 D - 0xfffff80003a13d00 [crypto_6] 100073 D - 0xfffff80003a13d00 [crypto_7] 100074 D - 0xfffff80003a13d00 [crypto_8] 100075 D - 0xfffff80003a13d00 [crypto_9] 100076 D - 0xfffff80003a13d00 [crypto_10] 100077 D - 0xfffff80003a13d00 [crypto_11] 100114 D - 0xfffff800041f9d00 [mca taskq] 100120 D - 0xfffff800200e2900 [acpi_task_0] 100121 D - 0xfffff800200e2900 [acpi_task_1] 100122 D - 0xfffff800200e2900 [acpi_task_2] 100124 D - 0xfffff80003a14100 [CAM taskq] 100425 D - 0xfffff80423608400 [dtrace_taskq] 100441 D - 0xfffff80189a1e300 [system_taskq_0] 100448 D - 0xfffff80189a1e300 [system_taskq_1] 100462 D - 0xfffff80189a1e300 [system_taskq_2] 100464 D - 0xfffff80189a1e300 [system_taskq_3] 100901 D - 0xfffff80189a1e300 [system_taskq_4] 100909 D - 0xfffff80189a1e300 [system_taskq_5] 100918 D - 0xfffff80189a1e300 [system_taskq_6] 100926 D - 0xfffff80189a1e300 [system_taskq_7] 101175 D - 0xfffff80189a1e300 [system_taskq_8] 101189 D - 0xfffff80189a1e300 [system_taskq_9] 101322 D - 0xfffff80189a1e300 [system_taskq_10] 101394 D - 0xfffff80189a1e300 [system_taskq_11] 14952 1 2367 0 Z+ pdfork db:0:pho> allt Tracing command rename14 pid 76041 tid 100678 td 0xfffffe012536da00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5018820 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5018860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50188a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5018900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5018910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e50189b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e5018a10 do_wait() at do_wait+0x206/frame 0xfffffe00e5018a80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00e5018ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5018bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5018bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76041 tid 100602 td 0xfffffe016c7a2700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033ee9a830 mi_switch() at mi_switch+0x159/frame 0xfffffe033ee9a870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ee9a8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ee9a910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033ee9a950 _sleep() at _sleep+0x258/frame 0xfffffe033ee9a9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033ee9aa80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe033ee9aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033ee9abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033ee9abf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76041 tid 100658 td 0xfffffe0130f5e100 (CPU 4) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1a3dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1a3df0 trap() at trap+0x56/frame 0xfffffe003e1a3f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1a3f20 --- trap 0x13, rip = 0xffffffff80c15482, rsp = 0xfffffe0339fd0400, rbp = 0xfffffe0339fd0410 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0339fd0410 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe0339fd04e0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe0339fd0520 workitem_alloc() at workitem_alloc+0xa6/frame 0xfffffe0339fd0550 softdep_setup_directory_add() at softdep_setup_directory_add+0x1f4/frame 0xfffffe0339fd0620 ufs_direnter() at ufs_direnter+0x4df/frame 0xfffffe0339fd06e0 ufs_mkdir() at ufs_mkdir+0x8e5/frame 0xfffffe0339fd0880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x59/frame 0xfffffe0339fd08a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe0339fd0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0339fd0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0339fd0bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800441c0a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76040 tid 107225 td 0xfffffe0156889c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033befe820 mi_switch() at mi_switch+0x159/frame 0xfffffe033befe860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033befe8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033befe900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033befe910 _sleep() at _sleep+0x2c3/frame 0xfffffe033befe9b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe033befea10 do_wait() at do_wait+0x206/frame 0xfffffe033befea80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe033befeac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033befebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033befebf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76040 tid 100651 td 0xfffffe0136b84e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033c730830 mi_switch() at mi_switch+0x159/frame 0xfffffe033c730870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033c7308b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033c730910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033c730950 _sleep() at _sleep+0x258/frame 0xfffffe033c7309f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033c730a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe033c730ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033c730bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033c730bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76040 tid 100666 td 0xfffffe0137f42300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe03447b2390 mi_switch() at mi_switch+0x159/frame 0xfffffe03447b23d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03447b2410 sleeplk() at sleeplk+0x107/frame 0xfffffe03447b2470 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe03447b2520 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe03447b25e0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe03447b2630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe03447b2650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe03447b26b0 lookup() at lookup+0xe1/frame 0xfffffe03447b2750 namei() at namei+0x579/frame 0xfffffe03447b2840 kern_renameat() at kern_renameat+0x175/frame 0xfffffe03447b2ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe03447b2bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03447b2bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76039 tid 104624 td 0xfffffe012531f000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe03441f8820 mi_switch() at mi_switch+0x159/frame 0xfffffe03441f8860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03441f88a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe03441f8900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03441f8910 _sleep() at _sleep+0x2c3/frame 0xfffffe03441f89b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe03441f8a10 do_wait() at do_wait+0x206/frame 0xfffffe03441f8a80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe03441f8ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe03441f8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03441f8bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76039 tid 100649 td 0xfffffe0130e8c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033ec04830 mi_switch() at mi_switch+0x159/frame 0xfffffe033ec04870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ec048b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ec04910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033ec04950 _sleep() at _sleep+0x258/frame 0xfffffe033ec049f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033ec04a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe033ec04ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033ec04bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033ec04bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76039 tid 100665 td 0xfffffe0130f61300 (CPU 8) kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76038 tid 106208 td 0xfffffe0160eef500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033ecfe820 mi_switch() at mi_switch+0x159/frame 0xfffffe033ecfe860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033ecfe8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033ecfe900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033ecfe910 _sleep() at _sleep+0x2c3/frame 0xfffffe033ecfe9b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe033ecfea10 do_wait() at do_wait+0x206/frame 0xfffffe033ecfea80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe033ecfeac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033ecfebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033ecfebf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76038 tid 100653 td 0xfffffe01380e6e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033d895830 mi_switch() at mi_switch+0x159/frame 0xfffffe033d895870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d8958b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033d895910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033d895950 _sleep() at _sleep+0x258/frame 0xfffffe033d8959f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033d895a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe033d895ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033d895bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033d895bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76038 tid 100670 td 0xfffffe0137e6aa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033853f390 mi_switch() at mi_switch+0x159/frame 0xfffffe033853f3d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033853f410 sleeplk() at sleeplk+0x107/frame 0xfffffe033853f470 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe033853f520 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe033853f5e0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe033853f630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe033853f650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe033853f6b0 lookup() at lookup+0xe1/frame 0xfffffe033853f750 namei() at namei+0x579/frame 0xfffffe033853f840 kern_renameat() at kern_renameat+0x9a/frame 0xfffffe033853fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033853fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033853fbf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76037 tid 105144 td 0xfffffe0151513800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe034b436820 mi_switch() at mi_switch+0x159/frame 0xfffffe034b436860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034b4368a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe034b436900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe034b436910 _sleep() at _sleep+0x2c3/frame 0xfffffe034b4369b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe034b436a10 do_wait() at do_wait+0x206/frame 0xfffffe034b436a80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe034b436ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe034b436bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034b436bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76037 tid 100661 td 0xfffffe0137f30700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0344645830 mi_switch() at mi_switch+0x159/frame 0xfffffe0344645870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03446458b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0344645910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0344645950 _sleep() at _sleep+0x258/frame 0xfffffe03446459f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0344645a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe0344645ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344645bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344645bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76037 tid 100672 td 0xfffffe01381ab500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0344703300 mi_switch() at mi_switch+0x159/frame 0xfffffe0344703340 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0344703380 sleeplk() at sleeplk+0x107/frame 0xfffffe03447033e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe03447034a0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe0344703560 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe03447035b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe03447035d0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe0344703630 ufs_rename() at ufs_rename+0x179/frame 0xfffffe0344703820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344703840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344703ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344703bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344703bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76036 tid 103765 td 0xfffffe0141c6b800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033b558820 mi_switch() at mi_switch+0x159/frame 0xfffffe033b558860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b5588a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033b558900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033b558910 _sleep() at _sleep+0x2c3/frame 0xfffffe033b5589b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe033b558a10 do_wait() at do_wait+0x206/frame 0xfffffe033b558a80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe033b558ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033b558bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033b558bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76036 tid 100659 td 0xfffffe0138171100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe034477b830 mi_switch() at mi_switch+0x159/frame 0xfffffe034477b870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034477b8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe034477b910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe034477b950 _sleep() at _sleep+0x258/frame 0xfffffe034477b9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe034477ba80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe034477bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe034477bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034477bbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76036 tid 100668 td 0xfffffe0130ca6500 (CPU 5) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1afdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1afdf0 trap() at trap+0x56/frame 0xfffffe003e1aff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1aff20 --- trap 0x13, rip = 0xffffffff81073ac6, rsp = 0xfffffe03446fead0, rbp = 0xfffffe03446febf0 --- amd64_syscall() at amd64_syscall+0x2b6/frame 0xfffffe03446febf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe03446febf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76035 tid 100329 td 0xfffffe00e633d100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e691c820 mi_switch() at mi_switch+0x159/frame 0xfffffe00e691c860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e691c8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e691c900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e691c910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e691c9b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e691ca10 do_wait() at do_wait+0x206/frame 0xfffffe00e691ca80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00e691cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e691cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e691cbf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76035 tid 100660 td 0xfffffe0138200a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0344726830 mi_switch() at mi_switch+0x159/frame 0xfffffe0344726870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03447268b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0344726910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0344726950 _sleep() at _sleep+0x258/frame 0xfffffe03447269f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0344726a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe0344726ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344726bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344726bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76035 tid 100669 td 0xfffffe0137f72300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033b580300 mi_switch() at mi_switch+0x159/frame 0xfffffe033b580340 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b580380 sleeplk() at sleeplk+0x107/frame 0xfffffe033b5803e0 lockmgr_xlock_hard() at lockmgr_xlock_hard+0x225/frame 0xfffffe033b5804a0 __lockmgr_args() at __lockmgr_args+0x62c/frame 0xfffffe033b580560 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe033b5805b0 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe033b5805d0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe033b580630 ufs_rename() at ufs_rename+0x179/frame 0xfffffe033b580820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe033b580840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe033b580ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033b580bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033b580bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76034 tid 100357 td 0xfffffe016c951800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00ecbd3820 mi_switch() at mi_switch+0x159/frame 0xfffffe00ecbd3860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00ecbd38a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00ecbd3900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00ecbd3910 _sleep() at _sleep+0x2c3/frame 0xfffffe00ecbd39b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00ecbd3a10 do_wait() at do_wait+0x206/frame 0xfffffe00ecbd3a80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00ecbd3ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00ecbd3bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00ecbd3bf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76034 tid 100650 td 0xfffffe0130a07700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe034a78f830 mi_switch() at mi_switch+0x159/frame 0xfffffe034a78f870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034a78f8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe034a78f910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe034a78f950 _sleep() at _sleep+0x258/frame 0xfffffe034a78f9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe034a78fa80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe034a78fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe034a78fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034a78fbf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76034 tid 100667 td 0xfffffe0137cc9c00 (CPU 11) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1f7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1f7df0 trap() at trap+0x56/frame 0xfffffe003e1f7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1f7f20 --- trap 0x13, rip = 0xffffffff80c15482, rsp = 0xfffffe0344717510, rbp = 0xfffffe0344717520 --- lock_delay() at lock_delay+0x32/frame 0xfffffe0344717520 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe03447175f0 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe0344717630 softdep_update_inodeblock() at softdep_update_inodeblock+0xbc/frame 0xfffffe0344717680 ffs_update() at ffs_update+0x1f6/frame 0xfffffe03447176e0 ufs_mkdir() at ufs_mkdir+0x820/frame 0xfffffe0344717880 VOP_MKDIR_APV() at VOP_MKDIR_APV+0x59/frame 0xfffffe03447178a0 kern_mkdirat() at kern_mkdirat+0x1b3/frame 0xfffffe0344717ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344717bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344717bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800441c0a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76033 tid 102733 td 0xfffffe01252de800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e6f1c820 mi_switch() at mi_switch+0x159/frame 0xfffffe00e6f1c860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e6f1c8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e6f1c900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e6f1c910 _sleep() at _sleep+0x2c3/frame 0xfffffe00e6f1c9b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe00e6f1ca10 do_wait() at do_wait+0x206/frame 0xfffffe00e6f1ca80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe00e6f1cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e6f1cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e6f1cbf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76033 tid 100143 td 0xfffffe0137c49500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0348e40830 mi_switch() at mi_switch+0x159/frame 0xfffffe0348e40870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0348e408b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0348e40910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0348e40950 _sleep() at _sleep+0x258/frame 0xfffffe0348e409f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0348e40a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe0348e40ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0348e40bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0348e40bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76033 tid 100654 td 0xfffffe0136b14700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033fcf93f0 mi_switch() at mi_switch+0x159/frame 0xfffffe033fcf9430 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033fcf9470 sleeplk() at sleeplk+0x107/frame 0xfffffe033fcf94d0 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe033fcf9580 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe033fcf9640 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe033fcf9690 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe033fcf96b0 _vn_lock() at _vn_lock+0x54/frame 0xfffffe033fcf9710 lookup() at lookup+0xe1/frame 0xfffffe033fcf97b0 namei() at namei+0x579/frame 0xfffffe033fcf98a0 kern_mkdirat() at kern_mkdirat+0x92/frame 0xfffffe033fcf9ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033fcf9bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033fcf9bf0 --- syscall (136, FreeBSD ELF64, sys_mkdir), rip = 0x800441c0a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command rename14 pid 76032 tid 104173 td 0xfffffe012522f700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033852b820 mi_switch() at mi_switch+0x159/frame 0xfffffe033852b860 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033852b8a0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033852b900 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033852b910 _sleep() at _sleep+0x2c3/frame 0xfffffe033852b9b0 umtxq_sleep() at umtxq_sleep+0x19e/frame 0xfffffe033852ba10 do_wait() at do_wait+0x206/frame 0xfffffe033852ba80 __umtx_op_wait() at __umtx_op_wait+0x78/frame 0xfffffe033852bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033852bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033852bbf0 --- syscall (454, FreeBSD ELF64, sys__umtx_op), rip = 0x80025fe5c, rsp = 0x7fffffffe5d8, rbp = 0x7fffffffe660 --- Tracing command rename14 pid 76032 tid 100664 td 0xfffffe00e6d2ae00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0344640830 mi_switch() at mi_switch+0x159/frame 0xfffffe0344640870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe03446408b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0344640910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe0344640950 _sleep() at _sleep+0x258/frame 0xfffffe03446409f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe0344640a80 sys_nanosleep() at sys_nanosleep+0x97/frame 0xfffffe0344640ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344640bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344640bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003d6dca, rsp = 0x7fffdfffded8, rbp = 0x7fffdfffdf00 --- Tracing command rename14 pid 76032 tid 100671 td 0xfffffe013830d800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe034460e390 mi_switch() at mi_switch+0x159/frame 0xfffffe034460e3d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034460e410 sleeplk() at sleeplk+0x107/frame 0xfffffe034460e470 lockmgr_slock_hard() at lockmgr_slock_hard+0x1d6/frame 0xfffffe034460e520 __lockmgr_args() at __lockmgr_args+0x798/frame 0xfffffe034460e5e0 ffs_lock() at ffs_lock+0x7c/frame 0xfffffe034460e630 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x40/frame 0xfffffe034460e650 _vn_lock() at _vn_lock+0x54/frame 0xfffffe034460e6b0 lookup() at lookup+0xe1/frame 0xfffffe034460e750 namei() at namei+0x579/frame 0xfffffe034460e840 kern_renameat() at kern_renameat+0x175/frame 0xfffffe034460eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe034460ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe034460ebf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command sleep pid 76031 tid 103300 td 0xfffffe0156916300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033d840830 mi_switch() at mi_switch+0x159/frame 0xfffffe033d840870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d8408b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033d840910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe033d840950 _sleep() at _sleep+0x258/frame 0xfffffe033d8409f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe033d840a80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe033d840ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033d840bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033d840bf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003abdca, rsp = 0x7fffffffe688, rbp = 0x7fffffffe6d0 --- Tracing command rename14 pid 62552 tid 101968 td 0xfffffe0141d89c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e68db6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e68db6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68db730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68db790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e68db7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e68db840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e68db8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e68dbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68dbbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x8003d6c6a, rsp = 0x7fffffffe658, rbp = 0x7fffffffe690 --- Tracing command md10 pid 62517 tid 104686 td 0xfffffe0175c80300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0343567a30 mi_switch() at mi_switch+0x159/frame 0xfffffe0343567a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0343567ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0343567b50 md_kthread() at md_kthread+0xd5/frame 0xfffffe0343567bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0343567bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0343567bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 62408 tid 107258 td 0xfffffe00e7956100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033bfc16b0 mi_switch() at mi_switch+0x159/frame 0xfffffe033bfc16f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033bfc1730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033bfc1790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033bfc17a0 _sleep() at _sleep+0x2c3/frame 0xfffffe033bfc1840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe033bfc18d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe033bfc1ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033bfc1bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033bfc1bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe478, rbp = 0x7fffffffe530 --- Tracing command tee pid 62407 tid 103371 td 0xfffffe01568ec000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033d99e7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe033d99e830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033d99e870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe033d99e8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe033d99e8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe033d99e980 pipe_read() at pipe_read+0x428/frame 0xfffffe033d99e9e0 dofileread() at dofileread+0x81/frame 0xfffffe033d99ea30 kern_readv() at kern_readv+0x49/frame 0xfffffe033d99ea70 sys_read() at sys_read+0x83/frame 0xfffffe033d99eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe033d99ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe033d99ebf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80041b8ea, rsp = 0x7fffffffe698, rbp = 0x7fffffffe6e0 --- Tracing command sh pid 62406 tid 104183 td 0xfffffe015168e300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe03385716b0 mi_switch() at mi_switch+0x159/frame 0xfffffe03385716f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0338571730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe0338571790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe03385717a0 _sleep() at _sleep+0x2c3/frame 0xfffffe0338571840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe03385718d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe0338571ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0338571bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0338571bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffa8f8, rbp = 0x7fffffffa9b0 --- Tracing command aiod4 pid 89141 tid 106129 td 0xfffffe0156a0b100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe034a1a3a00 mi_switch() at mi_switch+0x159/frame 0xfffffe034a1a3a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe034a1a3a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe034a1a3ac0 _sleep() at _sleep+0x26c/frame 0xfffffe034a1a3b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe034a1a3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034a1a3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034a1a3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod3 pid 89140 tid 103093 td 0xfffffe012538b700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0339a13a00 mi_switch() at mi_switch+0x159/frame 0xfffffe0339a13a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0339a13a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0339a13ac0 _sleep() at _sleep+0x26c/frame 0xfffffe0339a13b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe0339a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0339a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0339a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod2 pid 89139 tid 103781 td 0xfffffe01252b5300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe033b5a8a00 mi_switch() at mi_switch+0x159/frame 0xfffffe033b5a8a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe033b5a8a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe033b5a8ac0 _sleep() at _sleep+0x26c/frame 0xfffffe033b5a8b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe033b5a8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe033b5a8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe033b5a8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command aiod1 pid 89138 tid 102160 td 0xfffffe0162532e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e9726a00 mi_switch() at mi_switch+0x159/frame 0xfffffe00e9726a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e9726a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e9726ac0 _sleep() at _sleep+0x26c/frame 0xfffffe00e9726b60 aio_daemon() at aio_daemon+0x2ea/frame 0xfffffe00e9726bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e9726bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e9726bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command ftcleanup pid 36542 tid 100243 td 0xfffffe00e42b3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e51fca40 mi_switch() at mi_switch+0x159/frame 0xfffffe00e51fca80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51fcac0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e51fcb60 fasttrap_pid_cleanup_cb() at fasttrap_pid_cleanup_cb+0x27c/frame 0xfffffe00e51fcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e51fcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e51fcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sh pid 10274 tid 100287 td 0xfffffe00e6786000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e68e07f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e68e0830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e68e0870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e68e08d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e68e08e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e68e0980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e68e09e0 dofileread() at dofileread+0x81/frame 0xfffffe00e68e0a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e68e0a70 sys_read() at sys_read+0x83/frame 0xfffffe00e68e0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e68e0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e68e0bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047a8ea, rsp = 0x7fffffffe218, rbp = 0x7fffffffe320 --- Tracing command awk pid 10272 tid 100272 td 0xfffffe00e6776a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e689a7f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e689a830 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e689a870 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e689a8d0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e689a8e0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e689a980 pipe_read() at pipe_read+0x428/frame 0xfffffe00e689a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e689aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e689aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e689aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e689abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e689abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x80047f8ea, rsp = 0x7fffffffe308, rbp = 0x7fffffffe320 --- Tracing command sh pid 10271 tid 100200 td 0xfffffe00e42afa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e506a6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e506a6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e506a730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e506a790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e506a7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e506a840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e506a8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e506aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e506abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e506abf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffe228, rbp = 0x7fffffffe2e0 --- Tracing command sh pid 10232 tid 100234 td 0xfffffe00e432fc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e51cf6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775a20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775a30 trap() at trap+0x6c/frame 0xfffffe0344775b60 calltrap() at calltrap+0x8/frame 0xfffffe0344775b60 --- trap 0xc, rip = 0xffffffff81046850, rsp = 0xfffffe0344775c30, rbp = 0xfffffe0344775cc0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x32/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- *** error reading from address fffffe00e51cf6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775cb0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x4c/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command sh pid 2367 tid 100160 td 0xfffffe00d3df9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50276b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50276f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5027730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5027790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e50277a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00e5027840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00e50278d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00e5027ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5027bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5027bf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x80040ac6a, rsp = 0x7fffffffac18, rbp = 0x7fffffffacd0 --- Tracing command bash pid 2355 tid 100190 td 0xfffffe00e382a000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50e06d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50e0710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50e0750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50e07b0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e50e07c0 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50e0820 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e50e0860 kern_select() at kern_select+0x952/frame 0xfffffe00e50e0a40 sys_pselect() at sys_pselect+0x127/frame 0xfffffe00e50e0ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e50e0bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50e0bf0 --- syscall (522, FreeBSD ELF64, sys_pselect), rip = 0x800528d8a, rsp = 0x7fffffffd5d8, rbp = 0x7fffffffd6a0 --- Tracing command csh pid 2352 tid 100173 td 0xfffffe00d2d8aa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50658a0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775a20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775a30 trap() at trap+0x6c/frame 0xfffffe0344775b60 calltrap() at calltrap+0x8/frame 0xfffffe0344775b60 --- trap 0xc, rip = 0xffffffff81046850, rsp = 0xfffffe0344775c30, rbp = 0xfffffe0344775cc0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x32/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- *** error reading from address fffffe00e50658a8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775cb0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x4c/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command su pid 2351 tid 100147 td 0xfffffe003e1e7300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37e06b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775a20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775a30 trap() at trap+0x6c/frame 0xfffffe0344775b60 calltrap() at calltrap+0x8/frame 0xfffffe0344775b60 --- trap 0xc, rip = 0xffffffff81046850, rsp = 0xfffffe0344775c30, rbp = 0xfffffe0344775cc0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x32/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- *** error reading from address fffffe00e37e06b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775cb0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x4c/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command bash pid 2345 tid 100170 td 0xfffffe00e383f800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e504f6b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775a20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775a30 trap() at trap+0x6c/frame 0xfffffe0344775b60 calltrap() at calltrap+0x8/frame 0xfffffe0344775b60 --- trap 0xc, rip = 0xffffffff81046850, rsp = 0xfffffe0344775c30, rbp = 0xfffffe0344775cc0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x32/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- *** error reading from address fffffe00e504f6b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775cb0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x4c/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command sshd pid 2344 tid 100208 td 0xfffffe00d39df300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5134710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5134750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5134790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51347f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5134800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5134860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e51348a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5134a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5134ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5134bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5134bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffa538, rbp = 0x7fffffffa570 --- Tracing command sshd pid 2341 tid 100168 td 0xfffffe00e429e100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e503b790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e503b7d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e503b810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e503b870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e503b880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e503b8e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e503b920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e503baa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e503bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e503bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e503bbf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x80089c48a, rsp = 0x7fffffffe598, rbp = 0x7fffffffe5d0 --- Tracing command csh pid 2337 tid 100151 td 0xfffffe00d3df1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37f4770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37f47b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37f47f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37f4850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37f4860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37f48c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37f48f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37f4950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37f4980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37f49e0 dofileread() at dofileread+0x81/frame 0xfffffe00e37f4a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e37f4a70 sys_read() at sys_read+0x83/frame 0xfffffe00e37f4ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37f4bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37f4bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004ff8ea, rsp = 0x7fffffffe1d8, rbp = 0x7fffffffe200 --- Tracing command login pid 2330 tid 100212 td 0xfffffe00e4318500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e51666b0 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775a20 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775a30 trap() at trap+0x6c/frame 0xfffffe0344775b60 calltrap() at calltrap+0x8/frame 0xfffffe0344775b60 --- trap 0xc, rip = 0xffffffff81046850, rsp = 0xfffffe0344775c30, rbp = 0xfffffe0344775cc0 --- db_read_bytes() at db_read_bytes+0x90/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x32/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- *** error reading from address fffffe00e51666b8 *** KDB: reentering KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0344775cb0 kdb_reenter() at kdb_reenter+0x2c/frame 0xfffffe0344775cc0 db_get_value() at db_get_value+0x4c/frame 0xfffffe0344775d00 db_backtrace() at db_backtrace+0x23e/frame 0xfffffe0344775d90 db_trace_thread() at db_trace_thread+0x3b/frame 0xfffffe0344775db0 _db_stack_trace_all() at _db_stack_trace_all+0xb6/frame 0xfffffe0344775e50 db_command() at db_command+0x25c/frame 0xfffffe0344775f20 db_script_exec() at db_script_exec+0x1a8/frame 0xfffffe0344775fc0 db_command() at db_command+0x25c/frame 0xfffffe0344776090 db_command_loop() at db_command_loop+0x4d/frame 0xfffffe03447760a0 db_trap() at db_trap+0xe8/frame 0xfffffe0344776130 kdb_trap() at kdb_trap+0x157/frame 0xfffffe03447761b0 trap() at trap+0x7ae/frame 0xfffffe03447762e0 calltrap() at calltrap+0x8/frame 0xfffffe03447762e0 --- trap 0x3, rip = 0xffffffff80c13e77, rsp = 0xfffffe03447763b0, rbp = 0xfffffe03447763c0 --- kdb_enter() at kdb_enter+0x37/frame 0xfffffe03447763c0 vpanic() at vpanic+0x1a1/frame 0xfffffe0344776420 panic() at panic+0x43/frame 0xfffffe0344776480 journal_jremref() at journal_jremref+0x8d/frame 0xfffffe03447764b0 newdirrem() at newdirrem+0x9b3/frame 0xfffffe0344776560 softdep_setup_directory_change() at softdep_setup_directory_change+0x14a/frame 0xfffffe03447765e0 ufs_dirrewrite() at ufs_dirrewrite+0x155/frame 0xfffffe0344776630 ufs_rename() at ufs_rename+0xe12/frame 0xfffffe0344776820 VOP_RENAME_APV() at VOP_RENAME_APV+0x40/frame 0xfffffe0344776840 kern_renameat() at kern_renameat+0x350/frame 0xfffffe0344776ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe0344776bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0344776bf0 --- syscall (128, FreeBSD ELF64, sys_rename), rip = 0x80030768a, rsp = 0x7fffdfdfce78, rbp = 0x7fffdfdfcfb0 --- Tracing command getty pid 2329 tid 100211 td 0xfffffe00e4318c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e516b770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e516b7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e516b7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e516b850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e516b860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e516b8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e516b8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e516b950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e516b980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e516b9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e516ba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e516ba70 sys_read() at sys_read+0x83/frame 0xfffffe00e516bac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e516bbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e516bbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2328 tid 100159 td 0xfffffe00e432e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e501d770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e501d7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e501d7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e501d850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e501d860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e501d8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e501d8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e501d950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e501d980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e501d9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e501da30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e501da70 sys_read() at sys_read+0x83/frame 0xfffffe00e501dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e501dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e501dbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2327 tid 100210 td 0xfffffe00e39f3000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e515c770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e515c7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e515c7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e515c850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e515c860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e515c8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e515c8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e515c950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e515c980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e515c9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e515ca30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e515ca70 sys_read() at sys_read+0x83/frame 0xfffffe00e515cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e515cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e515cbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2326 tid 100209 td 0xfffffe00e39f3700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5161770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e51617b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51617f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5161850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5161860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e51618c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e51618f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e5161950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e5161980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e51619e0 dofileread() at dofileread+0x81/frame 0xfffffe00e5161a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e5161a70 sys_read() at sys_read+0x83/frame 0xfffffe00e5161ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5161bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5161bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2325 tid 100193 td 0xfffffe00e39f3e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50d6770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50d67b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50d67f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50d6850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e50d6860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50d68c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e50d68f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e50d6950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e50d6980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e50d69e0 dofileread() at dofileread+0x81/frame 0xfffffe00e50d6a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e50d6a70 sys_read() at sys_read+0x83/frame 0xfffffe00e50d6ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e50d6bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50d6bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2324 tid 100185 td 0xfffffe00e39f4500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50db770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50db7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50db7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50db850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e50db860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50db8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e50db8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e50db950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e50db980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e50db9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e50dba30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e50dba70 sys_read() at sys_read+0x83/frame 0xfffffe00e50dbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e50dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50dbbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2323 tid 100174 td 0xfffffe00d3df1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e506f770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e506f7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e506f7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e506f850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e506f860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e506f8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e506f8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e506f950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e506f980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e506f9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e506fa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e506fa70 sys_read() at sys_read+0x83/frame 0xfffffe00e506fac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e506fbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e506fbf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2322 tid 100171 td 0xfffffe00e383f100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e504a770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e504a7b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e504a7f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e504a850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e504a860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e504a8c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e504a8f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e504a950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e504a980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e504a9e0 dofileread() at dofileread+0x81/frame 0xfffffe00e504aa30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e504aa70 sys_read() at sys_read+0x83/frame 0xfffffe00e504aac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e504abf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e504abf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command getty pid 2321 tid 100142 td 0xfffffe00d39dec00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37b8770 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37b87b0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37b87f0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37b8850 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37b8860 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37b88c0 tty_wait() at tty_wait+0x42/frame 0xfffffe00e37b88f0 ttydisc_read() at ttydisc_read+0x20a/frame 0xfffffe00e37b8950 ttydev_read() at ttydev_read+0x4b/frame 0xfffffe00e37b8980 devfs_read_f() at devfs_read_f+0xde/frame 0xfffffe00e37b89e0 dofileread() at dofileread+0x81/frame 0xfffffe00e37b8a30 kern_readv() at kern_readv+0x49/frame 0xfffffe00e37b8a70 sys_read() at sys_read+0x83/frame 0xfffffe00e37b8ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37b8bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37b8bf0 --- syscall (3, FreeBSD ELF64, sys_read), rip = 0x8004378ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec00 --- Tracing command cron pid 2275 tid 100163 td 0xfffffe00d31ae300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e500e830 mi_switch() at mi_switch+0x159/frame 0xfffffe00e500e870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e500e8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e500e910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e500e950 _sleep() at _sleep+0x258/frame 0xfffffe00e500e9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e500ea80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e500eac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e500ebf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e500ebf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003dbdca, rsp = 0x7fffffffea98, rbp = 0x7fffffffec80 --- Tracing command sshd pid 2271 tid 100191 td 0xfffffe00d39e0800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50ef710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50ef750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50ef790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50ef7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e50ef800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e50ef860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e50ef8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e50efa80 sys_select() at sys_select+0x56/frame 0xfffffe00e50efac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e50efbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50efbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8008f98ca, rsp = 0x7fffffffe628, rbp = 0x7fffffffe660 --- Tracing command powerd pid 2243 tid 100150 td 0xfffffe00e383ce00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37ea6d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37ea710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37ea750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37ea7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37ea7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e37ea860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e37ea8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e37eaa80 sys_select() at sys_select+0x56/frame 0xfffffe00e37eaac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37eabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37eabf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004348ca, rsp = 0x7fffffffeb48, rbp = 0x7fffffffec90 --- Tracing command ntpd pid 2240 tid 100201 td 0xfffffe00e42b3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5143710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5143750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5143790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e51437f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e5143800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e5143860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e51438a0 kern_select() at kern_select+0x952/frame 0xfffffe00e5143a80 sys_select() at sys_select+0x56/frame 0xfffffe00e5143ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5143bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5143bf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80082c8ca, rsp = 0x7fffffffded8, rbp = 0x7fffffffdf10 --- Tracing command rpc.lockd pid 2175 tid 100172 td 0xfffffe00d3df1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37ef610 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37ef650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37ef690 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37ef6f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37ef730 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e37ef7a0 svc_run_internal() at svc_run_internal+0xabe/frame 0xfffffe00e37ef8e0 svc_run() at svc_run+0x253/frame 0xfffffe00e37ef940 sys_nlm_syscall() at sys_nlm_syscall+0x745/frame 0xfffffe00e37efac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37efbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37efbf0 --- syscall (154, FreeBSD ELF64, sys_nlm_syscall), rip = 0x8002f65ea, rsp = 0x7fffffffebb8, rbp = 0x7fffffffec80 --- Tracing command rpc.statd pid 2172 tid 100148 td 0xfffffe003e1e6c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37db6d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37db710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37db750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37db7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37db7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e37db860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e37db8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e37dba80 sys_select() at sys_select+0x56/frame 0xfffffe00e37dbac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37dbbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37dbbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80042b8ca, rsp = 0x7fffffffea68, rbp = 0x7fffffffebb0 --- Tracing command watchdogd pid 2126 tid 100192 td 0xfffffe00d39e0100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e50ea830 mi_switch() at mi_switch+0x159/frame 0xfffffe00e50ea870 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50ea8b0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e50ea910 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e50ea950 _sleep() at _sleep+0x258/frame 0xfffffe00e50ea9f0 kern_clock_nanosleep() at kern_clock_nanosleep+0x1e2/frame 0xfffffe00e50eaa80 sys_nanosleep() at sys_nanosleep+0x5f/frame 0xfffffe00e50eaac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e50eabf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e50eabf0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x8003c4dca, rsp = 0x7fffffffea58, rbp = 0x7fffffffeaa0 --- Tracing command rpcbind pid 2047 tid 100166 td 0xfffffe00e4331800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5031750 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5031790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50317d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5031830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5031870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e50318e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5031920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5031aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5031ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5031bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5031bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003d248a, rsp = 0x7fffffffc9f8, rbp = 0x7fffffffec10 --- Tracing command syslogd pid 2037 tid 100184 td 0xfffffe00e4331100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e502c710 mi_switch() at mi_switch+0x159/frame 0xfffffe00e502c750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e502c790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e502c7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e502c800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e502c860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e502c8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e502ca80 sys_select() at sys_select+0x56/frame 0xfffffe00e502cac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e502cbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e502cbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x80043c8ca, rsp = 0x7fffffffe708, rbp = 0x7fffffffec80 --- Tracing command devd pid 1966 tid 100145 td 0xfffffe00e382b500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37cc6d0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37cc710 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37cc750 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37cc7b0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e37cc7f0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e37cc860 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e37cc8a0 kern_select() at kern_select+0x952/frame 0xfffffe00e37cca80 sys_select() at sys_select+0x56/frame 0xfffffe00e37ccac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37ccbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37ccbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x2f803a, rsp = 0x7fffffffcb08, rbp = 0x7fffffffeca0 --- Tracing command dhclient pid 1961 tid 100158 td 0xfffffe00d31aea00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5013750 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5013790 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e50137d0 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e5013830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x12/frame 0xfffffe00e5013870 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x184/frame 0xfffffe00e50138e0 seltdwait() at seltdwait+0x6b/frame 0xfffffe00e5013920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e5013aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e5013ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e5013bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e5013bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f548a, rsp = 0x7fffffffebe8, rbp = 0x7fffffffec20 --- Tracing command dhclient pid 1914 tid 100162 td 0xfffffe00e382ae00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37c7790 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37c77d0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37c7810 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00e37c7870 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00e37c7880 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00e37c78e0 seltdwait() at seltdwait+0x8d/frame 0xfffffe00e37c7920 kern_poll() at kern_poll+0x48b/frame 0xfffffe00e37c7aa0 sys_poll() at sys_poll+0x50/frame 0xfffffe00e37c7ac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00e37c7bf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00e37c7bf0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x8003f548a, rsp = 0x7fffffffebf8, rbp = 0x7fffffffec20 --- Tracing command dhclient pid 1911 tid 100144 td 0xfffffe00d3df2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7fd710 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7fd750 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7fd790 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00de7fd7f0 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00de7fd800 _cv_wait_sig() at _cv_wait_sig+0x161/frame 0xfffffe00de7fd860 seltdwait() at seltdwait+0x8d/frame 0xfffffe00de7fd8a0 kern_select() at kern_select+0x952/frame 0xfffffe00de7fda80 sys_select() at sys_select+0x56/frame 0xfffffe00de7fdac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00de7fdbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00de7fdbf0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8004528ca, rsp = 0x7fffffffe9a8, rbp = 0x7fffffffea60 --- Tracing command vnlru pid 34 tid 100140 td 0xfffffe00d3df2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37a49b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37a49f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37a4a30 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37a4a70 _sleep() at _sleep+0x26c/frame 0xfffffe00e37a4b10 vnlru_proc() at vnlru_proc+0xaed/frame 0xfffffe00e37a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command syncer pid 33 tid 100138 td 0xfffffe00d3df3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7ee9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7eea30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7eea70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de7eeab0 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x184/frame 0xfffffe00de7eeb20 sched_sync() at sched_sync+0x69d/frame 0xfffffe00de7eebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7eebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7eebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100130 td 0xfffffe00d3df3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037be6a00 mi_switch() at mi_switch+0x159/frame 0xfffffe0037be6a40 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037be6a80 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037be6ac0 _sleep() at _sleep+0x26c/frame 0xfffffe0037be6b60 buf_daemon() at buf_daemon+0x112/frame 0xfffffe0037be6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037be6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037be6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100131 td 0xfffffe00d3df7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037beb9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037beba30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037beba70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bebab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bebb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bebbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bebbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bebbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100132 td 0xfffffe00d3df7300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf09f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf0a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf0a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf0ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf0b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bf0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100133 td 0xfffffe00d3df6c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bf59f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bf5a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bf5a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bf5ab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bf5b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bf5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bf5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bf5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100134 td 0xfffffe00d3df6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bfa9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bfaa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bfaa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bfaab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bfab50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bfabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bfabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bfabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100135 td 0xfffffe00d3df5e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bff9f0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bffa30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bffa70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bffab0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bffb50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe0037bffbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bffbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bffbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100136 td 0xfffffe00d3df5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de6249f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de624a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de624a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de624ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de624b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de624bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de624bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de624bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100139 td 0xfffffe00d3df5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7f89f0 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7f8a30 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7f8a70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00de7f8ab0 _sleep() at _sleep+0x26c/frame 0xfffffe00de7f8b50 bufspace_daemon() at bufspace_daemon+0x2d9/frame 0xfffffe00de7f8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7f8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7f8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100152 td 0xfffffe00d2d8b100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37bda20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37bda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37bdaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37bdae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37bdb80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e37bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100199 td 0xfffffe00d39dfa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e5139a20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e5139a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e5139aa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e5139ae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e5139b80 softdep_flush() at softdep_flush+0x175/frame 0xfffffe00e5139bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e5139bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e5139bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 32 tid 100587 td 0xfffffe0175b99100 (CPU 3) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e197dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e197df0 trap() at trap+0x56/frame 0xfffffe003e197f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e197f20 --- trap 0x13, rip = 0xffffffff80c15480, rsp = 0xfffffe034a758880, rbp = 0xfffffe034a758890 --- lock_delay() at lock_delay+0x30/frame 0xfffffe034a758890 __rw_wlock_hard() at __rw_wlock_hard+0x1b8/frame 0xfffffe034a758960 _rw_wlock_cookie() at _rw_wlock_cookie+0xbc/frame 0xfffffe034a7589a0 softdep_setup_inofree() at softdep_setup_inofree+0x54/frame 0xfffffe034a7589e0 ffs_freefile() at ffs_freefile+0x21c/frame 0xfffffe034a758a70 handle_workitem_freefile() at handle_workitem_freefile+0x138/frame 0xfffffe034a758ab0 process_worklist_item() at process_worklist_item+0x2aa/frame 0xfffffe034a758b40 softdep_process_worklist() at softdep_process_worklist+0xc7/frame 0xfffffe034a758b80 softdep_flush() at softdep_flush+0xff/frame 0xfffffe034a758bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe034a758bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe034a758bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 31 tid 100129 td 0xfffffe00d3df4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd5a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd5a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd5aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bd5b40 vm_daemon() at vm_daemon+0x82/frame 0xfffffe0037bd5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100128 td 0xfffffe00d6099e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bd0610 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bd0650 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bd0690 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bd06d0 _sleep() at _sleep+0x26c/frame 0xfffffe0037bd0770 vm_pageout_worker() at vm_pageout_worker+0x279/frame 0xfffffe0037bd0b70 vm_pageout() at vm_pageout+0x193/frame 0xfffffe0037bd0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bd0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bd0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100137 td 0xfffffe00d3dfb300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00de7e9810 mi_switch() at mi_switch+0x159/frame 0xfffffe00de7e9850 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00de7e9890 _sleep() at _sleep+0x2cd/frame 0xfffffe00de7e9930 vm_pageout_laundry_worker() at vm_pageout_laundry_worker+0xc1b/frame 0xfffffe00de7e9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00de7e9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00de7e9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 30 tid 100141 td 0xfffffe00d3dfac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e37aea20 mi_switch() at mi_switch+0x159/frame 0xfffffe00e37aea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e37aeaa0 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe00e37aeae0 _sleep() at _sleep+0x26c/frame 0xfffffe00e37aeb80 uma_reclaim_worker() at uma_reclaim_worker+0xb8/frame 0xfffffe00e37aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e37aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e37aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon1 pid 29 tid 100127 td 0xfffffe00d5cd2100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bcba10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bcba50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bcba90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bcbb30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bcbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bcbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bcbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command enc_daemon0 pid 28 tid 100126 td 0xfffffe00d5cd2800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc6a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc6a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc6a90 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc6b30 enc_daemon() at enc_daemon+0xf6/frame 0xfffffe0037bc6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 27 tid 100123 td 0xfffffe00d609b300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb79d0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb7a10 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb7a50 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037bb7a90 _sleep() at _sleep+0x26c/frame 0xfffffe0037bb7b30 random_kthread() at random_kthread+0x67/frame 0xfffffe0037bb7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 26 tid 100119 td 0xfffffe00d5ccf000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba3a70 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ba3ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba3af0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ba3b90 sctp_iterator_thread() at sctp_iterator_thread+0x59/frame 0xfffffe0037ba3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod4 pid 25 tid 100118 td 0xfffffe00d31af100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b92a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b92a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b92a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b92ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b92b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b92bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b92bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b92bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod3 pid 24 tid 100117 td 0xfffffe00d31af800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b8da10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b8da50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b8da90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b8dad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b8db70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b8dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b8dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b8dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod2 pid 23 tid 100116 td 0xfffffe00d6099000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b88a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b88a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b88a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b88ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b88b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command soaiod1 pid 22 tid 100115 td 0xfffffe00d6099700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b83a10 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b83a50 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b83a90 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xfffffe0037b83ad0 _sleep() at _sleep+0x26c/frame 0xfffffe0037b83b70 soaio_kproc_loop() at soaio_kproc_loop+0x168/frame 0xfffffe0037b83bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b83bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b83bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100096 td 0xfffffe00d2d89500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b24a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b24ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b24b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b24b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b24bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b24bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b24bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100097 td 0xfffffe00d2d88e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b29a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b29ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b29b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b29b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b29bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b29bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b29bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100098 td 0xfffffe00d2d88700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b2ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b2ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b2eb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b2eb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b2ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b2ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b2ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100099 td 0xfffffe00d2d88000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b33a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b33ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b33b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b33b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b33bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b33bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b33bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100100 td 0xfffffe003e474800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b38a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b38ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b38b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b38b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b38bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b38bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b38bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100102 td 0xfffffe003e473a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b42a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b42ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b42b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b42b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b42bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b42bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b42bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100103 td 0xfffffe00d2e22500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b47a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b47ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b47b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b47b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b47bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b47bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b47bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100104 td 0xfffffe00d2e21e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b4ca90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b4cad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b4cb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b4cb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b4cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b4cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b4cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100105 td 0xfffffe00d2e21700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b51a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b51ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b51b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b51b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b51bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b51bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b51bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100106 td 0xfffffe00d2e21000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b56a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b56ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b56b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b56b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b56bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b56bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b56bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100107 td 0xfffffe00d31ace00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b5ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b5bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b5bb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b5bb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b5bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b5bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b5bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100108 td 0xfffffe00d31ac700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b60a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b60ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b60b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b60b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b60bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b60bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b60bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100109 td 0xfffffe00d31ac000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b65a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b65ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b65b10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b65b70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100110 td 0xfffffe00d2e24800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6ab10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6ab70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command usb pid 21 tid 100111 td 0xfffffe00d2e24100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b6fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b6fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b6fb10 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037b6fb70 usb_process() at usb_process+0xc3/frame 0xfffffe0037b6fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b6fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b6fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100091 td 0xfffffe003e471700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b0ba40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b0ba80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b0bac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b0bb60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b0bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b0bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b0bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100092 td 0xfffffe003e471000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b10a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b10a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b10ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b10b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b10bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b10bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b10bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100093 td 0xfffffe003e188800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b15a40 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b15a80 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b15ac0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b15b60 xpt_done_td() at xpt_done_td+0x8b/frame 0xfffffe0037b15bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b15bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b15bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 20 tid 100125 td 0xfffffe00d609a500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bc1a30 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bc1a70 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bc1ab0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bc1b50 xpt_scanner_thread() at xpt_scanner_thread+0x92/frame 0xfffffe0037bc1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bc1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bc1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 11 pid 19 tid 100090 td 0xfffffe003e471e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b06a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b06a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b06aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b06b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b06bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b06bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b06bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 10 pid 18 tid 100089 td 0xfffffe003e472500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b01a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b01a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b01aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037b01b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037b01bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b01bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b01bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 9 pid 17 tid 100088 td 0xfffffe003e472c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037afca20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037afca60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037afcaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037afcb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037afcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037afcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037afcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 8 pid 16 tid 100087 td 0xfffffe003e473300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af7a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af7a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af7aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af7b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 7 pid 15 tid 100086 td 0xfffffe003e194800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037af2a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037af2a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037af2aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037af2b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037af2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037af2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037af2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 6 pid 9 tid 100085 td 0xfffffe003e185000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aeda20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aeda60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aedaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aedb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037aedbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aedbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aedbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 5 pid 8 tid 100084 td 0xfffffe003e185700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae8a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae8a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae8aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae8b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 4 pid 7 tid 100083 td 0xfffffe003e185e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ae3a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ae3a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ae3aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ae3b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ae3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ae3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ae3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 3 pid 6 tid 100082 td 0xfffffe003e186500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037adea20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037adea60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037adeaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037adeb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037adebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037adebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037adebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 2 pid 5 tid 100081 td 0xfffffe003e186c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad9a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad9a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad9aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad9b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 1 pid 4 tid 100080 td 0xfffffe003e187300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ad4a20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ad4a60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ad4aa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ad4b40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037ad4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ad4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ad4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns 0 pid 3 tid 100079 td 0xfffffe003e187a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acfa20 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acfa60 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acfaa0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acfb40 crypto_ret_proc() at crypto_ret_proc+0x23d/frame 0xfffffe0037acfbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acfbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acfbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 2 tid 100078 td 0xfffffe003e191000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037acaa50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037acaa90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037acaad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037acab70 crypto_proc() at crypto_proc+0x2bf/frame 0xfffffe0037acabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037acabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037acabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sequencer 00 pid 14 tid 100065 td 0xfffffe003e1c3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a89a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a89a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a89ad0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe0037a89b30 seq_eventthread() at seq_eventthread+0x8c/frame 0xfffffe0037a89bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a89bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a89bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100062 td 0xfffffe003e1cde00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a6ea50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a6ea90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a6ead0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a6eb70 g_run_events() at g_run_events+0x64/frame 0xfffffe0037a6ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a6ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a6ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100063 td 0xfffffe003e1c4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a73a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a73a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a73ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a73b70 g_io_schedule_up() at g_io_schedule_up+0x4c/frame 0xfffffe0037a73ba0 g_up_procbody() at g_up_procbody+0x5c/frame 0xfffffe0037a73bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a73bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a73bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100064 td 0xfffffe003e1c4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a78a50 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a78a90 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a78ad0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a78b70 g_io_schedule_down() at g_io_schedule_down+0x4c/frame 0xfffffe0037a78ba0 g_down_procbody() at g_down_procbody+0x5c/frame 0xfffffe0037a78bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a78bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a78bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100016 td 0xfffffe003e3e5800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb3ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb3b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100017 td 0xfffffe003e3fc300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addb8ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00addb8b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00addb8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addb8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addb8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100019 td 0xfffffe003e3fb500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100047 td 0xfffffe003e1cd700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377feae0 mi_switch() at mi_switch+0x159/frame 0xfffffe00377feb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe00377febb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377febf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377febf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100048 td 0xfffffe003e1cd000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a04ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a04b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a04bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a04bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a04bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100049 td 0xfffffe003e1dc800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a09ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a09b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100050 td 0xfffffe003e1dc100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a0eae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a0eb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a0ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a0ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a0ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100051 td 0xfffffe003e1dba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a13ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a13b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a13bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a13bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a13bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100052 td 0xfffffe003e1db300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a18ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a18b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a18bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a18bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a18bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100053 td 0xfffffe003e1dac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a1dae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a1db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a1dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a1dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a1dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100054 td 0xfffffe003e1da500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a22ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a22b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a22bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a22bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a22bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100055 td 0xfffffe003e1c1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a27ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a27b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a27bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a27bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a27bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100056 td 0xfffffe003e1d0800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a2cae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a2cb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a2cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a2cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a2cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100057 td 0xfffffe003e1d0100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a31ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a31b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a31bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a31bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a31bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100058 td 0xfffffe003e1cfa00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a36ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a36b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a36bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a36bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a36bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100059 td 0xfffffe003e1cf300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a3bae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a3bb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037a3bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a3bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a3bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100060 td 0xfffffe003e1cec00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100094 td 0xfffffe003e188100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1aae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1ab20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100095 td 0xfffffe00d2d89c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b1fae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b1fb20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b1fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b1fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b1fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100101 td 0xfffffe003e474100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b3dae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b3db20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b3dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b3dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b3dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100112 td 0xfffffe00d2e23a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100113 td 0xfffffe00d2e23300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b79ae0 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b79b20 ithread_loop() at ithread_loop+0x99/frame 0xfffffe0037b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100176 td 0xfffffe00e383ea00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100177 td 0xfffffe00e383e300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100178 td 0xfffffe00e383dc00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100179 td 0xfffffe00e383d500 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100180 td 0xfffffe00e39f6100 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100181 td 0xfffffe00e39f5a00 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100182 td 0xfffffe00e39f5300 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100183 td 0xfffffe00e39f4c00 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xfffffe003e3e4300 (CPU 0) cpustop_handler() at cpustop_handler+0x2a/frame 0xffffffff81d87450 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xffffffff81d87470 trap() at trap+0x56/frame 0xffffffff81d875a0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81d875a0 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add72ac0, rbp = 0xfffffe00add72ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add72ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add72bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add72bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add72bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100004 td 0xfffffe003e3e3c00 (CPU 1) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e17fdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e17fdf0 trap() at trap+0x56/frame 0xfffffe003e17ff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e17ff20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add77ac0, rbp = 0xfffffe00add77ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add77ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add77bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add77bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add77bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffffe003e3e3500 (CPU 2) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e18bdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e18bdf0 trap() at trap+0x56/frame 0xfffffe003e18bf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e18bf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add7cac0, rbp = 0xfffffe00add7cad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add7cad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add7cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add7cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add7cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffffe003e3e2e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add81a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add81ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add81bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add81bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add81bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffffe003e3e2700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add86a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add86ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add86bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add86bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add86bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100008 td 0xfffffe003e3e2000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add8ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add8bad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add8bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add8bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add8bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100009 td 0xfffffe003e3eca00 (CPU 6) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1bbdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1bbdf0 trap() at trap+0x56/frame 0xfffffe003e1bbf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1bbf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add90ac0, rbp = 0xfffffe00add90ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add90ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add90bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add90bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add90bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100010 td 0xfffffe003e3ec300 (CPU 7) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1c7dd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1c7df0 trap() at trap+0x56/frame 0xfffffe003e1c7f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1c7f20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add95ac0, rbp = 0xfffffe00add95ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add95ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add95bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add95bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add95bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100011 td 0xfffffe003e3ebc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add9aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00add9aad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00add9abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100012 td 0xfffffe003e3eb500 (CPU 9) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1dfdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1dfdf0 trap() at trap+0x56/frame 0xfffffe003e1dff20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1dff20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00add9fac0, rbp = 0xfffffe00add9fad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00add9fad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00add9fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add9fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add9fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100013 td 0xfffffe003e3eae00 (CPU 10) cpustop_handler() at cpustop_handler+0x2a/frame 0xfffffe003e1ebdd0 ipi_nmi_handler() at ipi_nmi_handler+0x3d/frame 0xfffffe003e1ebdf0 trap() at trap+0x56/frame 0xfffffe003e1ebf20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe003e1ebf20 --- trap 0x13, rip = 0xffffffff81032e4e, rsp = 0xfffffe00adda4ac0, rbp = 0xfffffe00adda4ad0 --- cpu_idle() at cpu_idle+0xee/frame 0xfffffe00adda4ad0 sched_idletd() at sched_idletd+0x3e1/frame 0xfffffe00adda4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100014 td 0xfffffe003e3ea700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00adda9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00adda9ad0 sched_idletd() at sched_idletd+0x9e/frame 0xfffffe00adda9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00adda9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00adda9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffffe003e3e4a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add6d6b0 mi_switch() at mi_switch+0x159/frame 0xfffffe00add6d6f0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add6d730 sleepq_catch_signals() at sleepq_catch_signals+0x3f2/frame 0xfffffe00add6d790 sleepq_wait_sig() at sleepq_wait_sig+0x9/frame 0xfffffe00add6d7a0 _sleep() at _sleep+0x2c3/frame 0xfffffe00add6d840 kern_wait6() at kern_wait6+0x482/frame 0xfffffe00add6d8d0 sys_wait4() at sys_wait4+0x78/frame 0xfffffe00add6dac0 amd64_syscall() at amd64_syscall+0x2ee/frame 0xfffffe00add6dbf0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe00add6dbf0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x2b2bfa, rsp = 0x7fffffffe768, rbp = 0x7fffffffe7d0 --- Tracing command audit pid 10 tid 100001 td 0xfffffe003e3e5100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00add68a70 mi_switch() at mi_switch+0x159/frame 0xfffffe00add68ab0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00add68af0 _cv_wait() at _cv_wait+0x15a/frame 0xfffffe00add68b50 audit_worker() at audit_worker+0x9f/frame 0xfffffe00add68bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00add68bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00add68bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81d9e1c0 sched_switch() at sched_switch+0x5ba/frame 0xffffffff822ffbf0 mi_switch() at mi_switch+0x159/frame 0xffffffff822ffc30 sleepq_switch() at sleepq_switch+0x11a/frame 0xffffffff822ffc70 sleepq_timedwait() at sleepq_timedwait+0x4b/frame 0xffffffff822ffcb0 _sleep() at _sleep+0x26c/frame 0xffffffff822ffd50 swapper() at swapper+0x75/frame 0xffffffff822ffda0 mi_startup() at mi_startup+0x2ed/frame 0xffffffff822ffdf0 btext() at btext+0x2c Tracing command kernel pid 0 tid 100015 td 0xfffffe003e3ea000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addaea60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addaeaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addaeae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addaeb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addaebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addaebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addaebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xfffffe003e3fbc00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addbda60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addbdaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addbdae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addbdb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addbdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addbdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addbdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffffe003e3fae00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addc7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00addc7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addc7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00addc7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00addc7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addc7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addc7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xfffffe003e3fa700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00addcca60 mi_switch() at mi_switch+0x159/frame 0xfffffe00addccaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00addccae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00addccb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00addccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00addccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00addccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffffe003e3fa000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037781a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037781ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037781b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037781b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037781bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037781bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037781bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffffe003e3ed800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037786a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037786ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037786b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037786b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037786bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037786bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037786bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffffe003e3ed100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003778ba90 mi_switch() at mi_switch+0x159/frame 0xfffffe003778bad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003778bb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003778bb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003778bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003778bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003778bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xfffffe003e1f2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037790a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037790ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037790b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037790b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037790bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037790bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037790bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xfffffe003e1f2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037795a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037795ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037795b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037795b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe0037795bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037795bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037795bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffffe003e1f1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779aa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779aad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779ab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779ab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779abb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779abf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779abf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffffe003e1f1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe003779fa90 mi_switch() at mi_switch+0x159/frame 0xfffffe003779fad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe003779fb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe003779fb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe003779fbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe003779fbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe003779fbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100029 td 0xfffffe003e1f1000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100030 td 0xfffffe003e3fd800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377a9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377a9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377a9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377a9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377a9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377a9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377a9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100031 td 0xfffffe003e3fd100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377aea90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377aead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377aeb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377aeb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377aebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377aebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377aebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100032 td 0xfffffe003e3fca00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b3a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b3ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b3b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b3b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b3bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b3bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b3bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffffe003e1e6500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377b8a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377b8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377b8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377b8b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377b8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377b8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377b8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffffe003e1e5e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377bda90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377bdad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377bdb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377bdb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377bdbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377bdbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377bdbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100035 td 0xfffffe003e1e5700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c2a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c2b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100036 td 0xfffffe003e1e5000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377c7a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377c7ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377c7b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377c7b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377c7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377c7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377c7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100037 td 0xfffffe003e1f4800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377cca90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377ccad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377ccb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377ccb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377ccbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377ccbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377ccbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100038 td 0xfffffe003e1f4100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d1a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d1ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d1b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d1b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffffe003e1f3a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377d6a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377d6ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377d6b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377d6b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377d6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377d6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377d6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100040 td 0xfffffe003e1f3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377dba90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377dbad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377dbb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377dbb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377dbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377dbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377dbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffffe003e1d9e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e0a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e0ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e0b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e0b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100042 td 0xfffffe003e1d9700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377e5a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377e5ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377e5b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377e5b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377e5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377e5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377e5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100043 td 0xfffffe003e1d9000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377eaa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377eaad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377eab10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377eab80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377eabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377eabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377eabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100044 td 0xfffffe003e1e8800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377efa90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377efad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377efb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377efb80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377efbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377efbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377efbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100045 td 0xfffffe003e1e8100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f4a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f4ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f4b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f4b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f4bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f4bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f4bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100046 td 0xfffffe003e1e7a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00377f9a90 mi_switch() at mi_switch+0x159/frame 0xfffffe00377f9ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00377f9b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe00377f9b80 gtaskqueue_thread_loop() at gtaskqueue_thread_loop+0xf1/frame 0xfffffe00377f9bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00377f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00377f9bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xfffffe003e1ce500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a69a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a69aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a69ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a69b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a69bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a69bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a69bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100066 td 0xfffffe003e1c3300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a8ea60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a8eaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a8eae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a8eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a8ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a8ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a8ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100067 td 0xfffffe003e1c2c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a93a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a93aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a93ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a93b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a93bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a93bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a93bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xfffffe003e1c2500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a98a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a98aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a98ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a98b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a98bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a98bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a98bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xfffffe003e1c1e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037a9da60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037a9daa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037a9dae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037a9db80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037a9dbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037a9dbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037a9dbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100070 td 0xfffffe003e1c1700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa2a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa2aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa2ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xfffffe003e194100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aa7a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aa7aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aa7ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aa7b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aa7bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aa7bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aa7bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100072 td 0xfffffe003e193a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037aaca60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037aacaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037aacae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037aacb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037aacbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037aacbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037aacbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100073 td 0xfffffe003e193300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab1a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab1aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab1ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab1b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab1bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab1bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab1bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xfffffe003e192c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ab6a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ab6aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ab6ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ab6b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ab6bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ab6bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ab6bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100075 td 0xfffffe003e192500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037abba60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037abbaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037abbae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037abbb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037abbbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037abbbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037abbbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100076 td 0xfffffe003e191e00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac0a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100077 td 0xfffffe003e191700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ac5a60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ac5aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ac5ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037ac5b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037ac5bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ac5bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ac5bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100114 td 0xfffffe00d2e22c00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037b7ea90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037b7ead0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037b7eb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037b7eb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037b7ebb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037b7ebf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037b7ebf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100120 td 0xfffffe00d609c800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037ba8a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037ba8ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037ba8b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037ba8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037ba8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037ba8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037ba8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100121 td 0xfffffe00d609c100 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bada90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037badad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037badb10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037badb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037badbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037badbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037badbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100122 td 0xfffffe00d609ba00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bb2a90 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bb2ad0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bb2b10 msleep_spin_sbt() at msleep_spin_sbt+0x152/frame 0xfffffe0037bb2b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xf1/frame 0xfffffe0037bb2bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bb2bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bb2bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100124 td 0xfffffe00d609ac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe0037bbca60 mi_switch() at mi_switch+0x159/frame 0xfffffe0037bbcaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe0037bbcae0 _sleep() at _sleep+0x2cd/frame 0xfffffe0037bbcb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe0037bbcbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe0037bbcbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0037bbcbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100425 td 0xfffffe00e430ac00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7a09a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7a09aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7a09ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7a09b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7a09bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7a09bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7a09bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100441 td 0xfffffe00e650e000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b88a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b88aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b88ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b88b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b88bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b88bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b88bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100448 td 0xfffffe00e650c300 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7aeaa60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7aeaaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7aeaae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7aeab80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7aeabb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7aeabf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7aeabf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100462 td 0xfffffe00e633d800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b2ba60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b2baa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b2bae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b2bb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b2bbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b2bbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b2bbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100464 td 0xfffffe00e6510a00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b79a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b79aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b79ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b79b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b79bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b79bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b79bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100901 td 0xfffffe00e6349500 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b1ca60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b1caa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b1cae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b1cb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b1cbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b1cbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b1cbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100909 td 0xfffffe00e4305000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b03a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b03aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b03ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b03b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b03bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b03bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b03bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100918 td 0xfffffe00e650ee00 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7bb0a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7bb0aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7bb0ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7bb0b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7bb0bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7bb0bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7bb0bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100926 td 0xfffffe00e6348700 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b97a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b97aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b97ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b97b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b97bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b97bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b97bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101175 td 0xfffffe00e660c000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e51e8a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e51e8aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e51e8ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e51e8b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e51e8bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e51e8bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e51e8bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101189 td 0xfffffe00e6789800 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7a40a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7a40aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7a40ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7a40b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7a40bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7a40bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7a40bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101322 td 0xfffffe00e65ce000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7b65a60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7b65aa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7b65ae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7b65b80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7b65bb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7b65bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7b65bf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 101394 td 0xfffffe00e4301000 sched_switch() at sched_switch+0x5ba/frame 0xfffffe00e7baba60 mi_switch() at mi_switch+0x159/frame 0xfffffe00e7babaa0 sleepq_switch() at sleepq_switch+0x11a/frame 0xfffffe00e7babae0 _sleep() at _sleep+0x2cd/frame 0xfffffe00e7babb80 taskqueue_thread_loop() at taskqueue_thread_loop+0xb1/frame 0xfffffe00e7babbb0 fork_exit() at fork_exit+0x80/frame 0xfffffe00e7babbf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00e7babbf0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:pho> show allchains chain 1: thread 100678 (pid 76041, rename14) sleeping on 0xfffff805e81ba780 "uwait" chain 2: thread 100602 (pid 76041, rename14) sleeping on 0xffffffff81c82719 "nanslp" chain 3: thread 107225 (pid 76040, rename14) sleeping on 0xfffff806e3700200 "uwait" chain 4: thread 100651 (pid 76040, rename14) sleeping on 0xffffffff81c82717 "nanslp" chain 5: thread 100666 (pid 76040, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 6: thread 104624 (pid 76039, rename14) sleeping on 0xfffff8065fdb9800 "uwait" chain 7: thread 100649 (pid 76039, rename14) sleeping on 0xffffffff81c8271a "nanslp" chain 8: thread 106208 (pid 76038, rename14) sleeping on 0xfffff8014bdb3800 "uwait" chain 9: thread 100653 (pid 76038, rename14) sleeping on 0xffffffff81c82712 "nanslp" chain 10: thread 100670 (pid 76038, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 11: thread 105144 (pid 76037, rename14) sleeping on 0xfffff806d091e880 "uwait" chain 12: thread 100661 (pid 76037, rename14) sleeping on 0xffffffff81c82710 "nanslp" chain 13: thread 100672 (pid 76037, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 14: thread 103765 (pid 76036, rename14) sleeping on 0xfffff8011c6f9180 "uwait" chain 15: thread 100659 (pid 76036, rename14) sleeping on 0xffffffff81c82718 "nanslp" chain 16: thread 100329 (pid 76035, rename14) sleeping on 0xfffff8002072fa80 "uwait" chain 17: thread 100660 (pid 76035, rename14) sleeping on 0xffffffff81c82717 "nanslp" chain 18: thread 100669 (pid 76035, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 19: thread 100357 (pid 76034, rename14) sleeping on 0xfffff802c1a8b580 "uwait" chain 20: thread 100650 (pid 76034, rename14) sleeping on 0xffffffff81c82711 "nanslp" chain 21: thread 102733 (pid 76033, rename14) sleeping on 0xfffff8065fd1f980 "uwait" chain 22: thread 100143 (pid 76033, rename14) sleeping on 0xffffffff81c82718 "nanslp" chain 23: thread 100654 (pid 76033, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 24: thread 104173 (pid 76032, rename14) sleeping on 0xfffff80137882400 "uwait" chain 25: thread 100664 (pid 76032, rename14) sleeping on 0xffffffff81c82716 "nanslp" chain 26: thread 100671 (pid 76032, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 27: thread 103300 (pid 76031, sleep) sleeping on 0xffffffff81c82718 "nanslp" chain 28: thread 101968 (pid 62552, rename14) sleeping on 0xfffff8082aaf7a60 "wait" chain 29: thread 104686 (pid 62517, md10) sleeping on 0xfffff807d48a3000 "mdwait" chain 30: thread 107258 (pid 62408, sh) sleeping on 0xfffff8003ca40a60 "wait" chain 31: thread 103371 (pid 62407, tee) sleeping on 0xfffff807c556c5f0 "piperd" chain 32: thread 104183 (pid 62406, sh) sleeping on 0xfffff8043d37e530 "wait" chain 33: thread 106129 (pid 89141, aiod4) sleeping on 0xfffff806cc285a60 "aiordy" chain 34: thread 103093 (pid 89140, aiod3) sleeping on 0xfffff803f75b1a60 "aiordy" chain 35: thread 103781 (pid 89139, aiod2) sleeping on 0xfffff803f7f39000 "aiordy" chain 36: thread 102160 (pid 89138, aiod1) sleeping on 0xfffff80767138000 "aiordy" chain 37: thread 100243 (pid 36542, ftcleanup) sleeping on 0xffffffff82e1d4f4 "ftcl" chain 38: thread 100287 (pid 10274, sh) sleeping on 0xfffff800208ddbe0 "piperd" chain 39: thread 100272 (pid 10272, awk) sleeping on 0xfffff80020773000 "piperd" chain 40: thread 100200 (pid 10271, sh) sleeping on 0xfffff8002083a000 "wait" chain 41: thread 100234 (pid 10232, sh) sleeping on 0xfffff80020c6b000 "wait" chain 42: thread 100160 (pid 2367, sh) sleeping on 0xfffff80020706000 "wait" chain 43: thread 100190 (pid 2355, bash) sleeping on 0xfffff8002072e840 "select" chain 44: thread 100173 (pid 2352, csh) sleeping on 0xfffff80004176b08 "pause" chain 45: thread 100147 (pid 2351, su) sleeping on 0xfffff80003893000 "wait" chain 46: thread 100170 (pid 2345, bash) sleeping on 0xfffff800209a8000 "wait" chain 47: thread 100208 (pid 2344, sshd) sleeping on 0xfffff8002030ecc0 "select" chain 48: thread 100168 (pid 2341, sshd) sleeping on 0xfffff8002030e5c0 "select" chain 49: thread 100151 (pid 2337, csh) sleeping on 0xfffff80017036cb0 "ttyin" chain 50: thread 100212 (pid 2330, login) sleeping on 0xfffff802c5adc000 "wait" chain 51: thread 100211 (pid 2329, getty) sleeping on 0xfffff800170350b0 "ttyin" chain 52: thread 100159 (pid 2328, getty) sleeping on 0xfffff800201878b0 "ttyin" chain 53: thread 100210 (pid 2327, getty) sleeping on 0xfffff80020187cb0 "ttyin" chain 54: thread 100209 (pid 2326, getty) sleeping on 0xfffff800201860b0 "ttyin" chain 55: thread 100193 (pid 2325, getty) sleeping on 0xfffff800201864b0 "ttyin" chain 56: thread 100185 (pid 2324, getty) sleeping on 0xfffff800201868b0 "ttyin" chain 57: thread 100174 (pid 2323, getty) sleeping on 0xfffff80020186cb0 "ttyin" chain 58: thread 100171 (pid 2322, getty) sleeping on 0xfffff800201850b0 "ttyin" chain 59: thread 100142 (pid 2321, getty) sleeping on 0xfffff800201854b0 "ttyin" chain 60: thread 100163 (pid 2275, cron) sleeping on 0xffffffff81c8271b "nanslp" chain 61: thread 100191 (pid 2271, sshd) sleeping on 0xfffff80020547f40 "select" chain 62: thread 100150 (pid 2243, powerd) sleeping on 0xfffff8002014b2c0 "select" chain 63: thread 100201 (pid 2240, ntpd) sleeping on 0xfffff80020248740 "select" chain 64: thread 100172 (pid 2175, NLM: master) sleeping on 0xfffff800207d3460 "rpcsvc" chain 65: thread 100148 (pid 2172, rpc.statd) sleeping on 0xfffff80020280dc0 "select" chain 66: thread 100192 (pid 2126, watchdogd) sleeping on 0xffffffff81c8271b "nanslp" chain 67: thread 100166 (pid 2047, rpcbind) sleeping on 0xfffff800039e7e40 "select" chain 68: thread 100184 (pid 2037, syslogd) sleeping on 0xfffff800039e7ec0 "select" chain 69: thread 100145 (pid 1966, devd) sleeping on 0xfffff8002072d340 "select" chain 70: thread 100158 (pid 1961, dhclient) sleeping on 0xfffff8002014b340 "select" chain 71: thread 100162 (pid 1914, dhclient) sleeping on 0xfffff800039f7e40 "select" chain 72: thread 100144 (pid 1911, dhclient) sleeping on 0xfffff8002030e640 "select" chain 73: thread 100140 (pid 34, vnlru) sleeping on 0xfffff80004148a60 "vlruwt" chain 74: thread 100138 (pid 33, syncer) sleeping on 0xffffffff81d58b98 "syncer" chain 75: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d58098 "qsleep" chain 76: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 77: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 78: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 79: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 80: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 81: thread 100136 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 82: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 83: thread 100152 (pid 32, / worker) sleeping on 0xfffff80020a73ce8 "sdflush" chain 84: thread 100199 (pid 32, /tmp worker) sleeping on 0xfffff800170ca8e8 "sdflush" chain 85: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 86: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 87: thread 100137 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 88: thread 100141 (pid 30, uma) sleeping on 0xffffffff80f0d610 "umarcl" chain 89: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80020233000 "idle" chain 90: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80020233530 "idle" chain 91: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 92: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 93: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 94: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 95: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 96: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 97: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 98: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 99: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 100: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 101: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 102: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 103: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 104: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 105: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 106: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 107: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 108: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 109: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 110: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 111: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 112: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 113: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 114: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 115: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003b12c50 "crypto_ret_wait" chain 116: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003b12bf0 "crypto_ret_wait" chain 117: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003b12b90 "crypto_ret_wait" chain 118: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003b12b30 "crypto_ret_wait" chain 119: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003b12ad0 "crypto_ret_wait" chain 120: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003b12a70 "crypto_ret_wait" chain 121: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003b12a10 "crypto_ret_wait" chain 122: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003b129b0 "crypto_ret_wait" chain 123: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003b12950 "crypto_ret_wait" chain 124: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003b128f0 "crypto_ret_wait" chain 125: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003b12890 "crypto_ret_wait" chain 126: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003b12830 "crypto_ret_wait" chain 127: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 128: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a75888 "seqstate" chain 129: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 130: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 131: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 132: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 133: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 134: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 135: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 136: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 137: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 138: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 139: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 140: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 141: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 142: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 143: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 144: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 145: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 146: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 147: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 148: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 149: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 150: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 151: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 152: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 153: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 154: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 155: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 156: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 157: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 158: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 159: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 160: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 161: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 162: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 163: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 164: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a12400 "-" chain 165: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a13d00 "-" chain 166: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a13d00 "-" chain 167: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a13d00 "-" chain 168: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a13d00 "-" chain 169: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a13d00 "-" chain 170: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a13d00 "-" chain 171: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a13d00 "-" chain 172: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a13d00 "-" chain 173: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a13d00 "-" chain 174: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a13d00 "-" chain 175: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a13d00 "-" chain 176: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a13d00 "-" chain 177: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800041f9d00 "-" chain 178: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800200e2900 "-" chain 179: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800200e2900 "-" chain 180: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800200e2900 "-" chain 181: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a14100 "-" chain 182: thread 100425 (pid 0, dtrace_taskq) sleeping on 0xfffff80423608400 "-" chain 183: thread 100441 (pid 0, system_taskq_0) sleeping on 0xfffff80189a1e300 "-" chain 184: thread 100448 (pid 0, system_taskq_1) sleeping on 0xfffff80189a1e300 "-" chain 185: thread 100462 (pid 0, system_taskq_2) sleeping on 0xfffff80189a1e300 "-" chain 186: thread 100464 (pid 0, system_taskq_3) sleeping on 0xfffff80189a1e300 "-" chain 187: thread 100901 (pid 0, system_taskq_4) sleeping on 0xfffff80189a1e300 "-" chain 188: thread 100909 (pid 0, system_taskq_5) sleeping on 0xfffff80189a1e300 "-" chain 189: thread 100918 (pid 0, system_taskq_6) sleeping on 0xfffff80189a1e300 "-" chain 190: thread 100926 (pid 0, system_taskq_7) sleeping on 0xfffff80189a1e300 "-" chain 191: thread 101175 (pid 0, system_taskq_8) sleeping on 0xfffff80189a1e300 "-" chain 192: thread 101189 (pid 0, system_taskq_9) sleeping on 0xfffff80189a1e300 "-" chain 193: thread 101322 (pid 0, system_taskq_10) sleeping on 0xfffff80189a1e300 "-" chain 194: thread 101394 (pid 0, system_taskq_11) sleeping on 0xfffff80189a1e300 "-" db:0:pho> chain 1: thread 100678 (pid 76041, rename14) sleeping on 0xfffff805e81ba780 "uwait" chain 2: thread 100602 (pid 76041, rename14) sleeping on 0xffffffff81c82719 "nanslp" chain 3: thread 107225 (pid 76040, rename14) sleeping on 0xfffff806e3700200 "uwait" chain 4: thread 100651 (pid 76040, rename14) sleeping on 0xffffffff81c82717 "nanslp" chain 5: thread 100666 (pid 76040, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 6: thread 104624 (pid 76039, rename14) sleeping on 0xfffff8065fdb9800 "uwait" chain 7: thread 100649 (pid 76039, rename14) sleeping on 0xffffffff81c8271a "nanslp" chain 8: thread 106208 (pid 76038, rename14) sleeping on 0xfffff8014bdb3800 "uwait" chain 9: thread 100653 (pid 76038, rename14) sleeping on 0xffffffff81c82712 "nanslp" chain 10: thread 100670 (pid 76038, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 11: thread 105144 (pid 76037, rename14) sleeping on 0xfffff806d091e880 "uwait" chain 12: thread 100661 (pid 76037, rename14) sleeping on 0xffffffff81c82710 "nanslp" chain 13: thread 100672 (pid 76037, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 14: thread 103765 (pid 76036, rename14) sleeping on 0xfffff8011c6f9180 "uwait" chain 15: thread 100659 (pid 76036, rename14) sleeping on 0xffffffff81c82718 "nanslp" chain 16: thread 100329 (pid 76035, rename14) sleeping on 0xfffff8002072fa80 "uwait" chain 17: thread 100660 (pid 76035, rename14) sleeping on 0xffffffff81c82717 "nanslp" chain 18: thread 100669 (pid 76035, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 19: thread 100357 (pid 76034, rename14) sleeping on 0xfffff802c1a8b580 "uwait" chain 20: thread 100650 (pid 76034, rename14) sleeping on 0xffffffff81c82711 "nanslp" chain 21: thread 102733 (pid 76033, rename14) sleeping on 0xfffff8065fd1f980 "uwait" chain 22: thread 100143 (pid 76033, rename14) sleeping on 0xffffffff81c82718 "nanslp" chain 23: thread 100654 (pid 76033, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 24: thread 104173 (pid 76032, rename14) sleeping on 0xfffff80137882400 "uwait" chain 25: thread 100664 (pid 76032, rename14) sleeping on 0xffffffff81c82716 "nanslp" chain 26: thread 100671 (pid 76032, rename14) blocked on lockmgr ufsEXCL thread 100665 (pid 76039, rename14) running on CPU 8 chain 27: thread 103300 (pid 76031, sleep) sleeping on 0xffffffff81c82718 "nanslp" chain 28: thread 101968 (pid 62552, rename14) sleeping on 0xfffff8082aaf7a60 "wait" chain 29: thread 104686 (pid 62517, md10) sleeping on 0xfffff807d48a3000 "mdwait" chain 30: thread 107258 (pid 62408, sh) sleeping on 0xfffff8003ca40a60 "wait" chain 31: thread 103371 (pid 62407, tee) sleeping on 0xfffff807c556c5f0 "piperd" chain 32: thread 104183 (pid 62406, sh) sleeping on 0xfffff8043d37e530 "wait" chain 33: thread 106129 (pid 89141, aiod4) sleeping on 0xfffff806cc285a60 "aiordy" chain 34: thread 103093 (pid 89140, aiod3) sleeping on 0xfffff803f75b1a60 "aiordy" chain 35: thread 103781 (pid 89139, aiod2) sleeping on 0xfffff803f7f39000 "aiordy" chain 36: thread 102160 (pid 89138, aiod1) sleeping on 0xfffff80767138000 "aiordy" chain 37: thread 100243 (pid 36542, ftcleanup) sleeping on 0xffffffff82e1d4f4 "ftcl" chain 38: thread 100287 (pid 10274, sh) sleeping on 0xfffff800208ddbe0 "piperd" chain 39: thread 100272 (pid 10272, awk) sleeping on 0xfffff80020773000 "piperd" chain 40: thread 100200 (pid 10271, sh) sleeping on 0xfffff8002083a000 "wait" chain 41: thread 100234 (pid 10232, sh) sleeping on 0xfffff80020c6b000 "wait" chain 42: thread 100160 (pid 2367, sh) sleeping on 0xfffff80020706000 "wait" chain 43: thread 100190 (pid 2355, bash) sleeping on 0xfffff8002072e840 "select" chain 44: thread 100173 (pid 2352, csh) sleeping on 0xfffff80004176b08 "pause" chain 45: thread 100147 (pid 2351, su) sleeping on 0xfffff80003893000 "wait" chain 46: thread 100170 (pid 2345, bash) sleeping on 0xfffff800209a8000 "wait" chain 47: thread 100208 (pid 2344, sshd) sleeping on 0xfffff8002030ecc0 "select" chain 48: thread 100168 (pid 2341, sshd) sleeping on 0xfffff8002030e5c0 "select" chain 49: thread 100151 (pid 2337, csh) sleeping on 0xfffff80017036cb0 "ttyin" chain 50: thread 100212 (pid 2330, login) sleeping on 0xfffff802c5adc000 "wait" chain 51: thread 100211 (pid 2329, getty) sleeping on 0xfffff800170350b0 "ttyin" chain 52: thread 100159 (pid 2328, getty) sleeping on 0xfffff800201878b0 "ttyin" chain 53: thread 100210 (pid 2327, getty) sleeping on 0xfffff80020187cb0 "ttyin" chain 54: thread 100209 (pid 2326, getty) sleeping on 0xfffff800201860b0 "ttyin" chain 55: thread 100193 (pid 2325, getty) sleeping on 0xfffff800201864b0 "ttyin" chain 56: thread 100185 (pid 2324, getty) sleeping on 0xfffff800201868b0 "ttyin" chain 57: thread 100174 (pid 2323, getty) sleeping on 0xfffff80020186cb0 "ttyin" chain 58: thread 100171 (pid 2322, getty) sleeping on 0xfffff800201850b0 "ttyin" chain 59: thread 100142 (pid 2321, getty) sleeping on 0xfffff800201854b0 "ttyin" chain 60: thread 100163 (pid 2275, cron) sleeping on 0xffffffff81c8271b "nanslp" chain 61: thread 100191 (pid 2271, sshd) sleeping on 0xfffff80020547f40 "select" chain 62: thread 100150 (pid 2243, powerd) sleeping on 0xfffff8002014b2c0 "select" chain 63: thread 100201 (pid 2240, ntpd) sleeping on 0xfffff80020248740 "select" chain 64: thread 100172 (pid 2175, NLM: master) sleeping on 0xfffff800207d3460 "rpcsvc" chain 65: thread 100148 (pid 2172, rpc.statd) sleeping on 0xfffff80020280dc0 "select" chain 66: thread 100192 (pid 2126, watchdogd) sleeping on 0xffffffff81c8271b "nanslp" chain 67: thread 100166 (pid 2047, rpcbind) sleeping on 0xfffff800039e7e40 "select" chain 68: thread 100184 (pid 2037, syslogd) sleeping on 0xfffff800039e7ec0 "select" chain 69: thread 100145 (pid 1966, devd) sleeping on 0xfffff8002072d340 "select" chain 70: thread 100158 (pid 1961, dhclient) sleeping on 0xfffff8002014b340 "select" chain 71: thread 100162 (pid 1914, dhclient) sleeping on 0xfffff800039f7e40 "select" chain 72: thread 100144 (pid 1911, dhclient) sleeping on 0xfffff8002030e640 "select" chain 73: thread 100140 (pid 34, vnlru) sleeping on 0xfffff80004148a60 "vlruwt" chain 74: thread 100138 (pid 33, syncer) sleeping on 0xffffffff81d58b98 "syncer" chain 75: thread 100130 (pid 32, bufdaemon) sleeping on 0xffffffff81d58098 "qsleep" chain 76: thread 100131 (pid 32, bufspacedaemon-0) sleeping on 0xffffffff8180a980 "-" chain 77: thread 100132 (pid 32, bufspacedaemon-1) sleeping on 0xffffffff81812c40 "-" chain 78: thread 100133 (pid 32, bufspacedaemon-2) sleeping on 0xffffffff8181af00 "-" chain 79: thread 100134 (pid 32, bufspacedaemon-3) sleeping on 0xffffffff818231c0 "-" chain 80: thread 100135 (pid 32, bufspacedaemon-4) sleeping on 0xffffffff8182b480 "-" chain 81: thread 100136 (pid 32, bufspacedaemon-5) sleeping on 0xffffffff81833740 "-" chain 82: thread 100139 (pid 32, bufspacedaemon-6) sleeping on 0xffffffff8183ba00 "-" chain 83: thread 100152 (pid 32, / worker) sleeping on 0xfffff80020a73ce8 "sdflush" chain 84: thread 100199 (pid 32, /tmp worker) sleeping on 0xfffff800170ca8e8 "sdflush" chain 85: thread 100129 (pid 31, vmdaemon) sleeping on 0xffffffff81d73b08 "psleep" chain 86: thread 100128 (pid 30, dom0) sleeping on 0xffffffff81d9fa98 "psleep" chain 87: thread 100137 (pid 30, laundry: dom0) sleeping on 0xffffffff81d9faa4 "launds" chain 88: thread 100141 (pid 30, uma) sleeping on 0xffffffff80f0d610 "umarcl" chain 89: thread 100127 (pid 29, enc_daemon1) sleeping on 0xfffff80020233000 "idle" chain 90: thread 100126 (pid 28, enc_daemon0) sleeping on 0xfffff80020233530 "idle" chain 91: thread 100123 (pid 27, rand_harvestq) sleeping on 0xffffffff81adcfb0 "-" chain 92: thread 100119 (pid 26, sctp_iterator) sleeping on 0xffffffff81de5060 "waiting_for_work" chain 93: thread 100118 (pid 25, soaiod4) sleeping on 0xffffffff81d57a9c "-" chain 94: thread 100117 (pid 24, soaiod3) sleeping on 0xffffffff81d57a9c "-" chain 95: thread 100116 (pid 23, soaiod2) sleeping on 0xffffffff81d57a9c "-" chain 96: thread 100115 (pid 22, soaiod1) sleeping on 0xffffffff81d57a9c "-" chain 97: thread 100096 (pid 21, usbus0) sleeping on 0xfffffe00d2d84440 "-" chain 98: thread 100097 (pid 21, usbus0) sleeping on 0xfffffe00d2d84498 "-" chain 99: thread 100098 (pid 21, usbus0) sleeping on 0xfffffe00d2d844f0 "-" chain 100: thread 100099 (pid 21, usbus0) sleeping on 0xfffffe00d2d84548 "-" chain 101: thread 100100 (pid 21, usbus0) sleeping on 0xfffffe00d2d845a0 "-" chain 102: thread 100102 (pid 21, usbus1) sleeping on 0xfffffe003e4a1cf0 "-" chain 103: thread 100103 (pid 21, usbus1) sleeping on 0xfffffe003e4a1d48 "-" chain 104: thread 100104 (pid 21, usbus1) sleeping on 0xfffffe003e4a1da0 "-" chain 105: thread 100105 (pid 21, usbus1) sleeping on 0xfffffe003e4a1df8 "-" chain 106: thread 100106 (pid 21, usbus1) sleeping on 0xfffffe003e4a1e50 "-" chain 107: thread 100107 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bcf0 "-" chain 108: thread 100108 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bd48 "-" chain 109: thread 100109 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bda0 "-" chain 110: thread 100110 (pid 21, usbus2) sleeping on 0xfffffe00d2e2bdf8 "-" chain 111: thread 100111 (pid 21, usbus2) sleeping on 0xfffffe00d2e2be50 "-" chain 112: thread 100091 (pid 20, doneq0) sleeping on 0xffffffff819b83c0 "-" chain 113: thread 100093 (pid 20, doneq2) sleeping on 0xffffffff819b84c0 "-" chain 114: thread 100125 (pid 20, scanner) sleeping on 0xffffffff819b8288 "-" chain 115: thread 100090 (pid 19, crypto returns 11) sleeping on 0xfffff80003b12c50 "crypto_ret_wait" chain 116: thread 100089 (pid 18, crypto returns 10) sleeping on 0xfffff80003b12bf0 "crypto_ret_wait" chain 117: thread 100088 (pid 17, crypto returns 9) sleeping on 0xfffff80003b12b90 "crypto_ret_wait" chain 118: thread 100087 (pid 16, crypto returns 8) sleeping on 0xfffff80003b12b30 "crypto_ret_wait" chain 119: thread 100086 (pid 15, crypto returns 7) sleeping on 0xfffff80003b12ad0 "crypto_ret_wait" chain 120: thread 100085 (pid 9, crypto returns 6) sleeping on 0xfffff80003b12a70 "crypto_ret_wait" chain 121: thread 100084 (pid 8, crypto returns 5) sleeping on 0xfffff80003b12a10 "crypto_ret_wait" chain 122: thread 100083 (pid 7, crypto returns 4) sleeping on 0xfffff80003b129b0 "crypto_ret_wait" chain 123: thread 100082 (pid 6, crypto returns 3) sleeping on 0xfffff80003b12950 "crypto_ret_wait" chain 124: thread 100081 (pid 5, crypto returns 2) sleeping on 0xfffff80003b128f0 "crypto_ret_wait" chain 125: thread 100080 (pid 4, crypto returns 1) sleeping on 0xfffff80003b12890 "crypto_ret_wait" chain 126: thread 100079 (pid 3, crypto returns 0) sleeping on 0xfffff80003b12830 "crypto_ret_wait" chain 127: thread 100078 (pid 2, crypto) sleeping on 0xffffffff81d6db78 "crypto_wait" chain 128: thread 100065 (pid 14, sequencer 00) sleeping on 0xfffff80003a75888 "seqstate" chain 129: thread 100062 (pid 13, g_event) sleeping on 0xffffffff81d9e0c8 "-" chain 130: thread 100063 (pid 13, g_up) sleeping on 0xffffffff81d9e0d8 "-" chain 131: thread 100064 (pid 13, g_down) sleeping on 0xffffffff81d9e0d0 "-" chain 132: thread 100002 (pid 1, init) sleeping on 0xfffff80003896000 "wait" chain 133: thread 100001 (pid 10, audit) sleeping on 0xffffffff81de5cf0 "audit_worker_cv" chain 134: thread 100000 (pid 0, swapper) sleeping on 0xffffffff81d8d688 "swapin" chain 135: thread 100015 (pid 0, aiod_kick taskq) sleeping on 0xfffff8000377f100 "-" chain 136: thread 100018 (pid 0, thread taskq) sleeping on 0xfffff8000377ea00 "-" chain 137: thread 100020 (pid 0, config_0) sleeping on 0xfffff80003777000 "-" chain 138: thread 100021 (pid 0, kqueue_ctx taskq) sleeping on 0xfffff8000377e500 "-" chain 139: thread 100022 (pid 0, if_io_tqg_0) sleeping on 0xfffff80003776e00 "-" chain 140: thread 100023 (pid 0, if_io_tqg_1) sleeping on 0xfffff80003776d00 "-" chain 141: thread 100024 (pid 0, if_io_tqg_2) sleeping on 0xfffff80003776c00 "-" chain 142: thread 100025 (pid 0, if_io_tqg_3) sleeping on 0xfffff80003776b00 "-" chain 143: thread 100026 (pid 0, if_io_tqg_4) sleeping on 0xfffff80003776a00 "-" chain 144: thread 100027 (pid 0, if_io_tqg_5) sleeping on 0xfffff80003776900 "-" chain 145: thread 100028 (pid 0, if_io_tqg_6) sleeping on 0xfffff80003776800 "-" chain 146: thread 100029 (pid 0, if_io_tqg_7) sleeping on 0xfffff80003776700 "-" chain 147: thread 100030 (pid 0, if_io_tqg_8) sleeping on 0xfffff80003776600 "-" chain 148: thread 100031 (pid 0, if_io_tqg_9) sleeping on 0xfffff80003776500 "-" chain 149: thread 100032 (pid 0, if_io_tqg_10) sleeping on 0xfffff80003776400 "-" chain 150: thread 100033 (pid 0, if_io_tqg_11) sleeping on 0xfffff80003776300 "-" chain 151: thread 100034 (pid 0, if_config_tqg_0) sleeping on 0xfffff80003776200 "-" chain 152: thread 100035 (pid 0, softirq_0) sleeping on 0xfffff80003776100 "-" chain 153: thread 100036 (pid 0, softirq_1) sleeping on 0xfffff80003776000 "-" chain 154: thread 100037 (pid 0, softirq_2) sleeping on 0xfffff80003775e00 "-" chain 155: thread 100038 (pid 0, softirq_3) sleeping on 0xfffff80003775d00 "-" chain 156: thread 100039 (pid 0, softirq_4) sleeping on 0xfffff80003775c00 "-" chain 157: thread 100040 (pid 0, softirq_5) sleeping on 0xfffff80003775b00 "-" chain 158: thread 100041 (pid 0, softirq_6) sleeping on 0xfffff80003775a00 "-" chain 159: thread 100042 (pid 0, softirq_7) sleeping on 0xfffff80003775900 "-" chain 160: thread 100043 (pid 0, softirq_8) sleeping on 0xfffff80003775800 "-" chain 161: thread 100044 (pid 0, softirq_9) sleeping on 0xfffff80003775700 "-" chain 162: thread 100045 (pid 0, softirq_10) sleeping on 0xfffff80003775600 "-" chain 163: thread 100046 (pid 0, softirq_11) sleeping on 0xfffff80003775500 "-" chain 164: thread 100061 (pid 0, firmware taskq) sleeping on 0xfffff80003a12400 "-" chain 165: thread 100066 (pid 0, crypto_0) sleeping on 0xfffff80003a13d00 "-" chain 166: thread 100067 (pid 0, crypto_1) sleeping on 0xfffff80003a13d00 "-" chain 167: thread 100068 (pid 0, crypto_2) sleeping on 0xfffff80003a13d00 "-" chain 168: thread 100069 (pid 0, crypto_3) sleeping on 0xfffff80003a13d00 "-" chain 169: thread 100070 (pid 0, crypto_4) sleeping on 0xfffff80003a13d00 "-" chain 170: thread 100071 (pid 0, crypto_5) sleeping on 0xfffff80003a13d00 "-" chain 171: thread 100072 (pid 0, crypto_6) sleeping on 0xfffff80003a13d00 "-" chain 172: thread 100073 (pid 0, crypto_7) sleeping on 0xfffff80003a13d00 "-" chain 173: thread 100074 (pid 0, crypto_8) sleeping on 0xfffff80003a13d00 "-" chain 174: thread 100075 (pid 0, crypto_9) sleeping on 0xfffff80003a13d00 "-" chain 175: thread 100076 (pid 0, crypto_10) sleeping on 0xfffff80003a13d00 "-" chain 176: thread 100077 (pid 0, crypto_11) sleeping on 0xfffff80003a13d00 "-" chain 177: thread 100114 (pid 0, mca taskq) sleeping on 0xfffff800041f9d00 "-" chain 178: thread 100120 (pid 0, acpi_task_0) sleeping on 0xfffff800200e2900 "-" chain 179: thread 100121 (pid 0, acpi_task_1) sleeping on 0xfffff800200e2900 "-" chain 180: thread 100122 (pid 0, acpi_task_2) sleeping on 0xfffff800200e2900 "-" chain 181: thread 100124 (pid 0, CAM taskq) sleeping on 0xfffff80003a14100 "-" chain 182: thread 100425 (pid 0, dtrace_taskq) sleeping on 0xfffff80423608400 "-" chain 183: thread 100441 (pid 0, system_taskq_0) sleeping on 0xfffff80189a1e300 "-" chain 184: thread 100448 (pid 0, system_taskq_1) sleeping on 0xfffff80189a1e300 "-" chain 185: thread 100462 (pid 0, system_taskq_2) sleeping on 0xfffff80189a1e300 "-" chain 186: thread 100464 (pid 0, system_taskq_3) sleeping on 0xfffff80189a1e300 "-" chain 187: thread 100901 (pid 0, system_taskq_4) sleeping on 0xfffff80189a1e300 "-" chain 188: thread 100909 (pid 0, system_taskq_5) sleeping on 0xfffff80189a1e300 "-" chain 189: thread 100918 (pid 0, system_taskq_6) sleeping on 0xfffff80189a1e300 "-" chain 190: thread 100926 (pid 0, system_taskq_7) sleeping on 0xfffff80189a1e300 "-" chain 191: thread 101175 (pid 0, system_taskq_8) sleeping on 0xfffff80189a1e300 "-" chain 192: thread 101189 (pid 0, system_taskq_9) sleeping on 0xfffff80189a1e300 "-" chain 193: thread 101322 (pid 0, system_taskq_10) sleeping on 0xfffff80189a1e300 "-" chain 194: thread 101394 (pid 0, system_taskq_11) sleeping on 0xfffff80189a1e300 "-" db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 8 (kgdb) bt #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=0x0) at ../../../kern/kern_shutdown.c:393 #2 0xffffffff8049bb3a in db_dump (dummy=, dummy2=, dummy3=, dummy4=) at ../../../ddb/db_command.c:575 #3 0xffffffff8049b8fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #4 0xffffffff804a08c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #5 0xffffffff8049b8fc in db_command (last_cmdp=, cmd_table=, dopager=0x0) at ../../../ddb/db_command.c:482 #6 0xffffffff804a08c8 in db_script_exec (scriptname=, warnifnotfound=) at ../../../ddb/db_script.c:304 #7 0xffffffff8049b8fc in db_command (last_cmdp=, cmd_table=, dopager=0x1) at ../../../ddb/db_command.c:482 #8 0xffffffff8049b66d in db_command_loop () at ../../../ddb/db_command.c:535 #9 0xffffffff8049e898 in db_trap (type=, code=) at ../../../ddb/db_main.c:252 #10 0xffffffff80c14717 in kdb_trap (type=0x3, code=0x0, tf=) at ../../../kern/subr_kdb.c:689 #11 0xffffffff81072aee in trap (frame=0xfffffe03447762f0) at ../../../amd64/amd64/trap.c:579 #12 #13 kdb_enter (why=0xffffffff81202c92 "panic", msg=) at ../../../kern/subr_kdb.c:476 #14 0xffffffff80bc9a31 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:899 #15 0xffffffff80bc97c3 in panic (fmt=0xffffffff81c7bf98 "Vn\034\201\377\377\377\377") at ../../../kern/kern_shutdown.c:836 #16 0xffffffff80ee2b4d in journal_jremref (dirrem=0xfffff8005ab65900, jremref=0xfffff80764841700, inodedep=) at ../../../ufs/ffs/ffs_softdep.c:9169 #17 0xffffffff80ed8653 in dirrem_journal (dirrem=, jremref=, dotremref=, dotdotremref=) at ../../../ufs/ffs/ffs_softdep.c:9192 #18 newdirrem (bp=0xfffff8041e194d00, dp=, ip=, isrmdir=, prevdirremp=0xfffffe0344776578) at ../../../ufs/ffs/ffs_softdep.c:9304 #19 0xffffffff80ed912a in softdep_setup_directory_change (bp=0xfffffe003b4db618, dp=0xfffff8057eabb500, ip=0xfffff80736f74000, newinum=0x1009c, isrmdir=0x2) at ../../../ufs/ffs/ffs_softdep.c:9401 #20 0xffffffff80ef6235 in ufs_dirrewrite (dp=0xfffff8057eabb500, oip=0xfffff80736f74000, newinum=0x1009c, newtype=0x4, isrmdir=0x2) at ../../../ufs/ufs/ufs_lookup.c:1337 #21 0xffffffff80efcda2 in ufs_rename (ap=) at ../../../ufs/ufs/ufs_vnops.c:1414 #22 0xffffffff810f0090 in VOP_RENAME_APV (vop=0xffffffff81959298 , a=0xfffffe0344776a28) at vnode_if.c:1432 #23 0xffffffff80cb52f0 in VOP_RENAME (fdvp=0x80, fcnp=, tcnp=0xfffffe03447768e8, fvp=, tdvp=, tvp=) at ./vnode_if.h:636 #24 kern_renameat (td=0xfffffe0130f61300, oldfd=0xffffff9c, old=0x7fffdfdfcf00 , newfd=0xffffff9c, new=0x7fffdfdfceb0 , pathseg=) at ../../../kern/vfs_syscalls.c:3607 #25 0xffffffff81073afe in syscallenter (td=0xfffffe0130f61300) at ../../../amd64/amd64/../../kern/subr_syscall.c:151 #26 amd64_syscall (td=0xfffffe0130f61300, traced=) at ../../../amd64/amd64/trap.c:1155 #27 #28 0x000000080030768a in ?? () Backtrace stopped: Cannot access memory at address 0x7fffdfdfce78 (kgdb) f 16 #16 0xffffffff80ee2b4d in journal_jremref (dirrem=0xfffff8005ab65900, jremref=0xfffff80764841700, inodedep=) at ../../../ufs/ffs/ffs_softdep.c:9169 9169 panic("journal_jremref: Lost inodedep"); (kgdb) l 9164 { 9165 9166 if (inodedep == NULL) 9167 if (inodedep_lookup(jremref->jr_list.wk_mp, 9168 jremref->jr_ref.if_ino, 0, &inodedep) == 0) 9169 panic("journal_jremref: Lost inodedep"); 9170 LIST_INSERT_HEAD(&dirrem->dm_jremrefhd, jremref, jr_deps); 9171 TAILQ_INSERT_TAIL(&inodedep->id_inoreflst, &jremref->jr_ref, if_deps); 9172 add_to_journal(&jremref->jr_list); 9173 } (kgdb) info loc No locals. (kgdb) p *dirrem $1 = {dm_list = {wk_list = {le_next = 0x0, le_prev = 0x0}, wk_mp = 0xfffffe00e63d1000, wk_type = 0xd, wk_state = 0x40, wk_func = 0x0, wk_line = 0x0, wk_all = {le_next = 0xfffff8060eb79b00, le_prev = 0xfffff8028e304e58}}, dm_next = {le_next = 0x0, le_prev = 0x0}, dm_inonext = { le_next = 0x0, le_prev = 0x0}, dm_jremrefhd = {lh_first = 0xfffff806a98ad500}, dm_oldinum = 0x10097, dm_offset = 0x32c, dm_un = {dmu_pagedep = 0xfffff8041e194d00, dmu_dirinum = 0xfffff8041e194d00}, dm_jwork = {lh_first = 0x0}} (kgdb) p *jremref $2 = {jr_ref = {if_list = {wk_list = {le_next = 0xdeadc0dedeadc0de, le_prev = 0xdeadc0dedeadc0de}, wk_mp = 0xfffffe00e63d1000, wk_type = 0x12, wk_state = 0x11, wk_func = 0xdeadc0dedeadc0de , wk_line = 0xdeadc0de, wk_all = {le_next = 0xfffff806a98ad500, le_prev = 0xfffff8028e304e80}}, if_deps = {tqe_next = 0xdeadc0dedeadc0de, tqe_prev = 0xdeadc0dedeadc0de}, if_jsegdep = 0xfffff802c1a64c00, if_diroff = 0xc, if_ino = 0x2, if_parent = 0x10097, if_nlink = 0x2a, if_mode = 0x41ed}, jr_deps = {le_next = 0xdeadc0dedeadc0de, le_prev = 0xdeadc0dedeadc0de}, jr_dirrem = 0xfffff8005ab65900} (kgdb) Index: src/sys/vm/swap_pager.c =================================================================== --- src/sys/vm/swap_pager.c (revision 357884) +++ src/sys/vm/swap_pager.c (working copy) @@ -1188,8 +1188,8 @@ swap_pager_unswapped(vm_page_t m) * The pages in "ma" must be busied and will remain busied upon return. */ static int -swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, int *rbehind, - int *rahead) +swap_pager_getpages_locked(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) { struct buf *bp; vm_page_t bm, mpred, msucc, p; @@ -1197,7 +1197,7 @@ static int daddr_t blk; int i, maxahead, maxbehind, reqcount; - VM_OBJECT_WLOCK(object); + VM_OBJECT_ASSERT_WLOCKED(object); reqcount = count; KASSERT(object->type == OBJT_SWAP, @@ -1352,6 +1352,15 @@ static int */ } +static int +swap_pager_getpages(vm_object_t object, vm_page_t *ma, int count, + int *rbehind, int *rahead) +{ + + VM_OBJECT_WLOCK(object); + return (swap_pager_getpages_locked(object, ma, count, rbehind, rahead)); +} + /* * swap_pager_getpages_async(): * @@ -1444,18 +1453,6 @@ swap_pager_putpages(vm_object_t object, vm_page_t /* Maximum I/O size is limited by maximum swap block size. */ n = min(count - i, nsw_cluster_max); - /* Get a block of swap of size up to size n. */ - blk = swp_pager_getswapspace(&n, 4); - if (blk == SWAPBLK_NONE) { - for (j = 0; j < n; ++j) - rtvals[i + j] = VM_PAGER_FAIL; - continue; - } - - /* - * All I/O parameters have been satisfied. Build the I/O - * request and assign the swap space. - */ if (async) { mtx_lock(&swbuf_mtx); while (nsw_wcount_async == 0) @@ -1464,6 +1461,7 @@ swap_pager_putpages(vm_object_t object, vm_page_t nsw_wcount_async--; mtx_unlock(&swbuf_mtx); } + bp = uma_zalloc(swwbuf_zone, M_WAITOK); if (async) bp->b_flags = B_ASYNC; @@ -1470,13 +1468,19 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_flags |= B_PAGING; bp->b_iocmd = BIO_WRITE; - bp->b_rcred = crhold(thread0.td_ucred); - bp->b_wcred = crhold(thread0.td_ucred); - bp->b_bcount = PAGE_SIZE * n; - bp->b_bufsize = PAGE_SIZE * n; - bp->b_blkno = blk; - + /* Get a block of swap of size up to size n. */ VM_OBJECT_WLOCK(object); + blk = swp_pager_getswapspace(&n, 4); + if (blk == SWAPBLK_NONE) { + VM_OBJECT_WUNLOCK(object); + for (j = 0; j < n; ++j) + rtvals[i + j] = VM_PAGER_FAIL; + mtx_lock(&swbuf_mtx); + nsw_wcount_async++; + mtx_unlock(&swbuf_mtx); + uma_zfree(swwbuf_zone, bp); + continue; + } for (j = 0; j < n; ++j) { mreq = ma[i + j]; vm_page_aflag_clear(mreq, PGA_SWAP_FREE); @@ -1490,7 +1494,14 @@ swap_pager_putpages(vm_object_t object, vm_page_t bp->b_pages[j] = mreq; } VM_OBJECT_WUNLOCK(object); + + bp->b_rcred = crhold(thread0.td_ucred); + bp->b_wcred = crhold(thread0.td_ucred); + bp->b_bcount = PAGE_SIZE * n; + bp->b_bufsize = PAGE_SIZE * n; + bp->b_blkno = blk; bp->b_npages = n; + /* * Must set dirty range for NFS to work. */ @@ -1712,72 +1723,12 @@ swp_pager_force_dirty(vm_page_t m) { vm_page_dirty(m); -#ifdef INVARIANTS - if (!vm_page_wired(m) && m->a.queue == PQ_NONE) - panic("page %p is neither wired nor queued", m); -#endif vm_page_xunbusy(m); swap_pager_unswapped(m); -} - -static void -swp_pager_force_launder(vm_page_t m) -{ - - vm_page_dirty(m); vm_page_launder(m); - vm_page_xunbusy(m); - swap_pager_unswapped(m); } /* - * SWP_PAGER_FORCE_PAGEIN() - force swap blocks to be paged in - * - * This routine dissociates pages starting at the given index within an - * object from their backing store, paging them in if they do not reside - * in memory. Pages that are paged in are marked dirty and placed in the - * laundry queue. Pages are marked dirty because they no longer have - * backing store. They are placed in the laundry queue because they have - * not been accessed recently. Otherwise, they would already reside in - * memory. - */ -static void -swp_pager_force_pagein(vm_object_t object, vm_pindex_t pindex, int npages) -{ - vm_page_t ma[npages]; - int i, j; - - KASSERT(npages > 0, ("%s: No pages", __func__)); - KASSERT(npages <= MAXPHYS / PAGE_SIZE, - ("%s: Too many pages: %d", __func__, npages)); - KASSERT(object->type == OBJT_SWAP, - ("%s: Object not swappable", __func__)); - vm_object_pip_add(object, npages); - vm_page_grab_pages(object, pindex, VM_ALLOC_NORMAL, ma, npages); - for (i = j = 0;; i++) { - /* Count nonresident pages, to page-in all at once. */ - if (i < npages && ma[i]->valid != VM_PAGE_BITS_ALL) - continue; - if (j < i) { - VM_OBJECT_WUNLOCK(object); - /* Page-in nonresident pages. Mark for laundering. */ - if (swap_pager_getpages(object, &ma[j], i - j, NULL, - NULL) != VM_PAGER_OK) - panic("%s: read from swap failed", __func__); - VM_OBJECT_WLOCK(object); - do { - swp_pager_force_launder(ma[j]); - } while (++j < i); - } - if (i == npages) - break; - /* Mark dirty a resident page. */ - swp_pager_force_dirty(ma[j++]); - } - vm_object_pip_wakeupn(object, npages); -} - -/* * swap_pager_swapoff_object: * * Page in all of the pages that have been paged out for an object @@ -1787,62 +1738,80 @@ static void swap_pager_swapoff_object(struct swdevt *sp, vm_object_t object) { struct swblk *sb; - vm_pindex_t pi, s_pindex; - daddr_t blk, n_blks, s_blk; - int i; + vm_page_t m, ma[SWAP_META_PAGES]; + vm_pindex_t pi; + daddr_t blk; + int i, j, npages, nv, rahead, rv; KASSERT(object->type == OBJT_SWAP, ("%s: Object not swappable", __func__)); - n_blks = 0; + for (pi = 0; (sb = SWAP_PCTRIE_LOOKUP_GE( &object->un_pager.swp.swp_blks, pi)) != NULL; ) { + if ((object->flags & OBJ_DEAD) != 0) { + swp_pager_meta_free_all(object); + break; + } for (i = 0; i < SWAP_META_PAGES; i++) { - blk = sb->d[i]; - if (!swp_pager_isondev(blk, sp)) - blk = SWAPBLK_NONE; - /* - * If there are no blocks/pages accumulated, start a new - * accumulation here. + * Count the number of contiguous valid blocks. */ - if (n_blks == 0) { - if (blk != SWAPBLK_NONE) { - s_blk = blk; - s_pindex = sb->p + i; - n_blks = 1; - } + for (nv = 0; nv < SWAP_META_PAGES - i; nv++) { + blk = sb->d[i + nv]; + if (!swp_pager_isondev(blk, sp) || + blk == SWAPBLK_NONE) + break; + } + if (nv == 0) continue; - } /* - * If the accumulation can be extended without breaking - * the sequence of consecutive blocks and pages that - * swp_pager_force_pagein() depends on, do so. + * Grab the page for the first valid block. If the page + * is valid, mark it dirty and free its swap block. Try + * to batch this operation since it may cause sp to be + * freed, meaning that we must restart the scan. + * Invalid pages will be revisited in future iterations. */ - if (n_blks < MAXPHYS / PAGE_SIZE && - s_blk + n_blks == blk && - s_pindex + n_blks == sb->p + i) { - ++n_blks; - continue; + m = vm_page_grab(object, sb->p + i, VM_ALLOC_NORMAL | + VM_ALLOC_WAITFAIL); + if (m == NULL) + break; + if (vm_page_all_valid(m)) { + npages = vm_page_grab_pages(object, + m->pindex + 1, + VM_ALLOC_NOCREAT | VM_ALLOC_NOWAIT, ma, + nv - 1); + swp_pager_force_dirty(m); + for (j = 0; j < npages; j++) { + if (vm_page_all_valid(ma[j])) + swp_pager_force_dirty(ma[j]); + else + vm_page_xunbusy(ma[j]); + } + break; } + vm_object_pip_add(object, 1); + rahead = SWAP_META_PAGES; + rv = swap_pager_getpages_locked(object, &m, 1, NULL, + &rahead); + if (rv != VM_PAGER_OK) + panic("%s: read from swap failed: %d", + __func__, rv); + vm_object_pip_wakeupn(object, 1); + VM_OBJECT_WLOCK(object); + vm_page_xunbusy(m); + /* - * The sequence of consecutive blocks and pages cannot - * be extended, so page them all in here. Then, - * because doing so involves releasing and reacquiring - * a lock that protects the swap block pctrie, do not - * rely on the current swap block. Break this loop and - * re-fetch the same pindex from the pctrie again. + * The object lock was dropped so we must restart the + * scan of this swap block. Pages paged in during this + * iteration will be marked dirty in a future iteration. */ - swp_pager_force_pagein(object, s_pindex, n_blks); - n_blks = 0; break; } if (i == SWAP_META_PAGES) pi = sb->p + SWAP_META_PAGES; } - if (n_blks > 0) - swp_pager_force_pagein(object, s_pindex, n_blks); } /* @@ -2078,7 +2047,7 @@ allocated: * Free the swblk if we end up with the empty page run. */ if (swapblk == SWAPBLK_NONE) - swp_pager_free_empty_swblk(object, sb); + swp_pager_free_empty_swblk(object, sb); return (prev_swapblk); } @@ -2350,7 +2319,7 @@ swaponsomething(struct vnode *vp, void *id, u_long sw_strategy_t *strategy, sw_close_t *close, dev_t dev, int flags) { struct swdevt *sp, *tsp; - swblk_t dvbase; + daddr_t dvbase; u_long mblocks; /* Index: src/sys/vm/swap_pager.h =================================================================== --- src/sys/vm/swap_pager.h (revision 357884) +++ src/sys/vm/swap_pager.h (working copy) @@ -38,14 +38,9 @@ */ #ifndef _VM_SWAP_PAGER_H_ -#define _VM_SWAP_PAGER_H_ 1 +#define _VM_SWAP_PAGER_H_ -typedef int32_t swblk_t; /* - * swap offset. This is the type used to - * address the "virtual swap device" and - * therefore the maximum swap space is - * 2^32 pages. - */ +#include struct buf; struct swdevt; @@ -62,8 +57,8 @@ struct swdevt { dev_t sw_dev; struct vnode *sw_vp; void *sw_id; - swblk_t sw_first; - swblk_t sw_end; + __daddr_t sw_first; + __daddr_t sw_end; struct blist *sw_blist; TAILQ_ENTRY(swdevt) sw_list; sw_strategy_t *sw_strategy; Index: src/sys/vm/vm_page.c =================================================================== --- src/sys/vm/vm_page.c (revision 357884) +++ src/sys/vm/vm_page.c (working copy) @@ -4258,7 +4258,7 @@ retrylookup: return (NULL); m = vm_page_alloc(object, pindex, pflags); if (m == NULL) { - if ((allocflags & VM_ALLOC_NOWAIT) != 0) + if ((allocflags & (VM_ALLOC_NOWAIT | VM_ALLOC_WAITFAIL)) != 0) return (NULL); goto retrylookup; } @@ -4466,7 +4466,8 @@ retrylookup: m = vm_page_alloc_after(object, pindex + i, pflags | VM_ALLOC_COUNT(count - i), mpred); if (m == NULL) { - if ((allocflags & VM_ALLOC_NOWAIT) != 0) + if ((allocflags & (VM_ALLOC_NOWAIT | + VM_ALLOC_WAITFAIL)) != 0) break; goto retrylookup; } -- Test scenario: misc/rename14.sh