Script started on Sun May 1 18:49:29 2016 Command: ./bhyve4.sh Launching virtual machine "freebsd-vm" ... Consoles: userboot FreeBSD/amd64 User boot, Revision 1.1 (pho@t1.osted.lan, Thu Apr 21 20:59:20 CEST 2016) /boot/entropy size=0x1000 Booting... GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2015 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #0 r292373: Sun May 1 12:15:08 CEST 2016 pho@t1.osted.lan:/usr/src/sys/amd64/compile/BENCH amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(vga): resolution 640x480 CPU: Intel(R) Xeon(R) CPU E5-2620 0 @ 2.00GHz (1994.87-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7 Features=0x9f83fbff Features2=0x9e9e6217 AMD Features=0x24100800 AMD Features2=0x1 XSAVE Features=0x1 TSC: P-state invariant Hypervisor: Origin = "bhyve bhyve " real memory = 7516192768 (7168 MB) avail memory = 6172745728 (5886 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 4 package(s) x 1 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 random: unblocking device. ioapic0 irqs 0-23 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80fac5a0, 0) error 19 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 10000000 Hz quality 950 Event timer "HPET" frequency 10000000 Hz quality 550 Event timer "HPET1" frequency 10000000 Hz quality 450 Event timer "HPET2" frequency 10000000 Hz quality 450 Event timer "HPET3" frequency 10000000 Hz quality 450 Event timer "HPET4" frequency 10000000 Hz quality 450 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 virtio_pci0: port 0x2000-0x201f mem 0xc0000000-0xc0001fff irq 16 at device 2.0 on pci0 vtnet0: on virtio_pci0 vtnet0: Ethernet address: 00:a0:98:df:f8:69 001.000048 [ 421] vtnet_netmap_attach max rings 1 vtnet0: netmap queues/slots: TX 1/1024, RX 1/1024 001.000049 [ 426] vtnet_netmap_attach virtio attached txq=1, txd=1024 rxq=1, rxd=1024 virtio_pci1: port 0x2040-0x207f mem 0xc0002000-0xc0003fff irq 17 at device 3.0 on pci0 vtblk0: on virtio_pci1 vtblk0: 81920MB (167772160 512 byte sectors) uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (9600,n,8,1) uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 vga0: at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec IPsec: Initialized Security Association Processing. SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! Trying to mount root from ufs:/dev/vtbd0p1 [rw]... Setting hostuuid: 3141f787-07e3-e111-b968-001e6756c168. Setting hostid: 0x564ac5b6. Starting ddb. Starting file system checks: /dev/vtbd0p1: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/vtbd0p1: clean, 17367677 free (581 frags, 2170887 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: freebsd-vm. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. vtnet0: link state changed to UP Starting Network: lo0 vtnet0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo vtnet0: flags=8943 metric 0 mtu 1500 options=80028 ether 00:a0:98:df:f8:69 nd6 options=29 media: Ethernet 10Gbase-T status: active ELF ldconfig path: /lib /usr/lib /usr/lib/compat 32-bit compatibility ldconfig path: /usr/lib32 Starting devd. Starting dhclient. DHCPREQUEST on vtnet0 to 255.255.255.255 port 67 DHCPACK from 192.168.1.1 bound to 192.168.1.25 -- renewal in 41400 seconds. add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. Starting casperd. Clearing /tmp (X related). Updating motd:. Mounting late file systems:. Configuring vt: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting cron. sysctl: unknown oid 'debug.vmem_check' at line 10 Sun May 1 20:49:46 CEST 2016 FreeBSD/amd64 (freebsd-vm) (console) login: root Password: May 1 20:49:49 freebsd-vm login: ROOT LOGIN (root) ON console Last login: Sun May 1 20:47:29 on console FreeBSD 11.0-CURRENT (BENCH) #0 r292373: Sun May 1 12:15:08 CEST 2016 Welcome to FreeBSD! Release Notes, Errata: https://www.FreeBSD.org/releases/ Security Advisories: https://www.FreeBSD.org/security/ FreeBSD Handbook: https://www.FreeBSD.org/handbook/ FreeBSD FAQ: https://www.FreeBSD.org/faq/ Questions List: https://lists.FreeBSD.org/mailman/listinfo/freebsd-questions/ FreeBSD Forums: https://forums.FreeBSD.org/ Documents installed with the system are in the /usr/local/share/doc/freebsd/ directory, or can be installed later with: pkg install en-freebsd-doc For other languages, replace "en" with a language code like de or fr. Show the version of FreeBSD installed: freebsd-version ; uname -a Please include that output and any error messages when posting questions. Introduction to manual pages: man man FreeBSD directory layout: man hier Edit /etc/motd to change this login announcement. root@freebsd-vm:~ # cd /usr/home/pho/stress2/misc root@freebsd-vm:/usr/home/pho/stress2/misc # uname -a FreeBSD freebsd-vm 11.0-CURRENT FreeBSD 11.0-CURRENT #0 r292373: Sun May 1 12:15:08 CEST 2016 pho@t1.osted.lan:/usr/src/sys/amd64/compile/BENCH amd64 root@freebsd-vm:/usr/home/pho/stress2/misc # ./mmap28.sh Fatal trap 12: page fault while in kernel mode cpuid = 3; apic id = 03 fault virtual address = 0x31 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff80af61ec stack pointer = 0x28:0xfffffe00002cdcd0 frame pointer = 0x28:0xfffffe00002cdd10 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 662 (mmap28) [ thread pid 662 tid 100080 ] Stopped at sglist_append_bio+0x1ac: movq 0x30(%rax),%rax db> run pho db:0:pho> bt Tracing pid 662 tid 100080 td 0xfffff8005d0e0000 sglist_append_bio() at sglist_append_bio+0x1ac/frame 0xfffffe00002cdd10 vtblk_request_execute() at vtblk_request_execute+0xaf/frame 0xfffffe00002cdd60 vtblk_startio() at vtblk_startio+0x18b/frame 0xfffffe00002cdda0 vtblk_strategy() at vtblk_strategy+0xde/frame 0xfffffe00002cdde0 g_disk_start() at g_disk_start+0x348/frame 0xfffffe00002cde50 g_io_request() at g_io_request+0x3bf/frame 0xfffffe00002cdeb0 g_part_start() at g_part_start+0x2ae/frame 0xfffffe00002cdf30 g_io_request() at g_io_request+0x3bf/frame 0xfffffe00002cdf90 vnode_pager_generic_getpages() at vnode_pager_generic_getpages+0x11b0/frame 0xfffffe00002ce0b0 vnode_pager_local_getpages() at vnode_pager_local_getpages+0x2e/frame 0xfffffe00002ce0d0 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xa6/frame 0xfffffe00002ce100 vnode_pager_getpages() at vnode_pager_getpages+0xc0/frame 0xfffffe00002ce180 vm_pager_get_pages() at vm_pager_get_pages+0x1f/frame 0xfffffe00002ce1b0 vm_fault_hold() at vm_fault_hold+0x849/frame 0xfffffe00002ce2c0 vm_fault_quick_hold_pages() at vm_fault_quick_hold_pages+0x149/frame 0xfffffe00002ce330 vn_io_fault1() at vn_io_fault1+0x317/frame 0xfffffe00002ce490 vn_rdwr() at vn_rdwr+0x269/frame 0xfffffe00002ce570 vn_rdwr_inchunks() at vn_rdwr_inchunks+0xb4/frame 0xfffffe00002ce5f0 elf64_coredump() at elf64_coredump+0xa99/frame 0xfffffe00002ce6f0 sigexit() at sigexit+0x988/frame 0xfffffe00002ce9a0 postsig() at postsig+0x2f3/frame 0xfffffe00002cea70 ast() at ast+0x4a7/frame 0xfffffe00002ceab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe840 db:0:bt> show allpcpu Current CPU: 3 cpuid = 0 dynamic pcpu = 0x711880 curthread = 0xfffff80003e2c9a0: pid 11 "idle: cpu0" curpcb = 0xfffffe01a51bfb80 fpcurthread = none idlethread = 0xfffff80003e2c9a0: tid 100004 "idle: cpu0" curpmap = 0xffffffff81cd1290 tssp = 0xffffffff81d07010 commontssp = 0xffffffff81d07010 rsp0 = 0xfffffe01a51bfb80 gs32p = 0xffffffff81d0d868 ldt = 0xffffffff81d0d8a8 tss = 0xffffffff81d0d898 cpuid = 1 dynamic pcpu = 0xfffffe01f146d880 curthread = 0xfffff80003e2c4d0: pid 11 "idle: cpu1" curpcb = 0xfffffe01a51c4b80 fpcurthread = none idlethread = 0xfffff80003e2c4d0: tid 100005 "idle: cpu1" curpmap = 0xffffffff81cd1290 tssp = 0xffffffff81d07078 commontssp = 0xffffffff81d07078 rsp0 = 0xfffffe01a51c4b80 gs32p = 0xffffffff81d0d8d0 ldt = 0xffffffff81d0d910 tss = 0xffffffff81d0d900 cpuid = 2 dynamic pcpu = 0xfffffe01f1475880 curthread = 0xfffff80003e2c000: pid 11 "idle: cpu2" curpcb = 0xfffffe01a51c9b80 fpcurthread = none idlethread = 0xfffff80003e2c000: tid 100006 "idle: cpu2" curpmap = 0xffffffff81cd1290 tssp = 0xffffffff81d070e0 commontssp = 0xffffffff81d070e0 rsp0 = 0xfffffe01a51c9b80 gs32p = 0xffffffff81d0d938 ldt = 0xffffffff81d0d978 tss = 0xffffffff81d0d968 cpuid = 3 dynamic pcpu = 0xfffffe0223825880 curthread = 0xfffff8005d0e0000: pid 662 "mmap28" curpcb = 0xfffffe00002ceb80 fpcurthread = none idlethread = 0xfffff80003e2b9a0: tid 100007 "idle: cpu3" curpmap = 0xfffff8005d193138 tssp = 0xffffffff81d07148 commontssp = 0xffffffff81d07148 rsp0 = 0xfffffe00002ceb80 gs32p = 0xffffffff81d0d9a0 ldt = 0xffffffff81d0d9e0 tss = 0xffffffff81d0d9d0 db:0:allpcpu> show alllocks No such command db:0:alllocks> show lockedvnods Locked vnodes 0xfffff80006744588: tag ufs, type VREG usecount 4, writecount 2, refcount 7 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8005d1be000 ref 2 pages 391 cleanbuf 1 dirtybuf 1 lock type ufs: SHARED (count 1) ino 6179723, on dev vtbd0p1 0xfffff80006a96000: tag ufs, type VREG usecount 1, writecount 1, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xfffff8005d19a400 ref 0 pages 24 cleanbuf 3 dirtybuf 0 lock type ufs: EXCL by thread 0xfffff8005d0e0000 (pid 662, mmap28, tid 100080) ino 6179732, on dev vtbd0p1 db:0:lockedvnods> show mount 0xfffff80006718330 /dev/vtbd0p1 on / (ufs) 0xfffff80006718660 devfs on /dev (devfs) More info: show mount db:0:mount> show page vm_cnt.v_free_count: 1481148 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 9843 vm_cnt.v_active_count: 4827 vm_cnt.v_wire_count: 22208 vm_cnt.v_free_reserved: 2026 vm_cnt.v_free_min: 9615 vm_cnt.v_free_target: 32382 vm_cnt.v_inactive_target: 48573 db:0:page> ps pid ppid pgrp uid state wmesg wchan cmd 662 651 651 0 R+ CPU 3 mmap28 651 640 651 0 S+ wait 0xfffff8000699b000 sh 640 639 640 0 S+ pause 0xfffff800069680a8 csh 639 1 639 0 Ss+ wait 0xfffff80006843a90 login 599 1 599 0 Ss nanslp 0xffffffff81b60f41 cron 595 1 595 0 Ss select 0xfffff80006739040 sshd 508 1 508 0 Ss select 0xfffff8000602f540 casperd 507 1 507 0 Ss select 0xfffff800067e1040 casperd 407 1 407 0 Ss select 0xfffff8000672ac40 syslogd 336 1 336 0 Ss select 0xfffff800067392c0 devd 335 1 335 65 Ss select 0xfffff800067e10c0 dhclient 290 1 290 0 Ss select 0xfffff800067e11c0 dhclient 17 0 0 0 DL syncer 0xffffffff81c51870 [syncer] 16 0 0 0 DL vlruwt 0xfffff800066a9a90 [vnlru] 15 0 0 0 DL (threaded) [bufdaemon] 100047 D psleep 0xffffffff81c50104 [bufdaemon] 100058 D sdflush 0xfffff800069e12e8 [/ worker] 14 0 0 0 DL - 0xffffffff81c50db4 [bufspacedaemon] 9 0 0 0 DL pgzero 0xffffffff81c5ab34 [pagezero] 8 0 0 0 DL psleep 0xffffffff81c5a314 [vmdaemon] 7 0 0 0 DL (threaded) [pagedaemon] 100043 D psleep 0xffffffff81d06384 [pagedaemon] 100050 D umarcl 0xffffffff81c59c40 [uma] 6 0 0 0 DL waiting_ 0xffffffff81cf8300 [sctp_iterator] 5 0 0 0 DL (threaded) [cam] 100021 D - 0xffffffff81985b00 [doneq0] 100042 D - 0xffffffff81985948 [scanner] 4 0 0 0 DL crypto_r 0xffffffff81c58758 [crypto returns] 3 0 0 0 DL crypto_w 0xffffffff81c58600 [crypto] 13 0 0 0 DL (threaded) [geom] 100014 D - 0xffffffff81cd0720 [g_event] 100015 D - 0xffffffff81cd0728 [g_up] 100016 D - 0xffffffff81cd0730 [g_down] 12 0 0 0 WL (threaded) [intr] 100008 I [swi1: netisr 0] 100009 I [swi4: clock (0)] 100010 I [swi4: clock (1)] 100011 I [swi4: clock (2)] 100012 I [swi4: clock (3)] 100013 I [swi3: vm] 100025 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100029 I [swi5: fast taskq] 100030 I [irq264: virtio_pci0] 100031 I [irq265: virtio_pci0] 100032 I [irq266: virtio_pci0] 100035 I [irq267: virtio_pci1] 100036 I [irq268: virtio_pci1] 100037 I [swi0: uart uart] 100038 I [irq1: atkbd0] 11 0 0 0 RL (threaded) [idle] 100004 Run CPU 0 [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100006 Run CPU 2 [idle: cpu2] 100007 CanRun [idle: cpu3] 2 0 0 0 DL - 0xffffffff81ab29b0 [rand_harvestq] 1 0 1 0 SLs wait 0xfffff80003e2a548 [init] 10 0 0 0 DL audit_wo 0xffffffff81cfd900 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xffffffff81cd0758 [swapper] 100017 D - 0xfffff80003e85000 [firmware taskq] 100020 D - 0xfffff80003e84e00 [kqueue taskq] 100022 D - 0xfffff80003e84c00 [acpi_task_0] 100023 D - 0xfffff80003e84c00 [acpi_task_1] 100024 D - 0xfffff80003e84c00 [acpi_task_2] 100027 D - 0xfffff80003e84900 [ffs_trim taskq] 100028 D - 0xfffff80003e84800 [thread taskq] 100033 D - 0xfffff80003e84600 [vtnet0 rxq 0] 100034 D - 0xfffff80003e84500 [vtnet0 txq 0] 100039 D - 0xffffffff81b5fce2 [deadlkres] 100041 D - 0xfffff80003e84d00 [CAM taskq] db:0:ps> allt Tracing command mmap28 pid 662 tid 100080 td 0xfffff8005d0e0000 sglist_append_bio() at sglist_append_bio+0x1ac/frame 0xfffffe00002cdd10 vtblk_request_execute() at vtblk_request_execute+0xaf/frame 0xfffffe00002cdd60 vtblk_startio() at vtblk_startio+0x18b/frame 0xfffffe00002cdda0 vtblk_strategy() at vtblk_strategy+0xde/frame 0xfffffe00002cdde0 g_disk_start() at g_disk_start+0x348/frame 0xfffffe00002cde50 g_io_request() at g_io_request+0x3bf/frame 0xfffffe00002cdeb0 g_part_start() at g_part_start+0x2ae/frame 0xfffffe00002cdf30 g_io_request() at g_io_request+0x3bf/frame 0xfffffe00002cdf90 vnode_pager_generic_getpages() at vnode_pager_generic_getpages+0x11b0/frame 0xfffffe00002ce0b0 vnode_pager_local_getpages() at vnode_pager_local_getpages+0x2e/frame 0xfffffe00002ce0d0 VOP_GETPAGES_APV() at VOP_GETPAGES_APV+0xa6/frame 0xfffffe00002ce100 vnode_pager_getpages() at vnode_pager_getpages+0xc0/frame 0xfffffe00002ce180 vm_pager_get_pages() at vm_pager_get_pages+0x1f/frame 0xfffffe00002ce1b0 vm_fault_hold() at vm_fault_hold+0x849/frame 0xfffffe00002ce2c0 vm_fault_quick_hold_pages() at vm_fault_quick_hold_pages+0x149/frame 0xfffffe00002ce330 vn_io_fault1() at vn_io_fault1+0x317/frame 0xfffffe00002ce490 vn_rdwr() at vn_rdwr+0x269/frame 0xfffffe00002ce570 vn_rdwr_inchunks() at vn_rdwr_inchunks+0xb4/frame 0xfffffe00002ce5f0 elf64_coredump() at elf64_coredump+0xa99/frame 0xfffffe00002ce6f0 sigexit() at sigexit+0x988/frame 0xfffffe00002ce9a0 postsig() at postsig+0x2f3/frame 0xfffffe00002cea70 ast() at ast+0x4a7/frame 0xfffffe00002ceab0 doreti_ast() at doreti_ast+0x1f/frame 0x7fffffffe840 Tracing command sh pid 651 tid 100075 td 0xfffff8000699d9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00002b5550 mi_switch() at mi_switch+0xd8/frame 0xfffffe00002b5580 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe00002b5600 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002b5630 _sleep() at _sleep+0x2d2/frame 0xfffffe00002b56c0 kern_wait6() at kern_wait6+0x707/frame 0xfffffe00002b57a0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe00002b5990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe00002b5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe00002b5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800b5d05a, rsp = 0x7fffffffe928, rbp = 0x7fffffffe9e0 --- Tracing command csh pid 640 tid 100072 td 0xfffff80006acc4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe00002a6790 mi_switch() at mi_switch+0xd8/frame 0xfffffe00002a67c0 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe00002a6840 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002a6870 _sleep() at _sleep+0x2d2/frame 0xfffffe00002a6900 kern_sigsuspend() at kern_sigsuspend+0xf4/frame 0xfffffe00002a6960 sys_sigsuspend() at sys_sigsuspend+0x31/frame 0xfffffe00002a6990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe00002a6ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe00002a6ab0 --- syscall (4, FreeBSD ELF64, sys_write), rip = 0x800dd90da, rsp = 0x7fffffffe228, rbp = 0x7fffffffe2b0 --- Tracing command login pid 639 tid 100066 td 0xfffff800068699a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000288550 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000288580 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0000288600 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe0000288630 _sleep() at _sleep+0x2d2/frame 0xfffffe00002886c0 kern_wait6() at kern_wait6+0x707/frame 0xfffffe00002887a0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe0000288990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe0000288ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0000288ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x800f4005a, rsp = 0x7fffffffebc8, rbp = 0x7fffffffed40 --- Tracing command cron pid 599 tid 100061 td 0xfffff800066eb4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe000026f780 mi_switch() at mi_switch+0xd8/frame 0xfffffe000026f7b0 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe000026f830 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe000026f860 _sleep() at _sleep+0x2ab/frame 0xfffffe000026f8f0 kern_nanosleep() at kern_nanosleep+0x10e/frame 0xfffffe000026f950 sys_nanosleep() at sys_nanosleep+0x53/frame 0xfffffe000026f990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe000026fab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe000026fab0 --- syscall (240, FreeBSD ELF64, sys_nanosleep), rip = 0x800d291da, rsp = 0x7fffffffead8, rbp = 0x7fffffffed00 --- Tracing command sshd pid 595 tid 100063 td 0xfffff8000676c000 sched_switch() at sched_switch+0x713/frame 0xfffffe00002795e0 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000279610 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0000279690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002796c0 _cv_wait_sig() at _cv_wait_sig+0x1ac/frame 0xfffffe0000279710 seltdwait() at seltdwait+0x10a/frame 0xfffffe0000279760 kern_select() at kern_select+0x979/frame 0xfffffe0000279950 sys_select() at sys_select+0x54/frame 0xfffffe0000279990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe0000279ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0000279ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x801f9a41a, rsp = 0x7fffffffe708, rbp = 0x7fffffffe740 --- Tracing command casperd pid 508 tid 100073 td 0xfffff800069a54d0 sched_switch() at sched_switch+0x713/frame 0xfffffe00002ab5e0 mi_switch() at mi_switch+0xd8/frame 0xfffffe00002ab610 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe00002ab690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002ab6c0 _cv_wait_sig() at _cv_wait_sig+0x1ac/frame 0xfffffe00002ab710 seltdwait() at seltdwait+0x10a/frame 0xfffffe00002ab760 kern_select() at kern_select+0x979/frame 0xfffffe00002ab950 sys_select() at sys_select+0x54/frame 0xfffffe00002ab990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe00002abab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe00002abab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011a341a, rsp = 0x7fffffffe828, rbp = 0x7fffffffed10 --- Tracing command casperd pid 507 tid 100055 td 0xfffff800069a64d0 sched_switch() at sched_switch+0x713/frame 0xfffffe00002515e0 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000251610 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0000251690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002516c0 _cv_wait_sig() at _cv_wait_sig+0x1ac/frame 0xfffffe0000251710 seltdwait() at seltdwait+0x10a/frame 0xfffffe0000251760 kern_select() at kern_select+0x979/frame 0xfffffe0000251950 sys_select() at sys_select+0x54/frame 0xfffffe0000251990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe0000251ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0000251ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x8011a341a, rsp = 0x7fffffffe688, rbp = 0x7fffffffe750 --- Tracing command syslogd pid 407 tid 100068 td 0xfffff8000676b9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe00002925e0 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000292610 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe0000292690 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe00002926c0 _cv_wait_sig() at _cv_wait_sig+0x1ac/frame 0xfffffe0000292710 seltdwait() at seltdwait+0x10a/frame 0xfffffe0000292760 kern_select() at kern_select+0x979/frame 0xfffffe0000292950 sys_select() at sys_select+0x54/frame 0xfffffe0000292990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe0000292ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0000292ab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x800b8c41a, rsp = 0x7fffffffde28, rbp = 0x7fffffffed00 --- Tracing command devd pid 336 tid 100060 td 0xfffff8000686a000 sched_switch() at sched_switch+0x713/frame 0xfffffe000026a5d0 mi_switch() at mi_switch+0xd8/frame 0xfffffe000026a600 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe000026a680 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe000026a6b0 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1d2/frame 0xfffffe000026a710 seltdwait() at seltdwait+0xba/frame 0xfffffe000026a760 kern_select() at kern_select+0x979/frame 0xfffffe000026a950 sys_select() at sys_select+0x54/frame 0xfffffe000026a990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe000026aab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe000026aab0 --- syscall (93, FreeBSD ELF64, sys_select), rip = 0x4a1a4a, rsp = 0x7fffffffcbc8, rbp = 0x7fffffffed20 --- Tracing command dhclient pid 335 tid 100053 td 0xfffff800066ec000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000247640 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000247670 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe00002476f0 sleepq_timedwait_sig() at sleepq_timedwait_sig+0x10/frame 0xfffffe0000247720 _cv_timedwait_sig_sbt() at _cv_timedwait_sig_sbt+0x1d2/frame 0xfffffe0000247780 seltdwait() at seltdwait+0xba/frame 0xfffffe00002477d0 kern_poll() at kern_poll+0x4fa/frame 0xfffffe0000247970 sys_poll() at sys_poll+0x61/frame 0xfffffe0000247990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe0000247ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0000247ab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800b38e4a, rsp = 0x7fffffffec68, rbp = 0x7fffffffeca0 --- Tracing command dhclient pid 290 tid 100064 td 0xfffff800069a59a0 sched_switch() at sched_switch+0x713/frame 0xfffffe000027e650 mi_switch() at mi_switch+0xd8/frame 0xfffffe000027e680 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe000027e700 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe000027e730 _cv_wait_sig() at _cv_wait_sig+0x1ac/frame 0xfffffe000027e780 seltdwait() at seltdwait+0x10a/frame 0xfffffe000027e7d0 kern_poll() at kern_poll+0x4fa/frame 0xfffffe000027e970 sys_poll() at sys_poll+0x61/frame 0xfffffe000027e990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe000027eab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe000027eab0 --- syscall (209, FreeBSD ELF64, sys_poll), rip = 0x800b38e4a, rsp = 0x7fffffffec78, rbp = 0x7fffffffeca0 --- Tracing command syncer pid 17 tid 100049 td 0xfffff800066ec9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000233910 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000233940 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe0000233970 _cv_timedwait_sbt() at _cv_timedwait_sbt+0x1d2/frame 0xfffffe00002339d0 sched_sync() at sched_sync+0x8f2/frame 0xfffffe0000233a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0000233ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000233ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vnlru pid 16 tid 100048 td 0xfffff800066ed000 sched_switch() at sched_switch+0x713/frame 0xfffffe000022e8c0 mi_switch() at mi_switch+0xd8/frame 0xfffffe000022e8f0 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe000022e920 _sleep() at _sleep+0x2bf/frame 0xfffffe000022e9b0 vnlru_proc() at vnlru_proc+0xa4/frame 0xfffffe000022ea70 fork_exit() at fork_exit+0x9c/frame 0xfffffe000022eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000022eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 15 tid 100047 td 0xfffff800066ed4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000229950 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000229980 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe00002299b0 _sleep() at _sleep+0x2bf/frame 0xfffffe0000229a40 buf_daemon() at buf_daemon+0xa8/frame 0xfffffe0000229a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0000229ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000229ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufdaemon pid 15 tid 100058 td 0xfffff800069a6000 sched_switch() at sched_switch+0x713/frame 0xfffffe0000260940 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000260970 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe00002609a0 _sleep() at _sleep+0x2bf/frame 0xfffffe0000260a30 softdep_flush() at softdep_flush+0x24a/frame 0xfffffe0000260a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0000260ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000260ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command bufspacedaemon pid 14 tid 100046 td 0xfffff800066ed9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000224950 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000224980 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe00002249b0 _sleep() at _sleep+0x2bf/frame 0xfffffe0000224a40 bufspace_daemon() at bufspace_daemon+0x28a/frame 0xfffffe0000224a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0000224ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000224ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagezero pid 9 tid 100045 td 0xfffff8000607f000 sched_switch() at sched_switch+0x713/frame 0xfffffe000021f960 mi_switch() at mi_switch+0xd8/frame 0xfffffe000021f990 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe000021f9c0 _sleep() at _sleep+0x2bf/frame 0xfffffe000021fa50 vm_pagezero() at vm_pagezero+0xb5/frame 0xfffffe000021fa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe000021fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000021fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command vmdaemon pid 8 tid 100044 td 0xfffff8000607f4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe000021a900 mi_switch() at mi_switch+0xd8/frame 0xfffffe000021a930 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe000021a960 _sleep() at _sleep+0x2df/frame 0xfffffe000021a9f0 vm_daemon() at vm_daemon+0xe0/frame 0xfffffe000021aa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe000021aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe000021aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 7 tid 100043 td 0xfffff8000607f9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743fd8f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743fd920 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe01743fd950 _sleep() at _sleep+0x2bf/frame 0xfffffe01743fd9e0 vm_pageout() at vm_pageout+0x22a/frame 0xfffffe01743fda70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743fdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743fdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command pagedaemon pid 7 tid 100050 td 0xfffff8000676c9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0000238960 mi_switch() at mi_switch+0xd8/frame 0xfffffe0000238990 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe00002389c0 _sleep() at _sleep+0x2df/frame 0xfffffe0000238a50 uma_reclaim_worker() at uma_reclaim_worker+0xb1/frame 0xfffffe0000238a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0000238ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0000238ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command sctp_iterator pid 6 tid 100040 td 0xfffff800060809a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743ee960 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743ee990 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743ee9c0 _sleep() at _sleep+0x2df/frame 0xfffffe01743eea50 sctp_iterator_thread() at sctp_iterator_thread+0x99/frame 0xfffffe01743eea70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743eeab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743eeab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100021 td 0xfffff80003f36000 sched_switch() at sched_switch+0x713/frame 0xfffffe017437b930 mi_switch() at mi_switch+0xd8/frame 0xfffffe017437b960 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe017437b990 _sleep() at _sleep+0x2df/frame 0xfffffe017437ba20 xpt_done_td() at xpt_done_td+0xbe/frame 0xfffffe017437ba70 fork_exit() at fork_exit+0x9c/frame 0xfffffe017437bab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe017437bab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command cam pid 5 tid 100042 td 0xfffff80006080000 sched_switch() at sched_switch+0x713/frame 0xfffffe01743f8920 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743f8950 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743f8980 _sleep() at _sleep+0x2df/frame 0xfffffe01743f8a10 xpt_scanner_thread() at xpt_scanner_thread+0xd4/frame 0xfffffe01743f8a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743f8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743f8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto returns pid 4 tid 100019 td 0xfffff80003f369a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0174371930 mi_switch() at mi_switch+0xd8/frame 0xfffffe0174371960 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe0174371990 _sleep() at _sleep+0x2df/frame 0xfffffe0174371a20 crypto_ret_proc() at crypto_ret_proc+0x131/frame 0xfffffe0174371a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174371ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174371ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command crypto pid 3 tid 100018 td 0xfffff80003e59000 sched_switch() at sched_switch+0x713/frame 0xfffffe017436c940 mi_switch() at mi_switch+0xd8/frame 0xfffffe017436c970 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe017436c9a0 _sleep() at _sleep+0x2df/frame 0xfffffe017436ca30 crypto_proc() at crypto_proc+0x2cf/frame 0xfffffe017436ca70 fork_exit() at fork_exit+0x9c/frame 0xfffffe017436cab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe017436cab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100014 td 0xfffff80003e5a4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51f1930 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51f1960 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01a51f1990 _sleep() at _sleep+0x2df/frame 0xfffffe01a51f1a20 g_run_events() at g_run_events+0x50/frame 0xfffffe01a51f1a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51f1ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51f1ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100015 td 0xfffff80003e5a000 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51f6940 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51f6970 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01a51f69a0 _sleep() at _sleep+0x2df/frame 0xfffffe01a51f6a30 g_io_schedule_up() at g_io_schedule_up+0x1c0/frame 0xfffffe01a51f6a60 g_up_procbody() at g_up_procbody+0x9d/frame 0xfffffe01a51f6a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51f6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51f6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command geom pid 13 tid 100016 td 0xfffff80003e599a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51fb930 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51fb960 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01a51fb990 _sleep() at _sleep+0x2df/frame 0xfffffe01a51fba20 g_io_schedule_down() at g_io_schedule_down+0xdc/frame 0xfffffe01a51fba60 g_down_procbody() at g_down_procbody+0x9d/frame 0xfffffe01a51fba70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51fbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51fbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100008 td 0xfffff80003e2b4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51d39f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51d3a20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe01a51d3a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51d3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51d3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100009 td 0xfffff80003e2b000 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51d89f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51d8a20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe01a51d8a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51d8ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51d8ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100010 td 0xfffff80003e5b9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xfffff80003e5b4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xfffff80003e5b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100013 td 0xfffff80003e5a9a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xfffff80003f349a0 sched_switch() at sched_switch+0x713/frame 0xfffffe017438f9f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe017438fa20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe017438fa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe017438fab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe017438fab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100026 td 0xfffff80003f344d0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743949f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe0174394a20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe0174394a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174394ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174394ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100029 td 0xfffff8000601a4d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100030 td 0xfffff8000601a000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xfffff800060199a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743bd9f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743bda20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe01743bda70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743bdab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743bdab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100032 td 0xfffff800060194d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100035 td 0xfffff800060184d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xfffff80006018000 sched_switch() at sched_switch+0x713/frame 0xfffffe01743d69f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743d6a20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe01743d6a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743d6ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743d6ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100037 td 0xfffff800060819a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743db9f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743dba20 ithread_loop() at ithread_loop+0x1b2/frame 0xfffffe01743dba70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743dbab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743dbab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command intr pid 12 tid 100038 td 0xfffff800060814d0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100004 td 0xfffff80003e2c9a0 cpustop_handler() at cpustop_handler+0x28/frame 0xffffffff81c5ed90 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xffffffff81c5edb0 trap() at trap+0x3a/frame 0xffffffff81c5efc0 nmi_calltrap() at nmi_calltrap+0x8/frame 0xffffffff81c5efc0 --- trap 0x13, rip = 0xffffffff81074913, rsp = 0xfffffe01a51bf950, rbp = 0xfffffe01a51bf960 --- cpu_idle_acpi() at cpu_idle_acpi+0x43/frame 0xfffffe01a51bf960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe01a51bf980 sched_idletd() at sched_idletd+0x3e3/frame 0xfffffe01a51bfa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51bfab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51bfab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100005 td 0xfffff80003e2c4d0 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0172df0cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0172df0d10 trap() at trap+0x3a/frame 0xfffffe0172df0f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0172df0f20 --- trap 0x13, rip = 0xffffffff81074913, rsp = 0xfffffe01a51c4950, rbp = 0xfffffe01a51c4960 --- cpu_idle_acpi() at cpu_idle_acpi+0x43/frame 0xfffffe01a51c4960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe01a51c4980 sched_idletd() at sched_idletd+0x3e3/frame 0xfffffe01a51c4a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51c4ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51c4ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100006 td 0xfffff80003e2c000 cpustop_handler() at cpustop_handler+0x28/frame 0xfffffe0172df8cf0 ipi_nmi_handler() at ipi_nmi_handler+0x4a/frame 0xfffffe0172df8d10 trap() at trap+0x3a/frame 0xfffffe0172df8f20 nmi_calltrap() at nmi_calltrap+0x8/frame 0xfffffe0172df8f20 --- trap 0x13, rip = 0xffffffff81074913, rsp = 0xfffffe01a51c9950, rbp = 0xfffffe01a51c9960 --- cpu_idle_acpi() at cpu_idle_acpi+0x43/frame 0xfffffe01a51c9960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe01a51c9980 sched_idletd() at sched_idletd+0x3e3/frame 0xfffffe01a51c9a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51c9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51c9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command idle pid 11 tid 100007 td 0xfffff80003e2b9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51ce7f0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51ce820 critical_exit() at critical_exit+0x7a/frame 0xfffffe01a51ce840 ipi_bitmap_handler() at ipi_bitmap_handler+0x79/frame 0xfffffe01a51ce880 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x8e/frame 0xfffffe01a51ce880 --- interrupt, rip = 0xffffffff81074913, rsp = 0xfffffe01a51ce950, rbp = 0xfffffe01a51ce960 --- cpu_idle_acpi() at cpu_idle_acpi+0x43/frame 0xfffffe01a51ce960 cpu_idle() at cpu_idle+0x95/frame 0xfffffe01a51ce980 sched_idletd() at sched_idletd+0x3e3/frame 0xfffffe01a51cea70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51ceab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51ceab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command rand_harvestq pid 2 tid 100003 td 0xfffff80003e2d000 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51ba920 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51ba950 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe01a51ba980 _sleep() at _sleep+0x2bf/frame 0xfffffe01a51baa10 random_kthread() at random_kthread+0x270/frame 0xfffffe01a51baa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51baab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51baab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command init pid 1 tid 100002 td 0xfffff80003e2d4d0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51b5550 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51b5580 sleepq_catch_signals() at sleepq_catch_signals+0xab/frame 0xfffffe01a51b5600 sleepq_wait_sig() at sleepq_wait_sig+0xf/frame 0xfffffe01a51b5630 _sleep() at _sleep+0x2d2/frame 0xfffffe01a51b56c0 kern_wait6() at kern_wait6+0x707/frame 0xfffffe01a51b57a0 sys_wait4() at sys_wait4+0x73/frame 0xfffffe01a51b5990 amd64_syscall() at amd64_syscall+0x50b/frame 0xfffffe01a51b5ab0 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe01a51b5ab0 --- syscall (7, FreeBSD ELF64, sys_wait4), rip = 0x41ef4a, rsp = 0x7fffffffe7a8, rbp = 0x7fffffffe810 --- Tracing command audit pid 10 tid 100001 td 0xfffff80003e2d9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01a51b0960 mi_switch() at mi_switch+0xd8/frame 0xfffffe01a51b0990 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01a51b09c0 _cv_wait() at _cv_wait+0x189/frame 0xfffffe01a51b0a00 audit_worker() at audit_worker+0xa3/frame 0xfffffe01a51b0a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01a51b0ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01a51b0ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xffffffff81cd0cb0 sched_switch() at sched_switch+0x713/frame 0xffffffff82094a20 mi_switch() at mi_switch+0xd8/frame 0xffffffff82094a50 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xffffffff82094a80 _sleep() at _sleep+0x2bf/frame 0xffffffff82094b10 swapper() at swapper+0x5f/frame 0xffffffff82094b70 btext() at btext+0x2c Tracing command kernel pid 0 tid 100017 td 0xfffff80003e594d0 sched_switch() at sched_switch+0x713/frame 0xfffffe0174367950 mi_switch() at mi_switch+0xd8/frame 0xfffffe0174367980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743679b0 _sleep() at _sleep+0x2df/frame 0xfffffe0174367a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe0174367a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174367ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174367ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xfffff80003f364d0 sched_switch() at sched_switch+0x713/frame 0xfffffe0174376950 mi_switch() at mi_switch+0xd8/frame 0xfffffe0174376980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743769b0 _sleep() at _sleep+0x2df/frame 0xfffffe0174376a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe0174376a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174376ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174376ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xfffff80003f359a0 sched_switch() at sched_switch+0x713/frame 0xfffffe0174380980 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743809b0 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743809e0 msleep_spin_sbt() at msleep_spin_sbt+0x1c6/frame 0xfffffe0174380a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x103/frame 0xfffffe0174380a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174380ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174380ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xfffff80003f354d0 sched_switch() at sched_switch+0x713/frame 0xfffffe0174385980 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743859b0 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743859e0 msleep_spin_sbt() at msleep_spin_sbt+0x1c6/frame 0xfffffe0174385a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x103/frame 0xfffffe0174385a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174385ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174385ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xfffff80003f35000 sched_switch() at sched_switch+0x713/frame 0xfffffe017438a980 mi_switch() at mi_switch+0xd8/frame 0xfffffe017438a9b0 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe017438a9e0 msleep_spin_sbt() at msleep_spin_sbt+0x1c6/frame 0xfffffe017438aa40 taskqueue_thread_loop() at taskqueue_thread_loop+0x103/frame 0xfffffe017438aa70 fork_exit() at fork_exit+0x9c/frame 0xfffffe017438aab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe017438aab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xfffff80003f34000 sched_switch() at sched_switch+0x713/frame 0xfffffe0174399950 mi_switch() at mi_switch+0xd8/frame 0xfffffe0174399980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743999b0 _sleep() at _sleep+0x2df/frame 0xfffffe0174399a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe0174399a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe0174399ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe0174399ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xfffff8000601a9a0 sched_switch() at sched_switch+0x713/frame 0xfffffe017439e950 mi_switch() at mi_switch+0xd8/frame 0xfffffe017439e980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe017439e9b0 _sleep() at _sleep+0x2df/frame 0xfffffe017439ea40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe017439ea70 fork_exit() at fork_exit+0x9c/frame 0xfffffe017439eab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe017439eab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100033 td 0xfffff80006019000 sched_switch() at sched_switch+0x713/frame 0xfffffe01743c7950 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743c7980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743c79b0 _sleep() at _sleep+0x2df/frame 0xfffffe01743c7a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe01743c7a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743c7ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743c7ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100034 td 0xfffff800060189a0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743cc950 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743cc980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743cc9b0 _sleep() at _sleep+0x2df/frame 0xfffffe01743cca40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe01743cca70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743ccab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743ccab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100039 td 0xfffff80006081000 sched_switch() at sched_switch+0x713/frame 0xfffffe01743e98e0 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743e9910 sleepq_timedwait() at sleepq_timedwait+0x3a/frame 0xfffffe01743e9940 _sleep() at _sleep+0x2bf/frame 0xfffffe01743e99d0 pause_sbt() at pause_sbt+0xd4/frame 0xfffffe01743e9a10 deadlkres() at deadlkres+0x2c/frame 0xfffffe01743e9a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743e9ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743e9ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Tracing command kernel pid 0 tid 100041 td 0xfffff800060804d0 sched_switch() at sched_switch+0x713/frame 0xfffffe01743f3950 mi_switch() at mi_switch+0xd8/frame 0xfffffe01743f3980 sleepq_wait() at sleepq_wait+0x3a/frame 0xfffffe01743f39b0 _sleep() at _sleep+0x2df/frame 0xfffffe01743f3a40 taskqueue_thread_loop() at taskqueue_thread_loop+0x131/frame 0xfffffe01743f3a70 fork_exit() at fork_exit+0x9c/frame 0xfffffe01743f3ab0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01743f3ab0 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- db:0:allt> call doadump Dumping 307 out of 6112 MB:..6%..11%..21%..32%..42%..53%..63%..73%..84%..94% Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 Script done on Sun May 1 18:51:09 2016