GDB: no debug ports present
KDB: debugger backends: ddb
KDB: current backend: ddb
Copyright (c) 1992-2007 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-CURRENT #0: Fri Aug 17 10:44:44 EDT 2007
test@hydra1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO
WARNING: WITNESS option enabled, expect reduced performance.
ACPI APIC Table: <PTLTD APIC >
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(R) CPU E5320 @ 1.86GHz (1866.75-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
Cores per package: 4
usable memory = 4281126912 (4082 MB)
avail memory = 4117626880 (3926 MB)
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 1
cpu2 (AP): APIC ID: 2
cpu3 (AP): APIC ID: 3
cpu4 (AP): APIC ID: 4
cpu5 (AP): APIC ID: 5
cpu6 (AP): APIC ID: 6
cpu7 (AP): APIC ID: 7
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
:
Trying to mount root from ufs:/dev/ad4s1a
em0: link state changed to UP
em1: link state changed to UP
Interface IP-Address Broadcast
Loading configuration files.
kernel dumps on /dev/ad4s1b
Entropy harvesting: interrupts ethernet point_to_point kickstart.
swapon: adding /dev/ad4s1b as swap device
swapon: adding /dev/ad4s1d as swap device
Starting file system checks:
/dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad4s1a: clean, 388860 free (884 frags, 48497 blocks, 0.2% fragmentation)
/dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad4s1e: clean, 8684956 free (45828 frags, 1079891 blocks, 0.5% fragmentation)
/dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS
/dev/ad4s1f: clean, 9854224 free (200 frags, 1231753 blocks, 0.0% fragmentation)
Setting hostuuid: 53d19f64-d663-a017-8922-0030483354ca.
Setting hostid: 0x4a759c96.
Mounting local file systems:.
Setting hostname: hydra1.netperf.freebsd.org.
net.inet6.ip6.auto_linklocal: 1 -> 0
fec_up: not found
em0: link state changed to DOWN
em0: no link .....em0: link state changed to UP
got link
DHCPREQUEST on em0 to 255.255.255.255 port 67
DHCPACK from 192.168.5.1
bound to 192.168.5.110 -- renewal in 300 seconds.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
inet6 ::1 prefixlen 128
inet 127.0.0.1 netmask 0xff000000
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=18b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWCSUM,TSO4>
ether 00:30:48:33:54:ca
inet 192.168.5.110 netmask 0xffffff00 broadcast 192.168.5.255
media: Ethernet autoselect (1000baseTX <full-duplex>)
status: active
Additional routing options: IP gateway=YES.
Starting devd.
hw.acpi.cpu.cx_lowest: C1 -> C1
Additional IP options:.
Mounting NFS file systems:.
Creating and/or trimming log files:.
Starting syslogd.
Checking for core dump on /dev/ad4s1b...
savecore: no dumps found
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
32-bit compatibility ldconfig path: /usr/lib32
Initial amd64 initialization:.
Additional ABI support:.
Clearing /tmp (X related).
Starting local daemons:.
Updating motd.
Mounting late file systems:.
Configuring syscons: blanktime.
Starting sshd.
Starting cron.
Local package initialization:.
Fri Aug 17 11:20:14 EDT 2007
FreeBSD/amd64 (hydra1.netperf.freebsd.org) (ttyd0)
login: kse_release: called outside of threading. exitingkse_release: called outside of threading. exitingkern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
:
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
kern.ipc.maxpipekva exceeded; see tuning(7)
Connection closed by foreign host.
$ telnet pm25 2007$
Trying 192.168.5.25...
Connected to pm25.
Escape character is '^]'.
FreeBSD/amd64 (hydra1.netperf.freebsd.org) (ttyd0)
login: kernel trap 9 with interrupts disabled
spin lock 0xffffffff80a258e0 (smp rendezvous) held by 0xffffff0005178340 (tid 100058) too long
panic: spin lock held too long
cpuid = 7
KDB: enter: panic
[thread pid 11395 tid 100179 ]
Stopped at kdb_enter+0x31: leave
db> where
Tracing pid 11395 tid 100179 td 0xffffff0005704680
kdb_enter() at kdb_enter+0x31
panic() at panic+0x173
_mtx_lock_spin_failed() at _mtx_lock_spin_failed+0x61
_mtx_lock_spin() at _mtx_lock_spin+0x9e
_mtx_lock_spin_flags() at _mtx_lock_spin_flags+0xf4
smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xd1
pmap_invalidate_page() at pmap_invalidate_page+0x6c
pmap_enter() at pmap_enter+0x350
vm_fault() at vm_fault+0x12ac
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4f3
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800662aaa, rsp = 0x7fffffffe7e0, rbp = 0x4027f0 ---
db> show allpcpu
Current CPU: 7
cpuid = 0
curthread = 0xffffff00012c9000: pid 45 "pagedaemon"
curpcb = 0xffffffffac560d40
fpcurthread = none
idlethread = 0xffffff000110d680: pid 18 "idle: cpu0"
spin locks held:
cpuid = 1
curthread = 0xffffff01241269c0: pid 11365 "syscall"
curpcb = 0xffffffffc589ed40
fpcurthread = none
idlethread = 0xffffff00010e6000: pid 17 "idle: cpu1"
spin locks held:
cpuid = 2
curthread = 0xffffff0005178340: pid 51 "softdepflush"
curpcb = 0xffffffffafe74d40
fpcurthread = none
idlethread = 0xffffff00010eb680: pid 16 "idle: cpu2"
spin locks held:
cpuid = 3
curthread = 0xffffff002076b000: pid 11378 "syscall"
curpcb = 0xffffffffb2e6ad40
fpcurthread = none
idlethread = 0xffffff00010eb340: pid 15 "idle: cpu3"
spin locks held:
cpuid = 4
curthread = 0xffffff00052c6000: pid 11329 "syscall"
curpcb = 0xffffffffb21fed40
fpcurthread = none
idlethread = 0xffffff00010eb000: pid 14 "idle: cpu4"
spin locks held:
cpuid = 5
curthread = 0xffffff0067be79c0: pid 11324 "syscall"
curpcb = 0xffffffffb363fd40
fpcurthread = none
idlethread = 0xffffff00010e99c0: pid 13 "idle: cpu5"
spin locks held:
cpuid = 6
curthread = 0xffffff012b3049c0: pid 11315 "syscall"
curpcb = 0xffffffffb6795d40
fpcurthread = none
idlethread = 0xffffff00010e9000: pid 12 "idle: cpu6"
spin locks held:
cpuid = 7
curthread = 0xffffff0005704680: pid 11395 "syscall"
curpcb = 0xffffffffb2438d40
fpcurthread = none
idlethread = 0xffffff00010e69c0: pid 11 "idle: cpu7"
spin locks held:
db> show alllocks
Process 11395 (syscall) thread 0xffffff0005704680 (100179)
exclusive sleep mutex pmap r = 0 (0xffffff00a6ee3df8) locked @ amd64/amd64/pmap.c:2241
exclusive sleep mutex vm page queue mutex r = 0 (0xffffffff80ab50e0) locked @ amd64/amd64/pmap.c:2240
exclusive sx user map r = 0 (0xffffff00a6ee3d70) locked @ vm/vm_map.c:3075
Process 11378 (syscall) thread 0xffffff002076b000 (100882)
exclusive sx user map r = 0 (0xffffff0092122890) locked @ vm/vm_map.c:2567
Process 11329 (syscall) thread 0xffffff00052c6000 (100074)
exclusive sleep mutex vm object (standard object) r = 0 (0xffffff0067836708) locked @ vm/vm_fault.c:900
exclusive sx user map r = 0 (0xffffff01061cf070) locked @ vm/vm_map.c:3075
Process 11324 (syscall) thread 0xffffff0067be79c0 (101040)
exclusive sx user map r = 0 (0xffffff00b051bd70) locked @ vm/vm_map.c:2567
Process 11315 (syscall) thread 0xffffff012b3049c0 (101515)
exclusive sx user map r = 0 (0xffffff00086943b0) locked @ vm/vm_map.c:2567
Process 758 (sshd) thread 0xffffff00012cc9c0 (100053)
exclusive sx so_rcv_sx r = 0 (0xffffff0005650100) locked @ kern/uipc_sockbuf.c:145
Process 3 (g_up) thread 0xffffff00010e9680 (100009)
exclusive sleep mutex vm object (kernel object) r = 0 (0xffffffff80ab4ea0) locked @ kern/vfs_bio.c:3686
db> ps
pid ppid pgrp uid state wmesg wchan cmd
11420 11326 764 1002 R+ syscall
11419 11387 11387 1002 R syscall
11418 11372 764 1002 R+ syscall
11417 11391 764 1002 R+ syscall
11416 11315 764 1002 N+ syscall
11415 11381 764 1002 R+ syscall
11414 11324 764 1002 N+ syscall
11413 11342 764 1002 R+ syscall
11412 11329 764 1002 R+ syscall
11411 11351 764 1002 R+ syscall
11410 11335 764 1002 R+ syscall
11409 11251 764 1002 N syscall
11408 11366 764 1002 R+ syscall
11407 11353 764 1002 R+ syscall
11406 11321 764 1002 R+ syscall
11405 11384 764 1002 R+ syscall
11404 11331 764 1002 R+ syscall
11403 11370 764 1002 R+ syscall
11402 11348 764 1002 R+ syscall
11401 11251 764 1002 N syscall
11400 11355 764 1002 R+ syscall
11399 11371 764 1002 R+ syscall
11398 11318 764 1002 R+ syscall
11397 11327 764 1002 R+ syscall
11396 11383 764 1002 R+ syscall
11395 11376 764 1002 RL+ CPU 7 syscall
11394 11378 764 1002 N+ syscall
11393 9819 764 1002 N syscall
11391 11312 764 1002 S+ wait 0xffffff007f7f48c0 syscall
11387 11312 11387 1002 Ss wait 0xffffff0067c168c0 syscall
11385 11312 11385 1002 Rs syscall
11384 11312 764 1002 S+ wait 0xffffff0008c318c0 syscall
11383 11312 764 1002 S+ wait 0xffffff0067c038c0 syscall
11381 11312 764 1002 S+ wait 0xffffff00053c1460 syscall
11379 11312 764 1002 R+ syscall
11378 11312 764 1002 RL+ CPU 3 syscall
11376 11312 764 1002 S+ wait 0xffffff009dfe6460 syscall
11372 11312 764 1002 S+ wait 0xffffff00b0404460 syscall
11371 11312 764 1002 S+ wait 0xffffff00594a6460 syscall
11370 11312 764 1002 S+ wait 0xffffff0059abe000 syscall
11367 11312 764 1002 R+ syscall
11366 11312 764 1002 S+ wait 0xffffff00088988c0 syscall
11365 11312 764 1002 R+ (threaded) syscall
101560 Run CPU 1 syscall
101380 RunQ syscall
11364 11312 764 1002 R+ syscall
11363 11312 764 1002 R+ syscall
11362 11312 764 1002 R+ syscall
11360 11312 764 1002 R+ syscall
11358 11312 764 1002 R+ syscall
11356 11312 764 1002 R+ syscall
11355 11312 764 1002 R+ syscall
11354 11312 764 1002 R+ syscall
11353 11312 764 1002 S+ wait 0xffffff00085bd8c0 syscall
11352 11312 764 1002 R+ syscall
11351 11312 764 1002 S+ wait 0xffffff0005da5460 syscall
11349 11312 764 1002 R+ syscall
11348 11312 764 1002 S+ wait 0xffffff0067bfe000 syscall
11346 11312 764 1002 R+ syscall
11342 11312 764 1002 S+ wait 0xffffff000d3488c0 syscall
11338 11312 764 1002 R+ syscall
11335 11312 764 1002 S+ wait 0xffffff0008a26460 syscall
11334 11312 764 1002 R+ syscall
11333 11312 764 1002 R+ syscall
11331 11312 764 1002 S+ wait 0xffffff002089d000 syscall
11329 11312 764 1002 RL+ CPU 4 syscall
11328 11312 764 1002 R+ syscall
11327 11312 764 1002 S+ wait 0xffffff00605e88c0 syscall
11326 11312 764 1002 S+ wait 0xffffff00678c1460 syscall
11324 11312 764 1002 RL+ CPU 5 syscall
11323 11312 764 1002 R+ syscall
11322 11312 764 1002 R+ syscall
11321 11312 764 1002 S+ wait 0xffffff0099205000 syscall
11318 11312 764 1002 R+ syscall
11317 11312 764 1002 R+ syscall
11315 11312 764 1002 TL+ (threaded) syscall
101515 Run CPU 6 syscall
11313 11312 764 1002 R+ syscall
11312 11311 764 1002 R+ syscall
11311 11309 764 1002 S+ wait 0xffffff0067c02000 syscall
11309 11308 764 1002 S+ wait 0xffffff006d0508c0 run
11308 11307 764 1002 S+ wait 0xffffff00053c18c0 run
11307 11302 764 1002 R+ run
11302 764 764 1002 S+ wait 0xffffff007f26e460 sh
764 762 764 1002 S+ wait 0xffffff00051748c0 sh
762 761 762 1002 SWs+ wait 0xffffff00057028c0 sh
761 758 758 1002 S select 0xffffffff80aa4270 sshd
758 697 758 0 SWs sbwait 0xffffff000565015c sshd
757 1 757 0 SWs+ ttyin 0xffffff00050f6010 getty
756 1 756 0 SWs+ ttyin 0xffffff00050f8c10 getty
755 1 755 0 SWs+ ttyin 0xffffff0005108010 getty
754 1 754 0 SWs+ ttyin 0xffffff0005108410 getty
753 1 753 0 SWs+ ttyin 0xffffff0005108810 getty
752 1 752 0 SWs+ ttyin 0xffffff0005108c10 getty
751 1 751 0 SWs+ ttyin 0xffffff0005109010 getty
750 1 750 0 SWs+ ttyin 0xffffff0005109410 getty
749 1 749 0 SWs+ ttyin 0xffffff0005109810 getty
713 1 713 0 Ss nanslp 0xffffffff80a1b688 cron
707 1 707 25 Ss pause 0xffffff0005347520 sendmail
703 1 703 0 Rs sendmail
697 1 697 0 SWs select 0xffffffff80aa4270 sshd
581 1 581 0 Ss snaplk 0xffffff0005471220 syslogd
535 1 535 0 SWs select 0xffffffff80aa4270 devd
319 1 319 65 Rs dhclient
300 1 53 0 S+ select 0xffffffff80aa4270 dhclient
166 1 166 0 SWs pause 0xffffff00053c0980 adjkerntz
52 0 0 0 SL - 0xffffffff80a1b308 [schedcpu]
51 0 0 0 RL CPU 2 [softdepflush]
50 0 0 0 RL [vnlru]
49 0 0 0 SL biord 0xffffffff9a5f4328 [syncer]
48 0 0 0 RL [bufdaemon]
47 0 0 0 SL pgzero 0xffffffff80ab5bb4 [pagezero]
46 0 0 0 SL psleep 0xffffffff80ab5168 [vmdaemon]
45 0 0 0 RL CPU 0 [pagedaemon]
44 0 0 0 SL waiting_ 0xffffffff80aa8200 [sctp_iterator]
43 0 0 0 WL [swi0: sio]
42 0 0 0 WL [irq1: atkbd0]
41 0 0 0 WL [irq15: ata1]
40 0 0 0 WL [irq14: ata0]
39 0 0 0 RL [usb3]
38 0 0 0 RL [usb2]
37 0 0 0 WL [irq18: uhci2]
36 0 0 0 RL [usb1]
35 0 0 0 WL [irq19: uhci1+]
34 0 0 0 SL usbtsk 0xffffffff80a16b88 [usbtask-dr]
33 0 0 0 SL usbtsk 0xffffffff80a16b60 [usbtask-hc]
32 0 0 0 RL [usb0]
31 0 0 0 WL [irq17: uhci0 ehci0]
30 0 0 0 SL - 0xffffff00012b5a00 [em1 taskq]
29 0 0 0 SL - 0xffffff00012b3500 [em0 taskq]
28 0 0 0 WL [irq9: acpi0]
27 0 0 0 SL - 0xffffff000120b880 [kqueue taskq]
26 0 0 0 WL [swi6: task queue]
25 0 0 0 WL [swi6: Giant taskq]
9 0 0 0 SL - 0xffffff000120bb00 [thread taskq]
24 0 0 0 WL [swi5: +]
23 0 0 0 WL [swi2: cambio]
8 0 0 0 SL ccb_scan 0xffffffff809e58e0 [xpt_thrd]
7 0 0 0 SL - 0xffffff000123e400 [acpi_task_2]
6 0 0 0 SL - 0xffffff000123e400 [acpi_task_1]
5 0 0 0 SL - 0xffffff000123e400 [acpi_task_0]
22 0 0 0 RL [yarrow]
4 0 0 0 RL [g_down]
3 0 0 0 RL [g_up]
2 0 0 0 RL [g_event]
21 0 0 0 WL [swi3: vm]
20 0 0 0 RL [swi4: clock sio]
19 0 0 0 WL [swi1: net]
18 0 0 0 RL [idle: cpu0]
17 0 0 0 RL [idle: cpu1]
16 0 0 0 RL [idle: cpu2]
15 0 0 0 RL [idle: cpu3]
14 0 0 0 RL [idle: cpu4]
13 0 0 0 RL [idle: cpu5]
12 0 0 0 RL [idle: cpu6]
11 0 0 0 RL [idle: cpu7]
1 0 1 0 SLs wait 0xffffff00010e58c0 [init]
10 0 0 0 SL audit_wo 0xffffffff80ab3880 [audit]
0 0 0 0 WLs [swapper]
11390 11312 764 1002 Z+ syscall
11388 11312 764 1002 Z+ syscall
11392 11312 764 1002 Z+ syscall
11368 11312 764 1002 Z+ syscall
11382 11312 764 1002 Z+ syscall
11375 11312 764 1002 Z+ syscall
11380 11312 764 1002 Z+ syscall
11389 11312 764 1002 Z+ syscall
11386 11312 764 1002 Z+ syscall
11341 11312 764 1002 Z+ syscall
11357 11312 764 1002 Z+ syscall
11359 11312 764 1002 Z+ syscall
11347 11312 764 1002 Z+ syscall
11374 11312 764 1002 Z+ syscall
11373 11312 764 1002 Z+ syscall
11377 11312 764 1002 Z+ syscall
11369 11312 764 1002 Z+ syscall
11330 11312 764 1002 Z+ syscall
11332 11312 764 1002 Z+ syscall
11344 11312 764 1002 Z+ syscall
11340 11312 764 1002 Z+ syscall
11319 11312 764 1002 Z+ syscall
11361 11312 764 1002 Z+ syscall
11320 11312 764 1002 Z+ syscall
11314 11312 764 1002 Z+ syscall
11336 11312 764 1002 Z+ syscall
11325 11312 764 1002 Z+ syscall
11339 11312 764 1002 Z+ syscall
11343 11312 764 1002 Z+ syscall
11337 11312 764 1002 Z+ syscall
11316 11312 764 1002 Z+ syscall
11350 11312 764 1002 Z+ syscall
11345 11312 764 1002 Z+ syscall
db> set $lines 0
db> allt
Tracing command syscall pid 11420 tid 100914 td 0xffffff00591279c0
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11419 tid 100172 td 0xffffff0005706340
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11418 tid 100577 td 0xffffff0008b45680
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11417 tid 100203 td 0xffffff00059a2340
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11416 tid 100728 td 0xffffff0020bb39c0
sched_switch() at sched_switch+0x176
(null)() at 0x6d700000246
Tracing command syscall pid 11415 tid 100984 td 0xffffff0016e32000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11414 tid 101358 td 0xffffff012b68d680
sched_switch() at sched_switch+0x176
(null)() at 0x3bf804ae802
MAXCPU() at 0x246
(null)() at 0x6d78046bf1c
(null)() at 0xffffff012b68d680
Tracing command syscall pid 11413 tid 101423 td 0xffffff00a9231000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11412 tid 100686 td 0xffffff001477f000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11411 tid 101295 td 0xffffff002f5f1340
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11410 tid 101026 td 0xffffff0067bf5680
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11409 tid 101529 td 0xffffff0121666000
sched_switch() at sched_switch+0x176
sched_lock() at sched_lock
Tracing command syscall pid 11408 tid 101084 td 0xffffff0067c129c0
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11407 tid 100124 td 0xffffff00053ba680
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11406 tid 100867 td 0xffffff006ddee000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11405 tid 101201 td 0xffffff00a9c77000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11404 tid 101485 td 0xffffff0124328000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11403 tid 100325 td 0xffffff000811e680
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11402 tid 100862 td 0xffffff012c64d340
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11401 tid 100387 td 0xffffff000897e680
sched_switch() at sched_switch+0x176
sched_lock() at sched_lock
Tracing command syscall pid 11400 tid 100510 td 0xffffff00088d7340
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11399 tid 100945 td 0xffffff00594ab000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11398 tid 100239 td 0xffffff0005e86000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11397 tid 100668 td 0xffffff00b08ce680
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11396 tid 100899 td 0xffffff006d250000
fork_trampoline() at fork_trampoline
Tracing command syscall pid 11395 tid 100179 td 0xffffff0005704680
kdb_enter() at kdb_enter+0x31
panic() at panic+0x173
_mtx_lock_spin_failed() at _mtx_lock_spin_failed+0x61
_mtx_lock_spin() at _mtx_lock_spin+0x9e
_mtx_lock_spin_flags() at _mtx_lock_spin_flags+0xf4
smp_targeted_tlb_shootdown() at smp_targeted_tlb_shootdown+0xd1
pmap_invalidate_page() at pmap_invalidate_page+0x6c
pmap_enter() at pmap_enter+0x350
vm_fault() at vm_fault+0x12ac
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4f3
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x800662aaa, rsp = 0x7fffffffe7e0, rbp = 0x4027f0 ---
Tracing command syscall pid 11394 tid 100156 td 0xffffff000546d680
sched_switch() at sched_switch+0x176
(null)() at 0x6c50546d680
MAXCPU() at 0x246
(null)() at 0x6d78046bf1c
dmapbase() at 0xffffff000546d680
Tracing command syscall pid 11393 tid 100330 td 0xffffff000811c340
sched_switch() at sched_switch+0x176
(null)() at 0x6d7804676ff
MAXCPU() at 0x46
dmapbase() at 0xffffff0008594000
Tracing command syscall pid 11391 tid 101454 td 0xffffff00c4651680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11387 tid 101063 td 0xffffff0067c01680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11385 tid 100700 td 0xffffff00b072e340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sx_xlock_hard() at _sx_xlock_hard+0x1a5
_sx_xlock() at _sx_xlock+0xb8
setsid() at setsid+0x6e
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (0, FreeBSD ELF64, nosys), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11384 tid 100446 td 0xffffff0008b4c340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11383 tid 101044 td 0xffffff0067be7340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11381 tid 100127 td 0xffffff00053b69c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11379 tid 100776 td 0xffffff00088379c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (22, FreeBSD ELF64, unmount), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11378 tid 100882 td 0xffffff002076b000
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8046c032, rsp = 0xffffffffab9a3ff0, rbp = 0xffffffffb2e6a950 ---
_mtx_lock_sleep() at _mtx_lock_sleep+0xf2
_mtx_lock_flags() at _mtx_lock_flags+0xe1
pmap_protect() at pmap_protect+0x50
vmspace_fork() at vmspace_fork+0x40e
vm_forkproc() at vm_forkproc+0xcb
fork1() at fork1+0xd61
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11376 tid 101279 td 0xffffff0106b8f000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11372 tid 100607 td 0xffffff00b0774680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11371 tid 100937 td 0xffffff0020714000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11370 tid 101104 td 0xffffff005910f680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11367 tid 101118 td 0xffffff005910c000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (3, FreeBSD ELF64, read), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11366 tid 100719 td 0xffffff0005f71000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11365 tid 101560 td 0xffffff01241269c0
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff806cf7c0, rsp = 0xffffffffab999ff0, rbp = 0xffffffffab9968d0 ---
Xpage() at Xpage
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab996990, rbp = 0xffffffffab996a70 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab996b30, rbp = 0xffffffffab996c10 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab996cd0, rbp = 0xffffffffab996db0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab996e70, rbp = 0xffffffffab996f50 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997010, rbp = 0xffffffffab9970f0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9971b0, rbp = 0xffffffffab997290 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997350, rbp = 0xffffffffab997430 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9974f0, rbp = 0xffffffffab9975d0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997690, rbp = 0xffffffffab997770 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997830, rbp = 0xffffffffab997910 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9979d0, rbp = 0xffffffffab997ab0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997b70, rbp = 0xffffffffab997c50 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997d10, rbp = 0xffffffffab997df0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab997eb0, rbp = 0xffffffffab997f90 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998050, rbp = 0xffffffffab998130 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9981f0, rbp = 0xffffffffab9982d0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998390, rbp = 0xffffffffab998470 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998530, rbp = 0xffffffffab998610 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9986d0, rbp = 0xffffffffab9987b0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998870, rbp = 0xffffffffab998950 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998a10, rbp = 0xffffffffab998af0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998bb0, rbp = 0xffffffffab998c90 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998d50, rbp = 0xffffffffab998e30 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab998ef0, rbp = 0xffffffffab998fd0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab999090, rbp = 0xffffffffab999170 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab999230, rbp = 0xffffffffab999310 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9993d0, rbp = 0xffffffffab9994b0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab999570, rbp = 0xffffffffab999650 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab999710, rbp = 0xffffffffab9997f0 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab9998b0, rbp = 0xffffffffab999990 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff806e8de2, rsp = 0xffffffffab999a50, rbp = 0xffffffffab999b30 ---
trap() at trap+0x22
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0xffffffff80712ea7, rsp = 0xffffffffab999bf0, rbp = 0xffffffffab999c40 ---
sio_cnputc() at sio_cnputc+0xd7
cnputc() at cnputc+0x7a
putchar() at putchar+0x6b
kvprintf() at kvprintf+0x72
cpustop_handler() at cpustop_handler+0x40
Tracing command syscall pid 11365 tid 101380 td 0xffffff012b5569c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11364 tid 100848 td 0xffffff0020bde9c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (2, FreeBSD ELF64, fork), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11363 tid 100866 td 0xffffff006ddee340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11362 tid 101392 td 0xffffff01176c19c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11360 tid 100320 td 0xffffff00081239c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (9, FreeBSD ELF64, link), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11358 tid 100256 td 0xffffff000811f340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (3, FreeBSD ELF64, read), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11356 tid 101129 td 0xffffff0117742340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11355 tid 100359 td 0xffffff00085c29c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (11400), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11354 tid 100979 td 0xffffff0059159680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11353 tid 100337 td 0xffffff0005c35680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11352 tid 100826 td 0xffffff00b02f0000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (9, FreeBSD ELF64, link), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11351 tid 100628 td 0xffffff00b02f7340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11349 tid 100207 td 0xffffff0005711340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11348 tid 101029 td 0xffffff0067bf6340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11346 tid 101056 td 0xffffff0067c10340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (9, FreeBSD ELF64, link), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11342 tid 100854 td 0xffffff000d34d340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11338 tid 100396 td 0xffffff00052ce340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (22, FreeBSD ELF64, unmount), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11335 tid 100421 td 0xffffff00085a9340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11334 tid 100636 td 0xffffff00c12d8340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (12, FreeBSD ELF64, chdir), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11333 tid 101194 td 0xffffff01172a5680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11331 tid 100652 td 0xffffff00b091e340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11329 tid 100074 td 0xffffff00052c6000
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8046c032, rsp = 0xffffffffab9a8ff0, rbp = 0xffffffffb21fe8e0 ---
_mtx_lock_sleep() at _mtx_lock_sleep+0xf2
_mtx_lock_flags() at _mtx_lock_flags+0xe1
vm_fault() at vm_fault+0x133b
trap_pfault() at trap_pfault+0x128
trap() at trap+0x4f3
calltrap() at calltrap+0x8
--- trap 0xc, rip = 0x80050b4f8, rsp = 0x7fffffffe718, rbp = 0x41b8 ---
Tracing command syscall pid 11328 tid 101061 td 0xffffff0067c08000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sx_xlock_hard() at _sx_xlock_hard+0x1a5
_sx_xlock() at _sx_xlock+0xb8
fork1() at fork1+0xa11
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11327 tid 101361 td 0xffffff01176a4680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11326 tid 101258 td 0xffffff00c6c69000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11324 tid 101040 td 0xffffff0067be79c0
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8046c032, rsp = 0xffffffffab9adff0, rbp = 0xffffffffb363f950 ---
_mtx_lock_sleep() at _mtx_lock_sleep+0xf2
_mtx_lock_flags() at _mtx_lock_flags+0xe1
pmap_protect() at pmap_protect+0x50
vmspace_fork() at vmspace_fork+0x40e
vm_forkproc() at vm_forkproc+0xcb
fork1() at fork1+0xd61
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11323 tid 100096 td 0xffffff00052f9000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11322 tid 101382 td 0xffffff011815d680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sx_xlock_hard() at _sx_xlock_hard+0x1a5
_sx_xlock() at _sx_xlock+0xb8
fork1() at fork1+0xa11
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11321 tid 101284 td 0xffffff012b6b89c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11318 tid 101541 td 0xffffff0117055680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sx_xlock_hard() at _sx_xlock_hard+0x1a5
_sx_xlock() at _sx_xlock+0xb8
kern_wait() at kern_wait+0xbd
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11317 tid 100581 td 0xffffff0020a68680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ast() at ast+0x1e7
Xfast_syscall() at Xfast_syscall+0xe0
--- syscall (14, FreeBSD ELF64, mknod), rip = 0x800687acc, rsp = 0x7fffffffe878, rbp = 0x7fffffffe8c0 ---
Tracing command syscall pid 11315 tid 101515 td 0xffffff012b3049c0
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8046c036, rsp = 0xffffffffab9b2ff0, rbp = 0xffffffffb6795940 ---
_mtx_lock_sleep() at _mtx_lock_sleep+0xf6
_mtx_lock_flags() at _mtx_lock_flags+0xe1
pmap_copy() at pmap_copy+0x83
vmspace_fork() at vmspace_fork+0x34e
vm_forkproc() at vm_forkproc+0xcb
fork1() at fork1+0xd61
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11313 tid 101398 td 0xffffff012b551340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sx_xlock_hard() at _sx_xlock_hard+0x1a5
_sx_xlock() at _sx_xlock+0xb8
fork1() at fork1+0xa11
fork() at fork+0x1c
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (2, FreeBSD ELF64, fork), rip = 0x80069ba5c, rsp = 0x7fffffffe7d8, rbp = 0x4027f0 ---
Tracing command syscall pid 11312 tid 100670 td 0xffffff00b004f000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_sleep() at _sleep+0x20a
kern_nanosleep() at kern_nanosleep+0x118
nanosleep() at nanosleep+0x6e
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x8006f7e6c, rsp = 0x7fffffffe438, rbp = 0x7fffffffe490 ---
Tracing command syscall pid 11311 tid 101036 td 0xffffff0067bf1680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe928, rbp = 0x7fffffffe950 ---
Tracing command run pid 11309 tid 100590 td 0xffffff00081e0340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe3d8, rbp = 0x7fffffffe870 ---
Tracing command run pid 11308 tid 100128 td 0xffffff00053b6680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80069ba3c, rsp = 0x7fffffffe8a8, rbp = 0x7fffffffe8d0 ---
Tracing command run pid 11307 tid 100427 td 0xffffff00085a09c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_sleep() at _sleep+0x20a
kern_nanosleep() at kern_nanosleep+0x118
nanosleep() at nanosleep+0x6e
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x8006f7e6c, rsp = 0x7fffffffe8a8, rbp = 0x7fffffffe900 ---
Tracing command sh pid 11302 tid 101387 td 0xffffff00a9500680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092aa3c, rsp = 0x7fffffffe778, rbp = 0x2fc ---
Tracing command sh pid 764 tid 100056 td 0xffffff00051789c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x80092aa3c, rsp = 0x7fffffffe558, rbp = 0x2fc ---
Tracing command sh pid 762 tid 100167 td 0xffffff0005710680
Tracing command sshd pid 761 tid 100174 td 0xffffff00057059c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x15f
kern_select() at kern_select+0x80b
select() at select+0x56
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (93, FreeBSD ELF64, select), rip = 0x8016f51ec, rsp = 0x7fffffffe528, rbp = 0x7fffffffe5a0 ---
Tracing command sshd pid 758 tid 100053 td 0xffffff00012cc9c0
Tracing command getty pid 757 tid 100123 td 0xffffff00053ba9c0
Tracing command getty pid 756 tid 100180 td 0xffffff0005704340
Tracing command getty pid 755 tid 100114 td 0xffffff00053bd000
Tracing command getty pid 754 tid 100109 td 0xffffff0005329000
Tracing command getty pid 753 tid 100164 td 0xffffff0005466680
Tracing command getty pid 752 tid 100107 td 0xffffff0005329680
Tracing command getty pid 751 tid 100120 td 0xffffff00053bb680
Tracing command getty pid 750 tid 100161 td 0xffffff000546c340
Tracing command getty pid 749 tid 100080 td 0xffffff00052b3680
Tracing command cron pid 713 tid 100118 td 0xffffff00053bc000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_sleep() at _sleep+0x20a
kern_nanosleep() at kern_nanosleep+0x118
nanosleep() at nanosleep+0x6e
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800912e6c, rsp = 0x7fffffffec38, rbp = 0x3c ---
Tracing command sendmail pid 707 tid 100112 td 0xffffff000532c340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_sigsuspend() at kern_sigsuspend+0xca
sigsuspend() at sigsuspend+0x34
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (341, FreeBSD ELF64, sigsuspend), rip = 0x800d0f90c, rsp = 0x7fffffffda58, rbp = 0x1 ---
Tracing command sendmail pid 703 tid 100159 td 0xffffff000546c9c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x16a
kern_select() at kern_select+0x7df
select() at select+0x56
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (93, FreeBSD ELF64, select), rip = 0x800d9c1ec, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd800 ---
Tracing command sshd pid 697 tid 100168 td 0xffffff0005710340
Tracing command syslogd pid 581 tid 100178 td 0xffffff00057049c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
acquire() at acquire+0x93
_lockmgr() at _lockmgr+0x2ac
ffs_copyonwrite() at ffs_copyonwrite+0x171
ffs_geom_strategy() at ffs_geom_strategy+0x1b5
ufs_strategy() at ufs_strategy+0x50
VOP_STRATEGY_APV() at VOP_STRATEGY_APV+0x9e
bufstrategy() at bufstrategy+0x43
bufwrite() at bufwrite+0x117
ffs_syncvnode() at ffs_syncvnode+0x2bf
ffs_fsync() at ffs_fsync+0x18
VOP_FSYNC_APV() at VOP_FSYNC_APV+0x96
fsync() at fsync+0x1ad
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (95, FreeBSD ELF64, fsync), rip = 0x80082310c, rsp = 0x7fffffffddf8, rbp = 0x8 ---
Tracing command devd pid 535 tid 100148 td 0xffffff0005470680
Tracing command dhclient pid 319 tid 100129 td 0xffffff00053b6340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19
_cv_timedwait_sig() at _cv_timedwait_sig+0x16a
poll() at poll+0x1e3
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006d10cc, rsp = 0x7fffffffeda8, rbp = 0x493e0 ---
Tracing command dhclient pid 300 tid 100147 td 0xffffff00054709c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_cv_wait_sig() at _cv_wait_sig+0x15f
poll() at poll+0x567
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (209, FreeBSD ELF64, poll), rip = 0x8006d10cc, rsp = 0x7fffffffeda8, rbp = 0x5 ---
Tracing command adjkerntz pid 166 tid 100125 td 0xffffff00053ba340
Tracing command schedcpu pid 52 tid 100057 td 0xffffff0005178680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
schedcpu_thread() at schedcpu_thread+0x220
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffafe79d30, rbp = 0 ---
Tracing command softdepflush pid 51 tid 100058 td 0xffffff0005178340
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff806da3f8, rsp = 0xffffffffab99eff0, rbp = 0xffffffffafe74920 ---
smp_tlb_shootdown() at smp_tlb_shootdown+0x88
pmap_invalidate_range() at pmap_invalidate_range+0xae
vfs_vmio_release() at vfs_vmio_release+0x120
brelse() at brelse+0x73d
indir_trunc() at indir_trunc+0x2ea
handle_workitem_freeblocks() at handle_workitem_freeblocks+0x29b
process_worklist_item() at process_worklist_item+0x245
softdep_process_worklist() at softdep_process_worklist+0xa0
softdep_flush() at softdep_flush+0xd2
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffafe74d30, rbp = 0 ---
Tracing command vnlru pid 50 tid 100059 td 0xffffff0005178000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
vnlru_proc() at vnlru_proc+0x6a3
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffafe6fd30, rbp = 0 ---
Tracing command syncer pid 49 tid 100039 td 0xffffff00012ca000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
bwait() at bwait+0x58
bufwait() at bufwait+0x56
bread() at bread+0x1e
ffs_balloc_ufs2() at ffs_balloc_ufs2+0xab0
ffs_copyonwrite() at ffs_copyonwrite+0x2c4
ffs_geom_strategy() at ffs_geom_strategy+0x1b5
bufwrite() at bufwrite+0x117
vfs_bio_awrite() at vfs_bio_awrite+0x74
vop_stdfsync() at vop_stdfsync+0x1fe
VOP_FSYNC_APV() at VOP_FSYNC_APV+0x96
sched_sync() at sched_sync+0x364
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac574d30, rbp = 0 ---
Tracing command bufdaemon pid 48 tid 100040 td 0xffffff00012c99c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
buf_daemon() at buf_daemon+0x208
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac56fd30, rbp = 0 ---
Tracing command pagezero pid 47 tid 100041 td 0xffffff00012c9680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
vm_pagezero() at vm_pagezero+0x73
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac56ad30, rbp = 0 ---
Tracing command vmdaemon pid 46 tid 100042 td 0xffffff00012c9340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
vm_daemon() at vm_daemon+0x4d
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac565d30, rbp = 0 ---
Tracing command pagedaemon pid 45 tid 100043 td 0xffffff00012c9000
cpustop_handler() at cpustop_handler+0x40
ipi_nmi_handler() at ipi_nmi_handler+0x30
trap() at trap+0x378
nmi_calltrap() at nmi_calltrap+0x8
--- trap 0x13, rip = 0xffffffff8046c04e, rsp = 0xffffffff80ac0490, rbp = 0xffffffffac560ae0 ---
_mtx_lock_sleep() at _mtx_lock_sleep+0x10e
_mtx_lock_flags() at _mtx_lock_flags+0xe1
vm_pageout() at vm_pageout+0x801
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac560d30, rbp = 0 ---
Tracing command sctp_iterator pid 44 tid 100044 td 0xffffff00012449c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
sctp_iterator_thread() at sctp_iterator_thread+0x47
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffafe42d30, rbp = 0 ---
Tracing command swi0: sio pid 43 tid 100045 td 0xffffff00038e59c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffae5f9d30, rbp = 0 ---
Tracing command irq1: atkbd0 pid 42 tid 100046 td 0xffffff00038e5680
fork_trampoline() at fork_trampoline
Tracing command irq15: ata1 pid 41 tid 100047 td 0xffffff00038e5340
fork_trampoline() at fork_trampoline
Tracing command irq14: ata0 pid 40 tid 100048 td 0xffffff00038e5000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffae5ead30, rbp = 0 ---
Tracing command usb3 pid 39 tid 100030 td 0xffffff0001243680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
usb_event_thread() at usb_event_thread+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac502d30, rbp = 0 ---
Tracing command usb2 pid 38 tid 100031 td 0xffffff0001243340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
usb_event_thread() at usb_event_thread+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4fdd30, rbp = 0 ---
Tracing command irq18: uhci2 pid 37 tid 100032 td 0xffffff0001243000
fork_trampoline() at fork_trampoline
Tracing command usb1 pid 36 tid 100033 td 0xffffff00011239c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
usb_event_thread() at usb_event_thread+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4f3d30, rbp = 0 ---
Tracing command irq19: uhci1+ pid 35 tid 100034 td 0xffffff0001123680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4eed30, rbp = 0 ---
Tracing command usbtask-dr pid 34 tid 100035 td 0xffffff00012cc000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
usb_task_thread() at usb_task_thread+0x94
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac588d30, rbp = 0 ---
Tracing command usbtask-hc pid 33 tid 100036 td 0xffffff00012ca9c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
usb_task_thread() at usb_task_thread+0x94
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac583d30, rbp = 0 ---
Tracing command usb0 pid 32 tid 100037 td 0xffffff00012ca680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
usb_event_thread() at usb_event_thread+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac57ed30, rbp = 0 ---
Tracing command irq17: uhci0 ehci0 pid 31 tid 100038 td 0xffffff00012ca340
fork_trampoline() at fork_trampoline
Tracing command em1 taskq pid 30 tid 100022 td 0xffffff0001121340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
msleep_spin() at msleep_spin+0x1fb
taskqueue_thread_loop() at taskqueue_thread_loop+0x45
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4d5d30, rbp = 0 ---
Tracing command em0 taskq pid 29 tid 100023 td 0xffffff0001121000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
msleep_spin() at msleep_spin+0x1fb
taskqueue_thread_loop() at taskqueue_thread_loop+0x45
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4d0d30, rbp = 0 ---
Tracing command irq9: acpi0 pid 28 tid 100024 td 0xffffff000110e9c0
fork_trampoline() at fork_trampoline
Tracing command kqueue taskq pid 27 tid 100025 td 0xffffff000110e680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4c4d30, rbp = 0 ---
Tracing command swi6: task queue pid 26 tid 100026 td 0xffffff0001244680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac516d30, rbp = 0 ---
Tracing command swi6: Giant taskq pid 25 tid 100027 td 0xffffff0001244340
fork_trampoline() at fork_trampoline
Tracing command thread taskq pid 9 tid 100028 td 0xffffff0001244000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac50cd30, rbp = 0 ---
Tracing command swi5: + pid 24 tid 100029 td 0xffffff00012439c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac507d30, rbp = 0 ---
Tracing command swi2: cambio pid 23 tid 100015 td 0xffffff000110d340
fork_trampoline() at fork_trampoline
Tracing command xpt_thrd pid 8 tid 100016 td 0xffffff000110d000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
xpt_scanner_thread() at xpt_scanner_thread+0x3a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4a6d30, rbp = 0 ---
Tracing command acpi_task_2 pid 7 tid 100017 td 0xffffff00010eb9c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4a1d30, rbp = 0 ---
Tracing command acpi_task_1 pid 6 tid 100018 td 0xffffff0001123340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4e9d30, rbp = 0 ---
Tracing command acpi_task_0 pid 5 tid 100019 td 0xffffff0001123000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_sleep() at _sleep+0x327
taskqueue_thread_loop() at taskqueue_thread_loop+0x71
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4e4d30, rbp = 0 ---
Tracing command yarrow pid 22 tid 100020 td 0xffffff00011219c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
random_kthread() at random_kthread+0x191
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4dfd30, rbp = 0 ---
Tracing command g_down pid 4 tid 100021 td 0xffffff0001121680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
g_io_schedule_down() at g_io_schedule_down+0x20f
g_down_procbody() at g_down_procbody+0x78
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4dad30, rbp = 0 ---
Tracing command g_up pid 3 tid 100009 td 0xffffff00010e9680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
critical_exit() at critical_exit+0x91
lapic_handle_timer() at lapic_handle_timer+0x113
Xtimerint() at Xtimerint+0x67
--- interrupt, rip = 0xffffffff806eb192, rsp = 0xffffffffac488960, rbp = 0xffffffffac488980 ---
DELAY() at DELAY+0x62
_mtx_lock_spin() at _mtx_lock_spin+0x6a
_mtx_lock_spin_flags() at _mtx_lock_spin_flags+0xf4
smp_tlb_shootdown() at smp_tlb_shootdown+0x58
pmap_invalidate_range() at pmap_invalidate_range+0xae
allocbuf() at allocbuf+0x63d
brelse() at brelse+0x967
bufdone() at bufdone+0x78
ffs_backgroundwritedone() at ffs_backgroundwritedone+0xc0
bufdone() at bufdone+0x48
g_io_schedule_up() at g_io_schedule_up+0xf1
g_up_procbody() at g_up_procbody+0x78
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac488d30, rbp = 0 ---
Tracing command g_event pid 2 tid 100010 td 0xffffff00010e9340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_timedwait() at sleepq_timedwait+0x3c
_sleep() at _sleep+0x314
g_event_procbody() at g_event_procbody+0xaa
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac483d30, rbp = 0 ---
Tracing command swi3: vm pid 21 tid 100011 td 0xffffff000110e340
fork_trampoline() at fork_trampoline
Tracing command swi4: clock sio pid 20 tid 100012 td 0xffffff000110e000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4bad30, rbp = 0 ---
Tracing command swi1: net pid 19 tid 100013 td 0xffffff000110d9c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
ithread_loop() at ithread_loop+0x39a
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4b5d30, rbp = 0 ---
Tracing command idle: cpu0 pid 18 tid 100014 td 0xffffff000110d680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac4b0d30, rbp = 0 ---
Tracing command idle: cpu1 pid 17 tid 100004 td 0xffffff00010e6000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac46ad30, rbp = 0 ---
Tracing command idle: cpu2 pid 16 tid 100005 td 0xffffff00010eb680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac49cd30, rbp = 0 ---
Tracing command idle: cpu3 pid 15 tid 100006 td 0xffffff00010eb340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac497d30, rbp = 0 ---
Tracing command idle: cpu4 pid 14 tid 100007 td 0xffffff00010eb000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac492d30, rbp = 0 ---
Tracing command idle: cpu5 pid 13 tid 100008 td 0xffffff00010e99c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac48dd30, rbp = 0 ---
Tracing command idle: cpu6 pid 12 tid 100000 td 0xffffff00010e9000
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac47ed30, rbp = 0 ---
Tracing command idle: cpu7 pid 11 tid 100001 td 0xffffff00010e69c0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sched_idletd() at sched_idletd+0x64
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac479d30, rbp = 0 ---
Tracing command init pid 1 tid 100002 td 0xffffff00010e6680
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_catch_signals() at sleepq_catch_signals+0x2ab
sleepq_wait_sig() at sleepq_wait_sig+0x16
_sleep() at _sleep+0x2e3
kern_wait() at kern_wait+0x3cb
wait4() at wait4+0x35
syscall() at syscall+0x1ce
Xfast_syscall() at Xfast_syscall+0xab
--- syscall (7, FreeBSD ELF64, wait4), rip = 0x40bf5c, rsp = 0x7fffffffe8e8, rbp = 0x7fffffffed70 ---
Tracing command audit pid 10 tid 100003 td 0xffffff00010e6340
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
sleepq_switch() at sleepq_switch+0xc7
sleepq_wait() at sleepq_wait+0x44
_cv_wait() at _cv_wait+0x14e
audit_worker() at audit_worker+0x86
fork_exit() at fork_exit+0x12a
fork_trampoline() at fork_trampoline+0xe
--- trap 0, rip = 0, rsp = 0xffffffffac46fd30, rbp = 0 ---
Tracing command swapper pid 0 tid 0 td 0xffffffff80a181e0
sched_switch() at sched_switch+0x176
mi_switch() at mi_switch+0x231
scheduler() at scheduler+0x3b1
mi_startup() at mi_startup+0x59
btext() at btext+0x2c
db> call doadump
Physical memory: 4082 MB
Dumping 925 MB: 910 894 878 862 846 830 814 798 782 766 750 734 718 702 686 670 654 638 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14
Dump complete
= 0xf
db> c
panic: boot: not running on cpu 0
cpuid = 7
KDB: enter: panic
[thread pid 11395 tid 100179 ]
Stopped at kdb_enter+0x31: leave
db> c
panic: boot: not running on cpu 0
cpuid = 7
KDB: enter: panic
[thread pid 11395 tid 100179 ]
Stopped at kdb_enter+0x31: leave
db> c
panic: boot: not running on cpu 0
cpuid = 7
KDB: enter: panic
[thread pid 11395 tid 100179 ]
Stopped at kdb_enter+0x31: leave
db> c
panic: boot: not running on cpu 0
cpuid = 7
KDB: enter: panic
[thread pid 11395 tid 100179 ]
Stopped at kdb_enter+0x31: leave
db> reset
cpu_reset: Restarting BSP
cpu_reset_proxy: Stopped CPU 7
(kgdb) bt
#0 doadump () at pcpu.h:194
#1 0xffffffff801b9f3c in db_fncall (dummy1=Variable "dummy1" is not available.
) at ../../../ddb/db_command.c:486
#2 0xffffffff801ba45c in db_command_loop () at ../../../ddb/db_command.c:401
#3 0xffffffff801bbeaf in db_trap (type=Variable "type" is not available.
) at ../../../ddb/db_main.c:222
#4 0xffffffff8049da55 in kdb_trap (type=0x3, code=0x0, tf=0xffffffffb24385e0) at ../../../kern/subr_kdb.c:502
#5 0xffffffff806e9055 in trap (frame=0xffffffffb24385e0) at ../../../amd64/amd64/trap.c:472
#6 0xffffffff806cf76e in calltrap () at ../../../amd64/amd64/exception.S:169
#7 0xffffffff8049dc21 in kdb_enter (msg=0xffffffff80e20fe0 "") at cpufunc.h:63
#8 0xffffffff80476d23 in panic (fmt=Variable "fmt" is not available.
) at ../../../kern/kern_shutdown.c:547
#9 0xffffffff8046be91 in _mtx_lock_spin_failed (m=Variable "m" is not available.
) at ../../../kern/kern_mutex.c:423
#10 0xffffffff8046bf3e in _mtx_lock_spin (m=0xffffffff80a258e0, tid=0xffffff0005704680, opts=Variable "opts" is not available.
)
at ../../../kern/kern_mutex.c:456
#11 0xffffffff8046c3a4 in _mtx_lock_spin_flags (m=0xffffffff80a258e0, opts=0x0,
file=0xffffffff807e9d48 "../../../amd64/amd64/mp_machdep.c", line=0x372) at ../../../kern/kern_mutex.c:225
#12 0xffffffff806da231 in smp_targeted_tlb_shootdown (mask=0x8, vector=0xf4, addr1=0x7fffffffe000, addr2=0x0)
at ../../../amd64/amd64/mp_machdep.c:882
#13 0xffffffff806dd44c in pmap_invalidate_page (pmap=Variable "pmap" is not available.
) at ../../../amd64/amd64/pmap.c:763
#14 0xffffffff806e11a0 in pmap_enter (pmap=0xffffff00a6ee3df8, va=0x7fffffffe000, m=0xffffff00c959fa70, prot=Variable "prot" is not available.
)
at ../../../amd64/amd64/pmap.c:2390
#15 0xffffffff8066e09c in vm_fault (map=0xffffff00a6ee3d00, vaddr=0x7fffffffe000, fault_type=0x2,
fault_flags=0x8) at ../../../vm/vm_fault.c:896
#16 0xffffffff806e8628 in trap_pfault (frame=0xffffffffb2438c70, usermode=0x1)
at ../../../amd64/amd64/trap.c:591
#17 0xffffffff806e92b3 in trap (frame=0xffffffffb2438c70) at ../../../amd64/amd64/trap.c:306
#18 0xffffffff806cf76e in calltrap () at ../../../amd64/amd64/exception.S:169
#19 0x0000000800662aaa in ?? ()
(kgdb) f 17
#17 0xffffffff806e92b3 in trap (frame=0xffffffffb2438c70) at ../../../amd64/amd64/trap.c:306
306 i = trap_pfault(frame, TRUE);
(kgdb) p *frame
$4 = {tf_rdi = 0x2, tf_rsi = 0x7fffffffe800, tf_rdx = 0x0, tf_rcx = 0x8007112dc, tf_r8 = 0xffffff0106b8f000,
tf_r9 = 0x7fffffffe7d8, tf_rax = 0x0, tf_rbx = 0x0, tf_rbp = 0x4027f0, tf_r10 = 0x0, tf_r11 = 0x206,
tf_r12 = 0x7fffffffe86c, tf_r13 = 0x7fffffffe800, tf_r14 = 0x0, tf_r15 = 0x7fffffffe840, tf_trapno = 0xc,
tf_addr = 0x7fffffffe7d8, tf_flags = 0xc, tf_err = 0x7, tf_rip = 0x800662aaa, tf_cs = 0x2b,
tf_rflags = 0x10246, tf_rsp = 0x7fffffffe7e0, tf_ss = 0x23}
(kgdb) proc 51
(kgdb) bt
#0 cpustop_handler () at atomic.h:244
#1 0xffffffff806db150 in ipi_nmi_handler () at ../../../amd64/amd64/mp_machdep.c:1111
#2 0xffffffff806e9138 in trap (frame=0xffffffffab99ef40) at ../../../amd64/amd64/trap.c:174
#3 0xffffffff806cfa6b in nmi_calltrap () at ../../../amd64/amd64/exception.S:369
#4 0x00000000000c00f5 in ?? ()
#5 0x0000000000000006 in ?? ()
#6 0x0000000000000000 in ?? ()
#7 0xffffffff99e22000 in ?? ()
#8 0x0000000000000046 in ?? ()
#9 0x00000000000c00f5 in ?? ()
#10 0x0000000000000001 in ?? ()
#11 0x0000000000000007 in ?? ()
#12 0xffffffffafe74920 in ?? ()
#13 0x0000000000000000 in ?? ()
#14 0xffffffff80995be0 in M_MTXPOOL_init_sys_init ()
#15 0xffffffffa6f21000 in ?? ()
#16 0xffffffffa6f25000 in ?? ()
#17 0x00000000000000f5 in ?? ()
#18 0x00000000b99db000 in ?? ()
#19 0x0000000000000013 in ?? ()
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0xffffffff806da3f8 in smp_tlb_shootdown (vector=245, addr1=18446744072215465984, addr2=18446744072215482368) at ../../../amd64/amd64/mp_machdep.c:850
#24 0xffffffff806dd3de in pmap_invalidate_range (pmap=Variable "pmap" is not available.
) at ../../../amd64/amd64/pmap.c:779
#25 0xffffffff804dc690 in vfs_vmio_release (bp=0xffffffff9a956410) at ../../../kern/vfs_bio.c:1566
#26 0xffffffff804de6ed in brelse (bp=0xffffffff9a956410) at ../../../kern/vfs_bio.c:1336
#27 0xffffffff806469aa in indir_trunc (freeblks=0xffffff00374f7a00, dbn=Variable "dbn" is not available.
) at ../../../ufs/ffs/ffs_softdep.c:2905
#28 0xffffffff80646cbb in handle_workitem_freeblocks (freeblks=0xffffff00374f7a00, flags=0) at ../../../ufs/ffs/ffs_softdep.c:2746
#29 0xffffffff80647e65 in process_worklist_item (mp=0xffffff00054c03c0, flags=Variable "flags" is not available.
) at ../../../ufs/ffs/ffs_softdep.c:963
#30 0xffffffff8064c370 in softdep_process_worklist (mp=0xffffff00054c03c0, full=0) at ../../../ufs/ffs/ffs_softdep.c:847
#31 0xffffffff8064c6b2 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:758
#32 0xffffffff80459f4a in fork_exit (callout=0xffffffff8064c5e0 <softdep_flush>, arg=0x0, frame=0xffffffffafe74c80) at ../../../kern/kern_fork.c:797
#33 0xffffffff806cfade in fork_trampoline () at ../../../amd64/amd64/exception.S:397