GENERIC HEAD from Aug 15 + vm_thread_new.6.patch GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.0-CURRENT #0: Fri Aug 24 19:23:02 CEST 2007 test@hydra1.netperf.freebsd.org:/usr/src/sys/amd64/compile/PHO WARNING: WITNESS option enabled, expect reduced performance. ACPI APIC Table: <PTLTD APIC > Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU E5320 @ 1.86GHz (1866.74-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x6f7 Stepping = 7 Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x4e3bd<SSE3,RSVD2,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA> AMD Features=0x20100800<SYSCALL,NX,LM> AMD Features2=0x1<LAHF> Cores per package: 4 usable memory = 4281126912 (4082 MB) avail memory = 4117626880 (3926 MB) FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 : rying to mount root from ufs:/dev/ad4s1a em0: link state changed to UP em1: link state changed to UP Interface IP-Address Broadcast Loading configuration files. kernel dumps on /dev/ad4s1b Entropy harvesting: interrupts ethernet point_to_point kickstart. swapon: adding /dev/ad4s1b as swap device swapon: adding /dev/ad4s1d as swap device Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 369119 free (151 frags, 46121 blocks, 0.0% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 8684307 free (46347 frags, 1079745 blocks, 0.5% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 9318152 free (208 frags, 1164743 blocks, 0.0% fragmentation) Setting hostuuid: 53d19f64-d663-a017-8922-0030483354ca. Setting hostid: 0x4a759c96. Mounting local file systems:. Setting hostname: hydra1.netperf.freebsd.org. net.inet6.ip6.auto_linklocal: 1 -> 0 fec_up: not found em0: link state changed to DOWN em0: no link .....em0: link state changed to UP got link DHCPDISCOVER on em0 to 255.255.255.255 port 67 interval 7 DHCPOFFER from 192.168.5.1 DHCPREQUEST on em0 to 255.255.255.255 port 67 DHCPACK from 192.168.5.1 bound to 192.168.5.110 -- renewal in 300 seconds. lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=18b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWCSUM,TSO4> ether 00:30:48:33:54:ca inet 192.168.5.110 netmask 0xffffff00 broadcast 192.168.5.255 media: Ethernet autoselect (1000baseTX <full-duplex>) status: active Additional routing options: IP gateway=YES. Starting devd. hw.acpi.cpu.cx_lowest: C1 -> C1 Additional IP options:. Mounting NFS file systems:. Creating and/or trimming log files:. Starting syslogd. Checking for core dump on /dev/ad4s1b... savecore: no dumps found ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib 32-bit compatibility ldconfig path: /usr/lib32 Initial amd64 initialization:. Additional ABI support:. Clearing /tmp (X related). Starting local daemons:. Updating motd. Mounting late file systems:. Configuring syscons: blanktime. Starting sshd. Starting cron. Local package initialization:. Fri Aug 24 14:32:22 EDT 2007 FreeBSD/amd64 (hydra1.netperf.freebsd.org) (ttyd0) panic: pmap_release: pmap resident count 2 != 0 cpuid = 2 KDB: enter: panic [thread pid 22492 tid 100844 ] Stopped at kdb_enter+0x31: leave db> Connection closed by foreign host. $ telnet pm25 2007$ Trying 192.168.5.25... Connected to pm25. Escape character is '^]'. where Tracing pid 22492 tid 100844 td 0xffffff0051f56680 kdb_enter() at kdb_enter+0x31 panic() at panic+0x173 pmap_release() at pmap_release+0xa2 vmspace_exit() at vmspace_exit+0xcf exit1() at exit1+0x396 sys_exit() at sys_exit+0xe syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (1, FreeBSD ELF64, sys_exit), rip = 0x8007b366c, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe3d0 --- db> show allpcpu Current CPU: 2 cpuid = 0 curthread = 0xffffff00010e9680: pid 18 "idle: cpu0" curpcb = 0xffffffffac497d40 fpcurthread = none idlethread = 0xffffff00010e9680: pid 18 "idle: cpu0" spin locks held: cpuid = 1 curthread = 0xffffff00010e99c0: pid 17 "idle: cpu1" curpcb = 0xffffffffac492d40 fpcurthread = none idlethread = 0xffffff00010e99c0: pid 17 "idle: cpu1" spin locks held: cpuid = 2 curthread = 0xffffff0051f56680: pid 22492 "mkfifo" curpcb = 0xffffffffdcf71d40 fpcurthread = none idlethread = 0xffffff00010f4000: pid 16 "idle: cpu2" spin locks held: cpuid = 3 curthread = 0xffffff00010f4340: pid 15 "idle: cpu3" curpcb = 0xffffffffac488d40 fpcurthread = none idlethread = 0xffffff00010f4340: pid 15 "idle: cpu3" spin locks held: cpuid = 4 curthread = 0xffffff00010f4680: pid 14 "idle: cpu4" curpcb = 0xffffffffac483d40 fpcurthread = none idlethread = 0xffffff00010f4680: pid 14 "idle: cpu4" spin locks held: cpuid = 5 curthread = 0xffffff00010e8000: pid 13 "idle: cpu5" curpcb = 0xffffffffac47ed40 fpcurthread = none idlethread = 0xffffff00010e8000: pid 13 "idle: cpu5" spin locks held: cpuid = 6 curthread = 0xffffff00010e8340: pid 12 "idle: cpu6" curpcb = 0xffffffffac479d40 fpcurthread = none idlethread = 0xffffff00010e8340: pid 12 "idle: cpu6" spin locks held: cpuid = 7 curthread = 0xffffff00010e8680: pid 11 "idle: cpu7" curpcb = 0xffffffffac474d40 fpcurthread = none idlethread = 0xffffff00010e8680: pid 11 "idle: cpu7" spin locks held: db> show alllocks Process 22495 (mkfifo) thread 0xffffff005123a680 (100550) exclusive sx so_snd_sx r = 0 (0xffffff00931b8cd8) locked @ kern/uipc_sockbuf.c:145 Process 22494 (mkfifo) thread 0xffffff0093fba680 (101063) exclusive sx so_snd_sx r = 0 (0xffffff00180764b0) locked @ kern/uipc_sockbuf.c:145 Process 22493 (mkfifo) thread 0xffffff002ff7f9c0 (100528) exclusive sx so_snd_sx r = 0 (0xffffff00489ef4b0) locked @ kern/uipc_sockbuf.c:145 Process 22490 (mkfifo) thread 0xffffff009181a680 (102388) exclusive sx so_snd_sx r = 0 (0xffffff0005933a20) locked @ kern/uipc_sockbuf.c:145 Process 22487 (mkfifo) thread 0xffffff001dbc2340 (100879) exclusive sx so_snd_sx r = 0 (0xffffff0023405768) locked @ kern/uipc_sockbuf.c:145 Process 22476 (mkfifo) thread 0xffffff0048636340 (100579) exclusive sx so_snd_sx r = 0 (0xffffff00413691f8) locked @ kern/uipc_sockbuf.c:145 Process 22443 (mkfifo) thread 0xffffff0009213000 (100256) exclusive sx so_snd_sx r = 0 (0xffffff00238b81f8) locked @ kern/uipc_sockbuf.c:145 Process 22441 (mkfifo) thread 0xffffff000544d000 (100088) exclusive sx so_snd_sx r = 0 (0xffffff0018076768) locked @ kern/uipc_sockbuf.c:145 Process 22438 (mkfifo) thread 0xffffff000538a340 (100080) exclusive sx so_snd_sx r = 0 (0xffffff0023405cd8) locked @ kern/uipc_sockbuf.c:145 Process 22201 (mkfifo) thread 0xffffff0048cba340 (101074) exclusive sx so_rcv_sx r = 0 (0xffffff0018077be0) locked @ kern/uipc_sockbuf.c:145 Process 22196 (mkfifo) thread 0xffffff0013a00000 (101361) exclusive sx so_rcv_sx r = 0 (0xffffff0067331100) locked @ kern/uipc_sockbuf.c:145 exclusive sleep mutex Giant r = 0 (0xffffffff80a1abc0) locked @ fs/fifofs/fifo_vnops.c:716 Process 785 (sshd) thread 0xffffff0005765680 (100124) exclusive sx so_rcv_sx r = 0 (0xffffff00059343b8) locked @ kern/uipc_sockbuf.c:145 db> ps^H ^H^H ^Hshow lockedvnods Locked vnodes db> ps pid ppid pgrp uid state wmesg wchan cmd 22495 22200 12679 1002 S+ sbwait 0xffffff00931b8d34 mkfifo 22494 22196 12679 1002 S+ sbwait 0xffffff001807650c mkfifo 22493 22194 12679 1002 S+ sbwait 0xffffff00489ef50c mkfifo 22492 22189 12679 1002 RE+ CPU 2 mkfifo 22490 22202 12679 1002 S+ sbwait 0xffffff0005933a7c mkfifo 22487 22199 12679 1002 S+ sbwait 0xffffff00234057c4 mkfifo 22481 22197 12679 1002 S+ sbwait 0xffffff002b30750c mkfifo 22480 22201 12679 1002 R+ mkfifo 22476 22198 12679 1002 S+ sbwait 0xffffff0041369254 mkfifo 22443 22187 12679 1002 S+ sbwait 0xffffff00238b8254 mkfifo 22441 22191 12679 1002 S+ sbwait 0xffffff00180767c4 mkfifo 22438 22195 12679 1002 S+ sbwait 0xffffff0023405d34 mkfifo 22431 22193 12679 1002 R+ mkfifo 22202 22185 12679 1002 R+ mkfifo 22201 22185 12679 1002 R+ mkfifo 22200 22185 12679 1002 R+ mkfifo 22199 22185 12679 1002 R+ mkfifo 22198 22185 12679 1002 R+ mkfifo 22197 22185 12679 1002 R+ mkfifo 22196 22185 12679 1002 R+ mkfifo 22195 22185 12679 1002 R+ mkfifo 22194 22185 12679 1002 R+ mkfifo 22193 22185 12679 1002 S+ sbwait 0xffffff004852b15c mkfifo 22192 22186 12679 1002 R+ swap 22191 22185 12679 1002 R+ mkfifo 22190 22186 12679 1002 R+ swap 22189 22185 12679 1002 S+ wait 0xffffff0048997000 mkfifo 22188 22186 12679 1002 R+ swap 22187 22185 12679 1002 R+ mkfifo 22186 22184 12679 1002 SW+ wait 0xffffff0009793000 swap 22185 22183 12679 1002 SW+ wait 0xffffff002d42f460 mkfifo 22184 19123 12679 1002 S+ nanslp 0xffffffff80a1b708 swap 22183 19123 12679 1002 S+ nanslp 0xffffffff80a1b708 mkfifo 19123 19122 12679 1002 SW+ wait 0xffffff0005484460 run 19122 19121 12679 1002 SW+ wait 0xffffff0005a088c0 run 19121 19114 12679 1002 SW+ wait 0xffffff0005486000 run 19114 12679 12679 1002 SW+ wait 0xffffff0023a018c0 sh 12679 789 12679 1002 SW+ wait 0xffffff009151f000 sh 819 784 819 0 SW+ ttyin 0xffffff0005159010 csh 789 788 789 1002 SWs+ wait 0xffffff00054f9460 sh 788 785 785 1002 SW select 0xffffffff80aa42f0 sshd 785 724 785 0 SWs sbwait 0xffffff0005934414 sshd 784 1 784 0 SWs+ wait 0xffffff00054c5000 login 783 1 783 0 SWs+ ttyin 0xffffff000515bc10 getty 782 1 782 0 SWs+ ttyin 0xffffff000516b010 getty 781 1 781 0 SWs+ ttyin 0xffffff000516b410 getty 780 1 780 0 SWs+ ttyin 0xffffff000516b810 getty 779 1 779 0 SWs+ ttyin 0xffffff000516bc10 getty 778 1 778 0 SWs+ ttyin 0xffffff000516c010 getty 777 1 777 0 SWs+ ttyin 0xffffff000516c410 getty 776 1 776 0 SWs+ ttyin 0xffffff000516c810 getty 740 1 740 0 Ss nanslp 0xffffffff80a1b708 cron 734 1 734 25 SWs pause 0xffffff00055df0c0 sendmail 730 1 730 0 Ss select 0xffffffff80aa42f0 sendmail 724 1 724 0 SWs select 0xffffffff80aa42f0 sshd 608 1 608 0 SWs select 0xffffffff80aa42f0 syslogd 562 1 562 0 SWs select 0xffffffff80aa42f0 devd 346 1 346 65 SWs select 0xffffffff80aa42f0 dhclient 300 1 53 0 SW+ select 0xffffffff80aa42f0 dhclient 166 1 166 0 SWs pause 0xffffff00054fb0c0 adjkerntz 52 0 0 0 SL - 0xffffffff80a1b388 [schedcpu] 51 0 0 0 SL sdflush 0xffffffff80ab4428 [softdepflush] 50 0 0 0 SL vlruwt 0xffffff00051da8c0 [vnlru] 49 0 0 0 SL syncer 0xffffffff80a1b380 [syncer] 48 0 0 0 SL psleep 0xffffffff80aa4b7c [bufdaemon] 47 0 0 0 SL pgzero 0xffffffff80ab5c34 [pagezero] 46 0 0 0 SL psleep 0xffffffff80ab51e8 [vmdaemon] 45 0 0 0 SL psleep 0xffffffff80ab51ac [pagedaemon] 44 0 0 0 SL waiting_ 0xffffffff80aa8280 [sctp_iterator] 43 0 0 0 WL [swi0: sio] 42 0 0 0 WL [irq1: atkbd0] 41 0 0 0 WL [irq15: ata1] 40 0 0 0 WL [irq14: ata0] 39 0 0 0 SL usbevt 0xffffff0003812420 [usb3] 38 0 0 0 SL usbevt 0xffffffff80e46420 [usb2] 37 0 0 0 WL [irq18: uhci2] 36 0 0 0 SL usbevt 0xffffffff80e44420 [usb1] 35 0 0 0 WL [irq19: uhci1+] 34 0 0 0 SL usbtsk 0xffffffff80a16c08 [usbtask-dr] 33 0 0 0 SL usbtsk 0xffffffff80a16be0 [usbtask-hc] 32 0 0 0 SL usbevt 0xffffffff80e42420 [usb0] 31 0 0 0 WL [irq17: uhci0 ehci0] 30 0 0 0 SL - 0xffffff00012a2d00 [em1 taskq] 29 0 0 0 SL - 0xffffff00012a3980 [em0 taskq] 28 0 0 0 WL [irq9: acpi0] 27 0 0 0 SL - 0xffffff0001207d80 [kqueue taskq] 26 0 0 0 WL [swi6: task queue] 25 0 0 0 WL [swi6: Giant taskq] 9 0 0 0 SL - 0xffffff000122f300 [thread taskq] 24 0 0 0 WL [swi5: +] 23 0 0 0 WL [swi2: cambio] 8 0 0 0 SL ccb_scan 0xffffffff809e5960 [xpt_thrd] 7 0 0 0 SL - 0xffffff00011e5680 [acpi_task_2] 6 0 0 0 SL - 0xffffff00011e5680 [acpi_task_1] 5 0 0 0 SL - 0xffffff00011e5680 [acpi_task_0] 22 0 0 0 SL - 0xffffffff80a1b388 [yarrow] 4 0 0 0 SL - 0xffffffff80a17cf8 [g_down] 3 0 0 0 SL - 0xffffffff80a17cf0 [g_up] 2 0 0 0 SL - 0xffffffff80a17ce0 [g_event] 21 0 0 0 WL [swi3: vm] 20 0 0 0 WL [swi4: clock sio] 19 0 0 0 WL [swi1: net] 18 0 0 0 RL CPU 0 [idle: cpu0] 17 0 0 0 RL CPU 1 [idle: cpu1] 16 0 0 0 RL [idle: cpu2] 15 0 0 0 RL CPU 3 [idle: cpu3] 14 0 0 0 RL CPU 4 [idle: cpu4] 13 0 0 0 RL CPU 5 [idle: cpu5] 12 0 0 0 RL CPU 6 [idle: cpu6] 11 0 0 0 RL CPU 7 [idle: cpu7] 1 0 1 0 SLs wait 0xffffff00010e58c0 [init] 10 0 0 0 SL audit_wo 0xffffffff80ab3900 [audit] 0 0 0 0 WLs [swapper] db> set $lines 0 db> allt Tracing command mkfifo pid 22495 tid 100550 td 0xffffff005123a680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22494 tid 101063 td 0xffffff0093fba680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22493 tid 100528 td 0xffffff002ff7f9c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22492 tid 100844 td 0xffffff0051f56680 kdb_enter() at kdb_enter+0x31 panic() at panic+0x173 pmap_release() at pmap_release+0xa2 vmspace_exit() at vmspace_exit+0xcf exit1() at exit1+0x396 sys_exit() at sys_exit+0xe syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (1, FreeBSD ELF64, sys_exit), rip = 0x8007b366c, rsp = 0x7fffffffe3a8, rbp = 0x7fffffffe3d0 --- Tracing command mkfifo pid 22490 tid 102388 td 0xffffff009181a680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22487 tid 100879 td 0xffffff001dbc2340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22481 tid 111786 td 0xffffff004893a340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22480 tid 100935 td 0xffffff00237b9680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22476 tid 100579 td 0xffffff0048636340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22443 tid 100256 td 0xffffff0009213000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22441 tid 100088 td 0xffffff000544d000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22438 tid 100080 td 0xffffff000538a340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 sosend_generic() at sosend_generic+0x3b0 fifo_write_f() at fifo_write_f+0x6f dofilewrite() at dofilewrite+0x85 kern_writev() at kern_writev+0x4c write() at write+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (4, FreeBSD ELF64, write), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22431 tid 100439 td 0xffffff0009e1d340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (32, FreeBSD ELF64, getsockname), rip = 0x80082124c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22202 tid 100531 td 0xffffff00483d2000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (32, FreeBSD ELF64, getsockname), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22201 tid 101074 td 0xffffff0048cba340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (256, FreeBSD ELF64, lkmressys), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22200 tid 104453 td 0xffffff0051f1c000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (512), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22199 tid 100992 td 0xffffff00328d0680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (128, FreeBSD ELF64, rename), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22198 tid 100539 td 0xffffff001aee2680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (64, FreeBSD ELF64, nosys), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22197 tid 100407 td 0xffffff0009bf4340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (256, FreeBSD ELF64, lkmressys), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22196 tid 101361 td 0xffffff0013a00000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 soreceive_generic() at soreceive_generic+0xffc fifo_read_f() at fifo_read_f+0x73 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x4c read() at read+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (3, FreeBSD ELF64, read), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22195 tid 100988 td 0xffffff000ccf0680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (16, FreeBSD ELF64, chown), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22194 tid 100382 td 0xffffff0009ad0680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (1024), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command mkfifo pid 22193 tid 100693 td 0xffffff00130c2680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 soreceive_generic() at soreceive_generic+0xffc fifo_read_f() at fifo_read_f+0x73 dofileread() at dofileread+0xa1 kern_readv() at kern_readv+0x4c read() at read+0x54 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (3, FreeBSD ELF64, read), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command swap pid 22192 tid 100837 td 0xffffff001de059c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 doreti_ast() at doreti_ast+0x1f Tracing command mkfifo pid 22191 tid 100608 td 0xffffff0023b7a000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (16, FreeBSD ELF64, chown), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command swap pid 22190 tid 100985 td 0xffffff0051172000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 doreti_ast() at doreti_ast+0x1f Tracing command mkfifo pid 22189 tid 119271 td 0xffffff0048904000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 kern_wait() at kern_wait+0x3cb wait4() at wait4+0x35 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (7, FreeBSD ELF64, wait4), rip = 0x8007a9a3c, rsp = 0x7fffffffe868, rbp = 0x7fffffffe890 --- Tracing command swap pid 22188 tid 100483 td 0xffffff0051e06340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 doreti_ast() at doreti_ast+0x1f Tracing command mkfifo pid 22187 tid 100981 td 0xffffff001d314680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ast() at ast+0x1e7 Xfast_syscall() at Xfast_syscall+0xe0 --- syscall (8, FreeBSD ELF64, nosys), rip = 0x80082126c, rsp = 0x7fffffffe838, rbp = 0x7fffffffe860 --- Tracing command swap pid 22186 tid 100341 td 0xffffff00097989c0 Tracing command mkfifo pid 22185 tid 100637 td 0xffffff005cf23680 Tracing command swap pid 22184 tid 100580 td 0xffffff00483e8340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x20a kern_nanosleep() at kern_nanosleep+0x118 nanosleep() at nanosleep+0x6e syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x8006f8e6c, rsp = 0x7fffffffe8c8, rbp = 0x7fffffffe920 --- Tracing command mkfifo pid 22183 tid 100866 td 0xffffff005187b340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x20a kern_nanosleep() at kern_nanosleep+0x118 nanosleep() at nanosleep+0x6e syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800805e6c, rsp = 0x7fffffffe8c8, rbp = 0x7fffffffe920 --- Tracing command run pid 19123 tid 103989 td 0xffffff005142f000 Tracing command run pid 19122 tid 100147 td 0xffffff0005a0e340 Tracing command run pid 19121 tid 101392 td 0xffffff0013a1f000 Tracing command sh pid 19114 tid 100794 td 0xffffff0051c4d9c0 Tracing command sh pid 12679 tid 100760 td 0xffffff00517b8000 Tracing command csh pid 819 tid 100121 td 0xffffff0005510340 Tracing command sh pid 789 tid 100098 td 0xffffff00054fe000 Tracing command sshd pid 788 tid 100100 td 0xffffff00054fd680 Tracing command sshd pid 785 tid 100124 td 0xffffff0005765680 Tracing command login pid 784 tid 100133 td 0xffffff0005495340 Tracing command getty pid 783 tid 100132 td 0xffffff0005495680 Tracing command getty pid 782 tid 100131 td 0xffffff00054959c0 Tracing command getty pid 781 tid 100090 td 0xffffff00054e0000 Tracing command getty pid 780 tid 100092 td 0xffffff00054ff680 Tracing command getty pid 779 tid 100064 td 0xffffff000533d000 Tracing command getty pid 778 tid 100110 td 0xffffff000539e9c0 Tracing command getty pid 777 tid 100060 td 0xffffff000538c9c0 Tracing command getty pid 776 tid 100109 td 0xffffff000548b000 Tracing command cron pid 740 tid 100063 td 0xffffff000533d340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _sleep() at _sleep+0x20a kern_nanosleep() at kern_nanosleep+0x118 nanosleep() at nanosleep+0x6e syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (240, FreeBSD ELF64, nanosleep), rip = 0x800912e6c, rsp = 0x7fffffffec38, rbp = 0x34 --- Tracing command sendmail pid 734 tid 100116 td 0xffffff0005511680 Tracing command sendmail pid 730 tid 100120 td 0xffffff0005510680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_timedwait_sig() at sleepq_timedwait_sig+0x19 _cv_timedwait_sig() at _cv_timedwait_sig+0x16a kern_select() at kern_select+0x7df select() at select+0x56 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (93, FreeBSD ELF64, select), rip = 0x800d9c1ec, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd800 --- Tracing command sshd pid 724 tid 100122 td 0xffffff0005510000 Tracing command syslogd pid 608 tid 100111 td 0xffffff00055fc9c0 Tracing command devd pid 562 tid 100070 td 0xffffff000538b9c0 Tracing command dhclient pid 346 tid 100103 td 0xffffff00054ce9c0 Tracing command dhclient pid 300 tid 100086 td 0xffffff000544d680 Tracing command adjkerntz pid 166 tid 100093 td 0xffffff00054ff340 Tracing command schedcpu pid 52 tid 100051 td 0xffffff00051d2340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 schedcpu_thread() at schedcpu_thread+0x220 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffb2131d30, rbp = 0 --- Tracing command softdepflush pid 51 tid 100050 td 0xffffff00051d2680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 softdep_flush() at softdep_flush+0x2d7 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe29d30, rbp = 0 --- Tracing command vnlru pid 50 tid 100049 td 0xffffff00051d29c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 vnlru_proc() at vnlru_proc+0x6a3 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe24d30, rbp = 0 --- Tracing command syncer pid 49 tid 100048 td 0xffffff00051d3000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 sched_sync() at sched_sync+0x53d fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe1fd30, rbp = 0 --- Tracing command bufdaemon pid 48 tid 100047 td 0xffffff00051d3340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 buf_daemon() at buf_daemon+0x208 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe1ad30, rbp = 0 --- Tracing command pagezero pid 47 tid 100046 td 0xffffff00051d3680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 vm_pagezero() at vm_pagezero+0x73 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe15d30, rbp = 0 --- Tracing command vmdaemon pid 46 tid 100045 td 0xffffff00051d39c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 vm_daemon() at vm_daemon+0x4d fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe10d30, rbp = 0 --- Tracing command pagedaemon pid 45 tid 100044 td 0xffffff00012449c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 vm_pageout() at vm_pageout+0x7b5 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe0bd30, rbp = 0 --- Tracing command sctp_iterator pid 44 tid 100043 td 0xffffff0003820000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 sctp_iterator_thread() at sctp_iterator_thread+0x47 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafe06d30, rbp = 0 --- Tracing command swi0: sio pid 43 tid 100042 td 0xffffff0003820340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffafdded30, rbp = 0 --- Tracing command irq1: atkbd0 pid 42 tid 100041 td 0xffffff0003820680 fork_trampoline() at fork_trampoline Tracing command irq15: ata1 pid 41 tid 100040 td 0xffffff00038209c0 fork_trampoline() at fork_trampoline Tracing command irq14: ata0 pid 40 tid 100039 td 0xffffff0003821000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae5a9d30, rbp = 0 --- Tracing command usb3 pid 39 tid 100038 td 0xffffff0003821340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 usb_event_thread() at usb_event_thread+0xaa fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae591d30, rbp = 0 --- Tracing command usb2 pid 38 tid 100037 td 0xffffff0003821680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 usb_event_thread() at usb_event_thread+0xaa fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae579d30, rbp = 0 --- Tracing command irq18: uhci2 pid 37 tid 100036 td 0xffffff00038219c0 fork_trampoline() at fork_trampoline Tracing command usb1 pid 36 tid 100035 td 0xffffff0003822000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 usb_event_thread() at usb_event_thread+0xaa fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae568d30, rbp = 0 --- Tracing command irq19: uhci1+ pid 35 tid 100034 td 0xffffff000122a680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae55cd30, rbp = 0 --- Tracing command usbtask-dr pid 34 tid 100033 td 0xffffff000122a9c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 usb_task_thread() at usb_task_thread+0x94 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae557d30, rbp = 0 --- Tracing command usbtask-hc pid 33 tid 100032 td 0xffffff0001243000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 usb_task_thread() at usb_task_thread+0x94 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae552d30, rbp = 0 --- Tracing command usb0 pid 32 tid 100031 td 0xffffff0001243340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 usb_event_thread() at usb_event_thread+0xaa fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffae54dd30, rbp = 0 --- Tracing command irq17: uhci0 ehci0 pid 31 tid 100030 td 0xffffff0001243680 fork_trampoline() at fork_trampoline Tracing command em1 taskq pid 30 tid 100029 td 0xffffff00012439c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 msleep_spin() at msleep_spin+0x1fb taskqueue_thread_loop() at taskqueue_thread_loop+0x45 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac53dd30, rbp = 0 --- Tracing command em0 taskq pid 29 tid 100028 td 0xffffff0001244000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 msleep_spin() at msleep_spin+0x1fb taskqueue_thread_loop() at taskqueue_thread_loop+0x45 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac518d30, rbp = 0 --- Tracing command irq9: acpi0 pid 28 tid 100027 td 0xffffff0001244340 fork_trampoline() at fork_trampoline Tracing command kqueue taskq pid 27 tid 100026 td 0xffffff0001244680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 taskqueue_thread_loop() at taskqueue_thread_loop+0x71 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4eed30, rbp = 0 --- Tracing command swi6: task queue pid 26 tid 100025 td 0xffffff000110b680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4e9d30, rbp = 0 --- Tracing command swi6: Giant taskq pid 25 tid 100024 td 0xffffff000110b9c0 fork_trampoline() at fork_trampoline Tracing command thread taskq pid 9 tid 100023 td 0xffffff0001229000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 taskqueue_thread_loop() at taskqueue_thread_loop+0x71 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4dfd30, rbp = 0 --- Tracing command swi5: + pid 24 tid 100022 td 0xffffff0001229340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4dad30, rbp = 0 --- Tracing command swi2: cambio pid 23 tid 100021 td 0xffffff0001229680 fork_trampoline() at fork_trampoline Tracing command xpt_thrd pid 8 tid 100020 td 0xffffff00012299c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 xpt_scanner_thread() at xpt_scanner_thread+0x3a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4d0d30, rbp = 0 --- Tracing command acpi_task_2 pid 7 tid 100019 td 0xffffff000122a000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 taskqueue_thread_loop() at taskqueue_thread_loop+0x71 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4cbd30, rbp = 0 --- Tracing command acpi_task_1 pid 6 tid 100018 td 0xffffff000122a340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 taskqueue_thread_loop() at taskqueue_thread_loop+0x71 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4c6d30, rbp = 0 --- Tracing command acpi_task_0 pid 5 tid 100017 td 0xffffff00010f49c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _sleep() at _sleep+0x327 taskqueue_thread_loop() at taskqueue_thread_loop+0x71 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4c1d30, rbp = 0 --- Tracing command yarrow pid 22 tid 100016 td 0xffffff000110a000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 random_kthread() at random_kthread+0x191 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4bcd30, rbp = 0 --- Tracing command g_down pid 4 tid 100015 td 0xffffff000110a340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 g_io_schedule_down() at g_io_schedule_down+0x20f g_down_procbody() at g_down_procbody+0x78 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4b7d30, rbp = 0 --- Tracing command g_up pid 3 tid 100014 td 0xffffff000110a680 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 g_io_schedule_up() at g_io_schedule_up+0x154 g_up_procbody() at g_up_procbody+0x78 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4b2d30, rbp = 0 --- Tracing command g_event pid 2 tid 100013 td 0xffffff000110a9c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_timedwait() at sleepq_timedwait+0x3c _sleep() at _sleep+0x314 g_event_procbody() at g_event_procbody+0xaa fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4add30, rbp = 0 --- Tracing command swi3: vm pid 21 tid 100012 td 0xffffff000110b000 fork_trampoline() at fork_trampoline Tracing command swi4: clock sio pid 20 tid 100011 td 0xffffff000110b340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac4a3d30, rbp = 0 --- Tracing command swi1: net pid 19 tid 100010 td 0xffffff00010e9340 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 ithread_loop() at ithread_loop+0x39a fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac49ed30, rbp = 0 --- Tracing command idle: cpu0 pid 18 tid 100009 td 0xffffff00010e9680 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffff80ac0510, rbp = 0xffffffffac497bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac497d30, rbp = 0 --- Tracing command idle: cpu1 pid 17 tid 100008 td 0xffffff00010e99c0 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab999ff0, rbp = 0xffffffffac492bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac492d30, rbp = 0 --- Tracing command idle: cpu2 pid 16 tid 100007 td 0xffffff00010f4000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sched_idletd() at sched_idletd+0x64 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac48dd30, rbp = 0 --- Tracing command idle: cpu3 pid 15 tid 100006 td 0xffffff00010f4340 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab9a3ff0, rbp = 0xffffffffac488bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac488d30, rbp = 0 --- Tracing command idle: cpu4 pid 14 tid 100005 td 0xffffff00010f4680 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab9a8ff0, rbp = 0xffffffffac483bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac483d30, rbp = 0 --- Tracing command idle: cpu5 pid 13 tid 100004 td 0xffffff00010e8000 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab9adff0, rbp = 0xffffffffac47ebd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac47ed30, rbp = 0 --- Tracing command idle: cpu6 pid 12 tid 100003 td 0xffffff00010e8340 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab9b2ff0, rbp = 0xffffffffac479bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac479d30, rbp = 0 --- Tracing command idle: cpu7 pid 11 tid 100002 td 0xffffff00010e8680 cpustop_handler() at cpustop_handler+0x40 ipi_nmi_handler() at ipi_nmi_handler+0x30 trap() at trap+0x388 nmi_calltrap() at nmi_calltrap+0x8 --- trap 0x13, rip = 0xffffffff806c8096, rsp = 0xffffffffab9b7ff0, rbp = 0xffffffffac474bd0 --- acpi_cpu_c1() at acpi_cpu_c1+0x6 acpi_cpu_idle() at acpi_cpu_idle+0x1a4 sched_idletd() at sched_idletd+0x35 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac474d30, rbp = 0 --- Tracing command init pid 1 tid 100001 td 0xffffff00010e89c0 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_catch_signals() at sleepq_catch_signals+0x2ab sleepq_wait_sig() at sleepq_wait_sig+0x16 _sleep() at _sleep+0x2e3 kern_wait() at kern_wait+0x3cb wait4() at wait4+0x35 syscall() at syscall+0x1ce Xfast_syscall() at Xfast_syscall+0xab --- syscall (7, FreeBSD ELF64, wait4), rip = 0x40bf5c, rsp = 0x7fffffffe8e8, rbp = 0x7fffffffed70 --- Tracing command audit pid 10 tid 100000 td 0xffffff00010e9000 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 sleepq_switch() at sleepq_switch+0xc7 sleepq_wait() at sleepq_wait+0x44 _cv_wait() at _cv_wait+0x14e audit_worker() at audit_worker+0x86 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xffffffffac46ad30, rbp = 0 --- Tracing command swapper pid 0 tid 0 td 0xffffffff80a18260 sched_switch() at sched_switch+0x176 mi_switch() at mi_switch+0x231 scheduler() at scheduler+0x3b1 mi_startup() at mi_startup+0x59 btext() at btext+0x2c db> call doadump Physical memory: 4082 MB Dumping 534 MB: 519 503 487 471 455 439 423 407 391 375 359 343 327 311 295 279 263 247 231 215 199 183 167 151 135 119 103 87 71 55 39 23 7 Dump complete = 0xf db> (kgdb) bt #0 doadump () at pcpu.h:194 #1 0xffffffff801b9f8c in db_fncall (dummy1=Variable "dummy1" is not available. ) at ../../../ddb/db_command.c:486 #2 0xffffffff801ba4ac in db_command_loop () at ../../../ddb/db_command.c:401 #3 0xffffffff801bbeff in db_trap (type=Variable "type" is not available. ) at ../../../ddb/db_main.c:222 #4 0xffffffff8049dbe5 in kdb_trap (type=3, code=0, tf=0xffffffffdcf71880) at ../../../kern/subr_kdb.c:502 #5 0xffffffff806e92b5 in trap (frame=0xffffffffdcf71880) at ../../../amd64/amd64/trap.c:474 #6 0xffffffff806cf9be in calltrap () at ../../../amd64/amd64/exception.S:169 #7 0xffffffff8049ddb1 in kdb_enter (msg=0xffffffff80e20fe0 "") at cpufunc.h:63 #8 0xffffffff80476e33 in panic (fmt=Variable "fmt" is not available. ) at ../../../kern/kern_shutdown.c:547 #9 0xffffffff806dd7c2 in pmap_release (pmap=Variable "pmap" is not available. ) at ../../../amd64/amd64/pmap.c:1455 #10 0xffffffff806755af in vmspace_exit (td=0xffffff0051f56680) at ../../../vm/vm_map.c:310 #11 0xffffffff80458ec6 in exit1 (td=0xffffff0051f56680, rv=256) at ../../../kern/kern_exit.c:294 #12 0xffffffff80459d1e in sys_exit (td=Variable "td" is not available. ) at ../../../kern/kern_exit.c:98 #13 0xffffffff806e8b5e in syscall (frame=0xffffffffdcf71c70) at ../../../amd64/amd64/trap.c:824 #14 0xffffffff806cfb6b in Xfast_syscall () at ../../../amd64/amd64/exception.S:272 #15 0x00000008007b366c in ?? () (kgdb) f 9 #9 0xffffffff806dd7c2 in pmap_release (pmap=Variable "pmap" is not available. ) at ../../../amd64/amd64/pmap.c:1455 1455 KASSERT(pmap->pm_stats.resident_count == 0, (kgdb) l 1450 void 1451 pmap_release(pmap_t pmap) 1452 { 1453 vm_page_t m; 1454 1455 KASSERT(pmap->pm_stats.resident_count == 0, 1456 ("pmap_release: pmap resident count %ld != 0", 1457 pmap->pm_stats.resident_count)); 1458 1459 m = PHYS_TO_VM_PAGE(pmap->pm_pml4[PML4PML4I] & PG_FRAME); (kgdb) p pmap Variable "pmap" is not available. (kgdb) up #10 0xffffffff806755af in vmspace_exit (td=0xffffff0051f56680) at ../../../vm/vm_map.c:310 310 pmap_release(vmspace_pmap(vm)); (kgdb) p *vm $3 = {vm_map = {header = {prev = 0xffffff0023d4f1a0, next = 0xffffff0023d4f1a0, left = 0x0, right = 0x0, start = 0, end = 140737488355328, avail_ssize = 0, adj_free = 0, max_free = 0, object = {vm_object = 0x0, sub_map = 0x0}, offset = 0, eflags = 0, protection = 0 '\0', max_protection = 0 '\0', inheritance = 0 '\0', wired_count = 0, lastr = 0}, lock = {lock_object = {lo_name = 0xffffffff807d72cb "user map", lo_type = 0xffffffff807d72cb "user map", lo_flags = 37421056, lo_witness_data = {lod_list = { stqe_next = 0xffffffff80a36a20}, lod_witness = 0xffffffff80a36a20}}, sx_lock = 1, sx_recurse = 0}, system_mtx = {lock_object = { lo_name = 0xffffffff807ae4f9 "system map", lo_type = 0xffffffff807ae4f9 "system map", lo_flags = 21168128, lo_witness_data = {lod_list = { stqe_next = 0xffffffff80a36de0}, lod_witness = 0xffffffff80a36de0}}, mtx_lock = 4, mtx_recurse = 0}, nentries = 0, size = 0, timestamp = 10, needs_wakeup = 0 '\0', system_map = 0 '\0', flags = 0 '\0', root = 0x0, pmap = 0xffffff0023d4f298}, vm_pmap = {pm_mtx = {lock_object = { lo_name = 0xffffffff807ea4a9 "pmap", lo_type = 0xffffffff807ea4a9 "pmap", lo_flags = 21168128, lo_witness_data = {lod_list = {stqe_next = 0xffffffff80a36c60}, lod_witness = 0xffffffff80a36c60}}, mtx_lock = 4, mtx_recurse = 0}, pm_pml4 = 0xffffff000c337000, pm_pvchunk = {tqh_first = 0x0, tqh_last = 0xffffff0023d4f2d0}, pm_active = 4, pm_stats = {resident_count = 2, wired_count = 0}}, vm_shm = 0x0, vm_swrss = 0, vm_tsize = 3, vm_dsize = 1, vm_ssize = 32, vm_taddr = 0x400000 <Address 0x400000 out of bounds>, vm_daddr = 0x503000 <Address 0x503000 out of bounds>, vm_maxsaddr = 0x7fffe0000000 <Address 0x7fffe0000000 out of bounds>, vm_refcnt = 0} (kgdb) p vm->vm_pmap $1 = {pm_mtx = {lock_object = {lo_name = 0xffffffff807ea4a9 "pmap", lo_type = 0xffffffff807ea4a9 "pmap", lo_flags = 21168128, lo_witness_data = {lod_list = { stqe_next = 0xffffffff80a36c60}, lod_witness = 0xffffffff80a36c60}}, mtx_lock = 4, mtx_recurse = 0}, pm_pml4 = 0xffffff000c337000, pm_pvchunk = {tqh_first = 0x0, tqh_last = 0xffffff0023d4f2d0}, pm_active = 4, pm_stats = {resident_count = 2, wired_count = 0}}