GENERIC RELENG_7 from Mon Apr 13 08:33:26 CEST 2009 r190972, vmcore.330 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.2-PRERELEASE #0 r190972: Mon Apr 13 08:33:26 CEST 2009 pho@crashbox.osted.lan:/var/tmp/RELENG_7/src/sys/i386/compile/PHO WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. link_elf: symbol __stack_chk_guard undefined KLD file acpi.ko - could not finalize loading Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) XEON(TM) CPU 1.80GHz (1799.81-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf24 Stepping = 4 Features=0x3febfbff Logical CPUs per core: 2 real memory = 1073676288 (1023 MB) avail memory = 1036439552 (988 MB) MPTable: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 6 cpu3 (AP): APIC ID: 7 : Trying to mount root from ufs:/dev/ad0s1a GEOM_LABEL: Label ufsid/434f618193a83f43 removed. GEOM_LABEL: Label for provider ad0s1a is ufsid/434f618193a83f43. Expensive timeout(9) function: 0xc0993740(0) 0.060797095 s GEOM_LABEL: Label ufsid/434f61819515a495 removed. GEOM_LABEL: Label for provider ad0s1f is ufsid/434f61819515a495. GEOM_LABEL: Label ufsid/434f6181a1e353a3 removed. GEOM_LABEL: Label for provider ad0s1e is ufsid/434f6181a1e353a3. GEOM_LABEL: Label ufsid/434f6181b485c4b5 removed. GEOM_LABEL: Label for provider ad0s1g is ufsid/434f6181b485c4b5. GEOM_LABEL: Label ufsid/434f6182153985e0 removed. GEOM_LABEL: Label for provider ad0s1d is ufsid/434f6182153985e0. GEOM_LABEL: Label ufsid/434f618193a83f43 removed. GEOM_LABEL: Label ufsid/434f61819515a495 removed. GEOM_LABEL: Label ufsid/434f6181a1e353a3 removed. GEOM_LABEL: Label ufsid/434f6181b485c4b5 removed. GEOM_LABEL: Label ufsid/434f6182153985e0 removed. fxp0: link state changed to UP panic: vm_reserv_reclaim: reserv 0xc2680058's popcnt is corrupted cpuid = 3 KDB: enter: panic [thread pid 40693 tid 100155 ] Stopped at kdb_enter_why+0x3a: movl $0,kdb_why db:0:kdb.enter.panic> run pho db:1:pho> bt Tracing pid 40693 tid 100155 td 0xc6adc230 kdb_enter_why(c0b8c0b6,c0b8c0b6,c0bb1fd1,e6ae3aa8,3,...) at kdb_enter_why+0x3a panic(c0bb1fd1,c2680058,c0bb1ef3,246,0,...) at panic+0x136 vm_reserv_reclaim(c0d29e10,4,c0bb1ef3,266,e6ae3afc,...) at vm_reserv_reclaim+0x145 vm_reserv_reclaim_inactive(0,0,0,370,0,...) at vm_reserv_reclaim_inactive+0x3d vm_page_alloc(c44d0e00,d,0,40,e6ae3be8,...) at vm_page_alloc+0x28f vm_fault(c6c56674,2807f000,2,8,2807fffc,...) at vm_fault+0x6e7 trap_pfault(5,0,c0bbd2b5,2f1,c6bfb2b8,...) at trap_pfault+0x118 trap(e6ae3d38) at trap+0x267 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28052f26, esp = 0xbfbfe440, ebp = 0xbfbfe468 --- db:1:bt> show allpcpu Current CPU: 3 cpuid = 0 curthread = 0xc422b690: pid 34 "pagedaemon" curpcb = 0xe46d3d90 fpcurthread = none idlethread = 0xc409a460: pid 14 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 curthread = 0xc409a690: pid 13 "idle: cpu1" curpcb = 0xc3eacd90 fpcurthread = none idlethread = 0xc409a690: pid 13 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 curthread = 0xc409a8c0: pid 12 "idle: cpu2" curpcb = 0xc3ea9d90 fpcurthread = none idlethread = 0xc409a8c0: pid 12 "idle: cpu2" APIC ID = 6 currentldt = 0x50 spin locks held: cpuid = 3 curthread = 0xc6adc230: pid 40693 "install" curpcb = 0xe6ae3d90 fpcurthread = none idlethread = 0xc409aaf0: pid 11 "idle: cpu3" APIC ID = 7 currentldt = 0x50 spin locks held: db:1:allpcpu> show alllocks Process 40693 (install) thread 0xc6adc230 (100155) exclusive sleep mutex vm page queue free mutex r = 0 (0xc0d29e10) locked @ vm/vm_page.c:1038 exclusive sleep mutex vm object (standard object) r = 0 (0xc44d0e00) locked @ vm/vm_fault.c:295 exclusive sx user map r = 0 (0xc6c566b8) locked @ vm/vm_map.c:3117 Process 1076 (sshd) thread 0xc45f6d20 (100116) exclusive sx so_rcv_sx r = 0 (0xc45e43cc) locked @ kern/uipc_sockbuf.c:148 Process 34 (pagedaemon) thread 0xc422b690 (100033) exclusive sleep mutex vm page queue mutex r = 0 (0xc0d29e28) locked @ vm/vm_object.c:1887 exclusive sleep mutex vm object (kmem object) r = 0 (0xc0d29d20) locked @ vm/vm_map.c:2306 exclusive sleep mutex system map r = 0 (0xc14710e8) locked @ vm/vm_map.c:2425 exclusive sleep mutex UMA lock r = 0 (0xc0d2998c) locked @ vm/uma_core.c:1489 db:1:alllocks> show lockedvnods Locked vnodes db:1:lockedvnods> show mount 0xc4466a38 /dev/ad0s1a on / (ufs) 0xc4467000 devfs on /dev (devfs) 0xc452a6d0 /dev/ad0s1f on /home (ufs) 0xc452a368 /dev/ad0s1e on /tmp (ufs) 0xc4530368 /dev/ad0s1g on /usr (ufs) 0xc4530000 /dev/ad0s1d on /var (ufs) 0xc452fa38 procfs on /proc (procfs) More info: show mount db:1:mount> ps pid ppid pgrp uid state wmesg wchan cmd 40693 40692 39847 0 RL+ CPU 3 install 40692 40691 39847 0 S+ wait 0xc4598828 make 40691 40690 39847 0 S+ wait 0xc7b9e000 sh 40690 39862 39847 0 S+ wait 0xc6bd5570 make 39862 39861 39847 0 S+ wait 0xc7bc6ae0 sh 39861 39860 39847 0 S+ wait 0xc44bc828 make 39860 39847 39847 0 S+ wait 0xc45732b8 sh 39847 1113 39847 0 S+ wait 0xc6c73000 make 1113 1109 1113 0 S+ wait 0xc449bae0 bash 1109 1108 1109 0 S+ pause 0xc449b060 csh 1108 1080 1108 1001 S+ wait 0xc44bdae0 su 1080 1078 1080 1001 Ss+ wait 0xc44bd2b8 bash 1078 1076 1076 1001 S select 0xc0d1d1fc sshd 1076 946 1076 0 Ss sbwait 0xc45e43fc sshd 1075 1 1075 0 Ss+ ttyin 0xc4252410 getty 1074 1 1074 0 Ss+ ttyin 0xc4252810 getty 1073 1 1073 0 Ss+ ttyin 0xc4252c10 getty 1072 1 1072 0 Ss+ ttyin 0xc4253010 getty 1071 1 1071 0 Ss+ ttyin 0xc4253410 getty 1070 1 1070 0 Ss+ ttyin 0xc4253810 getty 1069 1 1069 0 Ss+ ttyin 0xc4253c10 getty 1068 1 1068 0 Ss+ ttyin 0xc4254010 getty 1042 1 1042 0 Ss select 0xc0d1d1fc inetd 1018 1 1018 0 Ss select 0xc0d1d1fc moused 1004 1 1004 0 Ss nanslp 0xc0cc9c44 watchdogd 962 1 962 0 Ss nanslp 0xc0cc9c44 cron 955 1 955 25 Ss pause 0xc45e85d0 sendmail 951 1 951 0 Ss select 0xc0d1d1fc sendmail 946 1 946 0 Ss select 0xc0d1d1fc sshd 909 1 909 0 Ss select 0xc0d1d1fc ntpd 774 758 758 0 S - 0xc4443e00 nfsd 773 758 758 0 S - 0xc4442800 nfsd 772 758 758 0 S - 0xc4497000 nfsd 771 758 758 0 S - 0xc4442400 nfsd 770 758 758 0 S - 0xc4442a00 nfsd 769 758 758 0 S - 0xc4414c00 nfsd 768 758 758 0 S - 0xc4497200 nfsd 767 758 758 0 S - 0xc4442600 nfsd 766 758 758 0 S - 0xc4443200 nfsd 764 758 758 0 S - 0xc4497600 nfsd 763 758 758 0 S - 0xc4442c00 nfsd 762 758 758 0 S - 0xc4497400 nfsd 761 758 758 0 S - 0xc4414000 nfsd 760 758 758 0 S - 0xc4497800 nfsd 759 758 758 0 S - 0xc41c9e00 nfsd 758 1 758 0 Ss select 0xc0d1d1fc nfsd 756 1 756 0 Ss select 0xc0d1d1fc mountd 674 1 674 0 Ss select 0xc0d1d1fc rpcbind 656 1 656 0 Ss select 0xc0d1d1fc syslogd 491 1 491 0 Ss select 0xc0d1d1fc devd 40 0 0 0 SL sdflush 0xc0d29640 [softdepflush] 39 0 0 0 SL syncer 0xc0cc9a8c [syncer] 38 0 0 0 SL vlruwt 0xc424f570 [vnlru] 37 0 0 0 SL psleep 0xc0d1d684 [bufdaemon] 36 0 0 0 SL pgzero 0xc0d2a254 [pagezero] 35 0 0 0 SL psleep 0xc0d29e84 [vmdaemon] 34 0 0 0 RL CPU 0 [pagedaemon] 33 0 0 0 SL waiting_ 0xc0d1f40c [sctp_iterator] 32 0 0 0 WL [swi0: sio] 9 0 0 0 SL - 0xc419f63c [fdc0] 31 0 0 0 WL [irq12: psm0] 30 0 0 0 WL [irq1: atkbd0] 29 0 0 0 WL [irq15: ata1] 28 0 0 0 WL [irq14: ata0] 27 0 0 0 WL [irq17: fxp0] 26 0 0 0 SL usbtsk 0xc0cc6e74 [usbtask-dr] 25 0 0 0 SL usbtsk 0xc0cc6e60 [usbtask-hc] 24 0 0 0 SL usbevt 0xc41ad210 [usb0] 23 0 0 0 WL [irq16: uhci0] 8 0 0 0 SL - 0xc412e380 [em0 taskq] 22 0 0 0 WL [swi6: task queue] 21 0 0 0 WL [swi6: Giant taskq] 7 0 0 0 SL - 0xc412d600 [thread taskq] 20 0 0 0 WL [swi5: +] 6 0 0 0 SL - 0xc412d800 [kqueue taskq] 19 0 0 0 WL [swi2: cambio] 5 0 0 0 SL ccb_scan 0xc0c95d54 [xpt_thrd] 18 0 0 0 SL - 0xc0cc9a94 [yarrow] 4 0 0 0 SL - 0xc0cc760c [g_down] 3 0 0 0 SL - 0xc0cc7608 [g_up] 2 0 0 0 SL - 0xc0cc7600 [g_event] 17 0 0 0 WL [swi3: vm] 16 0 0 0 WL [swi4: clock sio] 15 0 0 0 WL [swi1: net] 14 0 0 0 RL [idle: cpu0] 13 0 0 0 RL CPU 1 [idle: cpu1] 12 0 0 0 RL CPU 2 [idle: cpu2] 11 0 0 0 RL [idle: cpu3] 1 0 1 0 SLs wait 0xc4098ae0 [init] 10 0 0 0 SL audit_wo 0xc0d29084 [audit] 0 0 0 0 SLs sched 0xc0cc76c0 [swapper] db:1:ps> allt Tracing command install pid 40693 tid 100155 td 0xc6adc230 kdb_enter_why(c0b8c0b6,c0b8c0b6,c0bb1fd1,e6ae3aa8,3,...) at kdb_enter_why+0x3a panic(c0bb1fd1,c2680058,c0bb1ef3,246,0,...) at panic+0x136 vm_reserv_reclaim(c0d29e10,4,c0bb1ef3,266,e6ae3afc,...) at vm_reserv_reclaim+0x145 vm_reserv_reclaim_inactive(0,0,0,370,0,...) at vm_reserv_reclaim_inactive+0x3d vm_page_alloc(c44d0e00,d,0,40,e6ae3be8,...) at vm_page_alloc+0x28f vm_fault(c6c56674,2807f000,2,8,2807fffc,...) at vm_fault+0x6e7 trap_pfault(5,0,c0bbd2b5,2f1,c6bfb2b8,...) at trap_pfault+0x118 trap(e6ae3d38) at trap+0x267 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28052f26, esp = 0xbfbfe440, ebp = 0xbfbfe468 --- Tracing command make pid 40692 tid 100101 td 0xc459c690 sched_switch(c459c690,0,1,180,61f2277a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4598840,...) at mi_switch+0x223 sleepq_switch(c4598840,0,c0b8fcb4,19e,c4598828,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4598828,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4598828,c45988b8,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c459c690,ffffffff,e69e9c2c,0,0,...) at kern_wait+0xab6 wait4(c459c690,e69e9cfc,10,c0b91e7f,c0c60828,...) at wait4+0x3b syscall(e69e9d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x806873f, esp = 0xbfbfdb7c, ebp = 0xbfbfdb98 --- Tracing command sh pid 40691 tid 100195 td 0xc7ba1230 sched_switch(c7ba1230,0,1,180,5d639070,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c7b9e018,...) at mi_switch+0x223 sleepq_switch(c7b9e018,0,c0b8fcb4,19e,c7b9e000,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c7b9e000,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c7b9e000,c7b9e090,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c7ba1230,ffffffff,e6b96c2c,2,0,...) at kern_wait+0xab6 wait4(c7ba1230,e6b96cfc,10,e6b96d38,c0c60828,...) at wait4+0x3b syscall(e6b96d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814f6bb, esp = 0xbfbfe55c, ebp = 0xbfbfe578 --- Tracing command make pid 40690 tid 100147 td 0xc4575690 sched_switch(c4575690,0,1,180,5c43567c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c6bd5588,...) at mi_switch+0x223 sleepq_switch(c6bd5588,0,c0b8fcb4,19e,c6bd5570,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c6bd5570,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c6bd5570,c6bd5600,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c4575690,ffffffff,e6ac9c2c,0,0,...) at kern_wait+0xab6 wait4(c4575690,e6ac9cfc,10,c0b91e7f,c0c60828,...) at wait4+0x3b syscall(e6ac9d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x806873f, esp = 0xbfbfdc0c, ebp = 0xbfbfdc28 --- Tracing command sh pid 39862 tid 100203 td 0xc7bc98c0 sched_switch(c7bc98c0,0,1,180,596e5088,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c7bc6af8,...) at mi_switch+0x223 sleepq_switch(c7bc6af8,0,c0b8fcb4,19e,c7bc6ae0,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c7bc6ae0,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c7bc6ae0,c7bc6b70,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c7bc98c0,ffffffff,e6baec2c,2,0,...) at kern_wait+0xab6 wait4(c7bc98c0,e6baecfc,10,c0b91f03,c0c60828,...) at wait4+0x3b syscall(e6baed38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814f6bb, esp = 0xbfbfdd2c, ebp = 0xbfbfdd48 --- Tracing command make pid 39861 tid 100045 td 0xc44c2460 sched_switch(c44c2460,0,1,180,65109d76,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c44bc840,...) at mi_switch+0x223 sleepq_switch(c44bc840,0,c0b8fcb4,19e,c44bc828,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c44bc828,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c44bc828,c44bc8b8,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c44c2460,ffffffff,e68e8c2c,0,0,...) at kern_wait+0xab6 wait4(c44c2460,e68e8cfc,10,c0b91e7f,c0c60828,...) at wait4+0x3b syscall(e68e8d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x806873f, esp = 0xbfbfdc3c, ebp = 0xbfbfdc58 --- Tracing command sh pid 39860 tid 100074 td 0xc4575230 sched_switch(c4575230,0,1,180,61971cda,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45732d0,...) at mi_switch+0x223 sleepq_switch(c45732d0,0,c0b8fcb4,19e,c45732b8,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c45732b8,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c45732b8,c4573348,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c4575230,ffffffff,e698cc2c,2,0,...) at kern_wait+0xab6 wait4(c4575230,e698ccfc,10,e698cd38,c0c60828,...) at wait4+0x3b syscall(e698cd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2814f6bb, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command make pid 39847 tid 100183 td 0xc6c768c0 sched_switch(c6c768c0,0,1,180,60843bf2,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c6c73018,...) at mi_switch+0x223 sleepq_switch(c6c73018,0,c0b8fcb4,19e,c6c73000,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c6c73000,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c6c73000,c6c73090,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c6c768c0,ffffffff,e6b6dc2c,0,0,...) at kern_wait+0xab6 wait4(c6c768c0,e6b6dcfc,10,c0b91e7f,c0c60828,...) at wait4+0x3b syscall(e6b6dd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x806873f, esp = 0xbfbfdd1c, ebp = 0xbfbfdd38 --- Tracing command bash pid 1113 tid 100053 td 0xc449daf0 sched_switch(c449daf0,0,1,180,c3f2e63e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c449baf8,...) at mi_switch+0x223 sleepq_switch(c449baf8,0,c0b8fcb4,19e,c449bae0,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c449bae0,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c449bae0,c449bb70,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c449daf0,ffffffff,e6915c2c,6,0,...) at kern_wait+0xab6 wait4(c449daf0,e6915cfc,10,c0b91dfe,c0c60828,...) at wait4+0x3b syscall(e6915d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282b36bb, esp = 0xbfbfe84c, ebp = 0xbfbfe868 --- Tracing command csh pid 1109 tid 100057 td 0xc449d230 sched_switch(c449d230,0,1,180,4fb3adec,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c449b018,...) at mi_switch+0x223 sleepq_switch(c449b018,0,c0b8fcb4,19e,c449b060,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,68,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c449b060,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c449b060,c449b090,168,c0b48f7b,0,...) at _sleep+0x379 kern_sigsuspend(c449d230,0,0,0,0,...) at kern_sigsuspend+0xe4 sigsuspend(c449d230,e6925cfc,4,c0b91dfe,c0c62778,...) at sigsuspend+0x4d syscall(e6925d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x2816d78b, esp = 0xbfbfe64c, ebp = 0xbfbfe6b8 --- Tracing command su pid 1108 tid 100069 td 0xc4546690 sched_switch(c4546690,0,1,180,36ac5d7e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c44bdaf8,...) at mi_switch+0x223 sleepq_switch(c44bdaf8,0,c0b8fcb4,19e,c44bdae0,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c44bdae0,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c44bdae0,c44bdb70,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c4546690,455,e6971c2c,2,0,...) at kern_wait+0xab6 wait4(c4546690,e6971cfc,10,e6971d38,c0c60828,...) at wait4+0x3b syscall(e6971d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2810d6bb, esp = 0xbfbfe69c, ebp = 0xbfbfe6b8 --- Tracing command bash pid 1080 tid 100042 td 0xc44c2af0 sched_switch(c44c2af0,0,1,180,d61e46d2,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c44bd2d0,...) at mi_switch+0x223 sleepq_switch(c44bd2d0,0,c0b8fcb4,19e,c44bd2b8,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c44bd2b8,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c44bd2b8,c44bd348,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c44c2af0,ffffffff,e68dcc2c,6,0,...) at kern_wait+0xab6 wait4(c44c2af0,e68dccfc,10,c0b91dfe,c0c60828,...) at wait4+0x3b syscall(e68dcd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282b36bb, esp = 0xbfbfea4c, ebp = 0xbfbfea68 --- Tracing command sshd pid 1078 tid 100066 td 0xc4546d20 sched_switch(c4546d20,0,1,180,61cfcece,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4543588,...) at mi_switch+0x223 sleepq_switch(c4543588,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c4546d20,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,e6965b04,...) at _cv_wait_sig+0x20b kern_select(c4546d20,a,285030dc,285030e0,0,0,5b,280f3ac8) at kern_select+0x6cc select(c4546d20,e6965cfc,14,c0b7a0ed,c0c61038,...) at select+0x5e syscall(e6965d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2839b103, esp = 0xbfbfe5dc, ebp = 0xbfbfe628 --- Tracing command sshd pid 1076 tid 100116 td 0xc45f6d20 sched_switch(c45f6d20,0,1,180,f1d51a58,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45e8af8,...) at mi_switch+0x223 sleepq_switch(c45e8af8,0,c0b8fcb4,19e,c45e43fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c45e43fc,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c45e43fc,c45e43b4,158,c0b94b40,0) at _sleep+0x379 sbwait(c45e4390,4,c0b94bf5,5b0,c45e43b4,...) at sbwait+0x76 soreceive_generic(c45e4340,0,e6a2cc60,0,0,...) at soreceive_generic+0x400 soreceive(c45e4340,0,e6a2cc60,0,0,...) at soreceive+0x38 soo_read(c4591260,e6a2cc60,c457f600,0,c45f6d20,...) at soo_read+0x3b dofileread(e6a2cc60,ffffffff,ffffffff,0,c4591260,...) at dofileread+0x96 kern_readv(c45f6d20,5,e6a2cc60,bfbfe62c,4,...) at kern_readv+0x58 read(c45f6d20,e6a2ccfc,c,c0ba81fc,c0c607c8,...) at read+0x4f syscall(e6a2cd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x2839b183, esp = 0xbfbfe5cc, ebp = 0xbfbfe608 --- Tracing command getty pid 1075 tid 100062 td 0xc4549690 sched_switch(c4549690,0,1,180,2a0fff9c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45442d0,...) at mi_switch+0x223 sleepq_switch(c45442d0,0,c0b8fcb4,19e,c4252410,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4252410,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4252410,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4252400,c4252410,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4252400,e6955c60,0,e6955b90,c06f105d,...) at ttread+0x4e7 ttyread(c41c8b00,e6955c60,0,e6955bb4,c07a87a0,...) at ttyread+0x38 scread(c41c8b00,e6955c60,0,19d,0,...) at scread+0x2d giant_read(c41c8b00,e6955c60,0,0,1,...) at giant_read+0x60 devfs_read_f(c45065a4,e6955c60,c4070300,0,c4549690,...) at devfs_read_f+0x7d dofileread(e6955c60,ffffffff,ffffffff,0,c45065a4,...) at dofileread+0x96 kern_readv(c4549690,0,e6955c60,bfbfee4b,1,...) at kern_readv+0x58 read(c4549690,e6955cfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e6955d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1074 tid 100104 td 0xc459c000 sched_switch(c459c000,0,1,180,2aaaee14,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4598018,...) at mi_switch+0x223 sleepq_switch(c4598018,0,c0b8fcb4,19e,c4252810,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4252810,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4252810,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4252800,c4252810,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4252800,e69f2c60,0,e69f2b90,c06f105d,...) at ttread+0x4e7 ttyread(c41c8c00,e69f2c60,0,e69f2bb4,c07a87a0,...) at ttyread+0x38 scread(c41c8c00,e69f2c60,0,19d,0,...) at scread+0x2d giant_read(c41c8c00,e69f2c60,0,0,1,...) at giant_read+0x60 devfs_read_f(c45069cc,e69f2c60,c4070300,0,c459c000,...) at devfs_read_f+0x7d dofileread(e69f2c60,ffffffff,ffffffff,0,c45069cc,...) at dofileread+0x96 kern_readv(c459c000,0,e69f2c60,bfbfee4b,1,...) at kern_readv+0x58 read(c459c000,e69f2cfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e69f2d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1073 tid 100119 td 0xc45f6690 sched_switch(c45f6690,0,1,180,2a9fc9e4,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45e82d0,...) at mi_switch+0x223 sleepq_switch(c45e82d0,0,c0b8fcb4,19e,c4252c10,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4252c10,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4252c10,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4252c00,c4252c10,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4252c00,e6a35c60,0,e6a35b90,c06f105d,...) at ttread+0x4e7 ttyread(c41c8d00,e6a35c60,0,e6a35bb4,c07a87a0,...) at ttyread+0x38 scread(c41c8d00,e6a35c60,0,19d,0,...) at scread+0x2d giant_read(c41c8d00,e6a35c60,0,0,1,...) at giant_read+0x60 devfs_read_f(c44a3720,e6a35c60,c4070300,0,c45f6690,...) at devfs_read_f+0x7d dofileread(e6a35c60,ffffffff,ffffffff,0,c44a3720,...) at dofileread+0x96 kern_readv(c45f6690,0,e6a35c60,bfbfee4b,1,...) at kern_readv+0x58 read(c45f6690,e6a35cfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e6a35d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1072 tid 100110 td 0xc45f7af0 sched_switch(c45f7af0,0,1,180,299ee2aa,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45ea018,...) at mi_switch+0x223 sleepq_switch(c45ea018,0,c0b8fcb4,19e,c4253010,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4253010,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4253010,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4253000,c4253010,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4253000,e6a1ac60,0,e6a1ab90,c06f105d,...) at ttread+0x4e7 ttyread(c41c8e00,e6a1ac60,0,e6a1abb4,c07a87a0,...) at ttyread+0x38 scread(c41c8e00,e6a1ac60,0,19d,0,...) at scread+0x2d giant_read(c41c8e00,e6a1ac60,0,0,1,...) at giant_read+0x60 devfs_read_f(c4506804,e6a1ac60,c4070300,0,c45f7af0,...) at devfs_read_f+0x7d dofileread(e6a1ac60,ffffffff,ffffffff,0,c4506804,...) at dofileread+0x96 kern_readv(c45f7af0,0,e6a1ac60,bfbfee4b,1,...) at kern_readv+0x58 read(c45f7af0,e6a1acfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e6a1ad38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1071 tid 100082 td 0xc4574000 sched_switch(c4574000,0,1,180,297f323a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4545840,...) at mi_switch+0x223 sleepq_switch(c4545840,0,c0b8fcb4,19e,c4253410,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4253410,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4253410,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4253400,c4253410,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4253400,e69a4c60,0,e69a4b90,c06f105d,...) at ttread+0x4e7 ttyread(c4250000,e69a4c60,0,e69a4bb4,c07a87a0,...) at ttyread+0x38 scread(c4250000,e69a4c60,0,19d,0,...) at scread+0x2d giant_read(c4250000,e69a4c60,0,0,1,...) at giant_read+0x60 devfs_read_f(c459117c,e69a4c60,c4070300,0,c4574000,...) at devfs_read_f+0x7d dofileread(e69a4c60,ffffffff,ffffffff,0,c459117c,...) at dofileread+0x96 kern_readv(c4574000,0,e69a4c60,bfbfee4b,1,...) at kern_readv+0x58 read(c4574000,e69a4cfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e69a4d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1070 tid 100097 td 0xc422caf0 sched_switch(c422caf0,0,1,180,2aa92d30,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4599588,...) at mi_switch+0x223 sleepq_switch(c4599588,0,c0b8fcb4,19e,c4253810,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4253810,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4253810,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4253800,c4253810,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4253800,e69ddc60,0,e69ddb90,c06f105d,...) at ttread+0x4e7 ttyread(c4250100,e69ddc60,0,e69ddbb4,c07a87a0,...) at ttyread+0x38 scread(c4250100,e69ddc60,0,19d,0,...) at scread+0x2d giant_read(c4250100,e69ddc60,0,0,1,...) at giant_read+0x60 devfs_read_f(c44a4720,e69ddc60,c4070300,0,c422caf0,...) at devfs_read_f+0x7d dofileread(e69ddc60,ffffffff,ffffffff,0,c44a4720,...) at dofileread+0x96 kern_readv(c422caf0,0,e69ddc60,bfbfee4b,1,...) at kern_readv+0x58 read(c422caf0,e69ddcfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e69ddd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1069 tid 100092 td 0xc4419690 sched_switch(c4419690,0,1,180,29523e82,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c459a588,...) at mi_switch+0x223 sleepq_switch(c459a588,0,c0b8fcb4,19e,c4253c10,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4253c10,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4253c10,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4253c00,c4253c10,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4253c00,e69cec60,0,e69ceb90,c06f105d,...) at ttread+0x4e7 ttyread(c4250200,e69cec60,0,e69cebb4,c07a87a0,...) at ttyread+0x38 scread(c4250200,e69cec60,0,19d,0,...) at scread+0x2d giant_read(c4250200,e69cec60,0,0,1,...) at giant_read+0x60 devfs_read_f(c4506e8c,e69cec60,c4070300,0,c4419690,...) at devfs_read_f+0x7d dofileread(e69cec60,ffffffff,ffffffff,0,c4506e8c,...) at dofileread+0x96 kern_readv(c4419690,0,e69cec60,bfbfee4b,1,...) at kern_readv+0x58 read(c4419690,e69cecfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e69ced38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command getty pid 1068 tid 100064 td 0xc4549230 sched_switch(c4549230,0,1,180,2a6464be,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4543af8,...) at mi_switch+0x223 sleepq_switch(c4543af8,0,c0b8fcb4,19e,c4254010,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,59,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4254010,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4254010,0,159,c0b93791,0,...) at _sleep+0x379 ttysleep(c4254000,c4254010,159,c0b93791,0,...) at ttysleep+0x39 ttread(c4254000,e695dc60,0,e695db90,c06f105d,...) at ttread+0x4e7 ttyread(c4250300,e695dc60,0,e695dbb4,c07a87a0,...) at ttyread+0x38 scread(c4250300,e695dc60,0,19d,0,...) at scread+0x2d giant_read(c4250300,e695dc60,0,0,1,...) at giant_read+0x60 devfs_read_f(c451ac2c,e695dc60,c4070300,0,c4549230,...) at devfs_read_f+0x7d dofileread(e695dc60,ffffffff,ffffffff,0,c451ac2c,...) at dofileread+0x96 kern_readv(c4549230,0,e695dc60,bfbfee4b,1,...) at kern_readv+0x58 read(c4549230,e695dcfc,c,c0bc1624,c0c607c8,...) at read+0x4f syscall(e695dd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (3, FreeBSD ELF32, read), eip = 0x28174183, esp = 0xbfbfee2c, ebp = 0xbfbfee58 --- Tracing command inetd pid 1042 tid 100060 td 0xc4549af0 sched_switch(c4549af0,0,1,180,8cff48c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4544840,...) at mi_switch+0x223 sleepq_switch(c4544840,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c4549af0,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,c4549b88,...) at _cv_wait_sig+0x20b kern_select(c4549af0,8,bfbfec7c,0,0,0,5b,281977f8) at kern_select+0x6cc select(c4549af0,e693bcfc,14,c0b91f77,c0c61038,...) at select+0x5e syscall(e693bd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28187103, esp = 0xbfbfe07c, ebp = 0xbfbfee68 --- Tracing command moused pid 1018 tid 100087 td 0xc441aaf0 sched_switch(c441aaf0,0,1,180,e75efa2a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c449a588,...) at mi_switch+0x223 sleepq_switch(c449a588,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c441aaf0,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,c441aaf0,...) at _cv_wait_sig+0x20b kern_select(c441aaf0,400,bfbfeaac,0,0,0,5b,0) at kern_select+0x6cc select(c441aaf0,e69b5cfc,14,c0bc1624,c0c61038,...) at select+0x5e syscall(e69b5d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2818c103, esp = 0xbfbfea2c, ebp = 0xbfbfebc8 --- Tracing command watchdogd pid 1004 tid 100115 td 0xc45f7000 sched_switch(c45f7000,0,1,180,291023d2,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45e9018,...) at mi_switch+0x223 sleepq_switch(c45e9018,0,c0b8fcb4,19e,c0cc9c44,...) at sleepq_switch+0x182 sleepq_catch_signals(e6a29bc0,c07d3efd,c0cd3ac0,4,5c,...) at sleepq_catch_signals+0x26f sleepq_timedwait_sig(c0cc9c44,0,c0b8ca3f,dc,0,...) at sleepq_timedwait_sig+0x17 _sleep(c0cc9c44,0,15c,c0b8d1cf,ea61,...) at _sleep+0x351 kern_nanosleep(c45f7000,e6a29c64,e6a29c6c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c45f7000,e6a29cfc,8,c0bc1624,c0c61e00,...) at nanosleep+0x6f syscall(e6a29d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28167b8f, esp = 0xbfbfed4c, ebp = 0xbfbfed78 --- Tracing command cron pid 962 tid 100071 td 0xc44be230 sched_switch(c44be230,0,1,180,8ca54b3e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4573af8,...) at mi_switch+0x223 sleepq_switch(c4573af8,0,c0b8fcb4,19e,c0cc9c44,...) at sleepq_switch+0x182 sleepq_catch_signals(e697ebc0,c07d3efd,c0cd3ac0,4,5c,...) at sleepq_catch_signals+0x26f sleepq_timedwait_sig(c0cc9c44,0,c0b8ca3f,dc,0,...) at sleepq_timedwait_sig+0x17 _sleep(c0cc9c44,0,15c,c0b8d1cf,ea61,...) at _sleep+0x351 kern_nanosleep(c44be230,e697ec64,e697ec6c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c44be230,e697ecfc,8,c0b92068,c0c61e00,...) at nanosleep+0x6f syscall(e697ed38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815fb8f, esp = 0xbfbfed0c, ebp = 0xbfbfed38 --- Tracing command sendmail pid 955 tid 100118 td 0xc45f68c0 sched_switch(c45f68c0,0,1,180,e36c3b8,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45e8588,...) at mi_switch+0x223 sleepq_switch(c45e8588,0,c0b8fcb4,19e,c45e85d0,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,68,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c45e85d0,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c45e85d0,c45e8600,168,c0b48f7b,0,...) at _sleep+0x379 kern_sigsuspend(c45f68c0,0,0,0,0,...) at kern_sigsuspend+0xe4 sigsuspend(c45f68c0,e6a32cfc,4,c0b91dfe,c0c62778,...) at sigsuspend+0x4d syscall(e6a32d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (341, FreeBSD ELF32, sigsuspend), eip = 0x2831978b, esp = 0xbfbfdb1c, ebp = 0xbfbfdb48 --- Tracing command sendmail pid 951 tid 100096 td 0xc422cd20 sched_switch(c422cd20,0,1,180,f7ae407c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4599840,...) at mi_switch+0x223 sleepq_switch(c4599840,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(e69daa84,c07d42aa,c0d1d1e4,0,c422cd20,...) at sleepq_catch_signals+0x26f sleepq_timedwait_sig(c0d1d1fc,1389,c0b91986,101,0,...) at sleepq_timedwait_sig+0x17 _cv_timedwait_sig(c0d1d1fc,c0d1d1e4,1389,31f,c422cd20,...) at _cv_timedwait_sig+0x21a kern_select(c422cd20,7,bfbfd94c,0,0,e69dac70,5,0) at kern_select+0x6b4 select(c422cd20,e69dacfc,14,c0b92326,c0c61038,...) at select+0x5e syscall(e69dad38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x283b0103, esp = 0xbfbfd0bc, ebp = 0xbfbfdb58 --- Tracing command sshd pid 946 tid 100084 td 0xc454aaf0 sched_switch(c454aaf0,0,1,180,e81af402,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45452d0,...) at mi_switch+0x223 sleepq_switch(c45452d0,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c454aaf0,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,e69aaafc,...) at _cv_wait_sig+0x20b kern_select(c454aaf0,7,285090ac,0,0,0,c454aaf0,e69aac98) at kern_select+0x6cc select(c454aaf0,e69aacfc,14,e69aad38,c0c61038,...) at select+0x5e syscall(e69aad38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x2839b103, esp = 0xbfbfe6ac, ebp = 0xbfbfee98 --- Tracing command ntpd pid 909 tid 100114 td 0xc45f7230 sched_switch(c45f7230,0,1,180,3e6fec9a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45e92d0,...) at mi_switch+0x223 sleepq_switch(c45e92d0,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c45f7230,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,0,...) at _cv_wait_sig+0x20b kern_select(c45f7230,1b,bfbfed7c,0,0,0,e6a26c98,246) at kern_select+0x6cc select(c45f7230,e6a26cfc,14,c45f7230,c0c61038,...) at select+0x5e syscall(e6a26d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28330103, esp = 0xbfbfed5c, ebp = 0xbfbfee18 --- Tracing command nfsd pid 774 tid 100108 td 0xc454a230 sched_switch(c454a230,0,1,180,179d898c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45ea588,...) at mi_switch+0x223 sleepq_switch(c45ea588,0,c0b8fcb4,19e,c4443e00,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4443e00,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4443e00,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c454a230,e6a14cfc,8,e6a14d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6a14d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 773 tid 100107 td 0xc454a460 sched_switch(c454a460,0,1,180,17a2a212,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45ea840,...) at mi_switch+0x223 sleepq_switch(c45ea840,0,c0b8fcb4,19e,c4442800,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4442800,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4442800,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c454a460,e6a11cfc,8,e6a11d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6a11d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 772 tid 100106 td 0xc454a690 sched_switch(c454a690,0,1,180,17655aa0,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45eaaf8,...) at mi_switch+0x223 sleepq_switch(c45eaaf8,0,c0b8fcb4,19e,c4497000,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4497000,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4497000,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c454a690,e6a0ecfc,8,e6a0ed38,c0c61608,...) at nfssvc+0x5d3 syscall(e6a0ed38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 771 tid 100105 td 0xc454a8c0 sched_switch(c454a8c0,0,1,180,17d15a72,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45eb018,...) at mi_switch+0x223 sleepq_switch(c45eb018,0,c0b8fcb4,19e,c4442400,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4442400,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4442400,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c454a8c0,e6a0bcfc,8,e6a0bd38,c0c61608,...) at nfssvc+0x5d3 syscall(e6a0bd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 770 tid 100081 td 0xc4574230 sched_switch(c4574230,0,1,180,173f73ae,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4545af8,...) at mi_switch+0x223 sleepq_switch(c4545af8,0,c0b8fcb4,19e,c4442a00,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4442a00,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4442a00,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4574230,e69a1cfc,8,e69a1d38,c0c61608,...) at nfssvc+0x5d3 syscall(e69a1d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 769 tid 100076 td 0xc4574d20 sched_switch(c4574d20,0,1,180,183d782c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4572af8,...) at mi_switch+0x223 sleepq_switch(c4572af8,0,c0b8fcb4,19e,c4414c00,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4414c00,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4414c00,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4574d20,e6992cfc,8,e6992d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6992d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 768 tid 100098 td 0xc422c8c0 sched_switch(c422c8c0,0,1,180,1718cf78,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45992d0,...) at mi_switch+0x223 sleepq_switch(c45992d0,0,c0b8fcb4,19e,c4497200,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4497200,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4497200,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c422c8c0,e69e0cfc,8,e69e0d38,c0c61608,...) at nfssvc+0x5d3 syscall(e69e0d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 767 tid 100075 td 0xc4575000 sched_switch(c4575000,0,1,180,17a99ce2,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4573018,...) at mi_switch+0x223 sleepq_switch(c4573018,0,c0b8fcb4,19e,c4442600,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4442600,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4442600,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4575000,e698fcfc,8,e698fd38,c0c61608,...) at nfssvc+0x5d3 syscall(e698fd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 766 tid 100077 td 0xc4574af0 sched_switch(c4574af0,0,1,180,16e1620a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4572840,...) at mi_switch+0x223 sleepq_switch(c4572840,0,c0b8fcb4,19e,c4443200,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4443200,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4443200,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4574af0,e6995cfc,8,e6995d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6995d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 764 tid 100073 td 0xc4575460 sched_switch(c4575460,0,1,180,16b3cee0,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4573588,...) at mi_switch+0x223 sleepq_switch(c4573588,0,c0b8fcb4,19e,c4497600,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4497600,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4497600,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4575460,e6989cfc,8,e6989d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6989d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 763 tid 100095 td 0xc4419000 sched_switch(c4419000,0,1,180,17095e0e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4599af8,...) at mi_switch+0x223 sleepq_switch(c4599af8,0,c0b8fcb4,19e,c4442c00,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4442c00,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4442c00,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4419000,e69d7cfc,8,e69d7d38,c0c61608,...) at nfssvc+0x5d3 syscall(e69d7d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 762 tid 100078 td 0xc45748c0 sched_switch(c45748c0,0,1,180,16dd6148,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4572588,...) at mi_switch+0x223 sleepq_switch(c4572588,0,c0b8fcb4,19e,c4497400,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4497400,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4497400,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c45748c0,e6998cfc,8,e6998d38,c0c61608,...) at nfssvc+0x5d3 syscall(e6998d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 761 tid 100083 td 0xc454ad20 sched_switch(c454ad20,0,1,180,16838b34,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4545588,...) at mi_switch+0x223 sleepq_switch(c4545588,0,c0b8fcb4,19e,c4414000,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4414000,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4414000,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c454ad20,e69a7cfc,8,e69a7d38,c0c61608,...) at nfssvc+0x5d3 syscall(e69a7d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 760 tid 100080 td 0xc4574460 sched_switch(c4574460,0,1,180,1655de7c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4572018,...) at mi_switch+0x223 sleepq_switch(c4572018,0,c0b8fcb4,19e,c4497800,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3ac0,4,c0b8ac7d,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4497800,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4497800,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c4574460,e699ecfc,8,e699ed38,c0c61608,...) at nfssvc+0x5d3 syscall(e699ed38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 759 tid 100041 td 0xc44c2d20 sched_switch(c44c2d20,0,1,180,1be1bb7e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c44bd588,...) at mi_switch+0x223 sleepq_switch(c44bd588,0,c0b8fcb4,19e,c41c9e00,...) at sleepq_switch+0x182 sleepq_catch_signals(c0b8fcb4,155,0,100,58,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c41c9e00,c0d28960,c0b82ef5,100,0,...) at sleepq_wait_sig+0x14 _sleep(c41c9e00,c0d28960,158,c0b82ef5,0,...) at _sleep+0x379 nfssvc(c44c2d20,e68d8cfc,8,e68d8d38,c0c61608,...) at nfssvc+0x5d3 syscall(e68d8d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280ce34b, esp = 0xbfbfeb2c, ebp = 0xbfbfeb48 --- Tracing command nfsd pid 758 tid 100054 td 0xc449d8c0 sched_switch(c449d8c0,0,1,180,2279ac4e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c449b840,...) at mi_switch+0x223 sleepq_switch(c449b840,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c449d8c0,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,e6919afc,...) at _cv_wait_sig+0x20b kern_select(c449d8c0,5,bfbfed48,0,0,0,c449d8c0,e6919c98) at kern_select+0x6cc select(c449d8c0,e6919cfc,14,e6919d38,c0c61038,...) at select+0x5e syscall(e6919d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28164103, esp = 0xbfbfeb4c, ebp = 0xbfbfee78 --- Tracing command mountd pid 756 tid 100090 td 0xc4419af0 sched_switch(c4419af0,0,1,180,143f561e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c459aaf8,...) at mi_switch+0x223 sleepq_switch(c459aaf8,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c4419af0,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,c0cd6ab4,...) at _cv_wait_sig+0x20b kern_select(c4419af0,9,bfbfedec,0,0,0,5b,281877f8) at kern_select+0x6cc select(c4419af0,e69c8cfc,14,c0ba81fc,c0c61038,...) at select+0x5e syscall(e69c8d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28177103, esp = 0xbfbfedbc, ebp = 0xbfbfee88 --- Tracing command rpcbind pid 674 tid 100048 td 0xc44bed20 sched_switch(c44bed20,0,1,180,9efeacfa,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c44bc018,...) at mi_switch+0x223 sleepq_switch(c44bc018,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(e68f5ad8,c07d42aa,c0d1d1e4,0,c44bed20,...) at sleepq_catch_signals+0x26f sleepq_timedwait_sig(c0d1d1fc,7531,c0b91986,101,0,...) at sleepq_timedwait_sig+0x17 _cv_timedwait_sig(c0d1d1fc,c0d1d1e4,7531,3cb,c0d1d138,...) at _cv_timedwait_sig+0x21a poll(c44bed20,e68f5cfc,c,c0b92068,c0c61b18,...) at poll+0x554 syscall(e68f5d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (209, FreeBSD ELF32, poll), eip = 0x28129cdf, esp = 0xbfbfcc7c, ebp = 0xbfbfee48 --- Tracing command syslogd pid 656 tid 100103 td 0xc459c230 sched_switch(c459c230,0,1,180,7f392cc,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c45982d0,...) at mi_switch+0x223 sleepq_switch(c45982d0,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c459c230,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,0,...) at _cv_wait_sig+0x20b kern_select(c459c230,9,2821f0a8,0,0,0,5b,281877f8) at kern_select+0x6cc select(c459c230,e69efcfc,14,c0b91f13,c0c61038,...) at select+0x5e syscall(e69efd38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x28177103, esp = 0xbfbfdf3c, ebp = 0xbfbfee88 --- Tracing command devd pid 491 tid 100072 td 0xc44be000 sched_switch(c44be000,0,1,180,ea2a5f7c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4573840,...) at mi_switch+0x223 sleepq_switch(c4573840,0,c0b8fcb4,19e,c0d1d1fc,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d42aa,c0d1d1e4,0,c0b8ac7d,c44be000,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c0d1d1fc,c0d1d1e4,c0b91986,101,0,...) at sleepq_wait_sig+0x14 _cv_wait_sig(c0d1d1fc,c0d1d1e4,c0b9198d,31f,e6981aec,...) at _cv_wait_sig+0x20b kern_select(c44be000,6,bfbfedf8,0,0,0,5b,10) at kern_select+0x6cc select(c44be000,e6981cfc,14,c0b3c47a,c0c61038,...) at select+0x5e syscall(e6981d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (93, FreeBSD ELF32, select), eip = 0x8086aaf, esp = 0xbfbfe9bc, ebp = 0xbfbfee98 --- Tracing command softdepflush pid 40 tid 100039 td 0xc4419d20 sched_switch(c4419d20,0,1,180,557d5066,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,44,...) at mi_switch+0x223 sleepq_switch(c4419d20,0,c0b8fcb4,266,44,...) at sleepq_switch+0x182 sleepq_timedwait(c0d29640,3e8,c0bad232,0,0,...) at sleepq_timedwait+0x68 _sleep(c0d29640,c0d29600,44,c0bad232,3e8,...) at _sleep+0x365 softdep_flush(0,e46e5d38,c0b883f2,322,c424f000,...) at softdep_flush+0x2d2 fork_exit(c09e8d40,0,e46e5d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46e5d70, ebp = 0 --- Tracing command syncer pid 39 tid 100038 td 0xc441a000 sched_switch(c441a000,0,1,180,760a726,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c441a000,...) at mi_switch+0x223 sleepq_switch(c441a000,0,c0b8fcb4,243,68,...) at sleepq_switch+0x182 sleepq_wait(c0cc9a8c,0,c0b989fd,0,0,...) at sleepq_wait+0x60 _sleep(c0cc9a8c,c0d1d968,68,c0b989fd,0,...) at _sleep+0x389 sched_sync(0,e46e2d38,c0b883f2,322,c424f2b8,...) at sched_sync+0x752 fork_exit(c0867430,0,e46e2d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46e2d70, ebp = 0 --- Tracing command vnlru pid 38 tid 100037 td 0xc41a2d20 sched_switch(c41a2d20,0,1,180,2d78b20e,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,50,...) at mi_switch+0x223 sleepq_switch(c41a2d20,0,c0b8fcb4,266,50,...) at sleepq_switch+0x182 sleepq_timedwait(c424f570,3e8,c0b98aa7,0,0,...) at sleepq_timedwait+0x68 _sleep(c424f570,c0d1d93c,250,c0b98aa7,3e8,...) at _sleep+0x365 vnlru_proc(0,e46dfd38,c0b883f2,322,c424f570,...) at vnlru_proc+0xf1 fork_exit(c0868460,0,e46dfd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46dfd70, ebp = 0 --- Tracing command bufdaemon pid 37 tid 100036 td 0xc422b000 sched_switch(c422b000,0,1,180,38f3a19a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,44,...) at mi_switch+0x223 sleepq_switch(c422b000,0,c0b8fcb4,266,44,...) at sleepq_switch+0x182 sleepq_timedwait(c0d1d684,3e8,c0b96113,0,0,...) at sleepq_timedwait+0x68 _sleep(c0d1d684,c0d1d688,44,c0b96113,3e8,...) at _sleep+0x365 buf_daemon(0,e46dcd38,c0b883f2,322,c424f828,...) at buf_daemon+0x21e fork_exit(c0850ec0,0,e46dcd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46dcd70, ebp = 0 --- Tracing command pagezero pid 36 tid 100035 td 0xc422b230 sched_switch(c422b230,0,1,180,bef1a112,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,0,...) at mi_switch+0x223 sleepq_switch(c422b230,0,c0b8fcb4,266,0,...) at sleepq_switch+0x182 sleepq_timedwait(c0d2a254,493e0,c0bb2395,0,0,...) at sleepq_timedwait+0x68 _sleep(c0d2a254,c0d29e10,0,c0bb2395,493e0,...) at _sleep+0x365 vm_pagezero(0,e46d9d38,c0b883f2,322,c424fae0,...) at vm_pagezero+0xdc fork_exit(c0a243c0,0,e46d9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46d9d70, ebp = 0 --- Tracing command vmdaemon pid 35 tid 100034 td 0xc422b460 sched_switch(c422b460,0,1,180,b27d429c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c422b460,...) at mi_switch+0x223 sleepq_switch(c422b460,0,c0b8fcb4,243,68,...) at sleepq_switch+0x182 sleepq_wait(c0d29e84,0,c0b8ca3f,dc,0,...) at sleepq_wait+0x60 _sleep(c0d29e84,c0d29e88,68,c0b96113,0,...) at _sleep+0x389 vm_daemon(0,e46d6d38,c0b883f2,322,c4251000,...) at vm_daemon+0x59 fork_exit(c0a1e750,0,e46d6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46d6d70, ebp = 0 --- Tracing command pagedaemon pid 34 tid 100033 td 0xc422b690 cpustop_handler(1,e46d3974,c0ada72d,0,0,...) at cpustop_handler+0x32 ipi_nmi_handler(0,0,0,0,c42512b8,...) at ipi_nmi_handler+0x2f trap(e46d3980) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0ab011c, esp = 0xe46d39c0, ebp = 0xe46d39e4 --- siointr1(c0d36b6c,0,c0bb6ccf,56f,e46d3a24,...) at siointr1+0x3cc siointr(c4256800,c0b86c77,216,c422b690,c4096000,...) at siointr+0x32 intr_execute_handlers(c407ecd0,e46d3a44,e46d3aa0,c0abedd4,38,...) at intr_execute_handlers+0xec lapic_handle_intr(38,e46d3a44) at lapic_handle_intr+0x3f Xapic_isr1() at Xapic_isr1+0x34 --- interrupt, eip = 0xc07d44ff, esp = 0xe46d3a84, ebp = 0xe46d3aa0 --- _mtx_lock_sleep(c0d29e10,c422b690,0,c0bb0e88,57e,...) at _mtx_lock_sleep+0xbf _mtx_lock_flags(c0d29e10,0,c0bb0e88,57e,a4c,...) at _mtx_lock_flags+0xef vm_page_free_toq(c230ee68,e46d3b20,c0a195e0,c230ee68,0,...) at vm_page_free_toq+0x147 vm_page_free(c230ee68,0,c230ee68,75f,902,...) at vm_page_free+0x16 vm_object_page_remove(c0d29d20,71a7,0,71a8,0,...) at vm_object_page_remove+0x1c0 vm_map_delete(c147108c,c70a6000,c70a7000,0,c1454a80,...) at vm_map_delete+0x271 vm_map_remove(c147108c,c70a6000,c70a7000,e46d3bbc,c0a07fe9,...) at vm_map_remove+0x51 kmem_free(c147108c,c70a6000,1000,e46d3bf4,c0a0af1c,...) at kmem_free+0x30 page_free(c70a6000,1000,2,2d9,2d2998c,...) at page_free+0x29 zone_drain(c144d1e0,0,c0baf241,5d1,0,...) at zone_drain+0x28c zone_foreach(c4081640,0,e46d3cf8,c0a1fa1c,c408164c,...) at zone_foreach+0x45 uma_reclaim(c408164c,0,c0bb1510,2b7,1388,...) at uma_reclaim+0x16 vm_pageout(0,e46d3d38,c0b883f2,322,c42512b8,...) at vm_pageout+0x71c fork_exit(c0a1f300,0,e46d3d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46d3d70, ebp = 0 --- Tracing command sctp_iterator pid 33 tid 100032 td 0xc422b8c0 sched_switch(c422b8c0,0,1,180,9884743a,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c422b8c0,...) at mi_switch+0x223 sleepq_switch(c422b8c0,0,c0b8fcb4,243,0,...) at sleepq_switch+0x182 sleepq_wait(c0d1f40c,c0d1f314,c0b9fb9a,0,0,...) at sleepq_wait+0x60 _sleep(c0d1f40c,c0d1f314,0,c0b9fb9a,0,...) at _sleep+0x389 sctp_iterator_thread(0,e46d0d38,c0b883f2,322,c4251570,...) at sctp_iterator_thread+0x60 fork_exit(c08d2260,0,e46d0d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46d0d70, ebp = 0 --- Tracing command swi0: sio pid 32 tid 100031 td 0xc422baf0 sched_switch(c422baf0,0,1,180,f3f68a0,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c4262768,...) at mi_switch+0x223 ithread_loop(c4238ae0,e46cad38,c0b883f2,322,c4251828,...) at ithread_loop+0x34e fork_exit(c07c09a0,c4238ae0,e46cad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46cad70, ebp = 0 --- Tracing command fdc0 pid 9 tid 100030 td 0xc422bd20 sched_switch(c422bd20,0,1,180,636e15c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,4c,...) at mi_switch+0x223 sleepq_switch(c422bd20,0,c0b8fcb4,266,4c,...) at sleepq_switch+0x182 sleepq_timedwait(c419f63c,3e8,c0b82ef5,0,0,...) at sleepq_timedwait+0x68 _sleep(c419f63c,c419f6f0,4c,c0b82ef5,3e8,...) at _sleep+0x365 fdc_thread(c419f600,e46c7d38,c0b883f2,322,c4251ae0,...) at fdc_thread+0x2be fork_exit(c0a96d80,c419f600,e46c7d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46c7d70, ebp = 0 --- Tracing command irq12: psm0 pid 31 tid 100029 td 0xc422c000 fork_trampoline() at fork_trampoline Tracing command irq1: atkbd0 pid 30 tid 100028 td 0xc422c230 sched_switch(c422c230,0,1,180,f3eed08,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40961e8,...) at mi_switch+0x223 ithread_loop(c4238160,e46b7d38,c0b883f2,322,c41a1570,...) at ithread_loop+0x34e fork_exit(c07c09a0,c4238160,e46b7d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe46b7d70, ebp = 0 --- Tracing command irq15: ata1 pid 29 tid 100027 td 0xc422c460 fork_trampoline() at fork_trampoline Tracing command irq14: ata0 pid 28 tid 100026 td 0xc40e2690 sched_switch(c40e2690,0,1,180,58e4f58e,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40df4e8,...) at mi_switch+0x223 ithread_loop(c4227760,e469ed38,c0b883f2,322,c41a1ae0,...) at ithread_loop+0x34e fork_exit(c07c09a0,c4227760,e469ed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe469ed70, ebp = 0 --- Tracing command irq17: fxp0 pid 27 tid 100025 td 0xc40e28c0 sched_switch(c40e28c0,0,1,180,61d4b6f4,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40df368,...) at mi_switch+0x223 ithread_loop(c41cec10,e4688d38,c0b883f2,322,c41bb000,...) at ithread_loop+0x34e fork_exit(c07c09a0,c41cec10,e4688d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe4688d70, ebp = 0 --- Tracing command usbtask-dr pid 26 tid 100024 td 0xc40e2af0 sched_switch(c40e2af0,0,1,180,1388bfe0,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c40e2af0,...) at mi_switch+0x223 sleepq_switch(c40e2af0,0,c0b8fcb4,243,5c,...) at sleepq_switch+0x182 sleepq_wait(c0cc6e74,0,c0b8ca3f,dc,0,...) at sleepq_wait+0x60 _sleep(c0cc6e74,0,5c,c0b7f40a,0,...) at _sleep+0x389 usb_task_thread(c0cc6e74,c3f0cd38,c0b883f2,322,c41bb2b8,...) at usb_task_thread+0x62 fork_exit(c074be40,c0cc6e74,c3f0cd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3f0cd70, ebp = 0 --- Tracing command usbtask-hc pid 25 tid 100023 td 0xc40e2d20 sched_switch(c40e2d20,0,1,180,138892b8,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c40e2d20,...) at mi_switch+0x223 sleepq_switch(c40e2d20,0,c0b8fcb4,243,5c,...) at sleepq_switch+0x182 sleepq_wait(c0cc6e60,0,c0b8ca3f,dc,0,...) at sleepq_wait+0x60 _sleep(c0cc6e60,0,5c,c0b7f40a,0,...) at _sleep+0x389 usb_task_thread(c0cc6e60,c3f09d38,c0b883f2,322,c41bb570,...) at usb_task_thread+0x62 fork_exit(c074be40,c0cc6e60,c3f09d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3f09d70, ebp = 0 --- Tracing command usb0 pid 24 tid 100022 td 0xc41a2000 sched_switch(c41a2000,0,1,180,15caff8,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,5c,...) at mi_switch+0x223 sleepq_switch(c41a2000,0,c0b8fcb4,266,5c,...) at sleepq_switch+0x182 sleepq_timedwait(c41ad210,ea60,c0b7f3cd,0,0,...) at sleepq_timedwait+0x68 _sleep(c41ad210,0,5c,c0b7f3cd,ea60,...) at _sleep+0x365 usb_event_thread(c41b1000,c3f06d38,c0b883f2,322,c41bb828,...) at usb_event_thread+0xca fork_exit(c074b6c0,c41b1000,c3f06d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3f06d70, ebp = 0 --- Tracing command irq16: uhci0 pid 23 tid 100021 td 0xc41a2230 sched_switch(c41a2230,0,1,180,f3e90e4,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40df3e8,...) at mi_switch+0x223 ithread_loop(c41b3930,c3f02d38,c0b883f2,322,c41bbae0,...) at ithread_loop+0x34e fork_exit(c07c09a0,c41b3930,c3f02d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3f02d70, ebp = 0 --- Tracing command em0 taskq pid 8 tid 100020 td 0xc41a2460 sched_switch(c41a2460,0,1,180,f369e14,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c41a2460,...) at mi_switch+0x223 sleepq_switch(c41a2460,0,c0b8fcb4,243,c41a2460,...) at sleepq_switch+0x182 sleepq_wait(c412e380,0,c0b8cb53,c0b82ef5,0,...) at sleepq_wait+0x60 msleep_spin(c412e380,c412e39c,c0b82ef5,0,c0b8ac7d,...) at msleep_spin+0x20d taskqueue_thread_loop(c41b835c,c3effd38,c0b883f2,322,c40e1828,...) at taskqueue_thread_loop+0x8e fork_exit(c08185a0,c41b835c,c3effd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3effd70, ebp = 0 --- Tracing command swi6: task queue pid 22 tid 100019 td 0xc41a2690 sched_switch(c41a2690,0,1,180,9c23e9ec,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c412d468,...) at mi_switch+0x223 ithread_loop(c41950a0,c3edcd38,c0b883f2,322,c40e1ae0,...) at ithread_loop+0x34e fork_exit(c07c09a0,c41950a0,c3edcd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3edcd70, ebp = 0 --- Tracing command swi6: Giant taskq pid 21 tid 100018 td 0xc41a28c0 fork_trampoline() at fork_trampoline Tracing command thread taskq pid 7 tid 100017 td 0xc41a2af0 sched_switch(c41a2af0,0,1,180,13a78e9c,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c41a2af0,...) at mi_switch+0x223 sleepq_switch(c41a2af0,0,c0b8fcb4,243,0,...) at sleepq_switch+0x182 sleepq_wait(c412d600,c412d61c,c0b82ef5,0,0,...) at sleepq_wait+0x60 _sleep(c412d600,c412d61c,0,c0b82ef5,0,...) at _sleep+0x389 taskqueue_thread_loop(c0cd5c1c,c3ed6d38,c0b883f2,322,c41a02b8,...) at taskqueue_thread_loop+0xb4 fork_exit(c08185a0,c0cd5c1c,c3ed6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ed6d70, ebp = 0 --- Tracing command swi5: + pid 20 tid 100016 td 0xc409c230 fork_trampoline() at fork_trampoline Tracing command kqueue taskq pid 6 tid 100015 td 0xc409c460 sched_switch(c409c460,0,1,180,138defdc,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c409c460,...) at mi_switch+0x223 sleepq_switch(c409c460,0,c0b8fcb4,243,0,...) at sleepq_switch+0x182 sleepq_wait(c412d800,c412d81c,c0b82ef5,0,0,...) at sleepq_wait+0x60 _sleep(c412d800,c412d81c,0,c0b82ef5,0,...) at _sleep+0x389 taskqueue_thread_loop(c0cc7e84,c3ed0d38,c0b883f2,322,c41a0828,...) at taskqueue_thread_loop+0xb4 fork_exit(c08185a0,c0cc7e84,c3ed0d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ed0d70, ebp = 0 --- Tracing command swi2: cambio pid 19 tid 100014 td 0xc409c690 fork_trampoline() at fork_trampoline Tracing command xpt_thrd pid 5 tid 100013 td 0xc409c8c0 sched_switch(c409c8c0,0,1,180,13881664,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c409c8c0,...) at mi_switch+0x223 sleepq_switch(c409c8c0,0,c0b8fcb4,243,4c,...) at sleepq_switch+0x182 sleepq_wait(c0c95d54,0,c0b8ca3f,dc,0,...) at sleepq_wait+0x60 _sleep(c0c95d54,c0c95d6c,4c,c0b38132,0,...) at _sleep+0x389 xpt_scanner_thread(0,c3ecad38,c0b883f2,322,c41a1000,...) at xpt_scanner_thread+0x41 fork_exit(c0470f30,0,c3ecad38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ecad70, ebp = 0 --- Tracing command yarrow pid 18 tid 100012 td 0xc409caf0 sched_switch(c409caf0,0,1,180,65f19994,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,0,...) at mi_switch+0x223 sleepq_switch(c409caf0,0,c0b8fcb4,266,0,...) at sleepq_switch+0x182 sleepq_timedwait(c0cc9a94,64,c0b82ef5,2,0,...) at sleepq_timedwait+0x68 _sleep(c0cc9a94,0,0,c0b82ef5,64,...) at _sleep+0x365 pause(c0b82ef5,64,c0b74bf4,113,0,...) at pause+0x47 random_kthread(0,c3ec7d38,c0b883f2,322,c40992b8,...) at random_kthread+0x1ef fork_exit(c06c37c0,0,c3ec7d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ec7d70, ebp = 0 --- Tracing command g_down pid 4 tid 100011 td 0xc409cd20 sched_switch(c409cd20,0,1,180,65340b60,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,4c,...) at mi_switch+0x223 sleepq_switch(c409cd20,0,c0b8fcb4,266,4c,...) at sleepq_switch+0x182 sleepq_timedwait(c0cc760c,64,c0b82ef5,0,0,...) at sleepq_timedwait+0x68 _sleep(c0cc760c,c0cc7528,24c,c0b82ef5,64,...) at _sleep+0x365 g_io_schedule_down(c409cd20,0,c0b846e7,74,0,...) at g_io_schedule_down+0x6b g_down_procbody(0,c3ec4d38,c0b883f2,322,c4099570,...) at g_down_procbody+0x8d fork_exit(c0789090,0,c3ec4d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ec4d70, ebp = 0 --- Tracing command g_up pid 3 tid 100010 td 0xc40e2000 sched_switch(c40e2000,0,1,180,65347924,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,4c,...) at mi_switch+0x223 sleepq_switch(c40e2000,0,c0b8fcb4,266,4c,...) at sleepq_switch+0x182 sleepq_timedwait(c0cc7608,64,c0b82ef5,0,0,...) at sleepq_timedwait+0x68 _sleep(c0cc7608,c0cc7568,24c,c0b82ef5,64,...) at _sleep+0x365 g_io_schedule_up(c40e2000,0,c0b846e7,5d,0,...) at g_io_schedule_up+0x133 g_up_procbody(0,c3ec1d38,c0b883f2,322,c4099828,...) at g_up_procbody+0x8d fork_exit(c0789120,0,c3ec1d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ec1d70, ebp = 0 --- Tracing command g_event pid 2 tid 100009 td 0xc40e2230 sched_switch(c40e2230,0,1,180,65f0e5dc,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,4c,...) at mi_switch+0x223 sleepq_switch(c40e2230,0,c0b8fcb4,266,4c,...) at sleepq_switch+0x182 sleepq_timedwait(c0cc7600,64,c0b82ef5,0,0,...) at sleepq_timedwait+0x68 _sleep(c0cc7600,0,4c,c0b82ef5,64,...) at _sleep+0x365 g_event_procbody(0,c3ebed38,c0b883f2,322,c4099ae0,...) at g_event_procbody+0xcb fork_exit(c07891b0,0,c3ebed38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ebed70, ebp = 0 --- Tracing command swi3: vm pid 17 tid 100008 td 0xc40e2460 fork_trampoline() at fork_trampoline Tracing command swi4: clock sio pid 16 tid 100007 td 0xc409a000 sched_switch(c409a000,0,1,180,6f72469e,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40e00e8,...) at mi_switch+0x223 ithread_loop(c4097260,c3eb8d38,c0b883f2,322,c40e12b8,...) at ithread_loop+0x34e fork_exit(c07c09a0,c4097260,c3eb8d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3eb8d70, ebp = 0 --- Tracing command swi1: net pid 15 tid 100006 td 0xc409a230 sched_switch(c409a230,0,1,180,1490bf7a,...) at sched_switch+0x49b mi_switch(1,0,c0b8867b,4a1,c40e0168,...) at mi_switch+0x223 ithread_loop(c4097270,c3eb5d38,c0b883f2,322,c40e1570,...) at ithread_loop+0x34e fork_exit(c07c09a0,c4097270,c3eb5d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3eb5d70, ebp = 0 --- Tracing command idle: cpu0 pid 14 tid 100005 td 0xc409a460 sched_switch(c409a460,0,6,17b,61ea5f28,...) at sched_switch+0x49b mi_switch(6,0,c0bbb473,47d,0,...) at mi_switch+0x223 ipi_bitmap_handler(c40e0008,28,460028,0,f,...) at ipi_bitmap_handler+0x72 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e --- interrupt, eip = 0xc0ac7fc5, esp = 0xc3eafcc0, ebp = 0xc3eafcc0 --- cpu_idle_default(c3eafcf8,c0803e09,c0cd3ac0,0,c0b8da8a,...) at cpu_idle_default+0x5 cpu_idle(c0cd3ac0,0,c0b8da8a,32d,c0ccd6c0,...) at cpu_idle+0x28 sched_idletd(0,c3eafd38,c0b883f2,322,c4098000,...) at sched_idletd+0x249 fork_exit(c0803bc0,0,c3eafd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3eafd70, ebp = 0 --- Tracing command idle: cpu1 pid 13 tid 100004 td 0xc409a690 cpustop_handler(2,c3eacc74,c0ada72d,c0802228,c3eacc24,...) at cpustop_handler+0x32 ipi_nmi_handler(c0802228,c3eacc24,c0803564,c40982b8,c40982b8,...) at ipi_nmi_handler+0x2f trap(c3eacc80) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0ac7fc5, esp = 0xc3eaccc0, ebp = 0xc3eaccc0 --- cpu_idle_default(c3eaccf8,c0803e09,c0cd3ac0,0,c0b8da8a,...) at cpu_idle_default+0x5 cpu_idle(c0cd3ac0,0,c0b8da8a,307,c0ccdd00,...) at cpu_idle+0x28 sched_idletd(0,c3eacd38,c0b883f2,322,c40982b8,...) at sched_idletd+0x249 fork_exit(c0803bc0,0,c3eacd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3eacd70, ebp = 0 --- Tracing command idle: cpu2 pid 12 tid 100003 td 0xc409a8c0 cpustop_handler(4,c3ea9c74,c0ada72d,c0802228,c3ea9c24,...) at cpustop_handler+0x32 ipi_nmi_handler(c0802228,c3ea9c24,c0803564,c4098570,c4098570,...) at ipi_nmi_handler+0x2f trap(c3ea9c80) at trap+0x2d calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0ac7fc5, esp = 0xc3ea9cc0, ebp = 0xc3ea9cc0 --- cpu_idle_default(c3ea9cf8,c0803e09,c0cd3b40,0,c0b8da8a,...) at cpu_idle_default+0x5 cpu_idle(c0cd3b40,0,c0b8da8a,32d,c0cce340,...) at cpu_idle+0x28 sched_idletd(0,c3ea9d38,c0b883f2,322,c4098570,...) at sched_idletd+0x249 fork_exit(c0803bc0,0,c3ea9d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ea9d70, ebp = 0 --- Tracing command idle: cpu3 pid 11 tid 100002 td 0xc409aaf0 sched_switch(c409aaf0,0,6,17b,61c8f746,...) at sched_switch+0x49b mi_switch(6,0,c0bbb473,47d,3,...) at mi_switch+0x223 ipi_bitmap_handler(c40e0008,28,460028,0,f,...) at ipi_bitmap_handler+0x72 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2e --- interrupt, eip = 0xc0ac7fc5, esp = 0xc3ea6cc0, ebp = 0xc3ea6cc0 --- cpu_idle_default(c3ea6cf8,c0803e09,c0cd3b40,0,c0b8da8a,...) at cpu_idle_default+0x5 cpu_idle(c0cd3b40,0,c0b8da8a,32d,c0cce980,...) at cpu_idle+0x28 sched_idletd(0,c3ea6d38,c0b883f2,322,c4098828,...) at sched_idletd+0x249 fork_exit(c0803bc0,0,c3ea6d38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3ea6d70, ebp = 0 --- Tracing command init pid 1 tid 100001 td 0xc409ad20 sched_switch(c409ad20,0,1,180,68725c34,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c4098af8,...) at mi_switch+0x223 sleepq_switch(c4098af8,0,c0b8fcb4,19e,c4098ae0,...) at sleepq_switch+0x182 sleepq_catch_signals(c07d3efd,c0cd3b40,4,c0b8ac7d,5c,...) at sleepq_catch_signals+0x26f sleepq_wait_sig(c4098ae0,0,c0b8ca3f,dc,0,...) at sleepq_wait_sig+0x14 _sleep(c4098ae0,c4098b70,15c,c0b91f24,0,...) at _sleep+0x379 kern_wait(c409ad20,ffffffff,c3ea2c2c,0,0,...) at kern_wait+0xab6 wait4(c409ad20,c3ea2cfc,10,c0b91d3f,c0c60828,...) at wait4+0x3b syscall(c3ea2d38) at syscall+0x2d3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x805455f, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command audit pid 10 tid 100000 td 0xc409c000 sched_switch(c409c000,0,1,180,13819bd8,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,c409c000,...) at mi_switch+0x223 sleepq_switch(c409c000,0,c0b8fcb4,243,c409c000,...) at sleepq_switch+0x182 sleepq_wait(c0d29084,c0d29064,c0baa852,1,0,...) at sleepq_wait+0x60 _cv_wait(c0d29084,c0d29064,c0bab2d3,194,0,...) at _cv_wait+0x20b audit_worker(0,c3e9fd38,c0b883f2,322,c4099000,...) at audit_worker+0x84 fork_exit(c09cd1f0,0,c3e9fd38) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc3e9fd70, ebp = 0 --- Tracing command swapper pid 0 tid 0 td 0xc0cc7980 sched_switch(c0cc7980,0,1,180,a6ba35d4,...) at sched_switch+0x49b mi_switch(1,0,c0b8fcb4,1cb,44,...) at mi_switch+0x223 sleepq_switch(c0cc7980,0,c0b8fcb4,266,44,...) at sleepq_switch+0x182 sleepq_timedwait(c0cc76c0,2710,c0b8e2d7,0,0,...) at sleepq_timedwait+0x68 _sleep(c0cc76c0,0,44,c0b8e2d7,2710,...) at _sleep+0x365 scheduler(0,101ec00,101ec00,101e000,1025000,...) at scheduler+0x28a mi_startup() at mi_startup+0x96 begin() at begin+0x2c db> call doadump Physical memory: 1011 MB Dumping 195 MB: 180 164 148 132 116 100 84 68 52 36 20 4 Dump complete = 0xf db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 3 (kgdb) bt #0 doadump () at pcpu.h:196 #1 0xc0496399 in db_fncall (dummy1=0x3f9, dummy2=0x0, dummy3=0x3fb, dummy4=0xe6ae3880 "ø\003") at ../../../ddb/db_command.c:516 #2 0xc049691c in db_command (last_cmdp=0xc0c96a14, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:413 #3 0xc0496a2a in db_command_loop () at ../../../ddb/db_command.c:466 #4 0xc049821d in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:228 #5 0xc080e826 in kdb_trap (type=0x3, code=0x0, tf=0xe6ae3a28) at ../../../kern/subr_kdb.c:524 #6 0xc0adacab in trap (frame=0xe6ae3a28) at ../../../i386/i386/trap.c:688 #7 0xc0abea0b in calltrap () at ../../../i386/i386/exception.s:159 #8 0xc080e9aa in kdb_enter_why (why=0xc0b8c0b6 "panic", msg=0xc0b8c0b6 "panic") at cpufunc.h:60 #9 0xc07e1c56 in panic (fmt=0xc0bb1fd1 "vm_reserv_reclaim: reserv %p's popcnt is corrupted") at ../../../kern/kern_shutdown.c:557 #10 0xc0a23205 in vm_reserv_reclaim (rv=Variable "rv" is not available. ) at ../../../vm/vm_reserv.c:597 #11 0xc0a2335d in vm_reserv_reclaim_inactive () at ../../../vm/vm_reserv.c:616 #12 0xc0a1d10f in vm_page_alloc (object=0xc44d0e00, pindex=0xd, req=0x40) at ../../../vm/vm_page.c:1076 #13 0xc0a0cde7 in vm_fault (map=0xc6c56674, vaddr=0x2807f000, fault_type=0x2, fault_flags=Variable "fault_flags" is not available. ) at ../../../vm/vm_fault.c:441 #14 0xc0ada058 in trap_pfault (frame=0xe6ae3d38, usermode=0x1, eva=0x2807fffc) at ../../../i386/i386/trap.c:829 #15 0xc0ada967 in trap (frame=0xe6ae3d38) at ../../../i386/i386/trap.c:397 #16 0xc0abea0b in calltrap () at ../../../i386/i386/exception.s:159 #17 0x28052f26 in ?? () (kgdb) f 10 #10 0xc0a23205 in vm_reserv_reclaim (rv=Variable "rv" is not available. ) at ../../../vm/vm_reserv.c:597 597 KASSERT(rv->popcnt == 0, (kgdb) l 592 if ((rv->pages[i].flags & (PG_CACHED | PG_FREE)) != 0) 593 vm_phys_free_pages(&rv->pages[i], 0); 594 else 595 rv->popcnt--; 596 } 597 KASSERT(rv->popcnt == 0, 598 ("vm_reserv_reclaim: reserv %p's popcnt is corrupted", rv)); 599 vm_reserv_reclaimed++; 600 } 601 (kgdb) f 11 #11 0xc0a2335d in vm_reserv_reclaim_inactive () at ../../../vm/vm_reserv.c:616 616 vm_reserv_reclaim(rv); (kgdb) l 611 { 612 vm_reserv_t rv; 613 614 mtx_assert(&vm_page_queue_free_mtx, MA_OWNED); 615 if ((rv = TAILQ_FIRST(&vm_rvq_partpop)) != NULL) { 616 vm_reserv_reclaim(rv); 617 return (TRUE); 618 } 619 return (FALSE); 620 } (kgdb) p *(vm_reserv_t)0xc2680058 $8 = {partpopq = {tqe_next = 0xc267f0b8, tqe_prev = 0xc0c84d80}, objq = {le_next = 0xc267fc20, le_prev = 0xc26801a0}, object = 0x0, pindex = 0x7101, pages = 0xc230bfb8, popcnt = 0x1, inpartpopq = 0x0} (kgdb) -- Test scenario: Kernel install