GENERIC releng8 from 2011-03-25 13:09:57 UTC, r220001M, vmcore.4 KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.2-STABLE #1 r220001M: Fri Apr 1 20:44:04 CEST 2011 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1799.99-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3536408576 (3372 MB) ACPI APIC Table: <060508 APIC1048> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: <060508 RSDT1048> on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, d7f00000 (3) failed Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 pci1: at device 5.2 (no driver attached) pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:21:85:15:33:7d re0: [ITHREAD] atapci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 atapci0: [ITHREAD] atapci0: AHCI v1.10 controller with 4 3Gbps ports, PM supported ata2: on atapci0 ata2: port is not ready (timeout 0ms) tfd = 000001d0 ata2: software reset clear timeout ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 ohci0: [ITHREAD] usbus0: on ohci0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 ohci1: [ITHREAD] usbus1: on ohci1 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 ohci2: [ITHREAD] usbus2: on ohci2 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 ohci3: [ITHREAD] usbus3: on ohci3 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 ohci4: [ITHREAD] usbus4: on ohci4 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: [ITHREAD] ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5: on ehci0 pci0: at device 20.0 (no driver attached) atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: on atapci1 ata0: [ITHREAD] pci0: at device 20.2 (no driver attached) isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 fwohci0: port 0xe800-0xe87f mem 0xfebff800-0xfebfffff irq 20 at device 6.0 on pci3 fwohci0: [ITHREAD] fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:dc:10:00:01:62:ad:eb fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 dcons_crom0: on firewire0 dcons_crom0: bus_addr 0xd9e0a0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:dc:10:62:ad:eb fwe0: Ethernet address: 02:dc:10:62:ad:eb fwip0: on firewire0 fwip0: Firewire address: 00:dc:10:00:01:62:ad:eb @ 0xfffe00000000, S400, maxrec 2048 fwohci0: Initiate bus reset fwohci0: fwohci_intr_core: BUS reset fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode acpi_button0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart0: console (115200,n,8,1) fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FILTER] atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse Explorer, device ID 4 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: parallel port not found. acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 hwpstate0: on cpu0 Timecounters tick every 1.000 msec firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me) firewire0: bus manager 0 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 acd0: DVDR at ata0-slave UDMA33 ugen0.1: at usbus0 uhub0: on usbus0 Expensive timeout(9) function: 0xc08cec30(0xc73b02e0) 0.016011811 s ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 ad4: 476940MB at ata2-master UDMA100 SATA 3Gb/s SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 uhub5: 10 ports with 10 removable, self powered Trying to mount root from ufs:/dev/ad4s2a Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s2a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2a: clean, 585424 free (912 frags, 73064 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 651524 free (1276 frags, 81281 blocks, 0.1% fragmentation) /dev/ad4s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1g: clean, 91347192 free (3048 frags, 11418018 blocks, 0.0% fragmentation) /dev/ad4s2d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2d: clean, 8635689 free (41841 frags, 1074231 blocks, 0.4% fragmentation) /dev/ad4s2e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2e: clean, 25210205 free (541 frags, 3151208 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 nd6 options=3 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.7 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier add net default: gateway 192.168.1.1 Starting devd. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linuxkldload: can't load linux: No such file or directory /etc/rc: WARNING: Unable to load kernel module linux . Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xdb1114b4 bufwait (bufwait) @ kern/vfs_bio.c:2636 2nd 0xc7a7c000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper(c0c7c998,2e687361,38323a63,a0d35,c088cd81,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08c9c0b,c0c7e7d2,c0f09e98,c712ff60,e9c29898,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e7d2,c7a7c000,c0c9b1ba,c71335d0,c0c9b000,...) at _witness_debugger+0x25 witness_checkorder(c7a7c000,9,c0c9aff7,11d,0,...) at witness_checkorder+0x6aa _sx_xlock(c7a7c000,0,c0c9aff7,11d,c7bb115c,...) at _sx_xlock+0x38 ufsdirhash_acquire(e9c299f0,13c,db9ce4e0,e9c29964,c0abab09,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7bb115c,e9c299f0,14e0,e9c29950,e9c29954,...) at ufsdirhash_add+0x10 ufs_direnter(c7e5d810,c7fd5ac0,e9c299f0,e9c29bd0,db111928,...) at ufs_direnter+0x6a9 ufs_mkdir(e9c29bf8,c0cacd9f,0,e9c29b3c,e9c29c1c,...) at ufs_mkdir+0x7d3 VOP_MKDIR_APV(c0d7bfa0,e9c29bf8,e9c29bd0,e9c29b3c,0,...) at VOP_MKDIR_APV+0x64 kern_mkdirat(c7fbe5c0,ffffff9c,28201020,0,1c0,...) at kern_mkdirat+0x21b kern_mkdir(c7fbe5c0,28201020,0,1c0,e9c29c7c,...) at kern_mkdir+0x2e mkdir(c7fbe5c0,e9c29cec,e9c29d28,c0c7dc04,0,...) at mkdir+0x29 syscallenter(c7fbe5c0,e9c29ce4,e9c29ce4,0,e9c29d28,...) at syscallenter+0x246 syscall(e9c29d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2816b9e3, esp = 0xbfbfe8fc, ebp = 0xbfbfeda8 --- Clearing /tmp (X related). Starting mountd. Starting nfsd. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Starting default moused. Starting inetd. Fri Apr 1 20:47:46 CEST 2011 FreeBSD/i386 (x4.osted.lan) (console) login: Apr 1 20:47:57 x4 su: pho to root on /dev/pts/0 SU test #1 lock order reversal: 1st 0xc856ec70 ufs (ufs) @ kern/vfs_vnops.c:607 2nd 0xdb1a8460 bufwait (bufwait) @ kern/vfs_bio.c:2636 3rd 0xc82df9c0 ufs (ufs) @ kern/vfs_subr.c:2130 KDB: stack backtrace: db_trace_self_wrapper(c0c7c998,d363336,c0c8000a,63b,c08d5e17,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08c9c0b,c0c7e7eb,c712ff60,852,e9d3c694,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e7eb,c82df9c0,c0c74a1f,c7133568,c0c840c2,...) at _witness_debugger+0x25 witness_checkorder(c82df9c0,9,c0c840b9,852,0,...) at witness_checkorder+0x6aa __lockmgr_args(c82df9c0,80100,c82dfa28,0,0,...) at __lockmgr_args+0x6bd ffs_lock(e9d3c79c,e9d3c798,80100,c82df968,e9d3c7bc,...) at ffs_lock+0x8a VOP_LOCK1_APV(c0d7bfa0,e9d3c79c,e9d3c79c,c0d95200,c82df968,...) at VOP_LOCK1_APV+0x4d _vn_lock(c82df968,80100,c0c840b9,852,0,...) at _vn_lock+0x3d vget(c82df968,80100,c8795b80,1713,fffffff0,...) at vget+0x6c softdep_request_cleanup(c7b83800,c856ec18,c8010d00,0,9e47,...) at softdep_request_cleanup+0x53e ffs_alloc(c86e8bc8,27,0,6ed58,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c856ec18,9c000,0,4000,c8010d00,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d3cb94,c0cacdbd,c856ec70,0,c0bbd0e2,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bfa0,e9d3cb94,c856ec18,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7ff7968,e9d3cc28,c8010d00,0,c8795b80,...) at vn_write+0x1aa dofilewrite(e9d3cc28,ffffffff,ffffffff,0,c7ff7968,...) at dofilewrite+0x95 kern_writev(c8795b80,3,e9d3cc28,e9d3cc48,1,...) at kern_writev+0x58 write(c8795b80,e9d3ccec,e9d3cd28,c0c7dc04,0,...) at write+0x4f syscallenter(c8795b80,e9d3cce4,e9d3cce4,0,c73d5b80,...) at syscallenter+0x246 syscall(e9d3cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Retry reclaim Seeking 5166 blocks Free inodes 140406, free blocks 5088, free fragments 23 Pending workitems 250, Allocated inodes 906 Found 70 files with 145600 blocks pending Other types: dirrem 0, freefrag 0, freefile 70 Retry reclaim Seeking 5166 blocks Free inodes 140406, free blocks 5088, free fragments 23 Pending workitems 351, Allocated inodes 906 Found 124 files with 257920 blocks pending Other types: dirrem 0, freefrag 0, freefile 125 Retry reclaim Seeking 5166 blocks Free inodes 140407, free blocks 5096, free fragments 23 Pending workitems 349, Allocated inodes 905 Found 174 files with 361920 blocks pending Other types: dirrem 0, freefrag 0, freefile 175 Retry reclaim Seeking 5166 blocks Free inodes 140409, free blocks 5106, free fragments 23 Pending workitems 345, Allocated inodes 903 Found 172 files with 357760 blocks pending Other types: dirrem 0, freefrag 0, freefile 173 Retry reclaim Seeking 5158 blocks Free inodes 140408, free blocks 5189, free fragments 23 Pending workitems 1315, Allocated inodes 904 Found 656 files with 1364480 blocks pending Other types: dirrem 0, freefrag 1, freefile 658 Retry reclaim Seeking 5158 blocks Free inodes 140409, free blocks 5162, free fragments 23 Pending workitems 1436, Allocated inodes 903 Found 708 files with 1472640 blocks pending Other types: dirrem 0, freefrag 18, freefile 710 lock order reversal: 1st 0xc82fb5b8 ufs (ufs) @ kern/vfs_mount.c:1204 2nd 0xc82fb710 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1035 KDB: stack backtrace: db_trace_self_wrapper(c0c7c998,30313a63,a0d3533,c712fe00,e9cd697c,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08c9c0b,c0c7e7d2,c0f09340,c7133568,e9cd6a24,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e7d2,c82fb710,c0c71ccd,c7133498,c0c9950f,...) at _witness_debugger+0x25 witness_checkorder(c82fb710,9,c0c99506,40b,c82fb778,...) at witness_checkorder+0x6aa __lockmgr_args(c82fb710,80400,c82fb778,0,0,...) at __lockmgr_args+0x6bd vop_stdlock(e9cd6b24,c0c99506,80400,c82fb6b8,e9cd6b44,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c0d561c0,e9cd6b24,e9cd6b24,c0d95200,c82fb6b8,...) at VOP_LOCK1_APV+0x4d _vn_lock(c82fb6b8,80400,c0c99506,40b,c7e532d0,...) at _vn_lock+0x3d softdep_flushworklist(c7e532d0,e9cd6bd0,c82f32e0,56c,c0c84867,...) at softdep_flushworklist+0x47 ffs_sync(c7e532d0,1,c0c83aa7,4f9,e9cd6c0c,...) at ffs_sync+0x2fd dounmount(c7e532d0,8000000,c82f32e0,47e,8eee1479,...) at dounmount+0x3d0 unmount(c82f32e0,e9cd6cec,2816fa85,1,0,...) at unmount+0x2ff syscallenter(c82f32e0,e9cd6ce4,c0ba02ae,c82f32e0,e9cd6d28,...) at syscallenter+0x246 syscall(e9cd6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280d8e6f, esp = 0xbfbfe32c, ebp = 0xbfbfe3f8 --- ~KDB: enter: Line break on console [thread pid 11 tid 100005 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc71732e0 kdb_enter(c0c260a6,c0c65a73,c0dca0fc,c73eba80,0,...) at kdb_enter+0x3a uart_intr(c73eba00,c71732e0,c71558d0,c716ed80,4,...) at uart_intr+0x126 intr_event_handle(c716ed80,c6f0ac18,1,0,c7286200,...) at intr_event_handle+0x5c intr_execute_handlers(c71558d0,c6f0ac18,1,c6f0ac58,c0b87b35,...) at intr_execute_handlers+0x49 lapic_handle_intr(30,c6f0ac18) at lapic_handle_intr+0x4c Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0b7fd85, esp = 0xc6f0ac58, ebp = 0xc6f0ac58 --- acpi_cpu_c1(c6f0ac74,c0d96850,1,ffffffff,c6f0aca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dce4c0,c6f0aca0,c0b9321b,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f0ace8,c08b995e,0,c6f0acc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f0acc4,c0c7b5ba,a08,c71732e0,...) at cpu_idle+0x1b sched_idletd(0,c6f0ad28,c0c76d43,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f0ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f0ad60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x68f700 curthread = 0xc7173000: pid 11 "idle: cpu0" curpcb = 0xc6f0dd80 fpcurthread = none idlethread = 0xc7173000: tid 100006 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x614e700 curthread = 0xc71732e0: pid 11 "idle: cpu1" curpcb = 0xc6f0ad80 fpcurthread = none idlethread = 0xc71732e0: tid 100005 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6151700 curthread = 0xc71735c0: pid 11 "idle: cpu2" curpcb = 0xc6f07d80 fpcurthread = none idlethread = 0xc71735c0: tid 100004 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6154700 curthread = 0xc71738a0: pid 11 "idle: cpu3" curpcb = 0xc6f04d80 fpcurthread = none idlethread = 0xc71738a0: tid 100003 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 4296 (sshd) thread 0xc82322e0 (100159) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc8092898) locked @ kern/uipc_sockbuf.c:148 Process 1194 (sshd) thread 0xc7fbd2e0 (100132) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc8021228) locked @ kern/uipc_sockbuf.c:148 db:0:alllocks> show lockedvnods Locked vnodes db:0:lockedvnods> show mount 0xc7b72b40 /dev/ad4s2a on / (ufs) 0xc7b73000 devfs on /dev (devfs) 0xc7e535a0 /dev/ad4s1f on /home (ufs) 0xc7b72870 /dev/ad4s1g on /tmp (ufs) 0xc7b725a0 /dev/ad4s2d on /usr (ufs) 0xc7b722d0 /dev/ad4s2e on /var (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 4542 2614 2611 1001 S nanslp 0xc0dca084 sleep 4299 4298 4299 1001 Ss+ ttyin 0xc88fb470 bash 4298 4296 4296 1001 S select 0xc83dc5a4 sshd 4296 1077 4296 0 Ss sbwait 0xc80928c4 sshd 4010 1217 1210 0 S+ mntref 0xc7e532d0 umount 2615 2611 2611 1001 S piperd 0xc7fc7c40 awk 2614 2611 2611 1001 S wait 0xc7f402b0 sh 2611 1 2611 1001 Ss wait 0xc876f560 sh 2609 1 2609 1001 Ss kqread 0xc866bd00 tail 1231 0 0 0 SL mdwait 0xc7b03800 [md5] 1217 1216 1210 0 S+ wait 0xc7f41000 sh 1216 1210 1210 0 S+ wait 0xc7e6bac0 time 1211 1206 1210 0 S+ piperd 0xc8025000 tee 1210 1206 1210 0 S+ wait 0xc7e6a810 sh 1206 1202 1206 0 S+ wait 0xc7f40000 bash 1202 1201 1202 0 S+ pause 0xc822f308 csh 1201 1197 1201 1001 S+ wait 0xc822f560 su 1197 1196 1197 1001 Ss+ wait 0xc822fac0 bash 1196 1194 1194 1001 S select 0xc80a09e4 sshd 1194 1077 1194 0 Ss sbwait 0xc8021254 sshd 1193 1 1193 0 Ss+ ttyin 0xc74f3070 getty 1192 1 1192 0 Ss+ ttyin 0xc74f3270 getty 1191 1 1191 0 Ss+ ttyin 0xc73f2a70 getty 1190 1 1190 0 Ss+ ttyin 0xc7382670 getty 1189 1 1189 0 Ss+ ttyin 0xc7382870 getty 1188 1 1188 0 Ss+ ttyin 0xc7382c70 getty 1187 1 1187 0 Ss+ ttyin 0xc73f2670 getty 1186 1 1186 0 Ss+ ttyin 0xc73f2870 getty 1185 1 1185 0 Ss+ ttyin 0xc7382a70 getty 1146 1 1146 0 Ss select 0xc80a19e4 inetd 1120 1 1120 0 Ss select 0xc7aaf5a4 moused 1096 1 1096 0 Ss nanslp 0xc0dca084 cron 1089 1 1089 25 Ss pause 0xc809cb18 sendmail 1085 1 1085 0 Ss select 0xc7ab1364 sendmail 1077 1 1077 0 Ss select 0xc7bf4024 sshd 1032 1 1032 0 Ss select 0xc7ab1e24 ntpd 899 898 898 0 S (threaded) nfsd 100129 S rpcsvc 0xc7ab14d0 nfsd: service 100128 S rpcsvc 0xc7ab1510 nfsd: service 100127 S rpcsvc 0xc7ab1550 nfsd: service 100085 S rpcsvc 0xc7aafd10 nfsd: master 898 1 898 0 Ss select 0xc7ab05e4 nfsd 889 1 889 0 Ss select 0xc7aaf0e4 mountd 792 1 792 0 Ss select 0xc74e2d24 rpcbind 765 1 765 0 Ss select 0xc7af2a64 syslogd 617 1 617 0 Ss select 0xc73f79e4 devd 21 0 0 0 SL c_flowcl 0xc0f37270 [flowcleaner] 20 0 0 0 SL sdflush 0xc0f42920 [softdepflush] 19 0 0 0 SL syncer 0xc0f37078 [syncer] 18 0 0 0 SL vlruwt 0xc7ad22b0 [vnlru] 17 0 0 0 SL psleep 0xc0f36da8 [bufdaemon] 16 0 0 0 SL pgzero 0xc0f435f4 [pagezero] 15 0 0 0 SL psleep 0xc0f4321c [vmdaemon] 9 0 0 0 SL psleep 0xc0f431e4 [pagedaemon] 8 0 0 0 SL ccb_scan 0xc0d965d4 [xpt_thrd] 7 0 0 0 SL waiting_ 0xc0f38ab8 [sctp_iterator] 6 0 0 0 SL - 0xc73f243c [fdc0] 5 0 0 0 SL - 0xc73f9000 [fw0_probe] 14 0 0 0 SL (threaded) usb 100058 D - 0xc73dad34 [usbus5] 100057 D - 0xc73dad04 [usbus5] 100056 D - 0xc73dacd4 [usbus5] 100055 D - 0xc73daca4 [usbus5] 100053 D - 0xc73cdb5c [usbus4] 100052 D - 0xc73cdb2c [usbus4] 100051 D - 0xc73cdafc [usbus4] 100050 D - 0xc73cdacc [usbus4] 100049 D - 0xc73c9b5c [usbus3] 100048 D - 0xc73c9b2c [usbus3] 100047 D - 0xc73c9afc [usbus3] 100046 D - 0xc73c9acc [usbus3] 100045 D - 0xc73bcb5c [usbus2] 100044 D - 0xc73bcb2c [usbus2] 100043 D - 0xc73bcafc [usbus2] 100042 D - 0xc73bcacc [usbus2] 100040 D - 0xc73b9b5c [usbus1] 100039 D - 0xc73b9b2c [usbus1] 100038 D - 0xc73b9afc [usbus1] 100037 D - 0xc73b9acc [usbus1] 100035 D - 0xc73a8b5c [usbus0] 100034 D - 0xc73a8b2c [usbus0] 100033 D - 0xc73a8afc [usbus0] 100032 D - 0xc73a8acc [usbus0] 13 0 0 0 SL - 0xc0dc9ee4 [yarrow] 4 0 0 0 SL - 0xc0dc7be4 [g_down] 3 0 0 0 SL - 0xc0dc7be0 [g_up] 2 0 0 0 SL - 0xc0dc7bd8 [g_event] 12 0 0 0 WL (threaded) intr 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: ohci0] 100030 I [irq22: atapci0] 100029 I [irq256: re0] 100028 I [irq9: acpi0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100023 I [swi5: +] 100022 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) idle 100006 Run CPU 0 [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100004 Run CPU 2 [idle: cpu2] 100003 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc7171ac0 [init] 10 0 0 0 SL audit_wo 0xc0f42240 [audit] 0 0 0 0 SLs (threaded) kernel 100061 D - 0xc73f8580 [fw0_taskq] 100025 D - 0xc733eac0 [thread taskq] 100024 D - 0xc733eb00 [ffs_trim taskq] 100021 D - 0xc733ee00 [acpi_task_2] 100020 D - 0xc733ee00 [acpi_task_1] 100019 D - 0xc733ee00 [acpi_task_0] 100018 D - 0xc733ee40 [kqueue taskq] 100016 D - 0xc7152880 [firmware taskq] 100000 D sched 0xc0dc7cc0 [swapper] db:0:ps> allt Tracing command sleep pid 4542 tid 100185 td 0xc8211000 sched_switch(c8211000,0,104,c8211000,352fe7c7,...) at sched_switch+0x28a mi_switch(104,0,c8211000,100,100,...) at mi_switch+0x11a sleepq_switch(c8211000,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c8211200,2711,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c0dca084,5c,c0c7aeda,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0dca084,0,15c,c0c7aeda,2711,...) at _sleep+0x288 kern_nanosleep(c8211000,e9d1ec34,e9d1ec3c,a,0,...) at kern_nanosleep+0xc1 nanosleep(c8211000,e9d1ecec,e9d1ed28,c0c7dc04,0,...) at nanosleep+0x6f syscallenter(c8211000,e9d1ece4,e9d1ece4,0,e9d1ed28,...) at syscallenter+0x246 syscall(e9d1ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815ef57, esp = 0xbfbfecac, ebp = 0xbfbfecf8 --- Tracing command bash pid 4299 tid 100182 td 0xc82115c0 sched_switch(c82115c0,0,104,c82115c0,6070e69b,...) at sched_switch+0x28a mi_switch(104,0,c82115c0,c82115c0,c82115c0,...) at mi_switch+0x11a sleepq_switch(c82115c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9d15aa8,c088cde9,c88fb404,0,c82115c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c88fb470,0,e9d15ae0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c88fb470,c88fb404,0,c88fb400,e9d15b60,...) at _cv_wait_sig+0x1b0 tty_wait(c88fb400,c88fb470,e9d15c28,1,0,...) at tty_wait+0x23 ttydisc_read(c88fb400,e9d15c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c8728900,e9d15c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bfec08,e9d15c28,c83b7280,0,c82115c0,...) at devfs_read_f+0x7e dofileread(e9d15c28,ffffffff,ffffffff,0,c7bfec08,...) at dofileread+0x96 kern_readv(c82115c0,0,e9d15c28,e9d15c48,1,...) at kern_readv+0x58 read(c82115c0,e9d15cec,e9d15d28,c0c7dc04,0,...) at read+0x4f syscallenter(c82115c0,e9d15ce4,e9d15ce4,0,e9d15d28,...) at syscallenter+0x246 syscall(e9d15d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2834f5d3, esp = 0xbfbfe01c, ebp = 0xbfbfe048 --- Tracing command sshd pid 4298 tid 100079 td 0xc7b9d5c0 sched_switch(c7b9d5c0,0,104,c7b9d5c0,6071730a,...) at sched_switch+0x28a mi_switch(104,0,c7b9d5c0,c7b9d5c0,c7b9d5c0,...) at mi_switch+0x11a sleepq_switch(c7b9d5c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b38a14,c088cde9,c83dc590,0,c7b9d5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c83dc5a4,0,e9b38a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c83dc5a4,c83dc590,c0c7eb90,627,c7fc3a48,...) at _cv_wait_sig+0x1b0 seltdwait(c7fc3a48,58,c868e680,c7b9d5c0,246,...) at seltdwait+0xa2 kern_select(c7b9d5c0,a,286030b4,286030d8,0,0,20,c7b99560,c7b99560) at kern_select+0x4ee select(c7b9d5c0,e9b38cec,e9b38d28,c0c7dc04,0,...) at select+0x66 syscallenter(c7b9d5c0,e9b38ce4,e9b38ce4,0,e9b38cb0,...) at syscallenter+0x246 syscall(e9b38d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command sshd pid 4296 tid 100159 td 0xc82322e0 sched_switch(c82322e0,0,104,c82322e0,61309b94,...) at sched_switch+0x28a mi_switch(104,0,c82322e0,100,100,...) at mi_switch+0x11a sleepq_switch(c82322e0,0,c0c7d836,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80928c4,58,c0c81c02,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80928c4,c8092884,158,c0c81c02,0,...) at _sleep+0x2bc sbwait(c8092860,0,c0c81c78,5a2,c8092884,...) at sbwait+0x52 soreceive_generic(c809280c,0,e9ccdc28,0,0,...) at soreceive_generic+0x2dc soreceive(c809280c,0,e9ccdc28,0,0,0) at soreceive+0x38 soo_read(c7ba0620,e9ccdc28,c85ba300,0,c82322e0,...) at soo_read+0x4e dofileread(e9ccdc28,ffffffff,ffffffff,0,c7ba0620,...) at dofileread+0x96 kern_readv(c82322e0,5,e9ccdc28,e9ccdc48,1,...) at kern_readv+0x58 read(c82322e0,e9ccdcec,e9ccdd28,c0c7dc04,0,...) at read+0x4f syscallenter(c82322e0,e9ccdce4,e9ccdce4,0,e9ccdd28,...) at syscallenter+0x246 syscall(e9ccdd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command umount pid 4010 tid 100161 td 0xc82f32e0 sched_switch(c82f32e0,0,104,c82f32e0,3aad804,...) at sched_switch+0x28a mi_switch(104,0,c82f32e0,c82f32e0,c82f32e0,...) at mi_switch+0x11a sleepq_switch(c82f32e0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c7e532d0,50,c0c83aef,0,0,...) at sleepq_wait+0x39 _sleep(c7e532d0,c7e532d0,50,c0c83aef,0,...) at _sleep+0x2d2 vfs_mount_destroy(c7e532d0,10,0,537,e9cd6c0c,...) at vfs_mount_destroy+0x78 dounmount(c7e532d0,8000000,c82f32e0,47e,8eee1479,...) at dounmount+0x63d unmount(c82f32e0,e9cd6cec,2816fa85,1,0,...) at unmount+0x2ff syscallenter(c82f32e0,e9cd6ce4,c0ba02ae,c82f32e0,e9cd6d28,...) at syscallenter+0x246 syscall(e9cd6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280d8e6f, esp = 0xbfbfe32c, ebp = 0xbfbfe3f8 --- Tracing command awk pid 2615 tid 100077 td 0xc7b9db80 sched_switch(c7b9db80,0,104,c7b9db80,34fffc2f,...) at sched_switch+0x28a mi_switch(104,0,c7b9db80,100,100,...) at mi_switch+0x11a sleepq_switch(c7b9db80,0,c0c7d836,1a0,4c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7fc7c40,4c,c0c7ec23,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7fc7c40,c7fc7db0,14c,c0c7ec23,0,...) at _sleep+0x2bc pipe_read(c82e3ce8,e9b30c28,c85dcd80,0,c7b9db80,...) at pipe_read+0x3aa dofileread(e9b30c28,ffffffff,ffffffff,0,c82e3ce8,...) at dofileread+0x96 kern_readv(c7b9db80,0,e9b30c28,e9b30c48,1,...) at kern_readv+0x58 read(c7b9db80,e9b30cec,e9b30d80,e9b30c88,0,...) at read+0x4f syscallenter(c7b9db80,e9b30ce4,c0b9ffcb,0,e9b30cb0,...) at syscallenter+0x246 syscall(e9b30d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281b35d3, esp = 0xbfbfe96c, ebp = 0xbfbfe988 --- Tracing command sh pid 2614 tid 100125 td 0xc7f462e0 sched_switch(c7f462e0,0,104,c7f462e0,350becdd,...) at sched_switch+0x28a mi_switch(104,0,c7f462e0,100,100,...) at mi_switch+0x11a sleepq_switch(c7f462e0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7f402b0,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7f402b0,c7f40338,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7f462e0,ffffffff,e9c5ac44,2,0,...) at kern_wait+0xa76 wait4(c7f462e0,e9c5acec,e9c5ad28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c7f462e0,e9c5ace4,e9c5ace4,0,e9c5ad28,...) at syscallenter+0x246 syscall(e9c5ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe95c, ebp = 0xbfbfe978 --- Tracing command sh pid 2611 tid 100211 td 0xc88598a0 sched_switch(c88598a0,0,104,c88598a0,94cfffef,...) at sched_switch+0x28a mi_switch(104,0,c88598a0,100,100,...) at mi_switch+0x11a sleepq_switch(c88598a0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c876f560,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c876f560,c876f5e8,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c88598a0,ffffffff,e9d86c44,2,0,...) at kern_wait+0xa76 wait4(c88598a0,e9d86cec,281ff6e8,1,0,...) at wait4+0x3b syscallenter(c88598a0,e9d86ce4,c0ba02ae,c88598a0,e9d86d28,...) at syscallenter+0x246 syscall(e9d86d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfeb5c, ebp = 0xbfbfeb78 --- Tracing command tail pid 2609 tid 100162 td 0xc82f3000 sched_switch(c82f3000,0,104,c82f3000,93897865,...) at sched_switch+0x28a mi_switch(104,0,c82f3000,100,100,...) at mi_switch+0x11a sleepq_switch(c82f3000,0,c0c7d836,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c82f3200,3e9,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c866bd00,58,c0c76a31,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c866bd00,c866bd00,158,c0c76a31,3e9,...) at _sleep+0x288 kern_kevent(c82f3000,4,0,1,e9cd9c28,...) at kern_kevent+0x374 kevent(c82f3000,e9cd9cec,e9cd9d28,c0c7dc04,0,...) at kevent+0x19b syscallenter(c82f3000,e9cd9ce4,e9cd9ce4,0,c0dce4c0,...) at syscallenter+0x246 syscall(e9cd9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x2816304b, esp = 0xbfbfeb4c, ebp = 0xbfbfec08 --- Tracing command md5 pid 1231 tid 100170 td 0xc82f15c0 sched_switch(c82f15c0,0,104,c82f15c0,3da4d80,...) at sched_switch+0x28a mi_switch(104,0,c82f15c0,c82f15c0,c82f15c0,...) at mi_switch+0x11a sleepq_switch(c82f15c0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c7b03800,4c,c0c503b4,0,0,...) at sleepq_wait+0x39 _sleep(c7b03800,c7b03820,24c,c0c503b4,0,...) at _sleep+0x2d2 md_kthread(c7b03800,e9cf1d28,c0c76d43,359,c82ee000,...) at md_kthread+0x119 fork_exit(c06c86c0,c7b03800,e9cf1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe9cf1d60, ebp = 0 --- Tracing command sh pid 1217 tid 100121 td 0xc7f47000 sched_switch(c7f47000,0,104,c7f47000,96f52d27,...) at sched_switch+0x28a mi_switch(104,0,c7f47000,100,100,...) at mi_switch+0x11a sleepq_switch(c7f47000,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7f41000,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7f41000,c7f41088,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7f47000,ffffffff,e9c4ec44,2,0,...) at kern_wait+0xa76 wait4(c7f47000,e9c4ecec,e9c4ed28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c7f47000,e9c4ece4,e9c4ece4,0,e9c4ed28,...) at syscallenter+0x246 syscall(e9c4ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe7cc, ebp = 0xbfbfe7e8 --- Tracing command time pid 1216 tid 100086 td 0xc7b9a000 sched_switch(c7b9a000,0,104,c7b9a000,cc2151ab,...) at sched_switch+0x28a mi_switch(104,0,c7b9a000,100,100,...) at mi_switch+0x11a sleepq_switch(c7b9a000,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7e6bac0,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e6bac0,c7e6bb48,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7b9a000,4c1,e9b6ec44,0,e9b6ebfc,...) at kern_wait+0xa76 wait4(c7b9a000,e9b6ecec,e9b6ed28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c7b9a000,e9b6ece4,e9b6ece4,0,e9b6ed28,...) at syscallenter+0x246 syscall(e9b6ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280edd5b, esp = 0xbfbfea0c, ebp = 0xbfbfead8 --- Tracing command tee pid 1211 tid 100140 td 0xc7f508a0 sched_switch(c7f508a0,0,104,c7f508a0,17a49c9e,...) at sched_switch+0x28a mi_switch(104,0,c7f508a0,100,100,...) at mi_switch+0x11a sleepq_switch(c7f508a0,0,c0c7d836,1a0,4c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c8025000,4c,c0c7ec23,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8025000,c8025170,14c,c0c7ec23,0,...) at _sleep+0x2bc pipe_read(c7bd75b0,e9c93c28,c7bf2280,0,c7f508a0,...) at pipe_read+0x3aa dofileread(e9c93c28,ffffffff,ffffffff,0,c7bd75b0,...) at dofileread+0x96 kern_readv(c7f508a0,0,e9c93c28,e9c93c48,1,...) at kern_readv+0x58 read(c7f508a0,e9c93cec,e9c93d28,c0c7dc04,0,...) at read+0x4f syscallenter(c7f508a0,e9c93ce4,e9c93ce4,0,e9c93d28,...) at syscallenter+0x246 syscall(e9c93d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2817c5d3, esp = 0xbfbfeaac, ebp = 0xbfbfeae8 --- Tracing command sh pid 1210 tid 100092 td 0xc7e738a0 sched_switch(c7e738a0,0,104,c7e738a0,cb7d3845,...) at sched_switch+0x28a mi_switch(104,0,c7e738a0,100,100,...) at mi_switch+0x11a sleepq_switch(c7e738a0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7e6a810,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e6a810,c7e6a898,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7e738a0,ffffffff,e9b80c44,2,0,...) at kern_wait+0xa76 wait4(c7e738a0,e9b80cec,e9b80d28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c7e738a0,e9b80ce4,e9b80ce4,0,e9b80d28,...) at syscallenter+0x246 syscall(e9b80d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command bash pid 1206 tid 100126 td 0xc7f46000 sched_switch(c7f46000,0,104,c7f46000,c4c97740,...) at sched_switch+0x28a mi_switch(104,0,c7f46000,100,100,...) at mi_switch+0x11a sleepq_switch(c7f46000,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7f40000,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7f40000,c7f40088,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7f46000,ffffffff,e9c5dc44,6,0,...) at kern_wait+0xa76 wait4(c7f46000,e9c5dcec,e9c5dd28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c7f46000,e9c5dce4,e9c5dce4,0,e9c5dd28,...) at syscallenter+0x246 syscall(e9c5dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282bfd5b, esp = 0xbfbfe6cc, ebp = 0xbfbfe6e8 --- Tracing command csh pid 1202 tid 100158 td 0xc82325c0 sched_switch(c82325c0,0,104,c82325c0,211339a0,...) at sched_switch+0x28a mi_switch(104,0,c82325c0,100,100,...) at mi_switch+0x11a sleepq_switch(c82325c0,0,c0c7d836,1a0,68,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c822f308,68,c0c30cc8,100,0,...) at sleepq_wait_sig+0x17 _sleep(c822f308,c822f338,168,c0c30cc8,0,...) at _sleep+0x2bc kern_sigsuspend(c82325c0,0,0,0,0,...) at kern_sigsuspend+0xb2 sigsuspend(c82325c0,e9ccacec,e9ccad28,c0c7dc04,0,...) at sigsuspend+0x4d syscallenter(c82325c0,e9ccace4,e9ccace4,0,e9ccacb0,...) at syscallenter+0x246 syscall(e9ccad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28179c0b, esp = 0xbfbfe60c, ebp = 0xbfbfe678 --- Tracing command su pid 1201 tid 100157 td 0xc82328a0 sched_switch(c82328a0,0,104,c82328a0,ca6c6bb4,...) at sched_switch+0x28a mi_switch(104,0,c82328a0,100,100,...) at mi_switch+0x11a sleepq_switch(c82328a0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c822f560,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c822f560,c822f5e8,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c82328a0,4b2,e9cc7c44,2,0,...) at kern_wait+0xa76 wait4(c82328a0,e9cc7cec,281c16e8,1,0,...) at wait4+0x3b syscallenter(c82328a0,e9cc7ce4,c0ba02ae,c82328a0,e9cc7d28,...) at syscallenter+0x246 syscall(e9cc7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811ed5b, esp = 0xbfbfe62c, ebp = 0xbfbfe648 --- Tracing command bash pid 1197 tid 100155 td 0xc8233000 sched_switch(c8233000,0,104,c8233000,df169752,...) at sched_switch+0x28a mi_switch(104,0,c8233000,100,100,...) at mi_switch+0x11a sleepq_switch(c8233000,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c822fac0,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c822fac0,c822fb48,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c8233000,ffffffff,e9cc1c44,6,0,...) at kern_wait+0xa76 wait4(c8233000,e9cc1cec,e9cc1d28,c0c7dc04,0,...) at wait4+0x3b syscallenter(c8233000,e9cc1ce4,e9cc1ce4,0,e9cc1d28,...) at syscallenter+0x246 syscall(e9cc1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282bfd5b, esp = 0xbfbfe9cc, ebp = 0xbfbfe9e8 --- Tracing command sshd pid 1196 tid 100133 td 0xc7fbd000 sched_switch(c7fbd000,0,104,c7fbd000,17a68b97,...) at sched_switch+0x28a mi_switch(104,0,c7fbd000,c7fbd000,c7fbd000,...) at mi_switch+0x11a sleepq_switch(c7fbd000,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c7ea14,c088cde9,c80a09d0,0,c7fbd000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80a09e4,0,e9c7ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c80a09e4,c80a09d0,c0c7eb90,627,c7fc3888,...) at _cv_wait_sig+0x1b0 seltdwait(c7fc3888,58,c7f55100,c7fbd000,246,...) at seltdwait+0xa2 kern_select(c7fbd000,a,286030b4,286030d8,0,0,20,c809c560,c809c560) at kern_select+0x4ee select(c7fbd000,e9c7ecec,e9c7ed28,c0c7dc04,0,...) at select+0x66 syscallenter(c7fbd000,e9c7ece4,e9c7ece4,0,e9c7ed28,...) at syscallenter+0x246 syscall(e9c7ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command sshd pid 1194 tid 100132 td 0xc7fbd2e0 sched_switch(c7fbd2e0,0,104,c7fbd2e0,da7eb13a,...) at sched_switch+0x28a mi_switch(104,0,c7fbd2e0,100,100,...) at mi_switch+0x11a sleepq_switch(c7fbd2e0,0,c0c7d836,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c8021254,58,c0c81c02,100,0,...) at sleepq_wait_sig+0x17 _sleep(c8021254,c8021214,158,c0c81c02,0,...) at _sleep+0x2bc sbwait(c80211f0,0,c0c81c78,5a2,c8021214,...) at sbwait+0x52 soreceive_generic(c802119c,0,e9c7bc28,0,0,...) at soreceive_generic+0x2dc soreceive(c802119c,0,e9c7bc28,0,0,0) at soreceive+0x38 soo_read(c7bfeb98,e9c7bc28,c7f54d80,0,c7fbd2e0,...) at soo_read+0x4e dofileread(e9c7bc28,ffffffff,ffffffff,0,c7bfeb98,...) at dofileread+0x96 kern_readv(c7fbd2e0,5,e9c7bc28,e9c7bc48,1,...) at kern_readv+0x58 read(c7fbd2e0,e9c7bcec,e9c7bd28,c0c7dc04,0,...) at read+0x4f syscallenter(c7fbd2e0,e9c7bce4,e9c7bce4,0,e9c7bd28,...) at syscallenter+0x246 syscall(e9c7bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command getty pid 1193 tid 100154 td 0xc82332e0 sched_switch(c82332e0,0,104,c82332e0,2f56fd5e,...) at sched_switch+0x28a mi_switch(104,0,c82332e0,c82332e0,c82332e0,...) at mi_switch+0x11a sleepq_switch(c82332e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82332e0,c82332e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c74f3070,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74f3070,c0dc9830,0,c74f3000,e9cbeb60,...) at _cv_wait_sig+0x1b0 tty_wait(c74f3000,c74f3070,e9cbec28,1,0,...) at tty_wait+0x23 ttydisc_read(c74f3000,e9cbec28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c73edc00,e9cbec28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7fc3498,e9cbec28,c716f100,0,c82332e0,...) at devfs_read_f+0x7e dofileread(e9cbec28,ffffffff,ffffffff,0,c7fc3498,...) at dofileread+0x96 kern_readv(c82332e0,0,e9cbec28,e9cbec48,1,...) at kern_readv+0x58 read(c82332e0,e9cbecec,e9cbed28,c0c7dc04,0,...) at read+0x4f syscallenter(c82332e0,e9cbece4,e9cbece4,0,e9cbed28,...) at syscallenter+0x246 syscall(e9cbed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1192 tid 100153 td 0xc82335c0 sched_switch(c82335c0,0,104,c82335c0,2f7e9ba6,...) at sched_switch+0x28a mi_switch(104,0,c82335c0,c82335c0,c82335c0,...) at mi_switch+0x11a sleepq_switch(c82335c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82335c0,c82335c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c74f3270,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74f3270,c0dc9830,0,c74f3200,e9cbbb60,...) at _cv_wait_sig+0x1b0 tty_wait(c74f3200,c74f3270,e9cbbc28,1,0,...) at tty_wait+0x23 ttydisc_read(c74f3200,e9cbbc28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3000,e9cbbc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bfe8c0,e9cbbc28,c716f100,0,c82335c0,...) at devfs_read_f+0x7e dofileread(e9cbbc28,ffffffff,ffffffff,0,c7bfe8c0,...) at dofileread+0x96 kern_readv(c82335c0,0,e9cbbc28,e9cbbc48,1,...) at kern_readv+0x58 read(c82335c0,e9cbbcec,e9cbbd28,c0c7dc04,0,...) at read+0x4f syscallenter(c82335c0,e9cbbce4,e9cbbce4,0,e9cbbd28,...) at syscallenter+0x246 syscall(e9cbbd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1191 tid 100152 td 0xc82338a0 sched_switch(c82338a0,0,104,c82338a0,2f7ddf1a,...) at sched_switch+0x28a mi_switch(104,0,c82338a0,c82338a0,c82338a0,...) at mi_switch+0x11a sleepq_switch(c82338a0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82338a0,c82338a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2a70,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2a70,c0dc9830,0,c73f2a00,e9cb8b60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2a00,c73f2a70,e9cb8c28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2a00,e9cb8c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3100,e9cb8c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bd7150,e9cb8c28,c716f100,0,c82338a0,...) at devfs_read_f+0x7e dofileread(e9cb8c28,ffffffff,ffffffff,0,c7bd7150,...) at dofileread+0x96 kern_readv(c82338a0,0,e9cb8c28,e9cb8c48,1,...) at kern_readv+0x58 read(c82338a0,e9cb8cec,e9cb8d28,c0c7dc04,0,...) at read+0x4f syscallenter(c82338a0,e9cb8ce4,e9cb8ce4,0,e9cb8d28,...) at syscallenter+0x246 syscall(e9cb8d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1190 tid 100151 td 0xc8233b80 sched_switch(c8233b80,0,104,c8233b80,2f7fc188,...) at sched_switch+0x28a mi_switch(104,0,c8233b80,c8233b80,c8233b80,...) at mi_switch+0x11a sleepq_switch(c8233b80,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c8233b80,c8233b80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382670,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382670,c0dc9830,0,c7382600,e9cb5b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382600,c7382670,e9cb5c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382600,e9cb5c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3200,e9cb5c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bd71f8,e9cb5c28,c716f100,0,c8233b80,...) at devfs_read_f+0x7e dofileread(e9cb5c28,ffffffff,ffffffff,0,c7bd71f8,...) at dofileread+0x96 kern_readv(c8233b80,0,e9cb5c28,e9cb5c48,1,...) at kern_readv+0x58 read(c8233b80,e9cb5cec,e9cb5d28,c0c7dc04,0,...) at read+0x4f syscallenter(c8233b80,e9cb5ce4,e9cb5ce4,0,e9cb5d28,...) at syscallenter+0x246 syscall(e9cb5d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1189 tid 100150 td 0xc8234000 sched_switch(c8234000,0,104,c8234000,2f6d480d,...) at sched_switch+0x28a mi_switch(104,0,c8234000,c8234000,c8234000,...) at mi_switch+0x11a sleepq_switch(c8234000,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c8234000,c8234000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382870,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382870,c0dc9830,0,c7382800,e9cb2b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382800,c7382870,e9cb2c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382800,e9cb2c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3500,e9cb2c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7fc3380,e9cb2c28,c716f100,0,c8234000,...) at devfs_read_f+0x7e dofileread(e9cb2c28,ffffffff,ffffffff,0,c7fc3380,...) at dofileread+0x96 kern_readv(c8234000,0,e9cb2c28,e9cb2c48,1,...) at kern_readv+0x58 read(c8234000,e9cb2cec,e9cb2d28,c0c7dc04,0,...) at read+0x4f syscallenter(c8234000,e9cb2ce4,e9cb2ce4,0,e9cb2d28,...) at syscallenter+0x246 syscall(e9cb2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1188 tid 100149 td 0xc82342e0 sched_switch(c82342e0,0,104,c82342e0,2f623d1e,...) at sched_switch+0x28a mi_switch(104,0,c82342e0,c82342e0,c82342e0,...) at mi_switch+0x11a sleepq_switch(c82342e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82342e0,c82342e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382c70,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382c70,c0dc9830,0,c7382c00,e9cafb60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382c00,c7382c70,e9cafc28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382c00,e9cafc28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3600,e9cafc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9fb98,e9cafc28,c716f100,0,c82342e0,...) at devfs_read_f+0x7e dofileread(e9cafc28,ffffffff,ffffffff,0,c7b9fb98,...) at dofileread+0x96 kern_readv(c82342e0,0,e9cafc28,e9cafc48,1,...) at kern_readv+0x58 read(c82342e0,e9cafcec,e9cafd28,c0c7dc04,0,...) at read+0x4f syscallenter(c82342e0,e9cafce4,e9cafce4,0,e9cafd28,...) at syscallenter+0x246 syscall(e9cafd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1187 tid 100148 td 0xc82345c0 sched_switch(c82345c0,0,104,c82345c0,2f784873,...) at sched_switch+0x28a mi_switch(104,0,c82345c0,c82345c0,c82345c0,...) at mi_switch+0x11a sleepq_switch(c82345c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82345c0,c82345c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2670,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2670,c0dc9830,0,c73f2600,e9cacb60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2600,c73f2670,e9cacc28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2600,e9cacc28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3700,e9cacc28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bb46c8,e9cacc28,c716f100,0,c82345c0,...) at devfs_read_f+0x7e dofileread(e9cacc28,ffffffff,ffffffff,0,c7bb46c8,...) at dofileread+0x96 kern_readv(c82345c0,0,e9cacc28,e9cacc48,1,...) at kern_readv+0x58 read(c82345c0,e9caccec,e9cacd28,c0c7dc04,0,...) at read+0x4f syscallenter(c82345c0,e9cacce4,e9cacce4,0,e9cacd28,...) at syscallenter+0x246 syscall(e9cacd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1186 tid 100147 td 0xc82348a0 sched_switch(c82348a0,0,104,c82348a0,2f600224,...) at sched_switch+0x28a mi_switch(104,0,c82348a0,c82348a0,c82348a0,...) at mi_switch+0x11a sleepq_switch(c82348a0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,c82348a0,c82348a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2870,0,c0c80b28,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2870,c0dc9830,0,c73f2800,e9ca9b60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2800,c73f2870,e9ca9c28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2800,e9ca9c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3800,e9ca9c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7fc3620,e9ca9c28,c716f100,0,c82348a0,...) at devfs_read_f+0x7e dofileread(e9ca9c28,ffffffff,ffffffff,0,c7fc3620,...) at dofileread+0x96 kern_readv(c82348a0,0,e9ca9c28,e9ca9c48,1,...) at kern_readv+0x58 read(c82348a0,e9ca9cec,e9ca9d28,c0c7dc04,0,...) at read+0x4f syscallenter(c82348a0,e9ca9ce4,e9ca9ce4,0,e9ca9d28,...) at syscallenter+0x246 syscall(e9ca9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1185 tid 100146 td 0xc8234b80 sched_switch(c8234b80,0,104,c8234b80,cb8c2bf9,...) at sched_switch+0x28a mi_switch(104,0,c8234b80,c8234b80,c8234b80,...) at mi_switch+0x11a sleepq_switch(c8234b80,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9ca6aa8,c088cde9,c7382a04,0,c8234b80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382a70,0,e9ca6ae0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382a70,c7382a04,0,c7382a00,e9ca6b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382a00,c7382a70,e9ca6c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382a00,e9ca6c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c7161900,e9ca6c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7bd7658,e9ca6c28,c716f100,0,c8234b80,...) at devfs_read_f+0x7e dofileread(e9ca6c28,ffffffff,ffffffff,0,c7bd7658,...) at dofileread+0x96 kern_readv(c8234b80,0,e9ca6c28,e9ca6c48,1,...) at kern_readv+0x58 read(c8234b80,e9ca6cec,e9ca6d28,c0c7dc04,0,...) at read+0x4f syscallenter(c8234b80,e9ca6ce4,e9ca6ce4,0,e9ca6d28,...) at syscallenter+0x246 syscall(e9ca6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command inetd pid 1146 tid 100144 td 0xc82122e0 sched_switch(c82122e0,0,104,c82122e0,2020bfa8,...) at sched_switch+0x28a mi_switch(104,0,c82122e0,c82122e0,c82122e0,...) at mi_switch+0x11a sleepq_switch(c82122e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c9fa14,c088cde9,c80a19d0,0,c82122e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80a19e4,0,e9c9fa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c80a19e4,c80a19d0,c0c7eb90,627,c7f3a888,...) at _cv_wait_sig+0x1b0 seltdwait(c7f3a888,58,c716f100,c82122e0,0,...) at seltdwait+0xa2 kern_select(c82122e0,6,bfbfdfc0,0,0,0,20,c7fb82b0,c7fb82b0) at kern_select+0x4ee select(c82122e0,e9c9fcec,e9c9fd28,c0c7dc04,0,...) at select+0x66 syscallenter(c82122e0,e9c9fce4,e9c9fce4,0,e9c9fd28,...) at syscallenter+0x246 syscall(e9c9fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281a3553, esp = 0xbfbfdf7c, ebp = 0xbfbfee08 --- Tracing command moused pid 1120 tid 100120 td 0xc7f472e0 sched_switch(c7f472e0,0,104,c7f472e0,15f8f409,...) at sched_switch+0x28a mi_switch(104,0,c7f472e0,c7f472e0,c7f472e0,...) at mi_switch+0x11a sleepq_switch(c7f472e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c4ba14,c088cde9,c7aaf590,0,c7f472e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7aaf5a4,0,e9c4ba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7aaf5a4,c7aaf590,c0c7eb90,627,c7f3ac08,...) at _cv_wait_sig+0x1b0 seltdwait(c7f3ac08,58,c716f100,c7f472e0,c014630a,...) at seltdwait+0xa2 kern_select(c7f472e0,6,bfbfea24,0,0,0,20,c7f412b0,c7f412b0) at kern_select+0x4ee select(c7f472e0,e9c4bcec,e9c4bd28,c0c7dc04,0,...) at select+0x66 syscallenter(c7f472e0,e9c4bce4,e9c4bce4,0,e9c4bd28,...) at syscallenter+0x246 syscall(e9c4bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281ac553, esp = 0xbfbfe9bc, ebp = 0xbfbfeb48 --- Tracing command cron pid 1096 tid 100114 td 0xc7e712e0 sched_switch(c7e712e0,0,104,c7e712e0,2c6d7e67,...) at sched_switch+0x28a mi_switch(104,0,c7e712e0,100,100,...) at mi_switch+0x11a sleepq_switch(c7e712e0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c7e714e0,ea61,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c0dca084,5c,c0c7aeda,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0dca084,0,15c,c0c7aeda,ea61,...) at _sleep+0x288 kern_nanosleep(c7e712e0,e9c1dc34,e9c1dc3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c7e712e0,e9c1dcec,e9c1dd28,c0c7dc04,0,...) at nanosleep+0x6f syscallenter(c7e712e0,e9c1dce4,e9c1dce4,0,e9c1dd28,...) at syscallenter+0x246 syscall(e9c1dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2817bf57, esp = 0xbfbfec7c, ebp = 0xbfbfeca8 --- Tracing command sendmail pid 1089 tid 100131 td 0xc7fbd5c0 sched_switch(c7fbd5c0,0,104,c7fbd5c0,fecf3399,...) at sched_switch+0x28a mi_switch(104,0,c7fbd5c0,100,100,...) at mi_switch+0x11a sleepq_switch(c7fbd5c0,0,c0c7d836,1a0,68,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c809cb18,68,c0c30cc8,100,0,...) at sleepq_wait_sig+0x17 _sleep(c809cb18,c809cb48,168,c0c30cc8,0,...) at _sleep+0x2bc kern_sigsuspend(c7fbd5c0,0,0,0,0,...) at kern_sigsuspend+0xb2 sigsuspend(c7fbd5c0,e9c74cec,e9c74d28,c0c7dc04,0,...) at sigsuspend+0x4d syscallenter(c7fbd5c0,e9c74ce4,e9c74ce4,0,c7fbd664,...) at syscallenter+0x246 syscall(e9c74d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28334c0b, esp = 0xbfbfcf8c, ebp = 0xbfbfcfb8 --- Tracing command sendmail pid 1085 tid 100081 td 0xc7b9d000 sched_switch(c7b9d000,0,104,c7b9d000,da5a9369,...) at sched_switch+0x28a mi_switch(104,0,c7b9d000,c7b9d000,c7b9d000,...) at mi_switch+0x11a sleepq_switch(c7b9d000,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c7ab1350,e9b40a14,c088cde9,c7ab1350,c7b9d000,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7ab1364,0,e9b40a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7ab1364,c7ab1350,1389,627,c7bb4b98,...) at _cv_timedwait_sig+0x1c0 seltdwait(e9b40bf8,e9b40c00,c7b79800,c7b9d000,246,...) at seltdwait+0x8a kern_select(c7b9d000,5,bfbfc500,0,0,e9b40c40,20,5,0) at kern_select+0x4ee select(c7b9d000,e9b40cec,e9b40d28,c0c7dc04,0,...) at select+0x66 syscallenter(c7b9d000,e9b40ce4,e9b40ce4,0,0,...) at syscallenter+0x246 syscall(e9b40d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283db553, esp = 0xbfbfc46c, ebp = 0xbfbfcf98 --- Tracing command sshd pid 1077 tid 100113 td 0xc7e715c0 sched_switch(c7e715c0,0,104,c7e715c0,602f2768,...) at sched_switch+0x28a mi_switch(104,0,c7e715c0,c7e715c0,c7e715c0,...) at mi_switch+0x11a sleepq_switch(c7e715c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c16a14,c088cde9,c7bf4010,0,c7e715c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7bf4024,0,e9c16a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7bf4024,c7bf4010,c0c7eb90,627,c7f3abd0,...) at _cv_wait_sig+0x1b0 seltdwait(c7f3abd0,58,c7f54c80,c7e715c0,e9c16ab4,...) at seltdwait+0xa2 kern_select(c7e715c0,5,286090ac,0,0,0,20,c7fb6810,c7fb6810) at kern_select+0x4ee select(c7e715c0,e9c16cec,2861a070,1,0,...) at select+0x66 syscallenter(c7e715c0,e9c16ce4,c0ba02ae,c7e715c0,e9c16d28,...) at syscallenter+0x246 syscall(e9c16d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe28c, ebp = 0xbfbfee28 --- Tracing command ntpd pid 1032 tid 100095 td 0xc7e73000 sched_switch(c7e73000,0,104,c7e73000,ac5862e9,...) at sched_switch+0x28a mi_switch(104,0,c7e73000,c7e73000,c7e73000,...) at mi_switch+0x11a sleepq_switch(c7e73000,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b89a14,c088cde9,c7ab1e10,0,c7e73000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7ab1e24,0,e9b89a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ab1e24,c7ab1e10,c0c7eb90,627,c7fc3d90,...) at _cv_wait_sig+0x1b0 seltdwait(c7fc3d90,58,c716f100,c7e73000,0,...) at seltdwait+0xa2 kern_select(c7e73000,1b,bfbfed18,0,0,0,20,c7e6a000,c7e6a000) at kern_select+0x4ee select(c7e73000,e9b89cec,e9b89d80,e9b89c88,0,...) at select+0x66 syscallenter(c7e73000,e9b89ce4,c0b9ffcb,fffffffe,3,...) at syscallenter+0x246 syscall(e9b89d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28355553, esp = 0xbfbfecec, ebp = 0xbfbfedb8 --- Tracing command nfsd pid 899 tid 100129 td 0xc7fbd8a0 sched_switch(c7fbd8a0,0,104,c7fbd8a0,6a91d7ff,...) at sched_switch+0x28a mi_switch(104,0,c7fbd8a0,c7fbd8a0,c7fbd8a0,...) at mi_switch+0x11a sleepq_switch(c7fbd8a0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c66be0,c088cde9,c74d5a80,c7fbd8a0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7ab14d0,0,e9c66c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7ab14d0,c74d5a80,1388,3b1,f,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c66d14,c0874e74,c74d5a80,e9c66d28,c0c76d43,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c66d28,c0c76d43,359,c7ad32b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c66d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 899 tid 100128 td 0xc7fbdb80 sched_switch(c7fbdb80,0,104,c7fbdb80,7266f2a6,...) at sched_switch+0x28a mi_switch(104,0,c7fbdb80,c7fbdb80,c7fbdb80,...) at mi_switch+0x11a sleepq_switch(c7fbdb80,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c63be0,c088cde9,c74d5a80,c7fbdb80,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7ab1510,0,e9c63c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7ab1510,c74d5a80,1388,3ec,0,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c63d14,c0874e74,c74d5a80,e9c63d28,c0c76d43,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c63d28,c0c76d43,359,c7ad32b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c63d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 899 tid 100127 td 0xc7fbe000 sched_switch(c7fbe000,0,104,c7fbe000,724b7813,...) at sched_switch+0x28a mi_switch(104,0,c7fbe000,c7fbe000,c7fbe000,...) at mi_switch+0x11a sleepq_switch(c7fbe000,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c60be0,c088cde9,c74d5a80,c7fbe000,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7ab1550,0,e9c60c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7ab1550,c74d5a80,1388,3b1,206c2d20,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c60d14,c0874e74,c74d5a80,e9c60d28,c0c76d43,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c60d28,c0c76d43,359,c7ad32b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c60d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 899 tid 100085 td 0xc7b9a2e0 sched_switch(c7b9a2e0,0,104,c7b9a2e0,7c7cf3f3,...) at sched_switch+0x28a mi_switch(104,0,c7b9a2e0,c7b9a2e0,c7b9a2e0,...) at mi_switch+0x11a sleepq_switch(c7b9a2e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9b54ab0,c088cde9,c74d5a80,c7b9a2e0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7aafd10,0,e9b54ae8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7aafd10,c74d5a80,1388,3b1,e9b54b30,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(c7b9a448,14,c0c97684,c0c964fa,e9b54c0c,...) at svc_run_internal+0x2bd svc_run(c74d5a80,0,c0c967bc,1c2,0,...) at svc_run+0x7b nfssvc_nfsd(bfbfe890,e9b54c0c,c,c716f100,e9b54c20,...) at nfssvc_nfsd+0xad nfssvc_nfsserver(c7b9a2e0,e9b54cec,c7ad32b0,0,c7b9a2e0,...) at nfssvc_nfsserver+0x1ff nfssvc(c7b9a2e0,e9b54cec,e9b54d28,c0c7dc04,0,...) at nfssvc+0x63 syscallenter(c7b9a2e0,e9b54ce4,e9b54ce4,0,e9b54d28,...) at syscallenter+0x246 syscall(e9b54d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280d980b, esp = 0xbfbfe84c, ebp = 0xbfbfeab8 --- Tracing command nfsd pid 898 tid 100112 td 0xc7e718a0 sched_switch(c7e718a0,0,104,c7e718a0,93cd3e38,...) at sched_switch+0x28a mi_switch(104,0,c7e718a0,c7e718a0,c7e718a0,...) at mi_switch+0x11a sleepq_switch(c7e718a0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c0fa14,c088cde9,c7ab05d0,0,c7e718a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7ab05e4,0,e9c0fa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ab05e4,c7ab05d0,c0c7eb90,627,c7fc31f8,...) at _cv_wait_sig+0x1b0 seltdwait(c7fc31f8,58,c716f100,c7e718a0,e9c0fab4,...) at seltdwait+0xa2 kern_select(c7e718a0,5,bfbfecd0,0,0,0,20,c7fb6ac0,c7fb6ac0) at kern_select+0x4ee select(c7e718a0,e9c0fcec,bfbffff4,1,0,...) at select+0x66 syscallenter(c7e718a0,e9c0fce4,c0ba02ae,c7e718a0,e9c0fd28,...) at syscallenter+0x246 syscall(e9c0fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2817f553, esp = 0xbfbfeabc, ebp = 0xbfbfee08 --- Tracing command mountd pid 889 tid 100078 td 0xc7b9d8a0 sched_switch(c7b9d8a0,0,104,c7b9d8a0,1962a2c0,...) at sched_switch+0x28a mi_switch(104,0,c7b9d8a0,c7b9d8a0,c7b9d8a0,...) at mi_switch+0x11a sleepq_switch(c7b9d8a0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b34a14,c088cde9,c7aaf0d0,0,c7b9d8a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7aaf0e4,0,e9b34a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7aaf0e4,c7aaf0d0,c0c7eb90,627,c7fc3070,...) at _cv_wait_sig+0x1b0 seltdwait(c7fc3070,58,c716f100,c7b9d8a0,c08d68dc,...) at seltdwait+0xa2 kern_select(c7b9d8a0,9,bfbfed6c,0,0,0,20,c7b99810,c7b99810) at kern_select+0x4ee select(c7b9d8a0,e9b34cec,e9b34d28,c0c7dc04,0,...) at select+0x66 syscallenter(c7b9d8a0,e9b34ce4,e9b34ce4,0,e9b34d28,...) at syscallenter+0x246 syscall(e9b34d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28193553, esp = 0xbfbfed3c, ebp = 0xbfbfee08 --- Tracing command rpcbind pid 792 tid 100080 td 0xc7b9d2e0 sched_switch(c7b9d2e0,0,104,c7b9d2e0,a21da81,...) at sched_switch+0x28a mi_switch(104,0,c7b9d2e0,c7b9d2e0,c7b9d2e0,...) at mi_switch+0x11a sleepq_switch(c7b9d2e0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74e2d10,e9b3ca6c,c088cde9,c74e2d10,c7b9d2e0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c74e2d24,0,e9b3caa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c74e2d24,c74e2d10,7531,627,e9b3cb5c,...) at _cv_timedwait_sig+0x1c0 seltdwait(e9b3cc2c,e9b3cc34,535,c7b9d2e0,e9b3cb2c,...) at seltdwait+0x8a poll(c7b9d2e0,e9b3ccec,e9b3cd28,c0c7dc04,0,...) at poll+0x300 syscallenter(c7b9d2e0,e9b3cce4,e9b3cce4,0,e9b3ccb0,...) at syscallenter+0x246 syscall(e9b3cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x28137eff, esp = 0xbfbfcbcc, ebp = 0xbfbfed98 --- Tracing command syslogd pid 765 tid 100087 td 0xc74e7b80 sched_switch(c74e7b80,0,104,c74e7b80,c146f5ac,...) at sched_switch+0x28a mi_switch(104,0,c74e7b80,c74e7b80,c74e7b80,...) at mi_switch+0x11a sleepq_switch(c74e7b80,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b71a14,c088cde9,c7af2a50,0,c74e7b80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7af2a64,0,e9b71a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7af2a64,c7af2a50,c0c7eb90,627,c7b9f268,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9f268,58,c716f100,c74e7b80,0,...) at seltdwait+0xa2 kern_select(c74e7b80,9,2822c0a8,0,0,0,20,c7e6b810,c7e6b810) at kern_select+0x4ee select(c74e7b80,e9b71cec,e9b71d28,c0c7dc04,0,...) at select+0x66 syscallenter(c74e7b80,e9b71ce4,e9b71ce4,0,0,...) at syscallenter+0x246 syscall(e9b71d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28192553, esp = 0xbfbfe29c, ebp = 0xbfbfee08 --- Tracing command devd pid 617 tid 100084 td 0xc7b9a5c0 sched_switch(c7b9a5c0,0,104,c7b9a5c0,61004f87,...) at sched_switch+0x28a mi_switch(104,0,c7b9a5c0,c7b9a5c0,c7b9a5c0,...) at mi_switch+0x11a sleepq_switch(c7b9a5c0,0,c0c7d836,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b4ea14,c088cde9,c73f79d0,0,c7b9a5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f79e4,0,e9b4ea4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f79e4,c73f79d0,c0c7eb90,627,c7ba0230,...) at _cv_wait_sig+0x1b0 seltdwait(c7ba0230,58,c716f100,c7b9a5c0,1,...) at seltdwait+0xa2 kern_select(c7b9a5c0,5,bfbfe990,0,0,0,20,c7ad3560,c7ad3560) at kern_select+0x4ee select(c7b9a5c0,e9b4ecec,e9b4ed28,c0c7dc04,0,...) at select+0x66 syscallenter(c7b9a5c0,e9b4ece4,e9b4ece4,0,e9b4ecb0,...) at syscallenter+0x246 syscall(e9b4ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x8088143, esp = 0xbfbfe95c, ebp = 0xbfbfee38 --- Tracing command flowcleaner pid 21 tid 100076 td 0xc73d58a0 sched_switch(c73d58a0,0,104,c73d58a0,7b7f90b7,...) at sched_switch+0x28a mi_switch(104,0,c73d58a0,c73d58a0,c73d58a0,...) at mi_switch+0x11a sleepq_switch(c73d58a0,0,c0c7d836,283,c73d58a0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f37270,0,e7940ca8,1,0,...) at sleepq_timedwait+0x3e _cv_timedwait(c0f37270,c0f37278,4e20,624,c73d58a0,...) at _cv_timedwait+0x1c0 flowtable_cleaner(0,e7940d28,c0c76d43,359,c727c810,...) at flowtable_cleaner+0x215 fork_exit(c0937c70,0,e7940d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7940d60, ebp = 0 --- Tracing command softdepflush pid 20 tid 100075 td 0xc73d5b80 sched_switch(c73d5b80,0,104,c73d5b80,92ea009f,...) at sched_switch+0x28a mi_switch(104,0,c73d5b80,0,0,...) at mi_switch+0x11a sleepq_switch(c73d5b80,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f42920,44,c0c9a338,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f42920,c0f428c4,44,c0c9a338,3e8,...) at _sleep+0x2a2 softdep_flush(0,e793dd28,c0c76d43,359,c727cac0,...) at softdep_flush+0x244 fork_exit(c0aab850,0,e793dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793dd60, ebp = 0 --- Tracing command syncer pid 19 tid 100074 td 0xc74e5000 sched_switch(c74e5000,0,104,c74e5000,8e0f79b5,...) at sched_switch+0x28a mi_switch(104,0,c74e5000,c74e5000,c74e5000,...) at mi_switch+0x11a sleepq_switch(c74e5000,0,c0c7d836,283,c74e5000,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f37078,0,e793ac74,1,0,...) at sleepq_timedwait+0x3e _cv_timedwait(c0f37078,c0f37064,3e8,766,4e20,...) at _cv_timedwait+0x1c0 sched_sync(0,e793ad28,c0c76d43,359,c7ad2000,...) at sched_sync+0x4bd fork_exit(c0921d10,0,e793ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793ad60, ebp = 0 --- Tracing command vnlru pid 18 tid 100073 td 0xc74e52e0 sched_switch(c74e52e0,0,104,c74e52e0,93053caa,...) at sched_switch+0x28a mi_switch(104,0,c74e52e0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e52e0,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c7ad22b0,50,c0c84b78,0,0,...) at sleepq_timedwait+0x3e _sleep(c7ad22b0,c0f37038,250,c0c84b78,3e8,...) at _sleep+0x2a2 vnlru_proc(0,e7937d28,c0c76d43,359,c7ad22b0,...) at vnlru_proc+0xe7 fork_exit(c09229a0,0,e7937d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7937d60, ebp = 0 --- Tracing command bufdaemon pid 17 tid 100072 td 0xc74e55c0 sched_switch(c74e55c0,0,104,c74e55c0,da9ac276,...) at sched_switch+0x28a mi_switch(104,0,c74e55c0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e55c0,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f36da8,44,c0c82754,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f36da8,c0f36dac,44,c0c82754,3e8,...) at _sleep+0x2a2 buf_daemon(0,e7934d28,c0c76d43,359,c7ad2560,...) at buf_daemon+0x138 fork_exit(c0909f80,0,e7934d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7934d60, ebp = 0 --- Tracing command pagezero pid 16 tid 100071 td 0xc74e58a0 sched_switch(c74e58a0,0,104,c74e58a0,66658296,...) at sched_switch+0x28a mi_switch(104,0,c74e58a0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e58a0,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f435f4,0,c0c9dbed,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f435f4,c0f431b0,0,c0c9dbed,493e0,...) at _sleep+0x2a2 vm_pagezero(0,e7931d28,c0c76d43,359,c7ad2810,...) at vm_pagezero+0xb3 fork_exit(c0ae44c0,0,e7931d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7931d60, ebp = 0 --- Tracing command vmdaemon pid 15 tid 100070 td 0xc74e5b80 sched_switch(c74e5b80,0,104,c74e5b80,a72de6a6,...) at sched_switch+0x28a mi_switch(104,0,c74e5b80,c74e5b80,c74e5b80,...) at mi_switch+0x11a sleepq_switch(c74e5b80,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0f4321c,68,c0c82754,0,0,...) at sleepq_wait+0x39 _sleep(c0f4321c,c0f43220,68,c0c82754,0,...) at _sleep+0x2d2 vm_daemon(0,e792ed28,c0c76d43,359,c7ad2ac0,...) at vm_daemon+0x59 fork_exit(c0adf9c0,0,e792ed28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe792ed60, ebp = 0 --- Tracing command pagedaemon pid 9 tid 100069 td 0xc74e6000 sched_switch(c74e6000,0,104,c74e6000,c4299b79,...) at sched_switch+0x28a mi_switch(104,0,c74e6000,0,0,...) at mi_switch+0x11a sleepq_switch(c74e6000,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f431e4,44,c0c82754,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f431e4,c0f431b0,44,c0c82754,1388,...) at _sleep+0x2a2 vm_pageout(0,e792bd28,c0c76d43,359,c7ad3000,...) at vm_pageout+0x2bb fork_exit(c0ae0770,0,e792bd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe792bd60, ebp = 0 --- Tracing command xpt_thrd pid 8 tid 100068 td 0xc74e62e0 sched_switch(c74e62e0,0,104,c74e62e0,a5aa5c21,...) at sched_switch+0x28a mi_switch(104,0,c74e62e0,c74e62e0,c74e62e0,...) at mi_switch+0x11a sleepq_switch(c74e62e0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0d965d4,4c,c0c17627,0,0,...) at sleepq_wait+0x39 _sleep(c0d965d4,c0d96618,4c,c0c17627,0,...) at _sleep+0x2d2 xpt_scanner_thread(0,e7928d28,c0c76d43,359,c71722b0,...) at xpt_scanner_thread+0x47 fork_exit(c04846a0,0,e7928d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7928d60, ebp = 0 --- Tracing command sctp_iterator pid 7 tid 100067 td 0xc74e65c0 sched_switch(c74e65c0,0,104,c74e65c0,c14d80f1,...) at sched_switch+0x28a mi_switch(104,0,c74e65c0,c74e65c0,c74e65c0,...) at mi_switch+0x11a sleepq_switch(c74e65c0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0f38ab8,0,c0c8ec1f,0,0,...) at sleepq_wait+0x39 _sleep(c0f38ab8,c0f38a80,0,c0c8ec1f,0,...) at _sleep+0x2d2 sctp_iterator_thread(0,e7925d28,c0c76d43,359,c7172560,...) at sctp_iterator_thread+0x5c fork_exit(c09a8480,0,e7925d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7925d60, ebp = 0 --- Tracing command fdc0 pid 6 tid 100064 td 0xc74e7000 sched_switch(c74e7000,0,104,c74e7000,8a6967f8,...) at sched_switch+0x28a mi_switch(104,0,c74e7000,0,0,...) at mi_switch+0x11a sleepq_switch(c74e7000,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c73f243c,4c,c0c727d5,0,0,...) at sleepq_timedwait+0x3e _sleep(c73f243c,c73f24f0,4c,c0c727d5,3e8,...) at _sleep+0x2a2 fdc_thread(c73f2400,e791cd28,c0c76d43,359,c7172810,...) at fdc_thread+0x2be fork_exit(c0b629f0,c73f2400,e791cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe791cd60, ebp = 0 --- Tracing command fw0_probe pid 5 tid 100062 td 0xc73c35c0 sched_switch(c73c35c0,0,104,c73c35c0,b8859ab9,...) at sched_switch+0x28a mi_switch(104,0,c73c35c0,100,100,...) at mi_switch+0x11a sleepq_switch(c73c35c0,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f9000,5c,c0c727d5,100,0,...) at sleepq_wait_sig+0x17 _sleep(c73f9000,c73fd488,15c,c0c727d5,0,...) at _sleep+0x2bc fw_bus_probe_thread(c73f9000,e790cd28,c0c76d43,359,c7172ac0,...) at fw_bus_probe_thread+0xa08 fork_exit(c0672420,c73f9000,e790cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe790cd60, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xc73d32e0 sched_switch(c73d32e0,0,104,c73d32e0,961a9225,...) at sched_switch+0x28a mi_switch(104,0,c73d32e0,c73d32e0,c73d32e0,...) at mi_switch+0x11a sleepq_switch(c73d32e0,0,c0c7d836,260,c73d32e0,...) at sleepq_switch+0xd3 sleepq_wait(c73dad34,0,e78f9cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dad34,c73dadd4,c0c6b3b7,6c,c73dad3c,...) at _cv_wait+0x1b0 usb_process(c73dad2c,e78f9d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dad2c,e78f9d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f9d60, ebp = 0 --- Tracing command usb pid 14 tid 100057 td 0xc73d35c0 sched_switch(c73d35c0,0,104,c73d35c0,eb9bf89,...) at sched_switch+0x28a mi_switch(104,0,c73d35c0,c73d35c0,c73d35c0,...) at mi_switch+0x11a sleepq_switch(c73d35c0,0,c0c7d836,260,c73d35c0,...) at sleepq_switch+0xd3 sleepq_wait(c73dad04,0,e78f6cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dad04,c73dadd4,c0c6b3b7,6c,c73dad0c,...) at _cv_wait+0x1b0 usb_process(c73dacfc,e78f6d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dacfc,e78f6d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f6d60, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc73d38a0 sched_switch(c73d38a0,0,104,c73d38a0,95b505ed,...) at sched_switch+0x28a mi_switch(104,0,c73d38a0,c73d38a0,c73d38a0,...) at mi_switch+0x11a sleepq_switch(c73d38a0,0,c0c7d836,260,c73d38a0,...) at sleepq_switch+0xd3 sleepq_wait(c73dacd4,0,e78f3cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dacd4,c73dadd4,c0c6b3b7,6c,c73dacdc,...) at _cv_wait+0x1b0 usb_process(c73daccc,e78f3d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73daccc,e78f3d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f3d60, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc73d3b80 sched_switch(c73d3b80,0,104,c73d3b80,95b4f787,...) at sched_switch+0x28a mi_switch(104,0,c73d3b80,c73d3b80,c73d3b80,...) at mi_switch+0x11a sleepq_switch(c73d3b80,0,c0c7d836,260,c73d3b80,...) at sleepq_switch+0xd3 sleepq_wait(c73daca4,0,e78f0cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73daca4,c73dadd4,c0c6b3b7,6c,c73dacac,...) at _cv_wait+0x1b0 usb_process(c73dac9c,e78f0d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dac9c,e78f0d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f0d60, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc73d52e0 sched_switch(c73d52e0,0,104,c73d52e0,95b4e7c4,...) at sched_switch+0x28a mi_switch(104,0,c73d52e0,c73d52e0,c73d52e0,...) at mi_switch+0x11a sleepq_switch(c73d52e0,0,c0c7d836,260,c73d52e0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdb5c,0,e78e7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdb5c,c73cdbfc,c0c6b3b7,6c,c73cdb64,...) at _cv_wait+0x1b0 usb_process(c73cdb54,e78e7d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdb54,e78e7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e7d60, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xc73d55c0 sched_switch(c73d55c0,0,104,c73d55c0,6e44dfc,...) at sched_switch+0x28a mi_switch(104,0,c73d55c0,c73d55c0,c73d55c0,...) at mi_switch+0x11a sleepq_switch(c73d55c0,0,c0c7d836,260,c73d55c0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdb2c,0,e78e4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdb2c,c73cdbfc,c0c6b3b7,6c,c73cdb34,...) at _cv_wait+0x1b0 usb_process(c73cdb24,e78e4d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdb24,e78e4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e4d60, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc73c1000 sched_switch(c73c1000,0,104,c73c1000,9551fc0c,...) at sched_switch+0x28a mi_switch(104,0,c73c1000,c73c1000,c73c1000,...) at mi_switch+0x11a sleepq_switch(c73c1000,0,c0c7d836,260,c73c1000,...) at sleepq_switch+0xd3 sleepq_wait(c73cdafc,0,e78e1cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdafc,c73cdbfc,c0c6b3b7,6c,c73cdb04,...) at _cv_wait+0x1b0 usb_process(c73cdaf4,e78e1d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdaf4,e78e1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e1d60, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc73c12e0 sched_switch(c73c12e0,0,104,c73c12e0,9551ec16,...) at sched_switch+0x28a mi_switch(104,0,c73c12e0,c73c12e0,c73c12e0,...) at mi_switch+0x11a sleepq_switch(c73c12e0,0,c0c7d836,260,c73c12e0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdacc,0,e78decac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdacc,c73cdbfc,c0c6b3b7,6c,c73cdad4,...) at _cv_wait+0x1b0 usb_process(c73cdac4,e78ded28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdac4,e78ded28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78ded60, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc73c15c0 sched_switch(c73c15c0,0,104,c73c15c0,9551db12,...) at sched_switch+0x28a mi_switch(104,0,c73c15c0,c73c15c0,c73c15c0,...) at mi_switch+0x11a sleepq_switch(c73c15c0,0,c0c7d836,260,c73c15c0,...) at sleepq_switch+0xd3 sleepq_wait(c73c9b5c,0,e78dacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9b5c,c73c9bfc,c0c6b3b7,6c,c73c9b64,...) at _cv_wait+0x1b0 usb_process(c73c9b54,e78dad28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9b54,e78dad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78dad60, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc73c18a0 sched_switch(c73c18a0,0,104,c73c18a0,76daeb3,...) at sched_switch+0x28a mi_switch(104,0,c73c18a0,c73c18a0,c73c18a0,...) at mi_switch+0x11a sleepq_switch(c73c18a0,0,c0c7d836,260,c73c18a0,...) at sleepq_switch+0xd3 sleepq_wait(c73c9b2c,0,e78d7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9b2c,c73c9bfc,c0c6b3b7,6c,c73c9b34,...) at _cv_wait+0x1b0 usb_process(c73c9b24,e78d7d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9b24,e78d7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d7d60, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc73c1b80 sched_switch(c73c1b80,0,104,c73c1b80,94eefa0d,...) at sched_switch+0x28a mi_switch(104,0,c73c1b80,c73c1b80,c73c1b80,...) at mi_switch+0x11a sleepq_switch(c73c1b80,0,c0c7d836,260,c73c1b80,...) at sleepq_switch+0xd3 sleepq_wait(c73c9afc,0,e78d4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9afc,c73c9bfc,c0c6b3b7,6c,c73c9b04,...) at _cv_wait+0x1b0 usb_process(c73c9af4,e78d4d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9af4,e78d4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d4d60, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc73c2000 sched_switch(c73c2000,0,104,c73c2000,94eee97a,...) at sched_switch+0x28a mi_switch(104,0,c73c2000,c73c2000,c73c2000,...) at mi_switch+0x11a sleepq_switch(c73c2000,0,c0c7d836,260,c73c2000,...) at sleepq_switch+0xd3 sleepq_wait(c73c9acc,0,e78d1cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9acc,c73c9bfc,c0c6b3b7,6c,c73c9ad4,...) at _cv_wait+0x1b0 usb_process(c73c9ac4,e78d1d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9ac4,e78d1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d1d60, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc73c22e0 sched_switch(c73c22e0,0,104,c73c22e0,94eed828,...) at sched_switch+0x28a mi_switch(104,0,c73c22e0,c73c22e0,c73c22e0,...) at mi_switch+0x11a sleepq_switch(c73c22e0,0,c0c7d836,260,c73c22e0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcb5c,0,e78cdcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcb5c,c73bcbfc,c0c6b3b7,6c,c73bcb64,...) at _cv_wait+0x1b0 usb_process(c73bcb54,e78cdd28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcb54,e78cdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78cdd60, ebp = 0 --- Tracing command usb pid 14 tid 100044 td 0xc73c25c0 sched_switch(c73c25c0,0,104,c73c25c0,65b0003,...) at sched_switch+0x28a mi_switch(104,0,c73c25c0,c73c25c0,c73c25c0,...) at mi_switch+0x11a sleepq_switch(c73c25c0,0,c0c7d836,260,c73c25c0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcb2c,0,e78cacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcb2c,c73bcbfc,c0c6b3b7,6c,c73bcb34,...) at _cv_wait+0x1b0 usb_process(c73bcb24,e78cad28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcb24,e78cad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78cad60, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc73c28a0 sched_switch(c73c28a0,0,104,c73c28a0,948c77c2,...) at sched_switch+0x28a mi_switch(104,0,c73c28a0,c73c28a0,c73c28a0,...) at mi_switch+0x11a sleepq_switch(c73c28a0,0,c0c7d836,260,c73c28a0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcafc,0,e78c7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcafc,c73bcbfc,c0c6b3b7,6c,c73bcb04,...) at _cv_wait+0x1b0 usb_process(c73bcaf4,e78c7d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcaf4,e78c7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c7d60, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc73c2b80 sched_switch(c73c2b80,0,104,c73c2b80,948c68dd,...) at sched_switch+0x28a mi_switch(104,0,c73c2b80,c73c2b80,c73c2b80,...) at mi_switch+0x11a sleepq_switch(c73c2b80,0,c0c7d836,260,c73c2b80,...) at sleepq_switch+0xd3 sleepq_wait(c73bcacc,0,e78c4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcacc,c73bcbfc,c0c6b3b7,6c,c73bcad4,...) at _cv_wait+0x1b0 usb_process(c73bcac4,e78c4d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcac4,e78c4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c4d60, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc73ae000 sched_switch(c73ae000,0,104,c73ae000,948c5506,...) at sched_switch+0x28a mi_switch(104,0,c73ae000,c73ae000,c73ae000,...) at mi_switch+0x11a sleepq_switch(c73ae000,0,c0c7d836,260,c73ae000,...) at sleepq_switch+0xd3 sleepq_wait(c73b9b5c,0,e78bdcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9b5c,c73b9bfc,c0c6b3b7,6c,c73b9b64,...) at _cv_wait+0x1b0 usb_process(c73b9b54,e78bdd28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9b54,e78bdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78bdd60, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc73ae2e0 sched_switch(c73ae2e0,0,104,c73ae2e0,677259e,...) at sched_switch+0x28a mi_switch(104,0,c73ae2e0,c73ae2e0,c73ae2e0,...) at mi_switch+0x11a sleepq_switch(c73ae2e0,0,c0c7d836,260,c73ae2e0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9b2c,0,e78bacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9b2c,c73b9bfc,c0c6b3b7,6c,c73b9b34,...) at _cv_wait+0x1b0 usb_process(c73b9b24,e78bad28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9b24,e78bad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78bad60, ebp = 0 --- Tracing command usb pid 14 tid 100038 td 0xc73ae5c0 sched_switch(c73ae5c0,0,104,c73ae5c0,942996bd,...) at sched_switch+0x28a mi_switch(104,0,c73ae5c0,c73ae5c0,c73ae5c0,...) at mi_switch+0x11a sleepq_switch(c73ae5c0,0,c0c7d836,260,c73ae5c0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9afc,0,e78b7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9afc,c73b9bfc,c0c6b3b7,6c,c73b9b04,...) at _cv_wait+0x1b0 usb_process(c73b9af4,e78b7d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9af4,e78b7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b7d60, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc73ae8a0 sched_switch(c73ae8a0,0,104,c73ae8a0,94298830,...) at sched_switch+0x28a mi_switch(104,0,c73ae8a0,c73ae8a0,c73ae8a0,...) at mi_switch+0x11a sleepq_switch(c73ae8a0,0,c0c7d836,260,c73ae8a0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9acc,0,e78b4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9acc,c73b9bfc,c0c6b3b7,6c,c73b9ad4,...) at _cv_wait+0x1b0 usb_process(c73b9ac4,e78b4d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9ac4,e78b4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b4d60, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc73b0000 sched_switch(c73b0000,0,104,c73b0000,94297583,...) at sched_switch+0x28a mi_switch(104,0,c73b0000,c73b0000,c73b0000,...) at mi_switch+0x11a sleepq_switch(c73b0000,0,c0c7d836,260,c73b0000,...) at sleepq_switch+0xd3 sleepq_wait(c73a8b5c,0,e78adcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8b5c,c73a8bfc,c0c6b3b7,6c,c73a8b64,...) at _cv_wait+0x1b0 usb_process(c73a8b54,e78add28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8b54,e78add28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78add60, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc73b02e0 sched_switch(c73b02e0,0,104,c73b02e0,5b62ee1,...) at sched_switch+0x28a mi_switch(104,0,c73b02e0,c73b02e0,c73b02e0,...) at mi_switch+0x11a sleepq_switch(c73b02e0,0,c0c7d836,260,c73b02e0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8b2c,0,e78aacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8b2c,c73a8bfc,c0c6b3b7,6c,c73a8b34,...) at _cv_wait+0x1b0 usb_process(c73a8b24,e78aad28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8b24,e78aad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78aad60, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc73b05c0 sched_switch(c73b05c0,0,104,c73b05c0,93bf828a,...) at sched_switch+0x28a mi_switch(104,0,c73b05c0,c73b05c0,c73b05c0,...) at mi_switch+0x11a sleepq_switch(c73b05c0,0,c0c7d836,260,c73b05c0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8afc,0,e78a7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8afc,c73a8bfc,c0c6b3b7,6c,c73a8b04,...) at _cv_wait+0x1b0 usb_process(c73a8af4,e78a7d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8af4,e78a7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a7d60, ebp = 0 --- Tracing command usb pid 14 tid 100032 td 0xc73b08a0 sched_switch(c73b08a0,0,104,c73b08a0,93bf729e,...) at sched_switch+0x28a mi_switch(104,0,c73b08a0,c73b08a0,c73b08a0,...) at mi_switch+0x11a sleepq_switch(c73b08a0,0,c0c7d836,260,c73b08a0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8acc,0,e78a4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8acc,c73a8bfc,c0c6b3b7,6c,c73a8ad4,...) at _cv_wait+0x1b0 usb_process(c73a8ac4,e78a4d28,c0c76d43,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8ac4,e78a4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a4d60, ebp = 0 --- Tracing command yarrow pid 13 tid 100017 td 0xc727a5c0 sched_switch(c727a5c0,0,104,c727a5c0,de7341d0,...) at sched_switch+0x28a mi_switch(104,0,c727a5c0,2,2,...) at mi_switch+0x11a sleepq_switch(c727a5c0,0,c0c7d836,283,2,...) at sleepq_switch+0xd3 sleepq_timedwait(c0dc9ee4,0,c0c727d5,2,0,...) at sleepq_timedwait+0x3e _sleep(c0dc9ee4,0,0,c0c727d5,64,...) at _sleep+0x2a2 pause(c0c727d5,64,c0c5ec97,111,0,...) at pause+0x30 random_kthread(0,c6f2fd28,c0c76d43,359,c727c2b0,...) at random_kthread+0x1b4 fork_exit(c0746e50,0,c6f2fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f2fd60, ebp = 0 --- Tracing command g_down pid 4 tid 100015 td 0xc727ab80 sched_switch(c727ab80,0,104,c727ab80,4c2f782d,...) at sched_switch+0x28a mi_switch(104,0,c727ab80,c727ab80,c727ab80,...) at mi_switch+0x11a sleepq_switch(c727ab80,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7be4,4c,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7be4,c0dc7b48,24c,c0c727d5,0,...) at _sleep+0x2d2 g_io_schedule_down(c727ab80,0,c0c7343c,74,0,...) at g_io_schedule_down+0x58 g_down_procbody(0,c6f29d28,c0c76d43,359,c727c560,...) at g_down_procbody+0x69 fork_exit(c083f3b0,0,c6f29d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f29d60, ebp = 0 --- Tracing command g_up pid 3 tid 100014 td 0xc727b000 sched_switch(c727b000,0,104,c727b000,4c5b0afa,...) at sched_switch+0x28a mi_switch(104,0,c727b000,c727b000,c727b000,...) at mi_switch+0x11a sleepq_switch(c727b000,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7be0,4c,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7be0,c0dc7b68,24c,c0c727d5,0,...) at _sleep+0x2d2 g_io_schedule_up(c727b000,0,c0c7343c,5d,0,...) at g_io_schedule_up+0xae g_up_procbody(0,c6f26d28,c0c76d43,359,c7171000,...) at g_up_procbody+0x69 fork_exit(c083f420,0,c6f26d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f26d60, ebp = 0 --- Tracing command g_event pid 2 tid 100013 td 0xc71752e0 sched_switch(c71752e0,0,104,c71752e0,3de49a8,...) at sched_switch+0x28a mi_switch(104,0,c71752e0,c71752e0,c71752e0,...) at mi_switch+0x11a sleepq_switch(c71752e0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7bd8,4c,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7bd8,c0dc7b28,24c,c0c727d5,0,...) at _sleep+0x2d2 g_run_events(c0dcde40,0,c0c7343c,8b) at g_run_events+0x340 g_event_procbody(0,c6f23d28,c0c76d43,359,c71712b0,...) at g_event_procbody+0x66 fork_exit(c083f490,0,c6f23d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f23d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc74e68a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc74e6b80 sched_switch(c74e6b80,0,109,529,93bd2f49,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c716f070,...) at mi_switch+0x11a ithread_loop(c74e8310,e791fd28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c74e8310,e791fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe791fd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc73c32e0 sched_switch(c73c32e0,0,109,529,cb8c0da1,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c73f1ef0,...) at mi_switch+0x11a ithread_loop(c74db3a0,e790fd28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c74db3a0,e790fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe790fd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc73c3b80 sched_switch(c73c3b80,0,109,529,93a78587,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b70f0,...) at mi_switch+0x11a ithread_loop(c73d2610,e7903d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c73d2610,e7903d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7903d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc73d3000 sched_switch(c73d3000,0,109,529,a085381a,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b73f0,...) at mi_switch+0x11a ithread_loop(c739ca70,e78ffd28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739ca70,e78ffd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78ffd60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc73d5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc73c3000 sched_switch(c73c3000,0,109,529,bb1fb811,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b71f0,...) at mi_switch+0x11a ithread_loop(c739c460,e78c1d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739c460,e78c1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c1d60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc73aeb80 sched_switch(c73aeb80,0,109,529,bb97390e,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b7270,...) at mi_switch+0x11a ithread_loop(c739c7f0,e78b1d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739c7f0,e78b1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b1d60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc73b0b80 sched_switch(c73b0b80,0,109,529,ba6c5b65,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b72f0,...) at mi_switch+0x11a ithread_loop(c7397610,e78a1d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7397610,e78a1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a1d60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc727b2e0 sched_switch(c727b2e0,0,109,529,4c5a642c,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6ef0,...) at mi_switch+0x11a ithread_loop(c7388a70,e7792d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7388a70,e7792d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7792d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc727b5c0 sched_switch(c727b5c0,0,109,529,60765a5f,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c7387870,...) at mi_switch+0x11a ithread_loop(c7388bc0,e778ed28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7388bc0,e778ed28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe778ed60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc727b8a0 sched_switch(c727b8a0,0,109,529,93bdcab3,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c716eb70,...) at mi_switch+0x11a ithread_loop(c71704f0,c6f77d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c71704f0,c6f77d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f77d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc727bb80 sched_switch(c727bb80,0,109,529,97c7496d,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c734a670,...) at mi_switch+0x11a ithread_loop(c7170210,c6f4dd28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170210,c6f4dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4dd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc734b000 sched_switch(c734b000,0,109,529,5e59fa50,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c734a6f0,...) at mi_switch+0x11a ithread_loop(c71703b0,c6f4ad28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c71703b0,c6f4ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4ad60, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc734b8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xc734bb80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc71755c0 sched_switch(c71755c0,0,109,529,7b7ab2ea,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6b70,...) at mi_switch+0x11a ithread_loop(c7170040,c6f20d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170040,c6f20d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f20d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc71758a0 sched_switch(c71758a0,0,109,529,9388439c,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6bf0,...) at mi_switch+0x11a ithread_loop(c7170050,c6f1dd28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170050,c6f1dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f1dd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7175b80 sched_switch(c7175b80,0,109,529,620240bf,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6c70,...) at mi_switch+0x11a ithread_loop(c7170060,c6f1ad28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170060,c6f1ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f1ad60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc71b8000 sched_switch(c71b8000,0,109,529,de734447,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6cf0,...) at mi_switch+0x11a ithread_loop(c7170070,c6f17d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170070,c6f17d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f17d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc71b82e0 sched_switch(c71b82e0,0,109,529,dcc95216,...) at sched_switch+0x28a mi_switch(109,0,c0c76eff,529,c71b6d70,...) at mi_switch+0x11a ithread_loop(c7170080,c6f14d28,c0c76d43,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170080,c6f14d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f14d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc71b85c0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc7173000 cpustop_handler(1,c6f0dc0c,c0b9fbe6,7fffbd2a,369e99,...) at cpustop_handler+0x34 ipi_nmi_handler(7fffbd2a,369e99,0,10f,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f0dc18) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b7fd85, esp = 0xc6f0dc58, ebp = 0xc6f0dc58 --- acpi_cpu_c1(c6f0dc74,c0d96850,0,ffffffff,c6f0dca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dcde40,c6f0dca0,c0b9321b,1,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(1,c6f0dce8,c08b995e,1,c6f0dcc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(1,c6f0dcc4,c0c7b5ba,a08,c7173000,...) at cpu_idle+0x1b sched_idletd(0,c6f0dd28,c0c76d43,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f0dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f0dd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc71732e0 kdb_enter(c0c260a6,c0c65a73,c0dca0fc,c73eba80,0,...) at kdb_enter+0x3a uart_intr(c73eba00,c71732e0,c71558d0,c716ed80,4,...) at uart_intr+0x126 intr_event_handle(c716ed80,c6f0ac18,1,0,c7286200,...) at intr_event_handle+0x5c intr_execute_handlers(c71558d0,c6f0ac18,1,c6f0ac58,c0b87b35,...) at intr_execute_handlers+0x49 lapic_handle_intr(30,c6f0ac18) at lapic_handle_intr+0x4c Xapic_isr1() at Xapic_isr1+0x35 --- interrupt, eip = 0xc0b7fd85, esp = 0xc6f0ac58, ebp = 0xc6f0ac58 --- acpi_cpu_c1(c6f0ac74,c0d96850,1,ffffffff,c6f0aca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dce4c0,c6f0aca0,c0b9321b,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f0ace8,c08b995e,0,c6f0acc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f0acc4,c0c7b5ba,a08,c71732e0,...) at cpu_idle+0x1b sched_idletd(0,c6f0ad28,c0c76d43,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f0ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f0ad60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc71735c0 cpustop_handler(4,c6f07c0c,c0b9fbe6,c0dca138,c6f07ba0,...) at cpustop_handler+0x34 ipi_nmi_handler(c0dca138,c6f07ba0,c088cb6d,c0dca138,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f07c18) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b7fd85, esp = 0xc6f07c58, ebp = 0xc6f07c58 --- acpi_cpu_c1(c6f07c74,c0d96850,2,ffffffff,c6f07ca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dceb40,c6f07ca0,c0b9321b,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f07ce8,c08b995e,0,c6f07cc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f07cc4,c0c7b5ba,a08,c71735c0,...) at cpu_idle+0x1b sched_idletd(0,c6f07d28,c0c76d43,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f07d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f07d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc71738a0 cpustop_handler(8,c6f04c5c,c0b9fbe6,0,c0c75b47,...) at cpustop_handler+0x34 ipi_nmi_handler(0,c0c75b47,1b7,c6f04bfc,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f04c68) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08b9938, esp = 0xc6f04ca8, ebp = 0xc6f04ce8 --- sched_idletd(0,c6f04d28,c0c76d43,359,c7171810,...) at sched_idletd+0x208 fork_exit(c08b9730,0,c6f04d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f04d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7173b80 sched_switch(c7173b80,0,104,c7173b80,191e3432,...) at sched_switch+0x28a mi_switch(104,0,c7173b80,100,100,...) at mi_switch+0x11a sleepq_switch(c7173b80,0,c0c7d836,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d836,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7171ac0,5c,c0c7ef4b,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7171ac0,c7171b48,15c,c0c7ef4b,0,...) at _sleep+0x2bc kern_wait(c7173b80,ffffffff,c6f00c44,0,0,...) at kern_wait+0xa76 wait4(c7173b80,c6f00cec,2811afdc,1,0,...) at wait4+0x3b syscallenter(c7173b80,c6f00ce4,c0ba02ae,c7173b80,c6f00d28,...) at syscallenter+0x246 syscall(c6f00d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054d7b, esp = 0xbfbfe8fc, ebp = 0xbfbfe918 --- Tracing command audit pid 10 tid 100001 td 0xc7175000 sched_switch(c7175000,0,104,c7175000,93be31c1,...) at sched_switch+0x28a mi_switch(104,0,c7175000,c7175000,c7175000,...) at mi_switch+0x11a sleepq_switch(c7175000,0,c0c7d836,260,c7175000,...) at sleepq_switch+0xd3 sleepq_wait(c0f42240,0,c6efdc8c,1,0,...) at sleepq_wait+0x39 _cv_wait(c0f42240,c0f42224,c0c97f52,192,0,...) at _cv_wait+0x1b0 audit_worker(0,c6efdd28,c0c76d43,359,c7172000,...) at audit_worker+0x50 fork_exit(c0a81a90,0,c6efdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6efdd60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc73c38a0 sched_switch(c73c38a0,0,104,c73c38a0,dd2a56d9,...) at sched_switch+0x28a mi_switch(104,0,c73c38a0,c73c38a0,c73c38a0,...) at mi_switch+0x11a sleepq_switch(c73c38a0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c73f8580,0,c0c7a9be,c0c727d5,0,...) at sleepq_wait+0x39 msleep_spin(c73f8580,c73f8598,c0c727d5,0,c0c76d43,...) at msleep_spin+0x1ce taskqueue_thread_loop(c73fd49c,e7909d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c73fd49c,e7909d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7909d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc734b2e0 sched_switch(c734b2e0,0,104,c734b2e0,a5b35bbf,...) at sched_switch+0x28a mi_switch(104,0,c734b2e0,c734b2e0,c734b2e0,...) at mi_switch+0x11a sleepq_switch(c734b2e0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733eac0,0,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c733eac0,c733ead8,0,c0c727d5,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0ddc8c8,c6f47d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0ddc8c8,c6f47d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f47d60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc734b5c0 sched_switch(c734b5c0,0,104,c734b5c0,96408054,...) at sched_switch+0x28a mi_switch(104,0,c734b5c0,c734b5c0,c734b5c0,...) at mi_switch+0x11a sleepq_switch(c734b5c0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733eb00,0,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c733eb00,c733eb18,0,c0c727d5,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0f42824,c6f44d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0f42824,c6f44d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f44d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc71b88a0 sched_switch(c71b88a0,0,104,c71b88a0,96406dac,...) at sched_switch+0x28a mi_switch(104,0,c71b88a0,c71b88a0,c71b88a0,...) at mi_switch+0x11a sleepq_switch(c71b88a0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a9be,c0c727d5,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c727d5,0,c0c76d43,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d994a0,c6f3bd28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d994a0,c6f3bd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc71b8b80 sched_switch(c71b8b80,0,104,c71b8b80,964061e8,...) at sched_switch+0x28a mi_switch(104,0,c71b8b80,c71b8b80,c71b8b80,...) at mi_switch+0x11a sleepq_switch(c71b8b80,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a9be,c0c727d5,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c727d5,0,c0c76d43,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d994a0,c6f38d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d994a0,c6f38d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f38d60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc727a000 sched_switch(c727a000,0,104,c727a000,964054c9,...) at sched_switch+0x28a mi_switch(104,0,c727a000,c727a000,c727a000,...) at mi_switch+0x11a sleepq_switch(c727a000,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a9be,c0c727d5,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c727d5,0,c0c76d43,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d994a0,c6f35d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d994a0,c6f35d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f35d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc727a2e0 sched_switch(c727a2e0,0,104,c727a2e0,963c8d7b,...) at sched_switch+0x28a mi_switch(104,0,c727a2e0,c727a2e0,c727a2e0,...) at mi_switch+0x11a sleepq_switch(c727a2e0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee40,0,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c733ee40,c733ee58,0,c0c727d5,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0dc8604,c6f32d28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0dc8604,c6f32d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f32d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc727a8a0 sched_switch(c727a8a0,0,104,c727a8a0,74d8d98a,...) at sched_switch+0x28a mi_switch(104,0,c727a8a0,c727a8a0,c727a8a0,...) at mi_switch+0x11a sleepq_switch(c727a8a0,0,c0c7d836,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c7152880,0,c0c727d5,0,0,...) at sleepq_wait+0x39 _sleep(c7152880,c7152898,0,c0c727d5,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0ddb360,c6f2cd28,c0c76d43,359,c0dc7cc0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0ddb360,c6f2cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f2cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0dc7f70 sched_switch(c0dc7f70,0,104,c0dc7f70,a671f647,...) at sched_switch+0x28a mi_switch(104,0,c0dc7f70,0,0,...) at mi_switch+0x11a sleepq_switch(c0dc7f70,0,c0c7d836,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0dc7cc0,44,c0c7bb95,0,0,...) at sleepq_timedwait+0x3e _sleep(c0dc7cc0,0,44,c0c7bb95,2710,...) at _sleep+0x2a2 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x217 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3439 MB Dumping 152 MB: 137 121 105 89 73 57 41 25 9 Dump complete = 0xf db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 sched_switch (td=0xc82f32e0, newtd=0xc7173000, flags=0x104) at ../../../kern/sched_ule.c:1865 #1 0xc08a2bea in mi_switch (flags=0x104, newtd=0x0) at ../../../kern/kern_synch.c:449 #2 0xc08cefb3 in sleepq_switch (wchan=Variable "wchan" is not available. ) at ../../../kern/subr_sleepqueue.c:530 #3 0xc08cf789 in sleepq_wait (wchan=0xc7e532d0, pri=0x50) at ../../../kern/subr_sleepqueue.c:609 #4 0xc08a3072 in _sleep (ident=0xc7e532d0, lock=0xc7e532d0, priority=0x50, wmesg=0xc0c83aef "mntref", timo=0x0) at ../../../kern/kern_synch.c:234 #5 0xc09175a8 in vfs_mount_destroy (mp=0xc7e532d0) at ../../../kern/vfs_mount.c:525 #6 0xc091abbd in dounmount (mp=0xc7e532d0, flags=0x8000000, td=0xc82f32e0) at ../../../kern/vfs_mount.c:1341 #7 0xc091aedf in unmount (td=0xc82f32e0, uap=0xe9cd6cec) at ../../../kern/vfs_mount.c:1179 #8 0xc08d1806 in syscallenter (td=0xc82f32e0, sa=0xe9cd6ce4) at ../../../kern/subr_trap.c:315 #9 0xc0b9fb2f in syscall (frame=0xe9cd6d28) at ../../../i386/i386/trap.c:1086 #10 0xc0b877d1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:266 #11 0x00000033 in ?? () (kgdb) f 5 #5 0xc09175a8 in vfs_mount_destroy (mp=0xc7e532d0) at ../../../kern/vfs_mount.c:525 525 msleep(mp, MNT_MTX(mp), PVFS, "mntref", 0); (kgdb) p *mp $2 = {mnt_mtx = {lock_object = {lo_name = 0xc0c7e9ae "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc712d380}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xc7b722e8}, mnt_op = 0xc0d7bd80, mnt_vfc = 0xc0d7bbe0, mnt_vnodecovered = 0xc82fb560, mnt_syncer = 0x0, mnt_ref = 0x1f, mnt_nvnodelist = {tqh_first = 0xc7aeac00, tqh_last = 0xc88fa414}, mnt_nvnodelistsize = 0x0, mnt_writeopcount = 0x0, mnt_kern_flag = 0x6100006c, mnt_flag = 0x200000, mnt_xflag = 0x0, mnt_noasync = 0x1, mnt_opt = 0xc7b37090, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x1, f_flags = 0x201000, f_bsize = 0x800, f_iosize = 0x4000, f_blocks = 0x7ba73, f_bfree = 0x7ba71, f_bavail = 0x71c2b, f_files = 0x227fe, f_ffree = 0x227fc, f_syncwrites = 0x0, f_asyncwrites = 0x0, f_syncreads = 0x0, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x4d961de3, 0x8eee1479}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/md5a", '\0' , f_mntonname = "/mnt", '\0' }, mnt_cred = 0xc7f54200, mnt_data = 0x0, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 0x679949e3, mnt_lockref = 0x0, mnt_secondary_writes = 0x0, mnt_secondary_accwrites = 0x58643c, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = {lo_name = 0xc0c83ae7 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xc71333c8}, lk_lock = 0x1, lk_timo = 0x0, lk_pri = 0x50, lk_stack = {depth = 0x7, pcs = {0xc0886b80, 0xc09114f7, 0xc0918e2c, 0xc09195f5, 0xc08d1806, 0xc0b9fb2f, 0xc0b877d1, 0x0 }}}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -62,6 +62,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -338,9 +339,10 @@ softdep_releasefile(ip) } int -softdep_request_cleanup(fs, vp) +softdep_request_cleanup(fs, vp, cred) struct fs *fs; struct vnode *vp; + struct ucred *cred; { return (0); @@ -678,6 +680,7 @@ static int stat_indir_blk_ptrs; /* bufs redirtied static int stat_inode_bitmap; /* bufs redirtied as inode bitmap not written */ static int stat_direct_blk_ptrs;/* bufs redirtied as direct ptrs not written */ static int stat_dir_entry; /* bufs redirtied as dir entry cannot write */ +static int stat_high_cleanup_delay; /* Maximum cleanup delay (in ticks) */ SYSCTL_INT(_debug, OID_AUTO, max_softdeps, CTLFLAG_RW, &max_softdeps, 0, ""); SYSCTL_INT(_debug, OID_AUTO, tickdelay, CTLFLAG_RW, &tickdelay, 0, ""); @@ -692,6 +695,7 @@ SYSCTL_INT(_debug, OID_AUTO, indir_blk_ptrs, CTLFL SYSCTL_INT(_debug, OID_AUTO, inode_bitmap, CTLFLAG_RW, &stat_inode_bitmap, 0, ""); SYSCTL_INT(_debug, OID_AUTO, direct_blk_ptrs, CTLFLAG_RW, &stat_direct_blk_ptrs, 0, ""); SYSCTL_INT(_debug, OID_AUTO, dir_entry, CTLFLAG_RW, &stat_dir_entry, 0, ""); +SYSCTL_INT(_debug, OID_AUTO, high_cleanup_delay, CTLFLAG_RW, &stat_high_cleanup_delay, 0, ""); /* SYSCTL_INT(_debug, OID_AUTO, worklist_num, CTLFLAG_RD, &softdep_on_worklist, 0, ""); */ SYSCTL_DECL(_vfs_ffs); @@ -5797,20 +5801,26 @@ softdep_slowdown(vp) * If the worklist yields no free space, encourage the syncer daemon * to help us. In no event will we try for longer than tickdelay seconds. */ + +static void check_block_count(char *, struct fs *, struct ufsmount *, + ufs2_daddr_t); + int -softdep_request_cleanup(fs, vp) +softdep_request_cleanup(fs, vp, cred) struct fs *fs; struct vnode *vp; + struct ucred *cred; { struct ufsmount *ump; + struct mount *mp; + struct vnode *lvp, *mvp; long starttime; ufs2_daddr_t needed; int error; ump = VTOI(vp)->i_ump; + mp = vp->v_mount; mtx_assert(UFS_MTX(ump), MA_OWNED); - needed = fs->fs_cstotal.cs_nbfree + fs->fs_contigsumsize; - starttime = time_second + tickdelay; /* * If we are being called because of a process doing a * copy-on-write, then it is not safe to update the vnode @@ -5823,9 +5833,38 @@ int if (error != 0) return (0); } - while (fs->fs_pendingblocks > 0 && fs->fs_cstotal.cs_nbfree <= needed) { - if (time_second > starttime) - return (0); + /* + * If we are in need of resources, consider pausing for + * tickdelay to give ourselves some breathing room. + */ + UFS_UNLOCK(ump); + ACQUIRE_LOCK(&lk); + request_cleanup(UFSTOVFS(ump), FLUSH_REMOVE_WAIT); + FREE_LOCK(&lk); + UFS_LOCK(ump); + /* + * Now clean up at least as much space as we will need. + * + * The amount of space that we will need is enough blocks to + * allocate a full-sized segment (fs_contigsumsize). The number of + * such segments that will be needed is set by the number of + * simultaneous writers (mnt_writeopcount) plus a bit of slop (2) + * in case some more show up while we are cleaning. + * + * Additionally, if we are unpriviledged we will need to ensure + * that we clean up enough blocks to get to the above threshhold + * of the minimum number of blocks required to be kept free by the + * filesystem (fs_minfree). + */ + needed = (mp->mnt_writeopcount + 2) * fs->fs_contigsumsize; + if (priv_check_cred(cred, PRIV_VFS_BLOCKRESERVE, 0)) + needed += fragstoblks(fs, + roundup((fs->fs_dsize * fs->fs_minfree / 100) - + fs->fs_cstotal.cs_nffree, fs->fs_frag)); + starttime = time_second + tickdelay; +retry: + while (ump->softdep_on_worklist > 0 && + fs->fs_cstotal.cs_nbfree <= needed) { UFS_UNLOCK(ump); ACQUIRE_LOCK(&lk); if (ump->softdep_on_worklist > 0 && @@ -5835,14 +5874,130 @@ int UFS_LOCK(ump); continue; } - request_cleanup(UFSTOVFS(ump), FLUSH_REMOVE_WAIT); FREE_LOCK(&lk); UFS_LOCK(ump); } + /* + * If we still need resources and there are no more worklist + * entries to process to obtain them, we have to start flushing + * the dirty vnodes to force the release of additional requests + * to the worklist that we can then process to reap addition + * resources. We start by flushing our own vnode and if that + * does not produce enough resources we walk the vnodes + * associated with the mount point until we get the needed + * worklist requests that we can reap. + */ + if (fs->fs_cstotal.cs_nbfree <= needed) { + UFS_UNLOCK(ump); + MNT_ILOCK(mp); + MNT_VNODE_FOREACH(lvp, mp, mvp) { + UFS_LOCK(ump); + if (ump->softdep_on_worklist > 0) { + MNT_IUNLOCK(mp); + check_block_count("Retry", fs, ump, needed); + goto retry; + } + UFS_UNLOCK(ump); + VI_LOCK(lvp); + if (TAILQ_FIRST(&lvp->v_bufobj.bo_dirty.bv_hd) == 0 || + VOP_ISLOCKED(lvp) != 0) { + VI_UNLOCK(lvp); + continue; + } + MNT_IUNLOCK(mp); + if (vget(lvp, LK_EXCLUSIVE | LK_INTERLOCK, curthread)) { + MNT_ILOCK(mp); + continue; + } + if (lvp->v_vflag & VV_NOSYNC) { /* unlinked */ + vput(lvp); + MNT_ILOCK(mp); + continue; + } + (void) ffs_syncvnode(lvp, MNT_WAIT); + vput(lvp); + MNT_ILOCK(mp); + } + MNT_IUNLOCK(mp); + check_block_count("Failed", fs, ump, needed); + UFS_LOCK(ump); + } + if (time_second - starttime > stat_high_cleanup_delay) + stat_high_cleanup_delay = time_second - starttime; return (1); } /* + * Check out counts above. + */ +static void +check_block_count(action, fs, ump, needed) + char *action; + struct fs *fs; + struct ufsmount *ump; + ufs2_daddr_t needed; +{ + struct worklist *wk; + static int maxFcount = 20, Rcount = -1; + int blkcnt, dircnt, fragcnt, inocnt; + ufs2_daddr_t pending; + + if (action[0] == 'F' && maxFcount-- <= 0) + return; + if (action[0] == 'R') { + Rcount += 1; + if ((Rcount & (Rcount - 1)) != 0) + return; + } + dircnt = 0; + fragcnt = 0; + blkcnt = 0; + inocnt = 0; + pending = 0; + LIST_FOREACH(wk, &ump->softdep_workitem_pending, wk_list) { + switch (wk->wk_type) { + + case D_DIRREM: + /* removal of a directory entry */ + dircnt += 1; + continue; + + case D_FREEBLKS: + /* releasing blocks and/or fragments from a file */ + pending += WK_FREEBLKS(wk)->fb_chkcnt; + blkcnt += 1; + continue; + + case D_FREEFRAG: + /* releasing a fragment when replaced as a file grows */ + fragcnt += 1; + continue; + + case D_FREEFILE: + /* releasing an inode when its link count drops to 0 */ + inocnt += 1; + continue; + + default: + panic("check_block_count: Unknown type %s", + TYPENAME(wk->wk_type)); + /* NOTREACHED */ + } + } + printf("%s reclaim\n", action); + printf("Seeking %lld blocks\n", needed); + printf("Free inodes %lld, free blocks %lld, free fragments %lld\n", + fs->fs_cstotal.cs_nifree, fs->fs_cstotal.cs_nbfree, + fs->fs_cstotal.cs_nffree); + printf("Pending workitems %d, Allocated inodes %lld\n", + ump->softdep_on_worklist, + (fs->fs_ncg * fs->fs_ipg) - fs->fs_cstotal.cs_nifree); + printf("Found %d files with %lld blocks pending\n", blkcnt, pending); + printf("Other types: dirrem %d, freefrag %d, freefile %d\n", + dircnt, fragcnt, inocnt); +} + +/* * If memory utilization has gotten too high, deliberately slow things * down and speed up the I/O processing. */ Index: /usr/src/sys/ufs/ffs/ffs_alloc.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_alloc.c (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_alloc.c (working copy) @@ -215,9 +215,9 @@ nospace: (void) chkdq(ip, -btodb(size), cred, FORCE); UFS_LOCK(ump); #endif - if (fs->fs_pendingblocks > 0 && reclaimed == 0) { + if (reclaimed == 0) { reclaimed = 1; - softdep_request_cleanup(fs, ITOV(ip)); + softdep_request_cleanup(fs, ITOV(ip), cred); goto retry; } UFS_UNLOCK(ump); @@ -430,9 +430,9 @@ nospace: /* * no space available */ - if (fs->fs_pendingblocks > 0 && reclaimed == 0) { + if (reclaimed == 0) { reclaimed = 1; - softdep_request_cleanup(fs, vp); + softdep_request_cleanup(fs, vp, cred); UFS_UNLOCK(ump); if (bp) { brelse(bp); Index: /usr/src/sys/ufs/ffs/ffs_extern.h =================================================================== --- /usr/src/sys/ufs/ffs/ffs_extern.h (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_extern.h (working copy) @@ -114,7 +114,7 @@ int softdep_flushfiles(struct mount *, int, struct void softdep_update_inodeblock(struct inode *, struct buf *, int); void softdep_load_inodeblock(struct inode *); void softdep_freefile(struct vnode *, ino_t, int); -int softdep_request_cleanup(struct fs *, struct vnode *); +int softdep_request_cleanup(struct fs *, struct vnode *, struct ucred *); void softdep_setup_freeblocks(struct inode *, off_t, int); void softdep_setup_inomapdep(struct buf *, struct inode *, ino_t); void softdep_setup_blkmapdep(struct buf *, struct mount *, ufs2_daddr_t); -- Test scenario: linger2.sh