GENERIC HEAD from Wed Oct 20 20:01:45 2010 r214116, vmcore.3 KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-CURRENT #2: Wed Oct 20 22:54:47 CEST 2010 test@leopard3.netperf.freebsd.org:/mnt/pho/obj/mnt/pho/src/sys/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: Intel(R) Xeon(R) CPU 3050 @ 2.13GHz (2128.04-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6f2 Family = 6 Model = f Stepping = 2 Features=0xbfebfbff Features2=0xe3bd AMD Features=0x20100000 AMD Features2=0x1 TSC: P-state invariant real memory = 2147483648 (2048 MB) avail memory = 2084974592 (1988 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0 irqs 0-23 on motherboard ioapic1 irqs 24-47 on motherboard ioapic2 irqs 48-71 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 cpu0: on acpi0 cpu1: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 pcib2: at device 0.0 on pci1 pci2: on pcib2 pcib3: at device 0.2 on pci1 pci3: on pcib3 pcib4: irq 16 at device 3.0 on pci0 pci10: on pcib4 pci10: at device 0.0 (no driver attached) pcib5: irq 17 at device 28.0 on pci0 pci14: on pcib5 pcib6: irq 17 at device 28.4 on pci0 pci18: on pcib6 em0: port 0x5000-0x501f mem 0xe0300000-0xe031ffff irq 16 at device 0.0 on pci18 em0: Using an MSI interrupt em0: Ethernet address: 00:30:48:8e:d0:68 pcib7: irq 16 at device 28.5 on pci0 pci19: on pcib7 em1: port 0x6000-0x601f mem 0xe0400000-0xe041ffff irq 17 at device 0.0 on pci19 em1: Using an MSI interrupt em1: Ethernet address: 00:30:48:8e:d0:69 uhci0: port 0x3000-0x301f irq 23 at device 29.0 on pci0 usbus0: on uhci0 uhci1: port 0x3020-0x303f irq 19 at device 29.1 on pci0 usbus1: on uhci1 uhci2: port 0x3040-0x305f irq 18 at device 29.2 on pci0 usbus2: on uhci2 uhci3: port 0x3060-0x307f irq 16 at device 29.3 on pci0 usbus3: on uhci3 ehci0: mem 0xe0000000-0xe00003ff irq 23 at device 29.7 on pci0 usbus4: EHCI version 1.0 usbus4: on ehci0 pcib8: at device 30.0 on pci0 pci20: on pcib8 vgapci0: port 0x7000-0x70ff mem 0xe8000000-0xefffffff,0xe0500000-0xe050ffff irq 16 at device 4.0 on pci20 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x30a0-0x30af at device 31.1 on pci0 ata0: on atapci0 atapci1: port 0x30e8-0x30ef,0x30dc-0x30df,0x30e0-0x30e7,0x30d8-0x30db,0x30b0-0x30bf mem 0xe0000400-0xe00007ff irq 19 at device 31.2 on pci0 atapci1: AHCI called from vendor specific driver atapci1: AHCI v1.10 controller with 4 3Gbps ports, PM not supported ata2: on atapci1 ata3: on atapci1 ata4: on atapci1 ata5: on atapci1 pci0: at device 31.3 (no driver attached) acpi_button0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fd0: <1440-KB 3.5" drive> on fdc0 drive 0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xcafff,0xcb000-0xcbfff pnpid ORM0000 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x100> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] ppc0: parallel port not found. est0: on cpu0 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est0 attach returned 6 p4tcc0: on cpu0 est1: on cpu1 est: CPU supports Enhanced Speedstep, but is not recognized. est: cpu_vendor GenuineIntel, msr 828082806000828 device_attach: est1 attach returned 6 p4tcc1: on cpu1 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 Expensive timeout(9) function: 0xc08f9ed0(0xc57085a0) 0.011132699 s ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 usbus4: 480Mbps High Speed USB v2.0 ugen4.1: at usbus4 uhub4: on usbus4 Expensive timeout(9) function: 0xc08f9ed0(0xc57ca870) 0.101365117 s acd0: CDROM at ata0-master UDMA33 ad4: 238475MB at ata2-master UDMA100 SATA 3Gb/s SMP: AP CPU #1 Launched! WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered Root mount waiting for: usbus4 Root mount waiting for: usbus4 Root mount waiting for: usbus4 uhub4: 8 ports with 8 removable, self powered Trying to mount root from nfs: []... NFS ROOT: 192.168.5.1:/zoo/leopard3 em0: link state changed to UP Interface em0 IP-Address 192.168.5.109 Broadcast 192.168.5.255 Setting hostuuid: 64a93476-27b1-3004-c299-0030488ed164. Setting hostid: 0x7acc54f1. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4d: clean, 114948236 free (1084 frags, 14368394 blocks, 0.0% fragmentation) mount_nfs: can't update /var/db/mounttab for 192.168.5.1:/zoo/leopard3 Mounting local file systems:. Setting hostname: leopard3.netperf.freebsd.org. Starting Network: lo0 em0 em1. lo0: flags=8049 metric 0 mtu 16384 options=3 inet 127.0.0.1 netmask 0xff000000 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 nd6 options=21 em0: flags=8843 metric 0 mtu 1500 options=219b ether 00:30:48:8e:d0:68 inet 192.168.5.109 netmask 0xffffff00 broadcast 192.168.5.255 inet6 fe80::230:48ff:fe8e:d068%em0 prefixlen 64 tentative scopeid 0x1 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active em1: flags=8802 metric 0 mtu 1500 options=219b ether 00:30:48:8e:d0:69 media: Ethernet autoselect status: no carrier Starting devd. Starting Network: em1. em1: flags=8802 metric 0 mtu 1500 options=219b ether 00:30:48:8e:d0:69 media: Ethernet autoselect status: no carrier add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. ELF ldconfig path: /lib /usr/lib /usr/lib/compat a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting date via ntp. Error : hostname nor servname provided, or not known 21 Oct 07:08:21 ntpdate[835]: can't find host zoo 21 Oct 07:08:21 ntpdate[835]: no servers can be used, exiting Starting rpcbind. NFS access cache time=60 Clearing /tmp (X related). Starting statd. Updating motd:. Configuring syscons: blanktime. Starting sshd. Starting cron. Thu Oct 21 07:08:22 UTC 2010 FreeBSD/i386 (leopard3.netperf.freebsd.org) (ttyu0) login: root Oct 21 07:08:59 leopard3 login: ROOT LOGIN (root) ON ttyu0 FreeBSD 9.0-CURRENT (PHO) #2: Wed Oct 20 22:54:47 CEST 2010 Welcome to FreeBSD! Before seeking technical support, please use the following resources: o Security advisories and updated errata information for all releases are at http://www.FreeBSD.org/releases/ - always consult the ERRATA section for your release first as it's updated frequently. o The Handbook and FAQ documents are at http://www.FreeBSD.org/ and, along with the mailing lists, can be searched by going to http://www.FreeBSD.org/search/. If the doc distribution has been installed, they're also available formatted in /usr/share/doc. If you still have a question or problem, please take the output of `uname -a', along with any relevant error messages, and email it as a question to the questions@FreeBSD.org mailing list. If you are unfamiliar with FreeBSD's directory layout, please refer to the hier(7) manual page. If you are not familiar with manual pages, type `man man'. You may also use sysinstall(8) to re-enter the installation and configuration utility. Edit /etc/motd to change this login announcement. leopard3# ~test/keepalive.sh Thu Oct 21 09:09:04 CEST 2010 9:09AM up 58 secs, 1 user, load averages: 1.20, 0.51, 0.20 lock order reversal: 1st 0xd95c6320 bufwait (bufwait) @ /mnt/pho/src/sys/kern/vfs_bio.c:2659 2nd 0xc68d2e00 dirhash (dirhash) @ /mnt/pho/src/sys/ufs/ufs/ufs_dirhash.c:283 KDB: stack backtrace: db_trace_self_wrapper(c0ce81fb,7366752f,7366752f,7366752f,7269645f,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f3fdb,c0ceb478,c5526168,c5529d88,e7f2a7e8,...) at kdb_backtrace+0x2a _witness_debugger(c0ceb478,c68d2e00,c0d10227,c5529d88,c0d0fea8,...) at _witness_debugger+0x25 witness_checkorder(c68d2e00,9,c0d0fea8,11b,0,...) at witness_checkorder+0x839 _sx_xlock(c68d2e00,0,c0d0fea8,11b,c6a61414,...) at _sx_xlock+0x85 ufsdirhash_acquire(d95c62c0,dbec0800,200,dbec0818,e7f2a8b8,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c6a61414,e7f2a914,818,e7f2a8a4,e7f2a8a8,...) at ufsdirhash_add+0x13 ufs_direnter(c6a642b8,c6c6ed98,e7f2a914,e7f2aba4,0,...) at ufs_direnter+0x749 ufs_makeinode(e7f2aba4,c0dfa000,e7f2ab00,e7f2aa5c,c0c20c95,...) at ufs_makeinode+0x5c5 ufs_create(e7f2ab00,c0d26972,0,0,e7f2ab78,...) at ufs_create+0x30 VOP_CREATE_APV(c0df9ac0,e7f2ab00,e7f2aba4,e7f2aa98,0,...) at VOP_CREATE_APV+0xc5 vn_open_cred(e7f2ab78,e7f2ac2c,1b0,0,c65a8b80,...) at vn_open_cred+0x205 vn_open(e7f2ab78,e7f2ac2c,1b0,c66a41f8,0,...) at vn_open+0x3b kern_openat(c69d1870,ffffff9c,bfbfe7b4,0,201,...) at kern_openat+0x128 kern_open(c69d1870,bfbfe7b4,0,200,1b0,...) at kern_open+0x35 open(c69d1870,e7f2acec,e7f2ad28,c0ce9cd3,0,...) at open+0x30 syscallenter(c69d1870,e7f2ace4,e7f2ace4,0,0,...) at syscallenter+0x263 syscall(e7f2ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x28187083, esp = 0xbfbfe6fc, ebp = 0xbfbfe838 --- Thu Oct 21 09:19:04 CEST 2010 9:19AM up 11 mins, 2 users, load averages: 0.59, 8.30, 8.60 Thu Oct 21 09:29:04 CEST 2010 9:29AM up 21 mins, 2 users, load averages: 0.69, 1.53, 4.46 Thu Oct 21 09:39:04 CEST 2010 9:39AM up 31 mins, 2 users, load averages: 0.02, 0.37, 2.33 Thu Oct 21 09:49:05 CEST 2010 9:49AM up 41 mins, 2 users, load averages: 0.01, 0.22, 1.29 Thu Oct 21 09:59:09 CEST 2010 9:59AM up 51 mins, 2 users, load averages: 23.46, 9.24, 4.32 Thu Oct 21 10:09:15 CEST 2010 10:09AM up 1:01, 2 users, load averages: 2.00, 9.71, 8.64 Thu Oct 21 10:19:27 CEST 2010 10:19AM up 1:11, 2 users, load averages: 16.17, 46.41, 32.42 Thu Oct 21 10:29:29 CEST 2010 10:29AM up 1:21, 2 users, load averages: 0.39, 6.77, 16.38 Thu Oct 21 10:39:29 CEST 2010 10:39AM up 1:31, 2 users, load averages: 0.45, 1.28, 8.37 Thu Oct 21 10:50:10 CEST 2010 10:50AM up 1:42, 2 users, load averages: 9.35, 5.15, 6.11 Thu Oct 21 11:00:19 CEST 2010 11:00AM up 1:52, 2 users, load averages: 183.37, 488.76, 236.33 Thu Oct 21 11:10:19 CEST 2010 11:10AM up 2:02, 2 users, load averages: 15.32, 71.81, 119.22 Thu Oct 21 11:20:20 CEST 2010 11:20AM up 2:12, 2 users, load averages: 20.03, 19.89, 63.56 Thu Oct 21 11:30:22 CEST 2010 11:30AM up 2:22, 2 users, load averages: 15.26, 18.63, 41.24 Thu Oct 21 11:40:24 CEST 2010 11:40AM up 2:32, 2 users, load averages: 25.58, 20.42, 29.51 Thu Oct 21 11:50:34 CEST 2010 11:50AM up 2:42, 2 users, load averages: 90.33, 143.21, 84.84 Thu Oct 21 12:00:34 CEST 2010 12:00PM up 2:52, 2 users, load averages: 0.02, 19.55, 42.15 Thu Oct 21 12:10:34 CEST 2010 12:10PM up 3:02, 2 users, load averages: 0.16, 2.71, 20.77 Thu Oct 21 12:20:34 CEST 2010 12:20PM up 3:12, 2 users, load averages: 0.34, 0.59, 10.48 Thu Oct 21 12:30:34 CEST 2010 12:30PM up 3:22, 2 users, load averages: 0.21, 0.28, 5.23 Thu Oct 21 12:40:34 CEST 2010 12:40PM up 3:32, 2 users, load averages: 0.39, 0.35, 2.74 Thu Oct 21 12:50:34 CEST 2010 12:50PM up 3:42, 2 users, load averages: 0.17, 0.52, 1.69 Thu Oct 21 13:00:44 CEST 2010 1:00PM up 3:53, 2 users, load averages: 10.38, 7.36, 4.05 Thu Oct 21 13:10:45 CEST 2010 1:10PM up 4:03, 2 users, load averages: 9.40, 5.94, 4.14 Thu Oct 21 13:20:47 CEST 2010 1:20PM up 4:13, 2 users, load averages: 73.13, 28.76, 14.71 Thu Oct 21 13:30:48 CEST 2010 1:30PM up 4:23, 2 users, load averages: 4.04, 31.96, 29.33 Thu Oct 21 13:40:48 CEST 2010 1:40PM up 4:33, 2 users, load averages: 0.22, 4.45, 14.48 Thu Oct 21 13:50:48 CEST 2010 1:50PM up 4:43, 2 users, load averages: 0.48, 0.91, 7.35 Thu Oct 21 14:00:48 CEST 2010 2:00PM up 4:53, 2 users, load averages: 0.16, 0.38, 3.77 Thu Oct 21 14:10:49 CEST 2010 2:10PM up 5:03, 2 users, load averages: 10.55, 5.85, 4.31 Expensive timeout(9) function: 0xc091fc20(0) 0.188929039 s Expensive timeout(9) function: 0xc0a484b0(0xc6fb9c58) 0.239968208 s Thu Oct 21 14:21:01 CEST 2010 2:21PM up 5:13, 2 users, load averages: 17.41, 72.72, 46.05 Thu Oct 21 14:31:02 CEST 2010 2:31PM up 5:23, 2 users, load averages: 5.59, 14.53, 25.22 Thu Oct 21 14:41:02 CEST 2010 2:41PM up 5:33, 2 users, load averages: 10.67, 4.85, 13.72 Thu Oct 21 14:51:13 CEST 2010 2:51PM up 5:43, 2 users, load averages: 9.85, 15.11, 15.70 Thu Oct 21 15:01:14 CEST 2010 3:01PM up 5:53, 2 users, load averages: 3.09, 10.46, 13.18 Thu Oct 21 15:12:50 CEST 2010 3:12PM up 6:05, 2 users, load averages: 167.71, 91.27, 45.27 Thu Oct 21 15:23:02 CEST 2010 3:23PM up 6:15, 2 users, load averages: 0.34, 62.77, 75.30 Thu Oct 21 15:33:03 CEST 2010 3:33PM up 6:25, 2 users, load averages: 0.34, 8.77, 37.24 Thu Oct 21 15:43:05 CEST 2010 3:43PM up 6:35, 2 users, load averages: 0.01, 1.32, 18.33 Thu Oct 21 15:54:12 CEST 2010 3:54PM up 6:46, 2 users, load averages: 7.67, 5.79, 11.21 Thu Oct 21 16:04:13 CEST 2010 4:04PM up 6:56, 2 users, load averages: 0.02, 1.02, 5.75 Thu Oct 21 16:15:35 CEST 2010 4:15PM up 7:07, 2 users, load averages: 3.29, 4.72, 5.60 Thu Oct 21 16:25:37 CEST 2010 4:25PM up 7:18, 2 users, load averages: 64.32, 44.03, 22.24 Thu Oct 21 16:35:38 CEST 2010 4:35PM up 7:28, 2 users, load averages: 2.17, 28.59, 29.88 Thu Oct 21 16:46:09 CEST 2010 4:46PM up 7:38, 2 users, load averages: 22.75, 15.83, 19.48 Thu Oct 21 16:56:21 CEST 2010 4:56PM up 7:48, 2 users, load averages: 1.02, 5.70, 11.93 Thu Oct 21 17:06:21 CEST 2010 5:06PM up 7:58, 2 users, load averages: 12.86, 6.15, 8.03 Thu Oct 21 17:16:31 CEST 2010 5:16PM up 8:08, 2 users, load averages: 8.89, 4.69, 6.05 Thu Oct 21 17:27:19 CEST 2010 5:27PM up 8:19, 2 users, load averages: 7.78, 13.40, 11.15 Thu Oct 21 17:38:06 CEST 2010 5:38PM up 8:30, 2 users, load averages: 16.88, 14.16, 11.49 Thu Oct 21 17:48:20 CEST 2010 5:48PM up 8:40, 2 users, load averages: 10.76, 15.82, 13.56 Thu Oct 21 17:58:21 CEST 2010 5:58PM up 8:50, 2 users, load averages: 0.12, 2.33, 6.86 Thu Oct 21 18:08:21 CEST 2010 6:08PM up 9 hrs, 2 users, load averages: 0.40, 0.60, 3.53 Thu Oct 21 18:18:21 CEST 2010 6:18PM up 9:10, 2 users, load averages: 1.60, 0.96, 2.16 Thu Oct 21 18:28:21 CEST 2010 6:28PM up 9:20, 2 users, load averages: 0.48, 0.39, 1.23 Thu Oct 21 18:38:47 CEST 2010 6:38PM up 9:31, 2 users, load averages: 7.30, 3.54, 2.05 Thu Oct 21 18:48:47 CEST 2010 6:48PM up 9:41, 2 users, load averages: 0.25, 0.70, 1.11 Thu Oct 21 18:58:53 CEST 2010 6:58PM up 9:51, 2 users, load averages: 16.90, 10.96, 5.80 lock order reversal: 1st 0xc6fa9120 so_snd_sx (so_snd_sx) @ /mnt/pho/src/sys/kern/uipc_sockbuf.c:148 2nd 0xd94e5be0 bufwait (bufwait) @ /mnt/pho/src/sys/vm/vm_pager.c:311 KDB: stack backtrace: db_trace_self_wrapper(c0ce81fb,2f6d762f,705f6d76,72656761,333a632e,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08f3fdb,c0ceb478,c5529770,c5526168,e80a06b4,...) at kdb_backtrace+0x2a _witness_debugger(c0ceb478,d94e5be0,c0cf0d23,c5526168,c0d14811,...) at _witness_debugger+0x25 witness_checkorder(d94e5be0,9,c0d14811,137,0,...) at witness_checkorder+0x839 __lockmgr_args(d94e5be0,80000,0,0,0,...) at __lockmgr_args+0x814 initpbuf(c0fc4574,0,c0d14811,162,0,...) at initpbuf+0xe0 getpbuf(c0fc2c70,0,c0d111f0,486,0,...) at getpbuf+0x12f swap_pager_getpages(c75416e8,e80a08e0,3,2,e80a0964,...) at swap_pager_getpages+0x1bd vm_fault(c6ea9a24,28477000,1,0,284770a8,...) at vm_fault+0x105f trap_pfault(5,0,c0d21cf2,c0f86060,c7bcdaa0,...) at trap_pfault+0x10d trap(e80a0a60) at trap+0x4c5 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0xc0c01b22, esp = 0xe80a0aa0, ebp = 0xe80a0ad8 --- copyin(c6e84518,4,e80a0c28,1,0,...) at copyin+0x32 m_uiotombuf(e80a0c28,2,e800,0,0,...) at m_uiotombuf+0xf6 sosend_generic(c6fa9000,0,e80a0c28,0,0,...) at sosend_generic+0x432 sosend(c6fa9000,0,e80a0c28,0,0,...) at sosend+0x3f soo_write(c668f8c0,e80a0c28,c65a8b80,0,c6b8c000,...) at soo_write+0x63 dofilewrite(e80a0c28,ffffffff,ffffffff,0,c668f8c0,...) at dofilewrite+0x95 kern_writev(c6b8c000,3,e80a0c28,e80a0c48,1,...) at kern_writev+0x58 write(c6b8c000,e80a0cec,e80a0d28,c0ce9cd3,0,...) at write+0x4f syscallenter(c6b8c000,e80a0ce4,e80a0ce4,0,ec,...) at syscallenter+0x263 syscall(e80a0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28194243, esp = 0xbfbfe92c, ebp = 0xbfbfe978 --- Thu Oct 21 19:09:03 CEST 2010 7:09PM up 10:01, 2 users, load averages: 13.22, 39.85, 25.59 Thu Oct 21 19:20:07 CEST 2010 7:20PM up 10:12, 2 users, load averages: 66.23, 62.30, 42.58 Thu Oct 21 19:30:08 CEST 2010 7:30PM up 10:22, 2 users, load averages: 0.46, 18.69, 31.14 Thu Oct 21 19:40:08 CEST 2010 7:40PM up 10:32, 2 users, load averages: 0.58, 2.90, 15.66 Thu Oct 21 19:50:51 CEST 2010 7:50PM up 10:43, 2 users, load averages: 22.57, 10.86, 11.75 Thu Oct 21 20:00:52 CEST 2010 8:00PM up 10:53, 2 users, load averages: 13.85, 14.48, 14.04 Thu Oct 21 20:10:59 CEST 2010 8:10PM up 11:03, 2 users, load averages: 5.39, 115.37, 95.07 Thu Oct 21 20:21:02 CEST 2010 8:21PM up 11:13, 2 users, load averages: 0.17, 17.98, 48.80 Thu Oct 21 20:31:03 CEST 2010 8:31PM up 11:23, 2 users, load averages: 9.63, 13.11, 30.07 Thu Oct 21 20:41:42 CEST 2010 8:41PM up 11:34, 2 users, load averages: 5.09, 11.68, 20.74 Thu Oct 21 20:52:05 CEST 2010 8:52PM up 11:44, 2 users, load averages: 14.81, 8.65, 13.29 Thu Oct 21 21:02:14 CEST 2010 9:02PM up 11:54, 2 users, load averages: 0.28, 6.51, 10.83 Thu Oct 21 21:12:15 CEST 2010 9:12PM up 12:04, 2 users, load averages: 0.44, 1.25, 5.56 Thu Oct 21 21:22:15 CEST 2010 9:22PM up 12:14, 2 users, load averages: 1.35, 0.79, 3.06 Thu Oct 21 21:32:15 CEST 2010 9:32PM up 12:24, 2 users, load averages: 0.04, 0.30, 1.63 Thu Oct 21 21:42:16 CEST 2010 9:42PM up 12:34, 2 users, load averages: 0.67, 0.62, 1.13 Thu Oct 21 21:53:13 CEST 2010 9:53PM up 12:45, 2 users, load averages: 13.70, 12.90, 7.06 Thu Oct 21 22:03:14 CEST 2010 10:03PM up 12:55, 2 users, load averages: 51.40, 109.52, 72.93 Thu Oct 21 22:13:16 CEST 2010 10:13PM up 13:05, 2 users, load averages: 0.07, 14.57, 35.92 Thu Oct 21 22:23:17 CEST 2010 10:23PM up 13:15, 2 users, load averages: 0.42, 2.14, 17.74 Thu Oct 21 22:33:17 CEST 2010 10:33PM up 13:25, 2 users, load averages: 0.37, 0.53, 8.73 Thu Oct 21 22:43:17 CEST 2010 10:43PM up 13:35, 2 users, load averages: 0.31, 0.29, 4.45 Thu Oct 21 22:53:17 CEST 2010 10:53PM up 13:45, 2 users, load averages: 0.16, 0.18, 2.28 Thu Oct 21 23:03:17 CEST 2010 11:03PM up 13:55, 2 users, load averages: 0.42, 0.32, 1.27 Thu Oct 21 23:14:42 CEST 2010 11:14PM up 14:07, 2 users, load averages: 17.68, 14.23, 7.53 Thu Oct 21 23:24:42 CEST 2010 11:24PM up 14:17, 2 users, load averages: 160.10, 240.03, 122.18 Thu Oct 21 23:34:42 CEST 2010 11:34PM up 14:27, 2 users, load averages: 1.44, 37.05, 63.40 Thu Oct 21 23:44:42 CEST 2010 11:44PM up 14:37, 2 users, load averages: 6.38, 9.76, 33.52 Thu Oct 21 23:54:43 CEST 2010 11:54PM up 14:47, 2 users, load averages: 2.16, 12.66, 24.97 Fri Oct 22 00:05:14 CEST 2010 12:05AM up 14:57, 2 users, load averages: 19.86, 14.84, 19.23 Fri Oct 22 00:15:27 CEST 2010 12:15AM up 15:07, 2 users, load averages: 0.09, 6.22, 13.51 Fri Oct 22 00:25:27 CEST 2010 12:25AM up 15:17, 2 users, load averages: 0.36, 1.01, 6.69 Fri Oct 22 00:35:27 CEST 2010 12:35AM up 15:27, 2 users, load averages: 1.24, 0.73, 3.57 Fri Oct 22 00:45:27 CEST 2010 12:45AM up 15:37, 2 users, load averages: 1.32, 0.79, 2.12 Fri Oct 22 00:55:27 CEST 2010 12:55AM up 15:47, 2 users, load averages: 0.01, 0.18, 1.09 Fri Oct 22 01:05:27 CEST 2010 1:05AM up 15:57, 2 users, load averages: 0.61, 0.46, 0.80 Fri Oct 22 01:17:55 CEST 2010 1:17AM up 16:10, 2 users, load averages: 74.20, 54.15, 25.82 Fri Oct 22 01:28:28 CEST 2010 1:28AM up 16:20, 2 users, load averages: 78.21, 62.41, 39.60 Fri Oct 22 01:38:28 CEST 2010 1:38AM up 16:30, 2 users, load averages: 0.53, 15.65, 27.04 Fri Oct 22 01:48:49 CEST 2010 1:48AM up 16:41, 2 users, load averages: 14.21, 7.78, 15.34 Fri Oct 22 01:58:50 CEST 2010 1:58AM up 16:51, 2 users, load averages: 12.77, 61.62, 48.13 Fri Oct 22 02:08:50 CEST 2010 2:08AM up 17:01, 2 users, load averages: 7.89, 12.80, 25.81 Fri Oct 22 02:18:50 CEST 2010 2:18AM up 17:11, 2 users, load averages: 0.01, 2.30, 13.39 Fri Oct 22 02:28:51 CEST 2010 2:28AM up 17:21, 2 users, load averages: 18.53, 15.37, 14.60 Fri Oct 22 02:40:39 CEST 2010 2:40AM up 17:33, 2 users, load averages: 20.82, 17.14, 14.67 Fri Oct 22 02:50:45 CEST 2010 2:50AM up 17:43, 2 users, load averages: 60.35, 419.95, 213.83 Fri Oct 22 03:00:46 CEST 2010 3:00AM up 17:53, 2 users, load averages: 0.37, 57.64, 106.48 Fri Oct 22 03:10:46 CEST 2010 3:10AM up 18:03, 2 users, load averages: 0.39, 7.90, 52.45 Fri Oct 22 03:20:46 CEST 2010 3:20AM up 18:13, 2 users, load averages: 0.54, 1.38, 25.79 Fri Oct 22 03:30:46 CEST 2010 3:30AM up 18:23, 2 users, load averages: 0.00, 0.27, 12.66 Fri Oct 22 03:40:46 CEST 2010 3:40AM up 18:33, 2 users, load averages: 0.53, 0.43, 6.42 Fri Oct 22 03:50:49 CEST 2010 3:50AM up 18:43, 2 users, load averages: 19.43, 10.67, 7.75 Fri Oct 22 04:01:33 CEST 2010 4:01AM up 18:53, 2 users, load averages: 42.15, 26.60, 16.24 Fri Oct 22 04:11:33 CEST 2010 4:11AM up 19:03, 2 users, load averages: 0.17, 4.65, 9.18 Fri Oct 22 04:21:33 CEST 2010 4:21AM up 19:13, 2 users, load averages: 0.11, 0.75, 4.58 Fri Oct 22 04:31:33 CEST 2010 4:31AM up 19:23, 2 users, load averages: 0.13, 0.20, 2.29 Fri Oct 22 04:41:33 CEST 2010 4:41AM up 19:33, 2 users, load averages: 0.18, 0.16, 1.19 Fri Oct 22 04:51:33 CEST 2010 4:51AM up 19:43, 2 users, load averages: 0.49, 0.28, 0.72 Fri Oct 22 05:03:43 CEST 2010 5:03AM up 19:56, 2 users, load averages: 18.59, 13.54, 6.63 Fri Oct 22 05:13:48 CEST 2010 5:13AM up 20:06, 2 users, load averages: 0.11, 3.24, 4.39 Fri Oct 22 05:23:49 CEST 2010 5:23AM up 20:16, 2 users, load averages: 3.11, 6.01, 5.26 Fri Oct 22 05:33:49 CEST 2010 5:33AM up 20:26, 2 users, load averages: 0.00, 0.86, 2.64 Fri Oct 22 05:43:52 CEST 2010 5:43AM up 20:36, 2 users, load averages: 33.85, 23.78, 13.48 Fri Oct 22 05:55:31 CEST 2010 5:55AM up 20:47, 2 users, load averages: 9.79, 12.22, 13.56 Fri Oct 22 06:05:42 CEST 2010 6:05AM up 20:58, 2 users, load averages: 2.63, 7.69, 10.03 Fri Oct 22 06:15:43 CEST 2010 6:15AM up 21:08, 2 users, load averages: 0.30, 1.30, 5.08 Fri Oct 22 06:25:44 CEST 2010 6:25AM up 21:18, 2 users, load averages: 0.42, 0.51, 2.67 Fri Oct 22 06:35:44 CEST 2010 6:35AM up 21:28, 2 users, load averages: 0.94, 0.47, 1.50 Fri Oct 22 06:47:26 CEST 2010 6:47AM up 21:39, 2 users, load averages: 12.32, 14.90, 8.62 Fri Oct 22 06:57:29 CEST 2010 6:57AM up 21:49, 2 users, load averages: 1.39, 5.36, 6.70 Fri Oct 22 07:07:43 CEST 2010 7:07AM up 22 hrs, 2 users, load averages: 13.08, 37.54, 29.10 Fri Oct 22 07:17:44 CEST 2010 7:17AM up 22:10, 2 users, load averages: 0.39, 5.51, 14.70 Fri Oct 22 07:27:44 CEST 2010 7:27AM up 22:20, 2 users, load averages: 0.30, 1.00, 7.38 Fri Oct 22 07:37:44 CEST 2010 7:37AM up 22:30, 2 users, load averages: 2.05, 0.91, 4.02 Fri Oct 22 07:47:44 CEST 2010 7:47AM up 22:40, 2 users, load averages: 20.85, 39.77, 24.58 Fri Oct 22 07:57:46 CEST 2010 7:57AM up 22:50, 2 users, load averages: 0.14, 5.59, 12.30 Fri Oct 22 08:07:47 CEST 2010 8:07AM up 23 hrs, 2 users, load averages: 0.73, 5.19, 9.17 Fri Oct 22 08:17:47 CEST 2010 8:17AM up 23:10, 2 users, load averages: 10.62, 8.65, 8.71 Fri Oct 22 08:27:48 CEST 2010 8:27AM up 23:20, 2 users, load averages: 4.15, 12.39, 12.53 Fri Oct 22 08:37:48 CEST 2010 8:37AM up 23:30, 2 users, load averages: 7.96, 11.92, 12.17 Fri Oct 22 08:47:48 CEST 2010 8:47AM up 23:40, 2 users, load averages: 0.34, 4.89, 9.10 Fri Oct 22 08:57:48 CEST 2010 8:57AM up 23:50, 2 users, load averages: 0.32, 0.88, 4.60 Fri Oct 22 09:07:48 CEST 2010 9:07AM up 1 day, 13 secs, 2 users, load averages: 0.63, 0.51, 2.47 Fri Oct 22 09:17:48 CEST 2010 9:17AM up 1 day, 10 mins, 2 users, load averages: 0.72, 0.79, 1.65 Fri Oct 22 09:27:48 CEST 2010 9:27AM up 1 day, 20 mins, 2 users, load averages: 0.02, 0.26, 0.92 Fri Oct 22 09:37:59 CEST 2010 9:37AM up 1 day, 30 mins, 2 users, load averages: 0.10, 0.28, 0.58 Fri Oct 22 09:48:00 CEST 2010 9:48AM up 1 day, 40 mins, 2 users, load averages: 12.91, 11.69, 5.64 Fri Oct 22 09:58:07 CEST 2010 9:58AM up 1 day, 50 mins, 2 users, load averages: 0.80, 5.51, 6.98 Fri Oct 22 10:08:50 CEST 2010 10:08AM up 1 day, 1:01, 2 users, load averages: 33.47, 47.85, 31.91 Fri Oct 22 10:18:50 CEST 2010 10:18AM up 1 day, 1:11, 2 users, load averages: 0.46, 7.22, 16.43 Fri Oct 22 10:28:51 CEST 2010 10:28AM up 1 day, 1:21, 2 users, load averages: 11.84, 4.28, 9.46 Fri Oct 22 10:40:58 CEST 2010 10:40AM up 1 day, 1:33, 2 users, load averages: 21.68, 96.87, 76.16 Read from remote host zoo.freebsd.org: Operation timed out Connection to zoo.freebsd.org closed. Fri Oct 22 16:30:59 CEST 2010 4:30PM up 1 day, 7:23, 2 users, load averages: 4.05, 13.00, 7.51 Fri Oct 22 16:40:59 CEST 2010 4:40PM up 1 day, 7:33, 2 users, load averages: 0.37, 2.13, 3.94 Fri Oct 22 16:51:00 CEST 2010 4:51PM up 1 day, 7:43, 2 users, load averages: 0.58, 0.87, 2.25 Fri Oct 22 17:01:01 CEST 2010 5:01PM up 1 day, 7:53, 2 users, load averages: 0.00, 0.95, 1.99 Fri Oct 22 17:11:12 CEST 2010 5:11PM up 1 day, 8:03, 2 users, load averages: 3.40, 11.53, 8.05 Fri Oct 22 17:21:13 CEST 2010 5:21PM up 1 day, 8:13, 2 users, load averages: 42.79, 22.36, 13.74 Fri Oct 22 17:31:13 CEST 2010 5:31PM up 1 day, 8:23, 2 users, load averages: 5.57, 32.25, 29.06 Fri Oct 22 17:41:13 CEST 2010 5:41PM up 1 day, 8:33, 2 users, load averages: 0.31, 4.54, 14.45 Fri Oct 22 17:51:14 CEST 2010 5:51PM up 1 day, 8:43, 2 users, load averages: 12.99, 5.01, 8.81 Fri Oct 22 18:01:18 CEST 2010 6:01PM up 1 day, 8:53, 2 users, load averages: 11.91, 11.80, 10.96 Fri Oct 22 18:11:19 CEST 2010 6:11PM up 1 day, 9:03, 2 users, load averages: 0.05, 2.10, 5.90 Fri Oct 22 18:21:20 CEST 2010 6:21PM up 1 day, 9:13, 2 users, load averages: 0.46, 4.45, 5.99 panic: Bad link elm 0xc77552d0 prev->next != elm cpuid = 1 KDB: enter: panic [ thread pid 82295 tid 100437 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> Read from remote host zoo.freebsd.org: Operation timed out Connection to zoo.freebsd.org closed. $ ssh -Y zoo.freebsd.org Connected to pm25. Escape character is '^]'. bt Tracing pid 82295 tid 100437 td 0xc77552d0 kdb_enter(c0ce4b9a,c0ce4b9a,c0c7aa69,e8420c20,1,...) at kdb_enter+0x3a panic(c0c7aa69,c77552d0,3dd,c6c94d48,e8420c50,...) at panic+0x134 tidhash_remove(c77552d0,e2e0ac49,7fffffff,0,c6c94d48,...) at tidhash_remove+0x5e thr_exit(c77552d0,e8420cec,e8420d28,c0ce9cd3,0,...) at thr_exit+0x4e syscallenter(c77552d0,e8420ce4,e8420ce4,0,0,...) at syscallenter+0x263 syscall(e8420d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (431, FreeBSD ELF32, thr_exit), eip = 0x280edaa1, esp = 0xbfbfe990, ebp = 0xbfbfe9d8 --- db> run pho db:0:pho> bt Tracing pid 82295 tid 100437 td 0xc77552d0 kdb_enter(c0ce4b9a,c0ce4b9a,c0c7aa69,e8420c20,1,...) at kdb_enter+0x3a panic(c0c7aa69,c77552d0,3dd,c6c94d48,e8420c50,...) at panic+0x134 tidhash_remove(c77552d0,e2e0ac49,7fffffff,0,c6c94d48,...) at tidhash_remove+0x5e thr_exit(c77552d0,e8420cec,e8420d28,c0ce9cd3,0,...) at thr_exit+0x4e syscallenter(c77552d0,e8420ce4,e8420ce4,0,0,...) at syscallenter+0x263 syscall(e8420d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (431, FreeBSD ELF32, thr_exit), eip = 0x280edaa1, esp = 0xbfbfe990, ebp = 0xbfbfe9d8 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x60ff80 curthread = 0xc7dd0000: pid 82293 "syscall" curpcb = 0xe819cd80 fpcurthread = none idlethread = 0xc55815a0: tid 100004 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x43d1f80 curthread = 0xc77552d0: pid 82295 "syscall" curpcb = 0xe8420d80 fpcurthread = none idlethread = 0xc5581870: tid 100003 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 82296 (syscall) thread 0xc76a4870 (100370) exclusive lockmgr bufwait (bufwait) r = 0 (0xd969d9c0) locked @ /mnt/pho/src/sys/kern/vfs_bio.c:2659 exclusive lockmgr bufwait (bufwait) r = 0 (0xd96c56c0) locked @ /mnt/pho/src/sys/kern/vfs_bio.c:1912 exclusive lockmgr ufs (ufs) r = 0 (0xc8fd19dc) locked @ /mnt/pho/src/sys/ufs/ffs/ffs_vfsops.c:1504 exclusive lockmgr ufs (ufs) r = 0 (0xc69ec724) locked @ /mnt/pho/src/sys/kern/vfs_lookup.c:501 Process 82295 (syscall) thread 0xc77552d0 (100437) exclusive rw tidhash (tidhash) r = 0 (0xc0e4a0e8) locked @ /mnt/pho/src/sys/kern/kern_thread.c:989 Process 82293 (syscall) thread 0xc7dd0000 (100288) shared sx user map (user map) r = 0 (0xc55897a8) locked @ /mnt/pho/src/sys/vm/vm_map.c:3552 Process 79449 (sshd) thread 0xc68bd000 (100099) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc6de3898) locked @ /mnt/pho/src/sys/kern/uipc_sockbuf.c:148 db:0:alllocks> show lockedvnods Locked vnodes 0xc69ec6cc: tag ufs, type VDIR usecount 59, writecount 0, refcount 62 mountedhere 0 flags () v_object 0xc68f2d48 ref 0 pages 1 lock type ufs: EXCL by thread 0xc76a4870 (pid 82296) with shared waiters pending #0 0xc08a4e65 at __lockmgr_args+0x5a5 #1 0xc0b0eca1 at ffs_lock+0xa1 #2 0xc0c1fcc5 at VOP_LOCK1_APV+0xb5 #3 0xc09617d8 at _vn_lock+0x78 #4 0xc0946c56 at lookup+0x106 #5 0xc0948032 at namei+0x592 #6 0xc09585d1 at kern_mkdirat+0x71 #7 0xc095884e at kern_mkdir+0x2e #8 0xc0958879 at mkdir+0x29 #9 0xc08fd3b3 at syscallenter+0x263 #10 0xc0c03daf at syscall+0x4f #11 0xc0beb3b1 at Xint0x80_syscall+0x21 ino 21903360, on dev ad4d 0xc8fd1984: tag ufs, type VDIR usecount 1, writecount 0, refcount 2 mountedhere 0 flags () lock type ufs: EXCL by thread 0xc76a4870 (pid 82296) #0 0xc08a54be at __lockmgr_args+0xbfe #1 0xc0b09489 at ffs_vgetf+0x189 #2 0xc0b098ae at ffs_vget+0x2e #3 0xc0ae2689 at ffs_valloc+0x4f9 #4 0xc0b21399 at ufs_mkdir+0xa9 #5 0xc0c20145 at VOP_MKDIR_APV+0xc5 #6 0xc0958785 at kern_mkdirat+0x225 #7 0xc095884e at kern_mkdir+0x2e #8 0xc0958879 at mkdir+0x29 #9 0xc08fd3b3 at syscallenter+0x263 #10 0xc0c03daf at syscall+0x4f #11 0xc0beb3b1 at Xint0x80_syscall+0x21 ino 21903382, on dev ad4d db:0:lockedvnods> show mount 0xc6302b50 192.168.5.1:/zoo/leopard3 on / (nfs) 0xc6303000 devfs on /dev (devfs) 0xc630287c /dev/ad4d on /work (ufs) 0xc63025a8 /dev/md0 on /var (ufs) 0xc63022d4 /dev/md1 on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 82336 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82335 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82334 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82333 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82332 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82331 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82330 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82329 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82328 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82327 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82326 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82325 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82324 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82323 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82322 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82321 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82320 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82319 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82318 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82317 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82316 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82315 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82314 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82313 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82312 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82311 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82310 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82309 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82308 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82307 82294 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82306 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82305 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82304 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82303 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82302 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82301 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82300 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82299 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82298 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82297 82292 79456 1001 D+ ufs 0xc69ec724 syscall 82296 82292 79456 1001 D+ biowr 0xd969d960 syscall 82295 82292 79456 1001 R+ CPU 1 syscall 82294 82290 79456 1001 S+ wait 0xc6a95550 swap 82293 82292 79456 1001 R+ CPU 0 syscall 82292 82291 79456 1001 S+ wait 0xc6b0f7f8 syscall 82291 82138 79456 1001 S+ nanslp 0xc0e4a1c4 syscall 82290 82138 79456 1001 S+ nanslp 0xc0e4a1c4 swap 82138 82137 79456 1001 S+ wait 0xc63682a8 run 82137 82136 79456 1001 SW+ wait 0xc6e41000 run 82136 82130 79456 1001 S+ nanslp 0xc0e4a1c4 run 82130 79456 79456 1001 SW+ wait 0xc62af7f8 sh 82064 1210 1210 0 SW+ nanslp 0xc0e4a1c4 sleep 79456 79455 79456 1001 SW+ wait 0xc65f4550 sh 79455 79454 79455 1001 SWs+ wait 0xc65fa550 sh 79454 79449 79449 1001 S select 0xc6cbae64 sshd 79449 1112 79449 0 SWs sbwait 0xc6de38c4 sshd 1210 1206 1210 0 SW+ wait 0xc6728550 sh 1206 1205 1206 0 SW+ pause 0xc6729058 csh 1205 1 1205 0 SWs+ wait 0xc6789550 login 1204 1 1204 0 Ss+ ttyin 0xc56f3670 getty 1203 1 1203 0 Ss+ ttyin 0xc56f3870 getty 1202 1 1202 0 Ss+ ttyin 0xc56f3a70 getty 1201 1 1201 0 Ss+ ttyin 0xc56f3c70 getty 1200 1 1200 0 Ss+ ttyin 0xc56f3e70 getty 1199 1 1199 0 Ss+ ttyin 0xc5819070 getty 1198 1 1198 0 Ss+ ttyin 0xc5819270 getty 1197 1 1197 0 Ss+ ttyin 0xc5819470 getty 1131 1 1131 0 Ss nanslp 0xc0e4a1c4 cron 1124 1 1124 25 SWs pause 0xc6714af8 sendmail 1120 1 1120 0 Ss select 0xc687fc64 sendmail 1112 1 1112 0 Ss select 0xc65b6364 sshd 971 1 971 0 Ss select 0xc65b6464 rpc.statd 898 0 0 0 DL mdwait 0xc573a000 [md1] 843 1 843 0 Ss select 0xc687fca4 rpcbind 813 1 813 0 Ss select 0xc687f3a4 syslogd 634 1 634 0 Ss select 0xc65b65e4 devd 102 0 0 0 DL mdwait 0xc573a800 [md0] 20 0 0 0 DL flowclea 0xc0fb7328 [flowcleaner] 19 0 0 0 DL sdflush 0xc0fc2ae0 [softdepflush] 18 0 0 0 DL syncer 0xc0fb7138 [syncer] 17 0 0 0 DL vlruwt 0xc62acaa0 [vnlru] 16 0 0 0 DL psleep 0xc0fb6dc8 [bufdaemon] 15 0 0 0 DL pgzero 0xc0fc495c [pagezero] 9 0 0 0 DL psleep 0xc0fc4550 [vmdaemon] 8 0 0 0 DL psleep 0xc0fc4518 [pagedaemon] 7 0 0 0 DL ccb_scan 0xc0e15e54 [xpt_thrd] 6 0 0 0 DL waiting_ 0xc0fb8b58 [sctp_iterator] 5 0 0 0 DL - 0xc572c23c [fdc0] 14 0 0 0 DL (threaded) [usb] 100049 D - 0xc57d1d34 [usbus4] 100048 D - 0xc57d1d04 [usbus4] 100047 D - 0xc57d1cd4 [usbus4] 100046 D - 0xc57d1ca4 [usbus4] 100045 D - 0xc57bcdac [usbus3] 100044 D - 0xc57bcd7c [usbus3] 100043 D - 0xc57bcd4c [usbus3] 100042 D - 0xc57bcd1c [usbus3] 100040 D - 0xc57aadac [usbus2] 100039 D - 0xc57aad7c [usbus2] 100038 D - 0xc57aad4c [usbus2] 100037 D - 0xc57aad1c [usbus2] 100035 D - 0xc5794dac [usbus1] 100034 D - 0xc5794d7c [usbus1] 100033 D - 0xc5794d4c [usbus1] 100032 D - 0xc5794d1c [usbus1] 100030 D - 0xc5777dac [usbus0] 100029 D - 0xc5777d7c [usbus0] 100028 D - 0xc5777d4c [usbus0] 100027 D - 0xc5777d1c [usbus0] 13 0 0 0 DL - 0xc0e4a004 [yarrow] 4 0 0 0 DL - 0xc0e47cc4 [g_down] 3 0 0 0 DL - 0xc0e47cc0 [g_up] 2 0 0 0 DL - 0xc0e47cb8 [g_event] 12 0 0 0 RL (threaded) [intr] 100053 I [irq1: atkbd0] 100051 I [swi0: uart uart] 100050 I [irq14: ata0] 100041 I [irq16: uhci3] 100036 I [irq18: uhci2] 100031 RunQ [irq19: uhci1+] 100026 I [irq23: uhci0 ehci0] 100023 I [irq9: acpi0] 100022 I [swi6: task queue] 100021 I [swi6: Giant taskq] 100019 I [swi5: +] 100017 I [swi2: cambio] 100008 I [swi4: clock] 100007 RunQ [swi4: clock] 100006 I [swi1: netisr 0] 100005 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100004 CanRun [idle: cpu0] 100003 CanRun [idle: cpu1] 1 0 1 0 SLs wait 0xc557fd48 [init] 10 0 0 0 DL audit_wo 0xc0fc2300 [audit] 0 0 0 0 DLs (threaded) [kernel] 100054 D deadlkre 0xc0e4a004 [deadlkres] 100025 D - 0xc5613b80 [em1 taskq] 100024 D - 0xc5613bc0 [em0 taskq] 100020 D - 0xc5613d00 [thread taskq] 100018 D - 0xc5613d80 [kqueue taskq] 100016 D - 0xc5613dc0 [acpi_task_2] 100015 D - 0xc5613dc0 [acpi_task_1] 100014 D - 0xc5613dc0 [acpi_task_0] 100009 D - 0xc5613e00 [firmware taskq] 100000 D sched 0xc0e47da0 [swapper] db:0:ps> allt Tracing command swap pid 82336 tid 100264 td 0xc64e5b40 sched_switch(c64e5b40,0,104,191,89175b80,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c64e5b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c64e5b40,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c64e5b40,e813ec34,e813ec3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c64e5b40,e813ecec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c64e5b40,e813ece4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e813ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82335 tid 100184 td 0xc6ac6b40 sched_switch(c6ac6b40,0,104,191,89182f78,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6ac6b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6ac6b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6ac6b40,e8008c34,e8008c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6ac6b40,e8008cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6ac6b40,e8008ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8008d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82334 tid 100452 td 0xc7982000 sched_switch(c7982000,0,104,191,89156978,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7982000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7982000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7982000,e8456c34,e8456c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7982000,e8456cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7982000,e8456ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8456d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82333 tid 100158 td 0xc6ad0b40 sched_switch(c6ad0b40,0,104,191,89162dc8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6ad0b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6ad0b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6ad0b40,e7fabc34,e7fabc3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6ad0b40,e7fabcec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6ad0b40,e7fabce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7fabd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82332 tid 100181 td 0xc6ac4000 sched_switch(c6ac4000,0,104,191,891383e0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6ac4000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6ac4000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6ac4000,e7ffec34,e7ffec3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6ac4000,e7ffecec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6ac4000,e7ffece4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7ffed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82331 tid 100223 td 0xc6b8c000 sched_switch(c6b8c000,0,104,191,89144628,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6b8c000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6b8c000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6b8c000,e80a0c34,e80a0c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6b8c000,e80a0cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6b8c000,e80a0ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e80a0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82330 tid 100471 td 0xc7ceeb40 sched_switch(c7ceeb40,0,104,191,89112970,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7ceeb40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7ceeb40,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7ceeb40,e84a0c34,e84a0c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7ceeb40,e84a0cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7ceeb40,e84a0ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e84a0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82329 tid 100078 td 0xc67182d0 sched_switch(c67182d0,0,104,191,89125a40,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c67182d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c67182d0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c67182d0,e7e54c34,e7e54c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c67182d0,e7e54cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c67182d0,e7e54ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7e54d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82328 tid 100094 td 0xc6776b40 sched_switch(c6776b40,0,104,191,890f21f8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6776b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6776b40,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6776b40,e7e97c34,e7e97c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6776b40,e7e97cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6776b40,e7e97ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7e97d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82327 tid 100072 td 0xc6718870 sched_switch(c6718870,0,104,191,89106150,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6718870,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6718870,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6718870,e7e3cc34,e7e3cc3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6718870,e7e3ccec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6718870,e7e3cce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7e3cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82326 tid 100266 td 0xc6b95b40 sched_switch(c6b95b40,0,104,191,890d2400,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6b95b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6b95b40,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6b95b40,e8144c34,e8144c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6b95b40,e8144cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6b95b40,e8144ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8144d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82325 tid 100122 td 0xc69d1b40 sched_switch(c69d1b40,0,104,191,890e5a18,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c69d1b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c69d1b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c69d1b40,e7f26c34,e7f26c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c69d1b40,e7f26cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c69d1b40,e7f26ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7f26d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82324 tid 100329 td 0xc7b872d0 sched_switch(c7b872d0,0,104,191,890b3160,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7b872d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7b872d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7b872d0,e8290c34,e8290c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7b872d0,e8290cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7b872d0,e8290ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8290d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82323 tid 100205 td 0xc6553b40 sched_switch(c6553b40,0,104,191,890c6958,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6553b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6553b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6553b40,e8066c34,e8066c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6553b40,e8066cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6553b40,e8066ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8066d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82322 tid 100336 td 0xc79d4000 sched_switch(c79d4000,0,104,191,890a8810,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c79d4000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c79d4000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c79d4000,e82f1c34,e82f1c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c79d4000,e82f1cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c79d4000,e82f1ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e82f1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82321 tid 100113 td 0xc68b92d0 sched_switch(c68b92d0,0,104,191,890933d0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c68b92d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c68b92d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c68b92d0,e7ef9c34,e7ef9c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c68b92d0,e7ef9cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c68b92d0,e7ef9ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7ef9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82320 tid 100282 td 0xc7cf0b40 sched_switch(c7cf0b40,0,104,191,89087d88,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7cf0b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7cf0b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7cf0b40,e818ac34,e818ac3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7cf0b40,e818acec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7cf0b40,e818ace4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e818ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82319 tid 100402 td 0xc74d85a0 sched_switch(c74d85a0,0,104,191,890735e0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c74d85a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c74d85a0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c74d85a0,e83b7c34,e83b7c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c74d85a0,e83b7cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c74d85a0,e83b7ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e83b7d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82318 tid 100415 td 0xc79f52d0 sched_switch(c79f52d0,0,104,191,89069380,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c79f52d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c79f52d0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c79f52d0,e83dec34,e83dec3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c79f52d0,e83decec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c79f52d0,e83dece4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e83ded28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82317 tid 100365 td 0xc7dd05a0 sched_switch(c7dd05a0,0,104,191,89053d68,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7dd05a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7dd05a0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7dd05a0,e8348c34,e8348c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7dd05a0,e8348cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7dd05a0,e8348ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8348d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82316 tid 100077 td 0xc62b9000 sched_switch(c62b9000,0,104,191,8904a308,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c62b9000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c62b9000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c62b9000,e7e50c34,e7e50c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c62b9000,e7e50cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c62b9000,e7e50ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7e50d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82315 tid 100391 td 0xc7be82d0 sched_switch(c7be82d0,0,104,191,89031730,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7be82d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7be82d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7be82d0,e8396c34,e8396c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7be82d0,e8396cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7be82d0,e8396ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8396d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82314 tid 100240 td 0xc65b45a0 sched_switch(c65b45a0,0,104,191,89029270,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c65b45a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c65b45a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c65b45a0,e80e2c34,e80e2c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c65b45a0,e80e2cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c65b45a0,e80e2ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e80e2d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82313 tid 100165 td 0xc6ad0000 sched_switch(c6ad0000,0,104,191,89010e70,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6ad0000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c6ad0000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c6ad0000,e7fc4c34,e7fc4c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c6ad0000,e7fc4cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c6ad0000,e7fc4ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7fc4d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82312 tid 100475 td 0xc7a7db40 sched_switch(c7a7db40,0,104,191,88ff05e8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7a7db40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7a7db40,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7a7db40,e84acc34,e84acc3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7a7db40,e84accec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7a7db40,e84acce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e84acd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82311 tid 100304 td 0xc79005a0 sched_switch(c79005a0,0,104,191,89008da0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c79005a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c79005a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c79005a0,e81f1c34,e81f1c3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c79005a0,e81f1cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c79005a0,e81f1ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e81f1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82310 tid 100356 td 0xc7f352d0 sched_switch(c7f352d0,0,104,191,88fe9538,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7f352d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7f352d0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7f352d0,e832dc34,e832dc3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7f352d0,e832dcec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7f352d0,e832dce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e832dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82309 tid 100371 td 0xc7ab52d0 sched_switch(c7ab52d0,0,104,191,88fceaf8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7ab52d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7ab52d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7ab52d0,e835ac34,e835ac3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7ab52d0,e835acec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7ab52d0,e835ace4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e835ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82308 tid 100340 td 0xc7a92b40 sched_switch(c7a92b40,0,104,191,88fc77c0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7a92b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(7d1,c08f9ed0,c7a92b40,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,7d1,...) at _sleep+0x328 kern_nanosleep(c7a92b40,e82fdc34,e82fdc3c,2,0,...) at kern_nanosleep+0xc1 nanosleep(c7a92b40,e82fdcec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c7a92b40,e82fdce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e82fdd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82307 tid 100389 td 0xc7ab02d0 sched_switch(c7ab02d0,0,104,191,88f9eac0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7ab02d0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(1771,c08f9ed0,c7ab02d0,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,1771,...) at _sleep+0x328 kern_nanosleep(c7ab02d0,e8390c34,e8390c3c,6,0,...) at kern_nanosleep+0xc1 nanosleep(c7ab02d0,e8390cec,280ddc30,1,0,...) at nanosleep+0x6f syscallenter(c7ab02d0,e8390ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8390d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9ac, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82306 tid 100103 td 0xc68bc2d0 sched_switch(c68bc2d0,0,104,191,89385cb0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c68bc2d0,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e7edba18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e7edba18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e7edba8c,...) at _vn_lock+0x78 lookup(e7edbba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e7edbba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c68bc2d0,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c68bc2d0,804bd00,0,1f8,e7edbc7c,...) at kern_mkdir+0x2e mkdir(c68bc2d0,e7edbcec,e7edbd28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c68bc2d0,e7edbce4,e7edbce4,0,0,...) at syscallenter+0x263 syscall(e7edbd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82305 tid 100148 td 0xc62bb5a0 sched_switch(c62bb5a0,0,104,191,89387250,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c62bb5a0,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e7f8da18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e7f8da18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e7f8da8c,...) at _vn_lock+0x78 lookup(e7f8dba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e7f8dba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c62bb5a0,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c62bb5a0,804bd00,0,1f8,e7f8dc7c,...) at kern_mkdir+0x2e mkdir(c62bb5a0,e7f8dcec,e7f8dd28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c62bb5a0,e7f8dce4,e7f8dce4,0,0,...) at syscallenter+0x263 syscall(e7f8dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82304 tid 100147 td 0xc6a9c2d0 sched_switch(c6a9c2d0,0,104,191,893417d0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c6a9c2d0,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e7f8aa18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e7f8aa18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e7f8aa8c,...) at _vn_lock+0x78 lookup(e7f8aba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e7f8aba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c6a9c2d0,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c6a9c2d0,804bd00,0,1f8,e7f8ac7c,...) at kern_mkdir+0x2e mkdir(c6a9c2d0,e7f8acec,e7f8ad28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c6a9c2d0,e7f8ace4,e7f8ace4,0,0,...) at syscallenter+0x263 syscall(e7f8ad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82303 tid 100460 td 0xc7dd02d0 sched_switch(c7dd02d0,0,104,191,89342c98,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c7dd02d0,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e846ea18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e846ea18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e846ea8c,...) at _vn_lock+0x78 lookup(e846eba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e846eba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c7dd02d0,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c7dd02d0,804bd00,0,1f8,e846ec7c,...) at kern_mkdir+0x2e mkdir(c7dd02d0,e846ecec,e846ed28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c7dd02d0,e846ece4,e846ece4,0,0,...) at syscallenter+0x263 syscall(e846ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82302 tid 100386 td 0xc7afab40 sched_switch(c7afab40,0,104,191,89385270,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c7afab40,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e8387a18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e8387a18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e8387a8c,...) at _vn_lock+0x78 lookup(e8387ba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e8387ba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c7afab40,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c7afab40,804bd00,0,1f8,e8387c7c,...) at kern_mkdir+0x2e mkdir(c7afab40,e8387cec,e8387d28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c7afab40,e8387ce4,e8387ce4,0,0,...) at syscallenter+0x263 syscall(e8387d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82301 tid 100473 td 0xc7cee000 sched_switch(c7cee000,0,104,191,89386688,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c7cee000,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e84a6a18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e84a6a18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e84a6a8c,...) at _vn_lock+0x78 lookup(e84a6ba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e84a6ba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c7cee000,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c7cee000,804bd00,0,1f8,e84a6c7c,...) at kern_mkdir+0x2e mkdir(c7cee000,e84a6cec,e84a6d28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c7cee000,e84a6ce4,e84a6ce4,0,0,...) at syscallenter+0x263 syscall(e84a6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82300 tid 100126 td 0xc69d1000 sched_switch(c69d1000,0,104,191,89340ce8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c69d1000,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e7f35a18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e7f35a18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e7f35a8c,...) at _vn_lock+0x78 lookup(e7f35ba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e7f35ba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c69d1000,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c69d1000,804bd00,0,1f8,e7f35c7c,...) at kern_mkdir+0x2e mkdir(c69d1000,e7f35cec,e7f35d28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c69d1000,e7f35ce4,e7f35ce4,0,0,...) at syscallenter+0x263 syscall(e7f35d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82299 tid 100447 td 0xc739b2d0 sched_switch(c739b2d0,0,104,191,89342220,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c739b2d0,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e843ea18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e843ea18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e843ea8c,...) at _vn_lock+0x78 lookup(e843eba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e843eba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c739b2d0,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c739b2d0,804bd00,0,1f8,e843ec7c,...) at kern_mkdir+0x2e mkdir(c739b2d0,e843ecec,e843ed28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c739b2d0,e843ece4,e843ece4,0,0,...) at syscallenter+0x263 syscall(e843ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82298 tid 100362 td 0xc79aab40 sched_switch(c79aab40,0,104,191,89384768,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c79aab40,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e833fa18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e833fa18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e833fa8c,...) at _vn_lock+0x78 lookup(e833fba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e833fba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c79aab40,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c79aab40,804bd00,0,1f8,e833fc7c,...) at kern_mkdir+0x2e mkdir(c79aab40,e833fcec,e833fd28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c79aab40,e833fce4,e833fce4,0,0,...) at syscallenter+0x263 syscall(e833fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82297 tid 100207 td 0xc6553000 sched_switch(c6553000,0,104,191,89343790,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c6553000,0,c0ce947a,268,c69ec724,...) at sleepq_switch+0x15f sleepq_wait(c69ec724,50,c0cdcb77,4,1,...) at sleepq_wait+0x63 __lockmgr_args(c69ec724,200400,c69ec790,0,0,...) at __lockmgr_args+0x4cf ffs_lock(e806ca18,0,c55231e0,200400,c69ec6cc,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c0df9ac0,e806ca18,c69ec790,c0e14940,c69ec6cc,...) at VOP_LOCK1_APV+0xb5 _vn_lock(c69ec6cc,200400,c0cf1d43,1f5,e806ca8c,...) at _vn_lock+0x78 lookup(e806cba4,c0cf1d43,ee,c9,ffffff9c,...) at lookup+0x106 namei(e806cba4,6,0,1,0,...) at namei+0x592 kern_mkdirat(c6553000,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x71 kern_mkdir(c6553000,804bd00,0,1f8,e806cc7c,...) at kern_mkdir+0x2e mkdir(c6553000,e806ccec,e806cd28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c6553000,e806cce4,e806cce4,0,0,...) at syscallenter+0x263 syscall(e806cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82296 tid 100370 td 0xc76a4870 sched_switch(c76a4870,0,104,191,89395ef0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c76a4870,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(d969d960,4c,c0cf04e6,0,0,...) at sleepq_wait+0x63 _sleep(d969d960,c553c100,4c,c0cf04e6,0,...) at _sleep+0x372 bwait(d969d960,4c,c0cf04e6,d969d960,e83578dc,...) at bwait+0x6f bufwait(d969d960,d969d960,df,d969d960,c8076074,...) at bufwait+0x48 bufwrite(d969d960,0,c0d0f489,756,0) at bufwrite+0x165 ffs_bufwrite(d969d960,c700f300,100,4000,0,...) at ffs_bufwrite+0x290 ffs_update(c8fd1984,1,18,200,c63fa280,...) at ffs_update+0x28c ufs_mkdir(e8357bf8,c0d267ac,0,0,e8357b3c,...) at ufs_mkdir+0x7eb VOP_MKDIR_APV(c0df9ac0,e8357bf8,e8357bd0,e8357b3c,0,...) at VOP_MKDIR_APV+0xc5 kern_mkdirat(c76a4870,ffffff9c,804bd00,0,1f8,...) at kern_mkdirat+0x225 kern_mkdir(c76a4870,804bd00,0,1f8,e8357c7c,...) at kern_mkdir+0x2e mkdir(c76a4870,e8357cec,e8357d28,c0ce9cd3,0,...) at mkdir+0x29 syscallenter(c76a4870,e8357ce4,e8357ce4,0,0,...) at syscallenter+0x263 syscall(e8357d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x28185043, esp = 0xbfbfe99c, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82295 tid 100437 td 0xc77552d0 kdb_enter(c0ce4b9a,c0ce4b9a,c0c7aa69,e8420c20,1,...) at kdb_enter+0x3a panic(c0c7aa69,c77552d0,3dd,c6c94d48,e8420c50,...) at panic+0x134 tidhash_remove(c77552d0,e2e0ac49,7fffffff,0,c6c94d48,...) at tidhash_remove+0x5e thr_exit(c77552d0,e8420cec,e8420d28,c0ce9cd3,0,...) at thr_exit+0x4e syscallenter(c77552d0,e8420ce4,e8420ce4,0,0,...) at syscallenter+0x263 syscall(e8420d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (431, FreeBSD ELF32, thr_exit), eip = 0x280edaa1, esp = 0xbfbfe990, ebp = 0xbfbfe9d8 --- Tracing command swap pid 82294 tid 100144 td 0xc6a9c870 sched_switch(c6a9c870,0,104,191,88f6be90,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6a9c870,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6a95550,5c,c0cebe39,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6a95550,c6a955d8,15c,c0cebe39,0,...) at _sleep+0x35c kern_wait(c6a9c870,14183,e7f81c44,0,0,...) at kern_wait+0xb66 wait4(c6a9c870,e7f81cec,281aba8c,1,0,...) at wait4+0x3b syscallenter(c6a9c870,e7f81ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7f81d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28103ddb, esp = 0xbfbfe9dc, ebp = 0xbfbfe9f8 --- Tracing command syscall pid 82293 tid 100288 td 0xc7dd0000 cpustop_handler(1,e819cb74,c0c03ec6,c0d235de,ec,...) at cpustop_handler+0x34 ipi_nmi_handler(c0d235de,ec,0,c08babc2,c6ecb7f8,...) at ipi_nmi_handler+0x2f trap(e819cb80) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08babc8, esp = 0xe819cbc0, ebp = 0xe819cbec --- _rw_wlock_hard(c0e4a0e8,c7dd0000,c0ce5c12,3dd,0,...) at _rw_wlock_hard+0xb8 _rw_wlock(c0e4a0e8,c0ce5c12,3dd,c6ecb7f8,e819cc50,...) at _rw_wlock+0xae tidhash_remove(c7dd0000,df57abab,7fffffff,0,c6ecb7f8,...) at tidhash_remove+0x26 thr_exit(c7dd0000,e819ccec,280eda9c,1,0,...) at thr_exit+0x4e syscallenter(c7dd0000,e819cce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e819cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (431, FreeBSD ELF32, thr_exit), eip = 0x280edaa1, esp = 0xbfbfe990, ebp = 0xbfbfe9d8 --- Tracing command syscall pid 82292 tid 100195 td 0xc6b95000 sched_switch(c6b95000,0,104,191,886fe328,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6b95000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6b0f7f8,5c,c0cebe39,100,0,...) at sleepq_wait_sig+0x17 _sleep(c6b0f7f8,c6b0f880,15c,c0cebe39,0,...) at _sleep+0x35c kern_wait(c6b95000,14175,e8035c44,0,0,...) at kern_wait+0xb66 wait4(c6b95000,e8035cec,281aaa8c,1,0,...) at wait4+0x3b syscallenter(c6b95000,e8035ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e8035d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28102ddb, esp = 0xbfbfe9dc, ebp = 0xbfbfe9f8 --- Tracing command syscall pid 82291 tid 100173 td 0xc6ac4870 sched_switch(c6ac4870,0,104,191,88354668,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6ac4870,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(3e9,c08f9ed0,c6ac4870,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,3e9,...) at _sleep+0x328 kern_nanosleep(c6ac4870,e7fe1c34,e7fe1c3c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c6ac4870,e7fe1cec,281aa0f4,1,0,...) at nanosleep+0x6f syscallenter(c6ac4870,e7fe1ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7fe1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28178533, esp = 0xbfbfe9fc, ebp = 0xbfbfea28 --- Tracing command swap pid 82290 tid 100073 td 0xc67185a0 sched_switch(c67185a0,0,104,191,883ede38,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c67185a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(3e9,c08f9ed0,c67185a0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,3e9,...) at _sleep+0x328 kern_nanosleep(c67185a0,e7e40c34,e7e40c3c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c67185a0,e7e40cec,281ab0f4,1,0,...) at nanosleep+0x6f syscallenter(c67185a0,e7e40ce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7e40d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28179533, esp = 0xbfbfe9fc, ebp = 0xbfbfea28 --- Tracing command run pid 82138 tid 100476 td 0xc7a7d5a0 sched_switch(c7a7d5a0,0,104,191,875bf588,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7a7d5a0,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c63682a8,5c,c0cebe39,100,0,...) at sleepq_wait_sig+0x17 _sleep(c63682a8,c6368330,15c,c0cebe39,0,...) at _sleep+0x35c kern_wait(c7a7d5a0,14172,e84afc44,0,0,...) at kern_wait+0xb66 wait4(c7a7d5a0,e84afcec,bfbfe538,1,0,...) at wait4+0x3b syscallenter(c7a7d5a0,e84afce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e84afd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x28102ddb, esp = 0xbfbfe4ec, ebp = 0xbfbfe508 --- Tracing command run pid 82137 tid 100244 td 0xc64e05a0 Tracing command run pid 82136 tid 100390 td 0xc7a98000 sched_switch(c7a98000,0,104,191,4f6f4718,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c7a98000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(3e9,c08f9ed0,c7a98000,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,3e9,...) at _sleep+0x328 kern_nanosleep(c7a98000,e8393c34,e8393c3c,1,0,...) at kern_nanosleep+0xc1 nanosleep(c7a98000,e8393cec,e8393d28,c0ce9cd3,0,...) at nanosleep+0x6f syscallenter(c7a98000,e8393ce4,e8393ce4,0,ec,...) at syscallenter+0x263 syscall(e8393d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28178533, esp = 0xbfbfe9bc, ebp = 0xbfbfe9e8 --- Tracing command sh pid 82130 tid 100414 td 0xc76c62d0 Tracing command sleep pid 82064 tid 100319 td 0xc79c5000 Tracing command sh pid 79456 tid 100357 td 0xc78dd000 Tracing command sh pid 79455 tid 100351 td 0xc7a4d000 Tracing command sshd pid 79454 tid 100339 td 0xc771b000 sched_switch(c771b000,0,104,191,882c2bf0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c771b000,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdfa,c6cbae50,0,c0ce32cb,c771b000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c6cbae64,0,e82faa4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c6cbae64,c6cbae50,c0ceb87f,627,c668e8c0,...) at _cv_wait_sig+0x243 seltdwait(c668e8c0,58,c662e000,c771b000,246,...) at seltdwait+0xa2 kern_select(c771b000,a,288060b8,288060cc,0,0,20,c6609550,c6609550) at kern_select+0x504 select(c771b000,e82facec,e82fad28,c0ce9cd3,0,...) at select+0x66 syscallenter(c771b000,e82face4,e82face4,0,0,...) at syscallenter+0x263 syscall(e82fad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b11e3, esp = 0xbfbfe1bc, ebp = 0xbfbfe208 --- Tracing command sshd pid 79449 tid 100099 td 0xc68bd000 Tracing command sh pid 1210 tid 100080 td 0xc580db40 Tracing command csh pid 1206 tid 100074 td 0xc62b9870 Tracing command login pid 1205 tid 100087 td 0xc67782d0 Tracing command getty pid 1204 tid 100104 td 0xc68bc000 sched_switch(c68bc000,0,104,191,81e0fa98,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c68bc000,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c68bc000,c68bc000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c56f3670,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c56f3670,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c56f3600,c56f3670,e7edec28,1,0,...) at tty_wait+0x71 ttydisc_read(c56f3600,e7edec28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720900,e7edec28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c668e3f0,e7edec28,c5561e80,0,c68bc000,...) at devfs_read_f+0x7e dofileread(e7edec28,ffffffff,ffffffff,0,c668e3f0,...) at dofileread+0x9e kern_readv(c68bc000,0,e7edec28,e7edec48,1,...) at kern_readv+0x58 read(c68bc000,e7edecec,e7eded28,c0ce9cd3,0,...) at read+0x4f syscallenter(c68bc000,e7edece4,e7edece4,0,0,...) at syscallenter+0x263 syscall(e7eded28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1203 tid 100105 td 0xc68bbb40 sched_switch(c68bbb40,0,104,191,81b4b3e0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c68bbb40,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c68bbb40,c68bbb40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c56f3870,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c56f3870,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c56f3800,c56f3870,e7ee1c28,1,0,...) at tty_wait+0x71 ttydisc_read(c56f3800,e7ee1c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720a00,e7ee1c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c668e3b8,e7ee1c28,c5561e80,0,c68bbb40,...) at devfs_read_f+0x7e dofileread(e7ee1c28,ffffffff,ffffffff,0,c668e3b8,...) at dofileread+0x9e kern_readv(c68bbb40,0,e7ee1c28,e7ee1c48,1,...) at kern_readv+0x58 read(c68bbb40,e7ee1cec,e7ee1d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c68bbb40,e7ee1ce4,e7ee1ce4,0,0,...) at syscallenter+0x263 syscall(e7ee1d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1202 tid 100110 td 0xc68b9b40 sched_switch(c68b9b40,0,104,191,81d9d630,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c68b9b40,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c68b9b40,c68b9b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c56f3a70,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c56f3a70,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c56f3a00,c56f3a70,e7ef0c28,1,0,...) at tty_wait+0x71 ttydisc_read(c56f3a00,e7ef0c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720b00,e7ef0c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c66a4850,e7ef0c28,c5561e80,0,c68b9b40,...) at devfs_read_f+0x7e dofileread(e7ef0c28,ffffffff,ffffffff,0,c66a4850,...) at dofileread+0x9e kern_readv(c68b9b40,0,e7ef0c28,e7ef0c48,1,...) at kern_readv+0x58 read(c68b9b40,e7ef0cec,e7ef0d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c68b9b40,e7ef0ce4,e7ef0ce4,0,0,...) at syscallenter+0x263 syscall(e7ef0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1201 tid 100082 td 0xc6715b40 sched_switch(c6715b40,0,104,191,818dce60,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6715b40,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c6715b40,c6715b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c56f3c70,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c56f3c70,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c56f3c00,c56f3c70,e7e64c28,1,0,...) at tty_wait+0x71 ttydisc_read(c56f3c00,e7e64c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720c00,e7e64c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c66a4620,e7e64c28,c5561e80,0,c6715b40,...) at devfs_read_f+0x7e dofileread(e7e64c28,ffffffff,ffffffff,0,c66a4620,...) at dofileread+0x9e kern_readv(c6715b40,0,e7e64c28,e7e64c48,1,...) at kern_readv+0x58 read(c6715b40,e7e64cec,e7e64d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c6715b40,e7e64ce4,e7e64ce4,0,0,...) at syscallenter+0x263 syscall(e7e64d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1200 tid 100108 td 0xc68bb2d0 sched_switch(c68bb2d0,0,104,191,819ab010,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c68bb2d0,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c68bb2d0,c68bb2d0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c56f3e70,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c56f3e70,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c56f3e00,c56f3e70,e7eeac28,1,0,...) at tty_wait+0x71 ttydisc_read(c56f3e00,e7eeac28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720d00,e7eeac28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c668f348,e7eeac28,c5561e80,0,c68bb2d0,...) at devfs_read_f+0x7e dofileread(e7eeac28,ffffffff,ffffffff,0,c668f348,...) at dofileread+0x9e kern_readv(c68bb2d0,0,e7eeac28,e7eeac48,1,...) at kern_readv+0x58 read(c68bb2d0,e7eeacec,e7eead28,c0ce9cd3,0,...) at read+0x4f syscallenter(c68bb2d0,e7eeace4,e7eeace4,0,0,...) at syscallenter+0x263 syscall(e7eead28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1199 tid 100098 td 0xc6776000 sched_switch(c6776000,0,104,191,81da5eb0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6776000,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c6776000,c6776000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c5819070,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c5819070,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c5819000,c5819070,e7ea3c28,1,0,...) at tty_wait+0x71 ttydisc_read(c5819000,e7ea3c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c5720e00,e7ea3c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c668fc78,e7ea3c28,c5561e80,0,c6776000,...) at devfs_read_f+0x7e dofileread(e7ea3c28,ffffffff,ffffffff,0,c668fc78,...) at dofileread+0x9e kern_readv(c6776000,0,e7ea3c28,e7ea3c48,1,...) at kern_readv+0x58 read(c6776000,e7ea3cec,e7ea3d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c6776000,e7ea3ce4,e7ea3ce4,0,0,...) at syscallenter+0x263 syscall(e7ea3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1198 tid 100075 td 0xc62b95a0 sched_switch(c62b95a0,0,104,191,818f02e8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c62b95a0,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c62b95a0,c62b95a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c5819270,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c5819270,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c5819200,c5819270,e7e48c28,1,0,...) at tty_wait+0x71 ttydisc_read(c5819200,e7e48c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c580a000,e7e48c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c66a4460,e7e48c28,c5561e80,0,c62b95a0,...) at devfs_read_f+0x7e dofileread(e7e48c28,ffffffff,ffffffff,0,c66a4460,...) at dofileread+0x9e kern_readv(c62b95a0,0,e7e48c28,e7e48c48,1,...) at kern_readv+0x58 read(c62b95a0,e7e48cec,e7e48d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c62b95a0,e7e48ce4,e7e48ce4,0,ec,...) at syscallenter+0x263 syscall(e7e48d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1197 tid 100090 td 0xc6777870 sched_switch(c6777870,0,104,191,81d2b348,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6777870,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,c6777870,c6777870,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c5819470,0,c0cedc54,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c5819470,c0e49930,c0ced5ca,514,0,...) at _cv_wait_sig+0x243 tty_wait(c5819400,c5819470,e7e83c28,1,0,...) at tty_wait+0x71 ttydisc_read(c5819400,e7e83c28,0,9f,0,...) at ttydisc_read+0x22c ttydev_read(c580a100,e7e83c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c668f268,e7e83c28,c5561e80,0,c6777870,...) at devfs_read_f+0x7e dofileread(e7e83c28,ffffffff,ffffffff,0,c668f268,...) at dofileread+0x9e kern_readv(c6777870,0,e7e83c28,e7e83c48,1,...) at kern_readv+0x58 read(c6777870,e7e83cec,e7e83d28,c0ce9cd3,0,...) at read+0x4f syscallenter(c6777870,e7e83ce4,e7e83ce4,0,0,...) at syscallenter+0x263 syscall(e7e83d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x28196263, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command cron pid 1131 tid 100093 td 0xc6777000 sched_switch(c6777000,0,104,191,647100b0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c6777000,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(ea61,c08f9ed0,c6777000,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c0e4a1c4,5c,c0ce5e60,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0e4a1c4,0,15c,c0ce5e60,ea61,...) at _sleep+0x328 kern_nanosleep(c6777000,e7e8dc34,e7e8dc3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c6777000,e7e8dcec,e7e8dd28,c0ce9cd3,0,...) at nanosleep+0x6f syscallenter(c6777000,e7e8dce4,e7e8dce4,0,0,...) at syscallenter+0x263 syscall(e7e8dd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x28184533, esp = 0xbfbfec6c, ebp = 0xbfbfec98 --- Tracing command sendmail pid 1124 tid 100085 td 0xc67785a0 Tracing command sendmail pid 1120 tid 100070 td 0xc62ba000 sched_switch(c62ba000,0,104,191,61597ef0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c62ba000,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e7e34a14,c08acdfa,c687fc50,0,c62ba000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c687fc64,0,e7e34a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c687fc64,c687fc50,1389,627,c68efd90,...) at _cv_timedwait_sig+0x252 seltdwait(e7e34bf8,e7e34c00,c5561380,c62ba000,c15aea94,...) at seltdwait+0x8a kern_select(c62ba000,4,bfbfc530,0,0,e7e34c40,20,5,0) at kern_select+0x504 select(c62ba000,e7e34cec,e7e34d28,c0ce9cd3,0,...) at select+0x66 syscallenter(c62ba000,e7e34ce4,e7e34ce4,0,0,...) at syscallenter+0x263 syscall(e7e34d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283e21e3, esp = 0xbfbfc49c, ebp = 0xbfbfcfc8 --- Tracing command sshd pid 1112 tid 100114 td 0xc68b9000 sched_switch(c68b9000,0,104,191,fd2b58,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c68b9000,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdfa,c65b6350,0,c0ce32cb,c68b9000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c65b6364,0,e7efca4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c65b6364,c65b6350,c0ceb87f,627,c668ee70,...) at _cv_wait_sig+0x243 seltdwait(c668ee70,58,c5561480,c68b9000,c0d127e1,...) at seltdwait+0xa2 kern_select(c68b9000,5,2880c0b0,0,0,0,20,c6712000,c6712000) at kern_select+0x504 select(c68b9000,e7efccec,280ceef7,1,0,...) at select+0x66 syscallenter(c68b9000,e7efcce4,c0c0460d,c0e49930,0,...) at syscallenter+0x263 syscall(e7efcd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284b11e3, esp = 0xbfbfe27c, ebp = 0xbfbfee18 --- Tracing command rpc.statd pid 971 tid 100068 td 0xc62ba5a0 sched_switch(c62ba5a0,0,104,191,9aada98,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c62ba5a0,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e7e2ca14,c08acdfa,c65b6450,0,c62ba5a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c65b6464,0,e7e2ca4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c65b6464,c65b6450,7531,627,c668e7a8,...) at _cv_timedwait_sig+0x252 seltdwait(e7e2cbf8,e7e2cc00,c5561e80,c62ba5a0,c0d127e1,...) at seltdwait+0x8a kern_select(c62ba5a0,8,bfbfed34,0,0,e7e2cc40,20,1e,0) at kern_select+0x504 select(c62ba5a0,e7e2ccec,e7e2cd28,c0ce9cd3,0,...) at select+0x66 syscallenter(c62ba5a0,e7e2cce4,e7e2cce4,0,0,...) at syscallenter+0x263 syscall(e7e2cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2818d1e3, esp = 0xbfbfec8c, ebp = 0xbfbfedc8 --- Tracing command md1 pid 898 tid 100106 td 0xc68bb870 sched_switch(c68bb870,0,104,191,8892e2b8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c68bb870,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c573a000,4c,c0cb624b,0,0,...) at sleepq_wait+0x63 _sleep(c573a000,c573a020,24c,c0cb624b,0,...) at _sleep+0x372 md_kthread(c573a000,e7ee4d28,c0cdfca8,349,c68b7550,...) at md_kthread+0x115 fork_exit(c06d68e0,c573a000,e7ee4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7ee4d60, ebp = 0 --- Tracing command rpcbind pid 843 tid 100091 td 0xc67775a0 sched_switch(c67775a0,0,104,191,b2854f00,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c67775a0,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(e7e86a6c,c08acdfa,c687fc90,0,c67775a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c687fca4,0,e7e86aa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c687fca4,c687fc90,7531,627,e7e86b5c,...) at _cv_timedwait_sig+0x252 seltdwait(e7e86c2c,e7e86c34,535,c67775a0,e7e86b2c,...) at seltdwait+0x8a poll(c67775a0,e7e86cec,e7e86d28,c0ce9cd3,0,...) at poll+0x300 syscallenter(c67775a0,e7e86ce4,e7e86ce4,0,0,...) at syscallenter+0x263 syscall(e7e86d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x2814006b, esp = 0xbfbfcbcc, ebp = 0xbfbfed98 --- Tracing command syslogd pid 813 tid 100089 td 0xc6777b40 sched_switch(c6777b40,0,104,191,425edda0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c6777b40,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdfa,c687f390,0,c0ce32cb,c6777b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c687f3a4,0,e7e80a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c687f3a4,c687f390,c0ceb87f,627,c668fd20,...) at _cv_wait_sig+0x243 seltdwait(c668fd20,58,c5561e80,c6777b40,c0d127e1,...) at seltdwait+0xa2 kern_select(c6777b40,9,284760ac,0,0,0,20,c6789000,c6789000) at kern_select+0x504 select(c6777b40,e7e80cec,e7e80d28,c0ce9cd3,0,...) at select+0x66 syscallenter(c6777b40,e7e80ce4,e7e80ce4,0,0,...) at syscallenter+0x263 syscall(e7e80d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281991e3, esp = 0xbfbfe2bc, ebp = 0xbfbfee08 --- Tracing command devd pid 634 tid 100071 td 0xc62b9b40 sched_switch(c62b9b40,0,104,191,b44fa2a8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c62b9b40,0,c0ce947a,1a7,0,...) at sleepq_switch+0x15f sleepq_catch_signals(c08acdfa,c65b65d0,0,c0ce32cb,c62b9b40,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c65b65e4,0,e7e38a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c65b65e4,c65b65d0,c0ceb87f,627,c668e738,...) at _cv_wait_sig+0x243 seltdwait(c668e738,58,c5561e80,c62b9b40,3,...) at seltdwait+0xa2 kern_select(c62b9b40,6,bfbfe980,0,0,0,20,c67292a8,c67292a8) at kern_select+0x504 select(c62b9b40,e7e38cec,e7e38d28,c0ce9cd3,0,...) at select+0x66 syscallenter(c62b9b40,e7e38ce4,e7e38ce4,0,c0ce32cb,...) at syscallenter+0x263 syscall(e7e38d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x808b783, esp = 0xbfbfe94c, ebp = 0xbfbfee28 --- Tracing command md0 pid 102 tid 100076 td 0xc62b92d0 sched_switch(c62b92d0,0,104,191,65f0f488,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c62b92d0,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c573a800,4c,c0cb624b,0,0,...) at sleepq_wait+0x63 _sleep(c573a800,c573a820,24c,c0cb624b,0,...) at _sleep+0x372 md_kthread(c573a800,e7e4cd28,c0cdfca8,349,c6728aa0,...) at md_kthread+0x115 fork_exit(c06d68e0,c573a800,e7e4cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7e4cd60, ebp = 0 --- Tracing command flowcleaner pid 20 tid 100064 td 0xc62bb000 sched_switch(c62bb000,0,104,191,506f5ee8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c62bb000,0,c0ce947a,28b,c62bb000,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb7328,0,e5c31cac,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0fb7328,c0fb7330,4e20,620,c62bb000,...) at _cv_timedwait+0x252 flowtable_cleaner(0,e5c31d28,c0cdfca8,349,c62ac2a8,...) at flowtable_cleaner+0x1ae fork_exit(c096bea0,0,e5c31d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c31d60, ebp = 0 --- Tracing command softdepflush pid 19 tid 100063 td 0xc57cc2d0 sched_switch(c57cc2d0,0,104,191,67ea25f0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,44,...) at mi_switch+0x200 sleepq_switch(c57cc2d0,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc2ae0,44,c0d0e9e9,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc2ae0,c0fc2a98,44,c0d0e9e9,3e8,...) at _sleep+0x342 softdep_flush(0,e5c2ed28,c0cdfca8,349,c62ac550,...) at softdep_flush+0x25a fork_exit(c0b02fe0,0,e5c2ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c2ed60, ebp = 0 --- Tracing command syncer pid 18 tid 100062 td 0xc57cc5a0 sched_switch(c57cc5a0,0,104,191,59a7d188,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cc5a0,0,c0ce947a,28b,c57cc5a0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb7138,0,e5c2bc78,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c0fb7138,c0fb7124,3e8,6e8,4e20,...) at _cv_timedwait+0x252 sched_sync(0,e5c2bd28,c0cdfca8,349,c62ac7f8,...) at sched_sync+0x512 fork_exit(c0954db0,0,e5c2bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c2bd60, ebp = 0 --- Tracing command vnlru pid 17 tid 100061 td 0xc57cc870 sched_switch(c57cc870,0,104,191,3859c1e0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,50,...) at mi_switch+0x200 sleepq_switch(c57cc870,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c62acaa0,50,c0cf3876,0,0,...) at sleepq_timedwait+0x6b _sleep(c62acaa0,c0fb70f8,250,c0cf3876,3e8,...) at _sleep+0x342 vnlru_proc(0,e5c28d28,c0cdfca8,349,c62acaa0,...) at vnlru_proc+0xe7 fork_exit(c09565c0,0,e5c28d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c28d60, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100060 td 0xc57ccb40 sched_switch(c57ccb40,0,104,191,4f6e9be8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,44,...) at mi_switch+0x200 sleepq_switch(c57ccb40,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fb6dc8,44,c0cf0b41,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fb6dc8,c0fb6dd0,44,c0cf0b41,3e8,...) at _sleep+0x342 buf_daemon(0,e5c25d28,c0cdfca8,349,c62acd48,...) at buf_daemon+0x16e fork_exit(c093c2d0,0,e5c25d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c25d60, ebp = 0 --- Tracing command pagezero pid 15 tid 100059 td 0xc580b000 sched_switch(c580b000,0,104,191,3691a350,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c580b000,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc495c,0,c0d152dd,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc495c,c0fc3400,0,c0d152dd,493e0,...) at _sleep+0x342 vm_pagezero(0,e5c22d28,c0cdfca8,349,c55802a8,...) at vm_pagezero+0xdc fork_exit(c0b49100,0,e5c22d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c22d60, ebp = 0 --- Tracing command vmdaemon pid 9 tid 100058 td 0xc580b2d0 sched_switch(c580b2d0,0,104,191,e4e9b998,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,68,...) at mi_switch+0x200 sleepq_switch(c580b2d0,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fc4550,68,c0cf0b41,0,0,...) at sleepq_wait+0x63 _sleep(c0fc4550,c0fc4554,68,c0cf0b41,0,...) at _sleep+0x372 vm_daemon(0,e5c1fd28,c0cdfca8,349,c5580550,...) at vm_daemon+0x59 fork_exit(c0b42f80,0,e5c1fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c1fd60, ebp = 0 --- Tracing command pagedaemon pid 8 tid 100057 td 0xc580b5a0 sched_switch(c580b5a0,0,104,191,2db0ca78,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,44,...) at mi_switch+0x200 sleepq_switch(c580b5a0,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0fc4518,44,c0cf0b41,0,0,...) at sleepq_timedwait+0x6b _sleep(c0fc4518,c0fc3400,44,c0cf0b41,1388,...) at _sleep+0x342 vm_pageout(0,e5c1cd28,c0cdfca8,349,c55807f8,...) at vm_pageout+0x2c7 fork_exit(c0b43ff0,0,e5c1cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c1cd60, ebp = 0 --- Tracing command xpt_thrd pid 7 tid 100056 td 0xc580b870 sched_switch(c580b870,0,104,191,a7800358,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c580b870,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e15e54,4c,c0c7af85,0,0,...) at sleepq_wait+0x63 _sleep(c0e15e54,c0e15e98,4c,c0c7af85,0,...) at _sleep+0x372 xpt_scanner_thread(0,e5c19d28,c0cdfca8,349,c5580aa0,...) at xpt_scanner_thread+0x47 fork_exit(c0485ca0,0,e5c19d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c19d60, ebp = 0 --- Tracing command sctp_iterator pid 6 tid 100055 td 0xc580bb40 sched_switch(c580bb40,0,104,191,c159bca8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c580bb40,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0fb8b58,0,c0cff8b2,0,0,...) at sleepq_wait+0x63 _sleep(c0fb8b58,c0fb8b20,0,c0cff8b2,0,...) at _sleep+0x372 sctp_iterator_thread(0,e5c16d28,c0cdfca8,349,c5580d48,...) at sctp_iterator_thread+0x5c fork_exit(c09e60e0,0,e5c16d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c16d60, ebp = 0 --- Tracing command fdc0 pid 5 tid 100052 td 0xc580d5a0 sched_switch(c580d5a0,0,104,191,44659260,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c580d5a0,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c572c23c,4c,c0cd9758,0,0,...) at sleepq_timedwait+0x6b _sleep(c572c23c,c572c2f0,4c,c0cd9758,3e8,...) at _sleep+0x342 fdc_thread(c572c200,e5c0dd28,c0cdfca8,349,c56dd000,...) at fdc_thread+0x27d fork_exit(c0bc7c80,c572c200,e5c0dd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c0dd60, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc57ca5a0 sched_switch(c57ca5a0,0,104,191,a779f688,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57ca5a0,0,c0ce947a,268,c57ca5a0,...) at sleepq_switch+0x15f sleepq_wait(c57d1d34,0,c52f4cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57d1d34,c57d1dd4,c0cd1d8f,6c,c57d1d3c,...) at _cv_wait+0x243 usb_process(c57d1d2c,c52f4d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57d1d2c,c52f4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52f4d60, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc57ca870 sched_switch(c57ca870,0,104,191,298c6f70,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57ca870,0,c0ce947a,268,c57ca870,...) at sleepq_switch+0x15f sleepq_wait(c57d1d04,0,c52f1cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57d1d04,c57d1dd4,c0cd1d8f,6c,c57d1d0c,...) at _cv_wait+0x243 usb_process(c57d1cfc,c52f1d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57d1cfc,c52f1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52f1d60, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc57cab40 sched_switch(c57cab40,0,104,191,a6f961c8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cab40,0,c0ce947a,268,c57cab40,...) at sleepq_switch+0x15f sleepq_wait(c57d1cd4,0,c52eecac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57d1cd4,c57d1dd4,c0cd1d8f,6c,c57d1cdc,...) at _cv_wait+0x243 usb_process(c57d1ccc,c52eed28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57d1ccc,c52eed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52eed60, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc57cb000 sched_switch(c57cb000,0,104,191,a6f94cb8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cb000,0,c0ce947a,268,c57cb000,...) at sleepq_switch+0x15f sleepq_wait(c57d1ca4,0,c52ebcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57d1ca4,c57d1dd4,c0cd1d8f,6c,c57d1cac,...) at _cv_wait+0x243 usb_process(c57d1c9c,c52ebd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57d1c9c,c52ebd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52ebd60, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc57cb2d0 sched_switch(c57cb2d0,0,104,191,a6f93698,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cb2d0,0,c0ce947a,268,c57cb2d0,...) at sleepq_switch+0x15f sleepq_wait(c57bcdac,0,c52e5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57bcdac,c57bce4c,c0cd1d8f,6c,c57bcdb4,...) at _cv_wait+0x243 usb_process(c57bcda4,c52e5d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57bcda4,c52e5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52e5d60, ebp = 0 --- Tracing command usb pid 14 tid 100044 td 0xc57cb5a0 sched_switch(c57cb5a0,0,104,191,d3443668,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cb5a0,0,c0ce947a,268,c57cb5a0,...) at sleepq_switch+0x15f sleepq_wait(c57bcd7c,0,c52e2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57bcd7c,c57bce4c,c0cd1d8f,6c,c57bcd84,...) at _cv_wait+0x243 usb_process(c57bcd74,c52e2d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57bcd74,c52e2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52e2d60, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc57cb870 sched_switch(c57cb870,0,104,191,9fd48ec8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cb870,0,c0ce947a,268,c57cb870,...) at sleepq_switch+0x15f sleepq_wait(c57bcd4c,0,c52dfcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57bcd4c,c57bce4c,c0cd1d8f,6c,c57bcd54,...) at _cv_wait+0x243 usb_process(c57bcd44,c52dfd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57bcd44,c52dfd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52dfd60, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc57cbb40 sched_switch(c57cbb40,0,104,191,9fd47b50,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57cbb40,0,c0ce947a,268,c57cbb40,...) at sleepq_switch+0x15f sleepq_wait(c57bcd1c,0,c52dccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57bcd1c,c57bce4c,c0cd1d8f,6c,c57bcd24,...) at _cv_wait+0x243 usb_process(c57bcd14,c52dcd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57bcd14,c52dcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52dcd60, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc57a3000 sched_switch(c57a3000,0,104,191,9fd46058,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a3000,0,c0ce947a,268,c57a3000,...) at sleepq_switch+0x15f sleepq_wait(c57aadac,0,c52d5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57aadac,c57aae4c,c0cd1d8f,6c,c57aadb4,...) at _cv_wait+0x243 usb_process(c57aada4,c52d5d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57aada4,c52d5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52d5d60, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc57a32d0 sched_switch(c57a32d0,0,104,191,d343cab0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a32d0,0,c0ce947a,268,c57a32d0,...) at sleepq_switch+0x15f sleepq_wait(c57aad7c,0,c52d2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57aad7c,c57aae4c,c0cd1d8f,6c,c57aad84,...) at _cv_wait+0x243 usb_process(c57aad74,c52d2d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57aad74,c52d2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52d2d60, ebp = 0 --- Tracing command usb pid 14 tid 100038 td 0xc57a35a0 sched_switch(c57a35a0,0,104,191,9f5844f8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a35a0,0,c0ce947a,268,c57a35a0,...) at sleepq_switch+0x15f sleepq_wait(c57aad4c,0,c52cfcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57aad4c,c57aae4c,c0cd1d8f,6c,c57aad54,...) at _cv_wait+0x243 usb_process(c57aad44,c52cfd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57aad44,c52cfd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52cfd60, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc57a3870 sched_switch(c57a3870,0,104,191,9f582fa8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a3870,0,c0ce947a,268,c57a3870,...) at sleepq_switch+0x15f sleepq_wait(c57aad1c,0,c52cccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c57aad1c,c57aae4c,c0cd1d8f,6c,c57aad24,...) at _cv_wait+0x243 usb_process(c57aad14,c52ccd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c57aad14,c52ccd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52ccd60, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc57a5000 sched_switch(c57a5000,0,104,191,9f5816c8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a5000,0,c0ce947a,268,c57a5000,...) at sleepq_switch+0x15f sleepq_wait(c5794dac,0,c52c5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5794dac,c5794e4c,c0cd1d8f,6c,c5794db4,...) at _cv_wait+0x243 usb_process(c5794da4,c52c5d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5794da4,c52c5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52c5d60, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc57a52d0 sched_switch(c57a52d0,0,104,191,d342f2b0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a52d0,0,c0ce947a,268,c57a52d0,...) at sleepq_switch+0x15f sleepq_wait(c5794d7c,0,c52c2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5794d7c,c5794e4c,c0cd1d8f,6c,c5794d84,...) at _cv_wait+0x243 usb_process(c5794d74,c52c2d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5794d74,c52c2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52c2d60, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc57a55a0 sched_switch(c57a55a0,0,104,191,9eddbc30,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a55a0,0,c0ce947a,268,c57a55a0,...) at sleepq_switch+0x15f sleepq_wait(c5794d4c,0,c52bfcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5794d4c,c5794e4c,c0cd1d8f,6c,c5794d54,...) at _cv_wait+0x243 usb_process(c5794d44,c52bfd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5794d44,c52bfd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52bfd60, ebp = 0 --- Tracing command usb pid 14 tid 100032 td 0xc57a5870 sched_switch(c57a5870,0,104,191,9eddaa00,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57a5870,0,c0ce947a,268,c57a5870,...) at sleepq_switch+0x15f sleepq_wait(c5794d1c,0,c52bccac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5794d1c,c5794e4c,c0cd1d8f,6c,c5794d24,...) at _cv_wait+0x243 usb_process(c5794d14,c52bcd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5794d14,c52bcd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52bcd60, ebp = 0 --- Tracing command usb pid 14 tid 100030 td 0xc57082d0 sched_switch(c57082d0,0,104,191,9edd8ee8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57082d0,0,c0ce947a,268,c57082d0,...) at sleepq_switch+0x15f sleepq_wait(c5777dac,0,c52b5cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5777dac,c5777e4c,c0cd1d8f,6c,c5777db4,...) at _cv_wait+0x243 usb_process(c5777da4,c52b5d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5777da4,c52b5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52b5d60, ebp = 0 --- Tracing command usb pid 14 tid 100029 td 0xc57085a0 sched_switch(c57085a0,0,104,191,d342a3d0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57085a0,0,c0ce947a,268,c57085a0,...) at sleepq_switch+0x15f sleepq_wait(c5777d7c,0,c52b2cac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5777d7c,c5777e4c,c0cd1d8f,6c,c5777d84,...) at _cv_wait+0x243 usb_process(c5777d74,c52b2d28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5777d74,c52b2d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52b2d60, ebp = 0 --- Tracing command usb pid 14 tid 100028 td 0xc5708870 sched_switch(c5708870,0,104,191,9e5a3780,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5708870,0,c0ce947a,268,c5708870,...) at sleepq_switch+0x15f sleepq_wait(c5777d4c,0,c52afcac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5777d4c,c5777e4c,c0cd1d8f,6c,c5777d54,...) at _cv_wait+0x243 usb_process(c5777d44,c52afd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5777d44,c52afd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52afd60, ebp = 0 --- Tracing command usb pid 14 tid 100027 td 0xc5708b40 sched_switch(c5708b40,0,104,191,9e5a2450,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5708b40,0,c0ce947a,268,c5708b40,...) at sleepq_switch+0x15f sleepq_wait(c5777d1c,0,c52accac,1,0,...) at sleepq_wait+0x63 _cv_wait(c5777d1c,c5777e4c,c0cd1d8f,6c,c5777d24,...) at _cv_wait+0x243 usb_process(c5777d14,c52acd28,c0cdfca8,349,c56dd2a8,...) at usb_process+0x193 fork_exit(c07e7360,c5777d14,c52acd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52acd60, ebp = 0 --- Tracing command yarrow pid 13 tid 100013 td 0xc55872d0 sched_switch(c55872d0,0,104,191,8519c700,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c55872d0,0,c0ce947a,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4a004,0,c0cd9758,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e4a004,0,0,c0cd9758,64,...) at _sleep+0x342 pause(c0cd9758,64,c0cc5562,111,0,...) at pause+0x47 random_kthread(0,c5212d28,c0cdfca8,349,c56dd550,...) at random_kthread+0x1ef fork_exit(c0758e70,0,c5212d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5212d60, ebp = 0 --- Tracing command g_down pid 4 tid 100012 td 0xc55875a0 sched_switch(c55875a0,0,104,191,8939b1f0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c55875a0,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e47cc4,4c,c0cd9758,0,0,...) at sleepq_wait+0x63 _sleep(c0e47cc4,c0e47c28,24c,c0cd9758,0,...) at _sleep+0x372 g_io_schedule_down(c55875a0,0,c0cdaf3e,74,0,...) at g_io_schedule_down+0x5b g_down_procbody(0,c520fd28,c0cdfca8,349,c557f000,...) at g_down_procbody+0x8d fork_exit(c0856760,0,c520fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc520fd60, ebp = 0 --- Tracing command g_up pid 3 tid 100011 td 0xc5587870 sched_switch(c5587870,0,104,191,89388dc8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c5587870,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c0e47cc0,4c,c0cd9758,0,0,...) at sleepq_wait+0x63 _sleep(c0e47cc0,c0e47c48,24c,c0cd9758,0,...) at _sleep+0x372 g_io_schedule_up(c5587870,0,c0cdaf3e,5d,0,...) at g_io_schedule_up+0x134 g_up_procbody(0,c520cd28,c0cdfca8,349,c557f2a8,...) at g_up_procbody+0x8d fork_exit(c08567f0,0,c520cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc520cd60, ebp = 0 --- Tracing command g_event pid 2 tid 100010 td 0xc5587b40 sched_switch(c5587b40,0,104,191,8515cf70,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,4c,...) at mi_switch+0x200 sleepq_switch(c5587b40,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e47cb8,4c,c0cd9758,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e47cb8,0,4c,c0cd9758,64,...) at _sleep+0x342 g_event_procbody(0,c5209d28,c0cdfca8,349,c557f550,...) at g_event_procbody+0xcb fork_exit(c0856880,0,c5209d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5209d60, ebp = 0 --- Tracing command intr pid 12 tid 100053 td 0xc580d2d0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100051 td 0xc57ca000 sched_switch(c57ca000,0,109,191,d5a76c58,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55cc4f0,...) at mi_switch+0x200 ithread_loop(c55d0190,e5c00d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d0190,e5c00d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c00d60, ebp = 0 --- Tracing command intr pid 12 tid 100050 td 0xc57ca2d0 sched_switch(c57ca2d0,0,109,191,2a6d24e0,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55c6870,...) at mi_switch+0x200 ithread_loop(c55d03f0,c531ad28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d03f0,c531ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc531ad60, ebp = 0 --- Tracing command intr pid 12 tid 100041 td 0xc57cc000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100036 td 0xc57a3b40 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100031 td 0xc57a5b40 sched_switch(c57a5b40,0,109,191,893811b0,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55c65f0,...) at mi_switch+0x200 ithread_loop(c55d0160,c52b9d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d0160,c52b9d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52b9d60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc5709000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc5709870 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xc5709b40 sched_switch(c5709b40,0,109,191,d0fc64b0,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55cc970,...) at mi_switch+0x200 ithread_loop(c55d0780,c5231d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d0780,c5231d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5231d60, ebp = 0 --- Tracing command intr pid 12 tid 100021 td 0xc55d1870 sched_switch(c55d1870,0,109,191,b1c22298,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55cc9f0,...) at mi_switch+0x200 ithread_loop(c55d0790,c522ed28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d0790,c522ed28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc522ed60, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc5707000 sched_switch(c5707000,0,109,191,d0938198,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55cca70,...) at mi_switch+0x200 ithread_loop(c55d07a0,c5228d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d07a0,c5228d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5228d60, ebp = 0 --- Tracing command intr pid 12 tid 100017 td 0xc57075a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc55d12d0 sched_switch(c55d12d0,0,109,191,851579a8,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55ccbf0,...) at mi_switch+0x200 ithread_loop(c55d07c0,c5203d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d07c0,c5203d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5203d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc55d15a0 sched_switch(c55d15a0,0,109,191,88e3f598,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55ccc70,...) at mi_switch+0x200 ithread_loop(c55d07d0,c5200d28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d07d0,c5200d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5200d60, ebp = 0 --- Tracing command intr pid 12 tid 100006 td 0xc5581000 sched_switch(c5581000,0,109,191,608244d0,...) at sched_switch+0x3bc mi_switch(109,0,c0cdff37,52d,c55cccf0,...) at mi_switch+0x200 ithread_loop(c55d07e0,c51fdd28,c0cdfca8,349,c557f7f8,...) at ithread_loop+0x206 fork_exit(c0895360,c55d07e0,c51fdd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc51fdd60, ebp = 0 --- Tracing command intr pid 12 tid 100005 td 0xc55812d0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100004 td 0xc55815a0 sched_switch(c55815a0,0,108,18c,89300b48,...) at sched_switch+0x3bc mi_switch(108,0,c0ce67db,9fe,c55815a0,...) at mi_switch+0x200 sched_idletd(0,c51f4d28,c0cdfca8,349,c557faa0,...) at sched_idletd+0x2bf fork_exit(c08e2330,0,c51f4d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc51f4d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc5581870 sched_switch(c5581870,0,108,18c,89397108,...) at sched_switch+0x3bc mi_switch(108,0,c0ce67db,3aa,c5581870,...) at mi_switch+0x200 sched_idletd(0,c51f1d28,c0cdfca8,349,c557faa0,...) at sched_idletd+0x19f fork_exit(c08e2330,0,c51f1d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc51f1d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc5581b40 sched_switch(c5581b40,0,104,191,83e02b28,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,5c,...) at mi_switch+0x200 sleepq_switch(c5581b40,0,c0ce947a,1a7,5c,...) at sleepq_switch+0x15f sleepq_catch_signals(c0ce947a,160,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(c557fd48,5c,c0cebe39,100,0,...) at sleepq_wait_sig+0x17 _sleep(c557fd48,c557fdd0,15c,c0cebe39,0,...) at _sleep+0x35c kern_wait(c5581b40,ffffffff,c51edc44,0,0,...) at kern_wait+0xb66 wait4(c5581b40,c51edcec,c51edd28,c0ce9cd3,0,...) at wait4+0x3b syscallenter(c5581b40,c51edce4,c51edce4,0,0,...) at syscallenter+0x263 syscall(c51edd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054cd3, esp = 0xbfbfe8dc, ebp = 0xbfbfe8f8 --- Tracing command audit pid 10 tid 100001 td 0xc5587000 sched_switch(c5587000,0,104,191,9e558fe0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5587000,0,c0ce947a,268,c5587000,...) at sleepq_switch+0x15f sleepq_wait(c0fc2300,0,c51eac8c,1,0,...) at sleepq_wait+0x63 _cv_wait(c0fc2300,c0fc22e4,c0d0aa75,194,0,...) at _cv_wait+0x243 audit_worker(0,c51ead28,c0cdfca8,349,c5580000,...) at audit_worker+0x84 fork_exit(c0acc160,0,c51ead28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc51ead60, ebp = 0 --- Tracing command kernel pid 0 tid 100054 td 0xc580d000 sched_switch(c580d000,0,104,191,8f061a88,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c580d000,0,c0ce947a,28b,2,...) at sleepq_switch+0x15f sleepq_timedwait(c0e4a004,0,c0cddde7,2,0,...) at sleepq_timedwait+0x6b _sleep(c0e4a004,0,0,c0cddde7,bb8,...) at _sleep+0x342 pause(c0cddde7,bb8,120,11e,c0e47e28,...) at pause+0x47 deadlkres(0,e5c13d28,c0cdfca8,349,c0e47da0,...) at deadlkres+0x302 fork_exit(c0877160,0,e5c13d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe5c13d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc57092d0 sched_switch(c57092d0,0,104,191,9de7e490,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57092d0,0,c0ce947a,268,c0e48050,...) at sleepq_switch+0x15f sleepq_wait(c5613b80,0,c0ce5770,c0cd9758,0,...) at sleepq_wait+0x63 msleep_spin(c5613b80,c5613b9c,c0cd9758,0,c0ce32cb,...) at msleep_spin+0x21d taskqueue_thread_loop(c5765568,c52a5d28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcff0,c5765568,c52a5d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc52a5d60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc57095a0 sched_switch(c57095a0,0,104,191,8834c9b0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57095a0,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613bc0,0,c0ce5770,c0cd9758,0,...) at sleepq_wait+0x63 msleep_spin(c5613bc0,c5613bdc,c0cd9758,0,c0ce32cb,...) at msleep_spin+0x21d taskqueue_thread_loop(c574c568,c527ad28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcff0,c574c568,c527ad28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc527ad60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc55d1b40 sched_switch(c55d1b40,0,104,191,d4156b98,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c55d1b40,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613d00,0,c0cd9758,0,0,...) at sleepq_wait+0x63 _sleep(c5613d00,c5613d1c,0,c0cd9758,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5c968,c522bd28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcff0,c0e5c968,c522bd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc522bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc57072d0 sched_switch(c57072d0,0,104,191,a79773b0,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c57072d0,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613d80,0,c0cd9758,0,0,...) at sleepq_wait+0x63 _sleep(c5613d80,c5613d9c,0,c0cd9758,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e486f8,c5225d28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcff0,c0e486f8,c5225d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5225d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc5707870 sched_switch(c5707870,0,104,191,a7976048,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5707870,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613dc0,0,c0ce5770,c0cd9758,0,...) at sleepq_wait+0x63 msleep_spin(c5613dc0,c5613ddc,c0cd9758,0,c0ce32cb,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e18d20,c521fd28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcff0,c0e18d20,c521fd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc521fd60, ebp = 0 --- Tracing command kernel pid 0 tid 100015 td 0xc5707b40 sched_switch(c5707b40,0,104,191,a7975150,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5707b40,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613dc0,0,c0ce5770,c0cd9758,0,...) at sleepq_wait+0x63 msleep_spin(c5613dc0,c5613ddc,c0cd9758,0,c0ce32cb,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e18d20,c521cd28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcff0,c0e18d20,c521cd28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc521cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100014 td 0xc5708000 sched_switch(c5708000,0,104,191,a7973fc8,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c5708000,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613dc0,0,c0ce5770,c0cd9758,0,...) at sleepq_wait+0x63 msleep_spin(c5613dc0,c5613ddc,c0cd9758,0,c0ce32cb,...) at msleep_spin+0x21d taskqueue_thread_loop(c0e18d20,c5219d28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0x8f fork_exit(c08fcff0,c0e18d20,c5219d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5219d60, ebp = 0 --- Tracing command kernel pid 0 tid 100009 td 0xc55d1000 sched_switch(c55d1000,0,104,191,fc0fe520,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,0,...) at mi_switch+0x200 sleepq_switch(c55d1000,0,c0ce947a,268,0,...) at sleepq_switch+0x15f sleepq_wait(c5613e00,0,c0cd9758,0,0,...) at sleepq_wait+0x63 _sleep(c5613e00,c5613e1c,0,c0cd9758,0,...) at _sleep+0x372 taskqueue_thread_loop(c0e5b3e0,c5206d28,c0cdfca8,349,c0e47da0,...) at taskqueue_thread_loop+0xb5 fork_exit(c08fcff0,c0e5b3e0,c5206d28) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc5206d60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0e48050 sched_switch(c0e48050,0,104,191,7e5bd910,...) at sched_switch+0x3bc mi_switch(104,0,c0ce947a,1f3,44,...) at mi_switch+0x200 sleepq_switch(c0e48050,0,c0ce947a,28b,0,...) at sleepq_switch+0x15f sleepq_timedwait(c0e47da0,44,c0ce70f7,0,0,...) at sleepq_timedwait+0x6b _sleep(c0e47da0,0,44,c0ce70f7,2710,...) at _sleep+0x342 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x23e mi_startup() at mi_startup+0x96 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 2030 MB Dumping 149 MB: 134 118 102 86 70 54 38 22 6 Dump complete = 0xf db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 doadump () at pcpu.h:231 #1 0xc04d5b49 in db_fncall (dummy1=-1064370694, dummy2=0, dummy3=-1, dummy4=0xe84208c4 "Ø\bBè") at /mnt/pho/src/sys/ddb/db_command.c:548 #2 0xc04d5f7f in db_command (last_cmdp=0xc0e16efc, cmd_table=0x0, dopager=0) at /mnt/pho/src/sys/ddb/db_command.c:445 #3 0xc04d6034 in db_command_script (command=0xc0e17e08 "call doadump") at /mnt/pho/src/sys/ddb/db_command.c:516 #4 0xc04da280 in db_script_exec (scriptname=0xc0e17760 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at /mnt/pho/src/sys/ddb/db_script.c:302 #5 0xc04da311 in db_run_cmd (addr=-1067359032, have_addr=0, count=-398325236, modif=0xe84209fc "`\027âÀ\030~ÎÀÿ") at /mnt/pho/src/sys/ddb/db_script.c:375 #6 0xc04d5f41 in db_command (last_cmdp=0xc0e16efc, cmd_table=0x0, dopager=1) at /mnt/pho/src/sys/ddb/db_command.c:445 #7 0xc04d609a in db_command_loop () at /mnt/pho/src/sys/ddb/db_command.c:498 #8 0xc04d7fbd in db_trap (type=3, code=0) at /mnt/pho/src/sys/ddb/db_main.c:229 #9 0xc08efc2e in kdb_trap (type=3, code=0, tf=0xe8420ba0) at /mnt/pho/src/sys/kern/subr_kdb.c:546 #10 0xc0c044fb in trap (frame=0xe8420ba0) at /mnt/pho/src/sys/i386/i386/trap.c:732 #11 0xc0beb34c in calltrap () at /mnt/pho/src/sys/i386/i386/exception.s:168 #12 0xc08efdfa in kdb_enter (why=0xc0ce4b9a "panic", msg=0xc0ce4b9a "panic") at cpufunc.h:71 #13 0xc08bcc44 in panic (fmt=0xc0c7aa69 "Bad link elm %p prev->next != elm") at /mnt/pho/src/sys/kern/kern_shutdown.c:574 #14 0xc08ca85e in tidhash_remove (td=0xc77552d0) at /mnt/pho/src/sys/kern/kern_thread.c:990 #15 0xc08c9f5e in thr_exit (td=0xc77552d0, uap=0xe8420cec) at /mnt/pho/src/sys/kern/kern_thr.c:287 #16 0xc08fd3b3 in syscallenter (td=0xc77552d0, sa=0xe8420ce4) at /mnt/pho/src/sys/kern/subr_trap.c:318 #17 0xc0c03daf in syscall (frame=0xe8420d28) at /mnt/pho/src/sys/i386/i386/trap.c:1095 #18 0xc0beb3b1 in Xint0x80_syscall () at /mnt/pho/src/sys/i386/i386/exception.s:266 #19 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 14 #14 0xc08ca85e in tidhash_remove (td=0xc77552d0) at /mnt/pho/src/sys/kern/kern_thread.c:990 990 LIST_REMOVE(td, td_hash); (kgdb) l 985 986 void 987 tidhash_remove(struct thread *td) 988 { 989 rw_wlock(&tidhash_lock); 990 LIST_REMOVE(td, td_hash); 991 rw_wunlock(&tidhash_lock); 992 } (kgdb) p *td $1 = {td_lock = 0xc0e4e2c0, td_proc = 0xc6c94d48, td_plist = {tqe_next = 0x0, tqe_prev = 0xc6c94d50}, td_runq = {tqe_next = 0x0, tqe_prev = 0xc0e4e5a8}, td_slpq = {tqe_next = 0x0, tqe_prev = 0xc555ec40}, td_lockq = {tqe_next = 0x0, tqe_prev = 0xe819ca14}, td_hash = {le_next = 0x0, le_prev = 0xc555b154}, td_cpuset = 0xc555fe38, td_sel = 0x0, td_sleepqueue = 0xc555ec40, td_turnstile = 0xc6bafa00, td_umtxq = 0xc7cff280, td_tid = 100437, td_sigqueue = {sq_signals = {__bits = {0, 0, 0, 0}}, sq_kill = {__bits = {0, 0, 0, 0}}, sq_list = {tqh_first = 0x0, tqh_last = 0xc7755338}, sq_proc = 0xc6c94d48, sq_flags = 1}, td_flags = 65540, td_inhibitors = 0, td_pflags = 0, td_dupfd = 0, td_sqqueue = 0, td_wchan = 0x0, td_wmesg = 0x0, td_lastcpu = 0 '\0', td_oncpu = 1 '\001', td_owepreempt = 0 '\0', td_tsqueue = 255 'ÿ', td_locks = 1, td_rw_rlocks = 0, td_lk_slocks = 0, td_blocked = 0x0, td_lockname = 0x0, td_contested = {lh_first = 0x0}, td_sleeplocks = 0xc0f729e8, td_intr_nesting_level = 0, td_pinned = 1, td_ucred = 0xc63fa280, td_estcpu = 0, td_slptick = 0, td_blktick = 0, td_ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 0}, ru_maxrss = 836, ru_ixrss = 12, ru_idrss = 3796, ru_isrss = 128, ru_minflt = 22, ru_majflt = 0, ru_nswap = 0, ru_inblock = 0, ru_oublock = 5, ru_msgsnd = 0, ru_msgrcv = 0, ru_nsignals = 0, ru_nvcsw = 7, ru_nivcsw = 2}, td_rux = {rux_runtime = 0, rux_uticks = 0, rux_sticks = 0, rux_iticks = 0, rux_uu = 0, rux_su = 0, rux_tu = 0}, td_incruntime = 1023992, td_runtime = 1023992, td_pticks = 1, td_sticks = 1, td_iticks = 0, td_uticks = 0, td_intrval = 0, td_oldsigmask = {__bits = {0, 0, 0, 0}}, td_sigmask = {__bits = {0, 0, 0, 0}}, td_generation = 9, td_sigstk = {ss_sp = 0x0, ss_size = 0, ss_flags = 4}, td_xsig = 0, td_profil_addr = 0, td_profil_ticks = 0, td_name = "syscall", '\0' , td_fpop = 0x0, td_dbgflags = 0, td_dbgksi = {ksi_link = {tqe_next = 0x0, tqe_prev = 0x0}, ksi_info = {si_signo = 0, si_errno = 0, si_code = 0, si_pid = 0, si_uid = 0, si_status = 0, si_addr = 0x0, si_value = {sival_int = 0, sival_ptr = 0x0, sigval_int = 0, sigval_ptr = 0x0}, _reason = {_fault = {_trapno = 0}, _timer = { _timerid = 0, _overrun = 0}, _mesgq = {_mqd = 0}, _poll = {_band = 0}, __spare__ = {__spare1__ = 0, __spare2__ = {0, 0, 0, 0, 0, 0, 0}}}}, ksi_flags = 0, ksi_sigq = 0x0}, td_ng_outbound = 0, td_osd = {osd_nslots = 0, osd_slots = 0x0, osd_next = {le_next = 0x0, le_prev = 0x0}}, td_map_def_user = 0x0, td_rqindex = 21 '\025', td_base_pri = 180 '´', td_priority = 180 '´', td_pri_class = 3 '\003', td_user_pri = 180 '´', td_base_user_pri = 180 '´', td_pcb = 0xe8420d80, td_state = TDS_RUNNING, td_retval = {0, 431}, td_slpcallout = {c_links = {sle = {sle_next = 0xc6b95244}, tqe = {tqe_next = 0xc6b95244, tqe_prev = 0xc55f1e70}}, c_time = 119914446, c_arg = 0xc77552d0, c_func = 0xc08f9ed0 , c_lock = 0x0, c_flags = 18, c_cpu = 1}, td_frame = 0xe8420d28, td_kstack_obj = 0xc6ad5908, td_kstack = 3896635392, td_kstack_pages = 2, td_critnest = 1, td_md = {md_spinlock_count = 0, md_saved_flags = 70}, td_sched = 0xc7755574, td_ar = 0x0, td_lprof = {{ lh_first = 0x0}, {lh_first = 0x0}}, td_dtrace = 0x0, td_errno = 0, td_vnet = 0x0, td_vnet_lpush = 0x0, td_intr_frame = 0x0} (kgdb) p *td->td_proc $2 = {p_list = {le_next = 0xc6a95550, le_prev = 0xc65eb2a8}, p_threads = {tqh_first = 0xc77552d0, tqh_last = 0xc77552d8}, p_slock = {lock_object = {lo_name = 0xc0ce35ba "process slock", lo_flags = 720896, lo_data = 0, lo_witness = 0x0}, mtx_lock = 4}, p_ucred = 0xc63fa280, p_fd = 0xc7947300, p_fdtol = 0x0, p_stats = 0xc6327300, p_limit = 0xc65e3800, p_limco = {c_links = {sle = {sle_next = 0x0}, tqe = {tqe_next = 0x0, tqe_prev = 0xc6a95588}}, c_time = 119995533, c_arg = 0xc6c94d48, c_func = 0xc08b7b20 , c_lock = 0xc6c94dd0, c_flags = 6, c_cpu = 0}, p_sigacts = 0xc80c5000, p_flag = 268435458, p_state = PRS_NORMAL, p_pid = 82295, p_hash = {le_next = 0x0, le_prev = 0xc55575dc}, p_pglist = {le_next = 0xc6ecb7f8, le_prev = 0xc65eb318}, p_pptr = 0xc6b0f7f8, p_sibling = {le_next = 0xc6ecb7f8, le_prev = 0xc65eb324}, p_children = {lh_first = 0x0}, p_mtx = {lock_object = {lo_name = 0xc0ce35ad "process lock", lo_flags = 21168128, lo_data = 0, lo_witness = 0xc5522340}, mtx_lock = 4}, p_ksi = 0xc6345aa0, p_sigqueue = {sq_signals = {__bits = {0, 0, 0, 0}}, sq_kill = {__bits = {0, 0, 0, 0}}, sq_list = {tqh_first = 0x0, tqh_last = 0xc6c94e08}, sq_proc = 0xc6c94d48, sq_flags = 1}, p_oppid = 0, p_vmspace = 0xc851e0ec, p_swtick = 119994533, p_realtimer = {it_interval = {tv_sec = 0, tv_usec = 0}, it_value = {tv_sec = 0, tv_usec = 0}}, p_ru = {ru_utime = {tv_sec = 0, tv_usec = 0}, ru_stime = {tv_sec = 0, tv_usec = 0}, ru_maxrss = 0, ru_ixrss = 0, ru_idrss = 0, ru_isrss = 0, ru_minflt = 0, ru_majflt = 0, ru_nswap = 0, ru_inblock = 0, ru_oublock = 0, ru_msgsnd = 0, ru_msgrcv = 0, ru_nsignals = 0, ru_nvcsw = 0, ru_nivcsw = 0}, p_rux = {rux_runtime = 0, rux_uticks = 0, rux_sticks = 0, rux_iticks = 0, rux_uu = 0, rux_su = 0, rux_tu = 0}, p_crux = {rux_runtime = 0, rux_uticks = 0, rux_sticks = 0, rux_iticks = 0, rux_uu = 0, rux_su = 0, rux_tu = 0}, p_profthreads = 0, p_exitthreads = 0, p_traceflag = 0, p_tracevp = 0x0, p_tracecred = 0x0, p_textvp = 0xc6a5b414, p_lock = 0, p_sigiolst = {slh_first = 0x0}, p_sigparent = 20, p_sig = 0, p_code = 0, p_stops = 0, p_stype = 0, p_step = 0 '\0', p_pfsflags = 0 '\0', p_nlminfo = 0x0, p_aioinfo = 0x0, p_singlethread = 0x0, p_suspcount = 0, p_xthread = 0x0, p_boundary_count = 0, p_pendingcnt = 0, p_itimers = 0x0, p_magic = 3203398350, p_osrel = 900021, p_comm = "syscall", '\0' , p_pgrp = 0xc758d4c0, p_sysent = 0xc0e03d40, p_args = 0xc571fd00, p_cpulimit = 200, p_nice = 0 '\0', p_fibnum = 0, p_xstat = 0, p_klist = {kl_list = {slh_first = 0x0}, kl_lock = 0xc0889810 , kl_unlock = 0xc0889840 , kl_assert_locked = 0xc0889b90 , kl_assert_unlocked = 0xc0889b60 , kl_lockarg = 0xc6c94dd0}, p_numthreads = 1, p_md = {md_ldt = 0x0}, p_itcallout = {c_links = {sle = {sle_next = 0x0}, tqe = { tqe_next = 0x0, tqe_prev = 0x0}}, c_time = 0, c_arg = 0x0, c_func = 0, c_lock = 0x0, c_flags = 16, c_cpu = 0}, p_acflag = 1, p_peers = 0x0, p_leader = 0xc6c94d48, p_emuldata = 0x0, p_label = 0x0, p_sched = 0xc6c94ff0, p_ktr = {stqh_first = 0x0, stqh_last = 0xc6c94fd8}, p_mqnotifier = {lh_first = 0x0}, p_dtrace = 0x0, p_pwait = {cv_description = 0xc0ce3dec "ppwait", cv_waiters = 0}} (kgdb) -- Test scenario: run.sh -a