GENERIC releng8 from 2011-03-25 13:09:57 UTC, r220001M, vmcore.3 KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2011 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.2-STABLE #0 r220001M: Fri Apr 1 07:59:30 CEST 2011 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.45-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3536408576 (3372 MB) ACPI APIC Table: <060508 APIC1048> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: <060508 RSDT1048> on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, d7f00000 (3) failed Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 pci1: at device 5.2 (no driver attached) pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:21:85:15:33:7d re0: [ITHREAD] atapci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 atapci0: [ITHREAD] atapci0: AHCI v1.10 controller with 4 3Gbps ports, PM supported ata2: on atapci0 ata2: port is not ready (timeout 0ms) tfd = 000001d0 ata2: software reset clear timeout ata2: [ITHREAD] ata3: on atapci0 ata3: [ITHREAD] ata4: on atapci0 ata4: [ITHREAD] ata5: on atapci0 ata5: [ITHREAD] ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 ohci0: [ITHREAD] usbus0: on ohci0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 ohci1: [ITHREAD] usbus1: on ohci1 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 ohci2: [ITHREAD] usbus2: on ohci2 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 ohci3: [ITHREAD] usbus3: on ohci3 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 ohci4: [ITHREAD] usbus4: on ohci4 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: [ITHREAD] ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5: on ehci0 pci0: at device 20.0 (no driver attached) atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: on atapci1 ata0: [ITHREAD] pci0: at device 20.2 (no driver attached) isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 fwohci0: port 0xe800-0xe87f mem 0xfebff800-0xfebfffff irq 20 at device 6.0 on pci3 fwohci0: [ITHREAD] fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:dc:10:00:01:62:ad:eb fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 dcons_crom0: on firewire0 dcons_crom0: bus_addr 0xd9e020 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:dc:10:62:ad:eb fwe0: Ethernet address: 02:dc:10:62:ad:eb fwip0: on firewire0 fwip0: Firewire address: 00:dc:10:00:01:62:ad:eb @ 0xfffe00000000, S400, maxrec 2048 fwohci0: Initiate bus reset fwohci0: fwohci_intr_core: BUS reset fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode acpi_button0: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: [FILTER] uart0: console (115200,n,8,1) fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FILTER] atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model IntelliMouse Explorer, device ID 4 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: parallel port not found. acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 hwpstate0: on cpu0 Timecounters tick every 1.000 msec firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me) firewire0: bus manager 0 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 acd0: DVDR at ata0-slave UDMA33 ugen0.1: at usbus0 uhub0: on usbus0 Expensive timeout(9) function: 0xc08cec30(0xc73b02e0) 0.010615874 s ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 ad4: 476940MB at ata2-master UDMA100 SATA 3Gb/s SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 uhub5: 10 ports with 10 removable, self powered Trying to mount root from ufs:/dev/ad4s2a Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s2a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2a: clean, 583720 free (912 frags, 72851 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 651530 free (1282 frags, 81281 blocks, 0.1% fragmentation) /dev/ad4s1g: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1g: clean, 91353168 free (3056 frags, 11418764 blocks, 0.0% fragmentation) /dev/ad4s2d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2d: clean, 8635689 free (41841 frags, 1074231 blocks, 0.4% fragmentation) /dev/ad4s2e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s2e: clean, 25271785 free (521 frags, 3158908 blocks, 0.0% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet6 ::1 prefixlen 128 inet 127.0.0.1 netmask 0xff000000 nd6 options=3 re0: flags=8843 metric 0 mtu 1500 options=389b ether 00:21:85:15:33:7d inet 192.168.1.7 netmask 0xffffff00 broadcast 192.168.1.255 media: Ethernet autoselect (none) status: no carrier add net default: gateway 192.168.1.1 Starting devd. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xdb112194 bufwait (bufwait) @ kern/vfs_bio.c:2636 2nd 0xc7aba600 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,2e687361,38323a63,a0d35,c088cd81,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08c9c0b,c0c7e772,c0f09dc0,c712ff60,e9bad898,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e772,c7aba600,c0c9b15a,c71335d0,c0c9afa0,...) at _witness_debugger+0x25 witness_checkorder(c7aba600,9,c0c9af97,11d,0,...) at witness_checkorder+0x6aa _sx_xlock(c7aba600,0,c0c9af97,11d,c7e724fc,...) at _sx_xlock+0x38 ufsdirhash_acquire(e9bad9f0,158,db9ee4b8,e9bad964,c0abaaa9,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(c7e724fc,e9bad9f0,14b8,e9bad950,e9bad954,...) at ufsdirhash_add+0x10 ufs_direnter(c7e682b0,c7ffe158,e9bad9f0,e9badbd0,db112608,...) at ufs_direnter+0x6a9 ufs_mkdir(e9badbf8,c0cacd3f,0,e9badb3c,e9badc1c,...) at ufs_mkdir+0x7d3 VOP_MKDIR_APV(c0d7bf40,e9badbf8,e9badbd0,e9badb3c,0,...) at VOP_MKDIR_APV+0x64 kern_mkdirat(c7e8d2e0,ffffff9c,28201020,0,1c0,...) at kern_mkdirat+0x21b kern_mkdir(c7e8d2e0,28201020,0,1c0,e9badc7c,...) at kern_mkdir+0x2e mkdir(c7e8d2e0,e9badcec,e9badd28,c0c7dba4,0,...) at mkdir+0x29 syscallenter(c7e8d2e0,e9badce4,e9badce4,0,369e99,...) at syscallenter+0x246 syscall(e9badd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, mkdir), eip = 0x2816b9e3, esp = 0xbfbfe8fc, ebp = 0xbfbfeda8 --- Clearing /tmp (X related). Starting mountd. Starting nfsd. Updating motd:. Starting ntpd. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Starting default moused. Expensive timeout(9) function: 0xc0781130(0xc0f951c0) 0.011763785 s Starting inetd. Fri Apr 1 08:10:20 CEST 2011 FreeBSD/i386 (x4.osted.lan) (console) login: Apr 1 08:10:31 x4 su: pho to root on /dev/pts/0 SU test #1 uma_zalloc_arg: zone "512" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5844 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,c712f4d0,c712ff60,3,c0f09268,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16d4,2,ffffffff,c0f0926c,e9c1e750,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9c1e764,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c37295,e9c1e7a4,...) at witness_warn+0x1fe uma_zalloc_arg(c198ba80,0,102,c83e8000,e9c1e840,...) at uma_zalloc_arg+0x34 malloc(158,c0d6b510,102,8bc,c83e8000,...) at malloc+0x51 __mnt_vnode_first(e9c1e840,c83e8000,c0c994a6,1703,fffffff2,...) at __mnt_vnode_first+0x87 softdep_request_cleanup(c83a6800,c8726158,c8390300,0,9e2d,...) at softdep_request_cleanup+0x3cb ffs_alloc(c84e85e4,18,0,4038,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c8726158,60000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9c1eb94,c0cacd5d,c87261b0,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9c1eb94,c8726158,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c83dd690,e9c1ec28,c8390300,0,c7e8a8a0,...) at vn_write+0x1aa dofilewrite(e9c1ec28,ffffffff,ffffffff,0,c83dd690,...) at dofilewrite+0x95 kern_writev(c7e8a8a0,3,e9c1ec28,e9c1ec48,1,...) at kern_writev+0x58 write(c7e8a8a0,e9c1ecec,e9c1ed28,c0c7dba4,0,...) at write+0x4f syscallenter(c7e8a8a0,e9c1ece4,e9c1ece4,0,c0dcddc0,...) at syscallenter+0x246 syscall(e9c1ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Retry reclaim Seeking 5167 blocks Free inodes 140407, free blocks 5087, free fragments 21 Pending workitems 1111, Allocated inodes 905 Found 555 files with 1154400 blocks pending Other types: dirrem 0, freefrag 0, freefile 556 uma_zalloc_arg: zone "512" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,4,1b000,0,c7e81d48,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37750,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37764,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c37295,e9d377a4,...) at witness_warn+0x1fe uma_zalloc_arg(c198ba80,0,102,c83e8000,e9d37840,...) at uma_zalloc_arg+0x34 malloc(158,c0d6b510,102,8bc,c83e8000,...) at malloc+0x51 __mnt_vnode_first(e9d37840,c83e8000,c0c994a6,1703,fffffff0,...) at __mnt_vnode_first+0x87 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x3cb ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- lock order reversal: (sleepable after non-sleepable) 1st 0xc83d6868 ufs (ufs) @ kern/vfs_vnops.c:607 2nd 0xc7e81d48 FFS (FFS Lock) @ ufs/ffs/ffs_softdep.c:5874 3rd 0xc873d1b0 ufs (ufs) @ kern/vfs_subr.c:2130 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,353a632e,d343738,c0b8000a,e9d37670,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c08c9c0b,c0c7e78b,c7133500,852,e9d37694,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e78b,c873d1b0,c0c749bf,c7133568,c0c84062,...) at _witness_debugger+0x25 witness_checkorder(c873d1b0,9,c0c84059,852,0,...) at witness_checkorder+0x6aa __lockmgr_args(c873d1b0,80100,c873d218,0,0,...) at __lockmgr_args+0x6bd ffs_lock(e9d3779c,c0c994af,80100,c873d158,e9d377bc,...) at ffs_lock+0x8a VOP_LOCK1_APV(c0d7bf40,e9d3779c,e9d3779c,c0d951a0,c873d158,...) at VOP_LOCK1_APV+0x4d _vn_lock(c873d158,80100,c0c84059,852,8,...) at _vn_lock+0x3d vget(c873d158,80100,c88265c0,1710,fffffff0,...) at vget+0x6c softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x4ea ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- uma_zalloc_arg: zone "g_bio" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,e9d375cc,c08d683b,c0c994af,c0c73ddd,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37654,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37668,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c73373,a4,...) at witness_warn+0x1fe uma_zalloc_arg(c1979000,0,102,e9d376d8,c0842db5,...) at uma_zalloc_arg+0x34 g_alloc_bio(e,0,0,db30bd24,e9d376f4,...) at g_alloc_bio+0x23 g_vfs_strategy(c83de3a4,db30bd24) at g_vfs_strategy+0x35 ffs_geom_strategy(c83de3a4,db30bd24,c873d1b0,e9d37714,c0bbd082,...) at ffs_geom_strategy+0x14f ufs_strategy(e9d37758,c0cacd1c,db30bd24,a00200b4,e9d37764,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c0d7bf40,e9d37758,c0d95200,c873d158,db30bd24,...) at VOP_STRATEGY_APV+0x73 bufstrategy(c873d24c,db30bd24,38d,0,db30bd24,...) at bufstrategy+0x2e bufwrite(db30bd24,e9d377ec,c0ab5aed,db30bd24,0,...) at bufwrite+0xfe bawrite(db30bd24,0,c0c9ad45,101,0,...) at bawrite+0x18 ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x26d softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping on "bo_wwait" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,0,0,0,c7abebe0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37714,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37728,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,c873d24c,c0c7a95e,c0c8229d,e9d37744,...) at witness_warn+0x1fe _sleep(c873d280,c873d24c,4f,c0c8229d,0,...) at _sleep+0x5f bufobj_wwait(c873d24c,3,0,138,0,...) at bufobj_wwait+0x43 ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x344 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- uma_zalloc_arg: zone "g_bio" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,e9d37594,c08d683b,c0c994af,c0c73ddd,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d3761c,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37630,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c73373,1000,...) at witness_warn+0x1fe uma_zalloc_arg(c1979000,0,102,e9d376a0,c0842db5,...) at uma_zalloc_arg+0x34 g_alloc_bio(e,db21a840,db21a840,db21a840,e9d376bc,...) at g_alloc_bio+0x23 g_vfs_strategy(c83de3a4,db21a840) at g_vfs_strategy+0x35 ffs_geom_strategy(c83de3a4,db21a840,0,db21a840,0,...) at ffs_geom_strategy+0x14f bufwrite(db21a840,0,c0c9a7c3,767,db21a840) at bufwrite+0x13b ffs_bufwrite(db21a840,0,c0c994a6,14f9,e9d37730,...) at ffs_bufwrite+0x268 softdep_sync_metadata(c873d158,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0x330 ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping on "biowr" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,0,1,c0dcddc0,c727ab80,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37628,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d3763c,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,c7146920,c0c7a95e,c0c824f4,0,...) at witness_warn+0x1fe _sleep(db21a840,c7146920,4c,c0c824f4,0,...) at _sleep+0x5f bwait(db21a840,4c,c0c824f4,db21a840,e9d376dc,...) at bwait+0x6f bufwait(db21a840,db21a840,0,db21a840,0,...) at bufwait+0x48 bufwrite(db21a840,0,c0c9a7c3,767,db21a840) at bufwrite+0x143 ffs_bufwrite(db21a840,0,c0c994a6,14f9,e9d37730,...) at ffs_bufwrite+0x268 softdep_sync_metadata(c873d158,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0x330 ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- uma_zalloc_arg: zone "g_bio" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,e9d3753c,c08d683b,c0c994af,c0c73ddd,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d375c4,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d375d8,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c73373,c08d5e17,...) at witness_warn+0x1fe uma_zalloc_arg(c1979000,0,102,e9d37648,c0842db5,...) at uma_zalloc_arg+0x34 g_alloc_bio(e,0,0,db30bd24,e9d37664,...) at g_alloc_bio+0x23 g_vfs_strategy(c83de3a4,db30bd24) at g_vfs_strategy+0x35 ffs_geom_strategy(c83de3a4,db30bd24,c873d1b0,e9d37684,c0bbd082,...) at ffs_geom_strategy+0x14f ufs_strategy(e9d376c8,c0cacd1c,db30bd24,a00200a4,e9d376d4,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c0d7bf40,e9d376c8,c0d95200,c873d158,db30bd24,...) at VOP_STRATEGY_APV+0x73 bufstrategy(c873d24c,db30bd24,38d,db30bd24,0,...) at bufstrategy+0x2e bufwrite(db30bd24,e9d37790,c0aade5a,db30bd24,0,...) at bufwrite+0xfe bawrite(db30bd24,0,c0c994a6,155d,e9d37730,...) at bawrite+0x18 softdep_sync_metadata(c873d158,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0xdaa ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping on "drainvp" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,0,0,0,c855f000,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37684,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37698,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,c873d24c,c0c7a95e,c0c99ca1,e9d376b4,...) at witness_warn+0x1fe _sleep(c873d280,c873d24c,4d,c0c99ca1,0,...) at _sleep+0x5f drain_output(c873d24c,0,c0c994a6,14b8,e9d37730,...) at drain_output+0x5b softdep_sync_metadata(c873d158,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0xe7 ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- uma_zalloc_arg: zone "g_bio" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,e9d375c0,c08d683b,c0c994af,c0c73ddd,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37648,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d3765c,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c73373,c83a6800,...) at witness_warn+0x1fe uma_zalloc_arg(c1979000,0,102,e9d376cc,c0842db5,...) at uma_zalloc_arg+0x34 g_alloc_bio(e,db24c010,db24c010,db24c010,e9d376e8,...) at g_alloc_bio+0x23 g_vfs_strategy(c83de3a4,db24c010) at g_vfs_strategy+0x35 ffs_geom_strategy(c83de3a4,db24c010,0,db24c010,c881b3a0,...) at ffs_geom_strategy+0x14f bufwrite(db24c010,0,c0c9a7c3,767,0) at bufwrite+0x13b ffs_bufwrite(db24c010,c8679500,100,4000,0,...) at ffs_bufwrite+0x268 ffs_update(c873d158,1,c0c9ad45,165,0,...) at ffs_update+0x27b ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x3ed softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping on "biowr" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,3,1,c0dcf140,c727ab80,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f0910c,e9d37654,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9d37668,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,c71468bc,c0c7a95e,c0c824f4,0,...) at witness_warn+0x1fe _sleep(db24c010,c71468bc,4c,c0c824f4,0,...) at _sleep+0x5f bwait(db24c010,4c,c0c824f4,db24c010,e9d37708,...) at bwait+0x6f bufwait(db24c010,db24c010,0,db24c010,c881b3a0,...) at bufwait+0x48 bufwrite(db24c010,0,c0c9a7c3,767,0) at bufwrite+0x143 ffs_bufwrite(db24c010,c8679500,100,4000,0,...) at ffs_bufwrite+0x268 ffs_update(c873d158,1,c0c9ad45,165,0,...) at ffs_update+0x27b ffs_syncvnode(c873d158,1,c88265c0,1710,fffffff0,...) at ffs_syncvnode+0x3ed softdep_request_cleanup(c83a6800,c83d6810,c8390300,0,9e37,...) at softdep_request_cleanup+0x579 ffs_alloc(c861f828,36,0,4fa08,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c83d6810,d8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9d37b94,c0cacd5d,c83d6868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9d37b94,c83d6810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9edc8,e9d37c28,c8390300,0,c88265c0,...) at vn_write+0x1aa dofilewrite(e9d37c28,ffffffff,ffffffff,0,c7b9edc8,...) at dofilewrite+0x95 kern_writev(c88265c0,3,e9d37c28,e9d37c48,1,...) at kern_writev+0x58 write(c88265c0,e9d37cec,e9d37d28,c0c7dba4,0,...) at write+0x4f syscallenter(c88265c0,e9d37ce4,e9d37ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Retry reclaim Seeking 5158 blocks Free inodes 140408, free blocks 5086, free fragments 23 Pending workitems 1315, Allocated inodes 904 Found 657 files with 1366560 blocks pending Other types: dirrem 0, freefrag 0, freefile 658 uma_zalloc_arg: zone "512" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,4,1b000,0,c7e81d48,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f08504,e9cfa750,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9cfa764,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c37295,e9cfa7a4,...) at witness_warn+0x1fe uma_zalloc_arg(c198ba80,0,102,c83e8000,e9cfa840,...) at uma_zalloc_arg+0x34 malloc(158,c0d6b510,102,8bc,c83e8000,...) at malloc+0x51 __mnt_vnode_first(e9cfa840,c83e8000,c0c994a6,1703,fffffff4,...) at __mnt_vnode_first+0x87 softdep_request_cleanup(c83a6800,c86d4d70,c8390300,0,9e43,...) at softdep_request_cleanup+0x3cb ffs_alloc(c8822828,39,0,37a28,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c86d4d70,e4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cfab94,c0cacd5d,c86d4dc8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cfab94,c86d4d70,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891a508,e9cfac28,c8390300,0,c83e08a0,...) at vn_write+0x1aa dofilewrite(e9cfac28,ffffffff,ffffffff,0,c891a508,...) at dofilewrite+0x95 kern_writev(c83e08a0,3,e9cfac28,e9cfac48,1,...) at kern_writev+0x58 write(c83e08a0,e9cfacec,e9cfad28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e08a0,e9cface4,e9cface4,0,c0dce440,...) at syscallenter+0x246 syscall(e9cfad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- uma_zalloc_arg: zone "g_bio" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,e9cfa5cc,c08d683b,c0c994af,c0c73ddd,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f08504,e9cfa654,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9cfa668,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c0c9c0d6,c0c73373,a4,...) at witness_warn+0x1fe uma_zalloc_arg(c1979000,0,102,e9cfa6d8,c0842db5,...) at uma_zalloc_arg+0x34 g_alloc_bio(e,0,0,db14830c,e9cfa6f4,...) at g_alloc_bio+0x23 g_vfs_strategy(c83de3a4,db14830c) at g_vfs_strategy+0x35 ffs_geom_strategy(c83de3a4,db14830c,c84a4868,e9cfa714,c0bbd082,...) at ffs_geom_strategy+0x14f ufs_strategy(e9cfa758,c0cacd1c,db14830c,a00200a4,e9cfa764,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c0d7bf40,e9cfa758,c0d95200,c84a4810,db14830c,...) at VOP_STRATEGY_APV+0x73 bufstrategy(c84a4904,db14830c,38d,0,db14830c,...) at bufstrategy+0x2e bufwrite(db14830c,e9cfa7ec,c0ab5aed,db14830c,0,...) at bufwrite+0xfe bawrite(db14830c,0,c0c9ad45,101,0,...) at bawrite+0x18 ffs_syncvnode(c84a4810,1,c83e08a0,1710,fffffff4,...) at ffs_syncvnode+0x26d softdep_request_cleanup(c83a6800,c86d4d70,c8390300,0,9e43,...) at softdep_request_cleanup+0x579 ffs_alloc(c8822828,39,0,37a28,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c86d4d70,e4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cfab94,c0cacd5d,c86d4dc8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cfab94,c86d4d70,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891a508,e9cfac28,c8390300,0,c83e08a0,...) at vn_write+0x1aa dofilewrite(e9cfac28,ffffffff,ffffffff,0,c891a508,...) at dofilewrite+0x95 kern_writev(c83e08a0,3,e9cfac28,e9cfac48,1,...) at kern_writev+0x58 write(c83e08a0,e9cfacec,e9cfad28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e08a0,e9cface4,e9cface4,0,c0dce440,...) at syscallenter+0x246 syscall(e9cfad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping on "bo_wwait" with the following non-sleepable locks held: exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,0,0,0,c7abb558,...) at db_trace_self_wrapper+0x26 kdb_backtrace(16f2,2,ffffffff,c0f08504,e9cfa714,...) at kdb_backtrace+0x2a _witness_debugger(c0c7e09e,e9cfa728,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,c84a4904,c0c7a95e,c0c8229d,e9cfa744,...) at witness_warn+0x1fe _sleep(c84a4938,c84a4904,4f,c0c8229d,0,...) at _sleep+0x5f bufobj_wwait(c84a4904,3,0,138,0,...) at bufobj_wwait+0x43 ffs_syncvnode(c84a4810,1,c83e08a0,1710,fffffff4,...) at ffs_syncvnode+0x344 softdep_request_cleanup(c83a6800,c86d4d70,c8390300,0,9e43,...) at softdep_request_cleanup+0x579 ffs_alloc(c8822828,39,0,37a28,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c86d4d70,e4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cfab94,c0cacd5d,c86d4dc8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cfab94,c86d4d70,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891a508,e9cfac28,c8390300,0,c83e08a0,...) at vn_write+0x1aa dofilewrite(e9cfac28,ffffffff,ffffffff,0,c891a508,...) at dofilewrite+0x95 kern_writev(c83e08a0,3,e9cfac28,e9cfac48,1,...) at kern_writev+0x58 write(c83e08a0,e9cfacec,e9cfad28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e08a0,e9cface4,e9cface4,0,c0dce440,...) at syscallenter+0x246 syscall(e9cfad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Sleeping thread (tid 100181, pid 2961) owns a non-sleepable lock sched_switch(c83e08a0,0,104,c83e08a0,12c8c527,...) at sched_switch+0x28a mi_switch(104,0,c83e08a0,c83e08a0,c83e08a0,...) at mi_switch+0x11a sleepq_switch(c83e08a0,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c828d8,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,80900,c0f42844,0,0,...) at __lockmgr_args+0x9af getdirtybuf(c0f42844,0,c0c994a6,14c5,e9cfa730,...) at getdirtybuf+0xa9 softdep_sync_metadata(c84a4810,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0x2fb ffs_syncvnode(c84a4810,1,c83e08a0,1710,fffffff4,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c86d4d70,c8390300,0,9e43,...) at softdep_request_cleanup+0x579 ffs_alloc(c8822828,39,0,37a28,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c86d4d70,e4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cfab94,c0cacd5d,c86d4dc8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cfab94,c86d4d70,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891a508,e9cfac28,c8390300,0,c83e08a0,...) at vn_write+0x1aa dofilewrite(e9cfac28,ffffffff,ffffffff,0,c891a508,...) at dofilewrite+0x95 kern_writev(c83e08a0,3,e9cfac28,e9cfac48,1,...) at kern_writev+0x58 write(c83e08a0,e9cfacec,e9cfad28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e08a0,e9cface4,e9cface4,0,c0dce440,...) at syscallenter+0x246 syscall(e9cfad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- panic: sleeping thread cpuid = 0 KDB: stack backtrace: db_trace_self_wrapper(c0c7c938,36393220,6f202931,20736e77,6f6e2061,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0ca8ab5,0,c0c7ddb1,e793dba4,0,...) at kdb_backtrace+0x2a panic(c0c7ddb1,ffffffff,b91,cc,c7fda000,...) at panic+0x117 propagate_priority(c0ddcb3c,0,c0c7dd56,2e1,c0ddcb38,...) at propagate_priority+0xe3 turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,e7e,...) at turnstile_wait+0x239 _mtx_lock_sleep(c7e81d48,c73d5b80,0,c0c994a6,e7e,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c994a6,e7e,8,...) at _mtx_lock_flags+0x6f handle_workitem_freefile(0,e793dc7c,2,3b6,8,...) at handle_workitem_freefile+0xab process_worklist_item(c0f42844,0,c0c994a6,34a,c73d5b80,...) at process_worklist_item+0x1d2 softdep_process_worklist(c83e8000,0,c0c994a6,2fa,3e8,...) at softdep_process_worklist+0x63 softdep_flush(0,e793dd28,c0c76ce3,359,c727cac0,...) at softdep_flush+0x287 fork_exit(c0aab850,0,e793dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793dd60, ebp = 0 --- KDB: enter: panic [thread pid 20 tid 100075 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 20 tid 100075 td 0xc73d5b80 kdb_enter(c0c7a393,c0c7a393,c0c7ddb1,e793dba4,0,...) at kdb_enter+0x3a panic(c0c7ddb1,ffffffff,b91,cc,c7fda000,...) at panic+0x134 propagate_priority(c0ddcb3c,0,c0c7dd56,2e1,c0ddcb38,...) at propagate_priority+0xe3 turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,e7e,...) at turnstile_wait+0x239 _mtx_lock_sleep(c7e81d48,c73d5b80,0,c0c994a6,e7e,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c994a6,e7e,8,...) at _mtx_lock_flags+0x6f handle_workitem_freefile(0,e793dc7c,2,3b6,8,...) at handle_workitem_freefile+0xab process_worklist_item(c0f42844,0,c0c994a6,34a,c73d5b80,...) at process_worklist_item+0x1d2 softdep_process_worklist(c83e8000,0,c0c994a6,2fa,3e8,...) at softdep_process_worklist+0x63 softdep_flush(0,e793dd28,c0c76ce3,359,c727cac0,...) at softdep_flush+0x287 fork_exit(c0aab850,0,e793dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793dd60, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x68f780 curthread = 0xc73d5b80: pid 20 "softdepflush" curpcb = 0xe793dd80 fpcurthread = none idlethread = 0xc7173000: tid 100006 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x614e780 curthread = 0xc71732e0: pid 11 "idle: cpu1" curpcb = 0xc6f0ad80 fpcurthread = none idlethread = 0xc71732e0: tid 100005 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6151780 curthread = 0xc71735c0: pid 11 "idle: cpu2" curpcb = 0xc6f07d80 fpcurthread = none idlethread = 0xc71735c0: tid 100004 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6154780 curthread = 0xc71738a0: pid 11 "idle: cpu3" curpcb = 0xc6f04d80 fpcurthread = none idlethread = 0xc71738a0: tid 100003 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 2967 (linger2) thread 0xc7fda000 (100162) exclusive lockmgr ufs (ufs) r = 0 (0xc8759710) locked @ kern/vfs_vnops.c:607 Process 2966 (linger2) thread 0xc7fda5c0 (100145) exclusive lockmgr ufs (ufs) r = 0 (0xc83ad1b0) locked @ kern/vfs_lookup.c:502 Process 2965 (linger2) thread 0xc80ea000 (100172) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb3a5708) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2a7288) locked @ kern/vfs_bio.c:2636 exclusive lockmgr ufs (ufs) r = 0 (0xc88195b8) locked @ kern/vfs_vnops.c:607 Process 2964 (linger2) thread 0xc7f6b2e0 (100108) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2c9c28) locked @ kern/vfs_bio.c:2636 exclusive lockmgr ufs (ufs) r = 0 (0xc8717868) locked @ kern/vfs_vnops.c:607 Process 2963 (linger2) thread 0xc8826b80 (100194) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb37bb24) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb281d74) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb30b240) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb1e46c8) locked @ kern/vfs_bio.c:1891 exclusive lockmgr ufs (ufs) r = 0 (0xc8779c70) locked @ kern/vfs_vnops.c:607 Process 2962 (linger2) thread 0xc7fcdb80 (100200) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2399ec) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2cde24) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb324fdc) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb31abb4) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb223fe8) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb16dbb8) locked @ kern/vfs_bio.c:1891 exclusive lockmgr ufs (ufs) r = 0 (0xc8759b18) locked @ kern/vfs_vnops.c:607 Process 2961 (linger2) thread 0xc83e08a0 (100181) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb14836c) locked @ ufs/ffs/ffs_softdep.c:6342 exclusive lockmgr ufs (ufs) r = 0 (0xc84a4868) locked @ kern/vfs_subr.c:2130 exclusive sleep mutex FFS (FFS Lock) r = 0 (0xc7e81d48) locked @ ufs/ffs/ffs_softdep.c:5874 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb207874) locked @ kern/vfs_bio.c:2636 exclusive lockmgr ufs (ufs) r = 0 (0xc86d4dc8) locked @ kern/vfs_vnops.c:607 Process 2960 (linger2) thread 0xc7fdb8a0 (100136) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2d7bdc) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb385408) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb1d3d3c) locked @ kern/vfs_bio.c:2636 exclusive lockmgr bufwait (bufwait) r = 0 (0xdb34a01c) locked @ kern/vfs_bio.c:1891 exclusive lockmgr ufs (ufs) r = 0 (0xc875f460) locked @ kern/vfs_vnops.c:607 Process 2959 (linger2) thread 0xc83e1b80 (100175) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb22d25c) locked @ kern/vfs_bio.c:2636 exclusive lockmgr ufs (ufs) r = 0 (0xc85ddc70) locked @ kern/vfs_vnops.c:607 Process 2958 (linger2) thread 0xc7be72e0 (100089) exclusive lockmgr bufwait (bufwait) r = 0 (0xdb2a4714) locked @ kern/vfs_bio.c:2636 exclusive lockmgr ufs (ufs) r = 0 (0xc8758868) locked @ kern/vfs_vnops.c:607 Process 1382 (sshd) thread 0xc7fd7b80 (100163) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc80b8560) locked @ kern/uipc_sockbuf.c:148 Process 1381 (sshd) thread 0xc7fdb5c0 (100140) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc817e08c) locked @ kern/uipc_sockbuf.c:148 Process 1380 (sshd) thread 0xc7f67b80 (100129) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc80e408c) locked @ kern/uipc_sockbuf.c:148 Process 1193 (sshd) thread 0xc7e8e000 (100101) exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xc80b83c4) locked @ kern/uipc_sockbuf.c:148 db:0:alllocks> show lockedvnods Locked vnodes 0xc83ad158: tag ufs, type VDIR usecount 13, writecount 0, refcount 16 mountedhere 0 flags (VV_ROOT) v_object 0xc7e88440 ref 0 pages 4 lock type ufs: EXCL by thread 0xc7fda5c0 (pid 2966) #0 0xc08865a5 at __lockmgr_args+0x4a5 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc09148c5 at lookup+0xe5 #5 0xc0915b5f at namei+0x4cf #6 0xc092bc60 at vn_open_cred+0x90 #7 0xc092c1cb at vn_open+0x3b #8 0xc0929915 at kern_openat+0x125 #9 0xc0929cb5 at kern_open+0x35 #10 0xc0929cf0 at open+0x30 #11 0xc08d1806 at syscallenter+0x246 #12 0xc0b9facf at syscall+0x4f #13 0xc0b87771 at Xint0x80_syscall+0x21 ino 2, on dev md5a 0xc84a4810: tag ufs, type VREG usecount 1, writecount 0, refcount 9 mountedhere 0 flags () v_object 0xc83e95d8 ref 0 pages 260 lock type ufs: EXCL by thread 0xc83e08a0 (pid 2961) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc091fdec at vget+0x6c #5 0xc0aac00a at softdep_request_cleanup+0x4ea #6 0xc0a96def at ffs_alloc+0x29f #7 0xc0a98cc8 at ffs_balloc_ufs2+0x1908 #8 0xc0ab4fbd at ffs_write+0x33d #9 0xc0bbffdc at VOP_WRITE_APV+0xcc #10 0xc092d70a at vn_write+0x1aa #11 0xc08d90c5 at dofilewrite+0x95 #12 0xc08d9368 at kern_writev+0x58 #13 0xc08d93ef at write+0x4f #14 0xc08d1806 at syscallenter+0x246 #15 0xc0b9facf at syscall+0x4f #16 0xc0b87771 at Xint0x80_syscall+0x21 ino 592, on dev md5a 0xc8819560: tag ufs, type VREG usecount 1, writecount 1, refcount 64 mountedhere 0 flags () v_object 0xc87857f8 ref 0 pages 248 lock type ufs: EXCL by thread 0xc80ea000 (pid 2965) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 855, on dev md5a 0xc8717810: tag ufs, type VREG usecount 1, writecount 1, refcount 65 mountedhere 0 flags () v_object 0xc87664c8 ref 0 pages 252 lock type ufs: EXCL by thread 0xc7f6b2e0 (pid 2964) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 856, on dev md5a 0xc8758810: tag ufs, type VREG usecount 1, writecount 1, refcount 44 mountedhere 0 flags () v_object 0xc89cc908 ref 0 pages 168 lock type ufs: EXCL by thread 0xc7be72e0 (pid 2958) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 857, on dev md5a 0xc85ddc18: tag ufs, type VREG usecount 1, writecount 1, refcount 63 mountedhere 0 flags () v_object 0xc811bdd0 ref 0 pages 244 lock type ufs: EXCL by thread 0xc83e1b80 (pid 2959) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 858, on dev md5a 0xc8759ac0: tag ufs, type VREG usecount 1, writecount 1, refcount 60 mountedhere 0 flags () v_object 0xc848e770 ref 0 pages 232 lock type ufs: EXCL by thread 0xc7fcdb80 (pid 2962) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 859, on dev md5a 0xc8779c18: tag ufs, type VREG usecount 1, writecount 1, refcount 58 mountedhere 0 flags () v_object 0xc83dc4c8 ref 0 pages 224 lock type ufs: EXCL by thread 0xc8826b80 (pid 2963) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 861, on dev md5a 0xc875f408: tag ufs, type VREG usecount 1, writecount 1, refcount 53 mountedhere 0 flags () v_object 0xc88cc550 ref 0 pages 204 lock type ufs: EXCL by thread 0xc7fdb8a0 (pid 2960) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 862, on dev md5a 0xc86d4d70: tag ufs, type VREG usecount 1, writecount 1, refcount 60 mountedhere 0 flags () v_object 0xc8518b28 ref 0 pages 232 lock type ufs: EXCL by thread 0xc83e08a0 (pid 2961) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 863, on dev md5a 0xc87596b8: tag ufs, type VREG usecount 1, writecount 1, refcount 5 mountedhere 0 flags () v_object 0xc8653198 ref 0 pages 12 lock type ufs: EXCL by thread 0xc7fda000 (pid 2967) #0 0xc0886b80 at __lockmgr_args+0xa80 #1 0xc0ab5e0a at ffs_lock+0x8a #2 0xc0bbf78d at VOP_LOCK1_APV+0x4d #3 0xc092c4bd at _vn_lock+0x3d #4 0xc092d696 at vn_write+0x136 #5 0xc08d90c5 at dofilewrite+0x95 #6 0xc08d9368 at kern_writev+0x58 #7 0xc08d93ef at write+0x4f #8 0xc08d1806 at syscallenter+0x246 #9 0xc0b9facf at syscall+0x4f #10 0xc0b87771 at Xint0x80_syscall+0x21 ino 865, on dev md5a db:0:lockedvnods> show mount 0xc7b4fb40 /dev/ad4s2a on / (ufs) 0xc7b50000 devfs on /dev (devfs) 0xc7b4f870 /dev/ad4s1f on /home (ufs) 0xc7e695a0 /dev/ad4s1g on /tmp (ufs) 0xc7e692d0 /dev/ad4s2d on /usr (ufs) 0xc7e69000 /dev/ad4s2e on /var (ufs) 0xc83e8000 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2967 1237 1236 1001 L+ *FFS 0xc80eb280 linger2 2966 1237 1236 1001 L+ *FFS 0xc80eb280 linger2 2965 1237 1236 1001 L+ *FFS 0xc80eb280 linger2 2964 1237 1236 1001 L+ *FFS 0xc80eb280 linger2 2963 1237 1236 1001 S+ getblk 0xdb3a5708 linger2 2962 1237 1236 1001 S+ getblk 0xdb3a5708 linger2 2961 1237 1236 1001 S+ bufwait 0xdb3a5708 linger2 2960 1237 1236 1001 S+ getblk 0xdb3a5708 linger2 2959 1237 1236 1001 L+ *FFS 0xc80eb280 linger2 2958 1237 1236 1001 S+ getblk 0xdb3a5708 linger2 2957 1392 1391 1001 S nanslp 0xc0dca004 sleep 1393 1391 1391 1001 S piperd 0xc7ff2ab8 awk 1392 1391 1391 1001 S wait 0xc7fc9000 sh 1391 1389 1391 1001 Ss wait 0xc87e6810 sh 1390 1387 1390 1001 Ss+ select 0xc8460224 top 1389 1382 1382 1001 S select 0xc86d65a4 sshd 1388 1386 1388 1001 Ss kqread 0xc860f000 tail 1387 1380 1380 1001 S select 0xc86884e4 sshd 1386 1381 1381 1001 S select 0xc849b0a4 sshd 1382 1076 1382 0 Ss sbwait 0xc80b858c sshd 1381 1076 1381 0 Ss sbwait 0xc817e0b8 sshd 1380 1076 1380 0 Ss sbwait 0xc80e40b8 sshd 1237 1236 1236 1001 S+ wait 0xc83b4810 linger2 1236 1235 1236 1001 S+ wait 0xc80e6000 bash 1235 1216 1209 0 S+ wait 0xc83b4560 su 1230 0 0 0 SL mdwait 0xc7b6a000 [md5] 1216 1215 1209 0 S+ wait 0xc83b6000 sh 1215 1209 1209 0 S+ wait 0xc7fd52b0 time 1210 1205 1209 0 S+ piperd 0xc7bb4620 tee 1209 1205 1209 0 S+ wait 0xc7f63560 sh 1205 1201 1205 0 S+ wait 0xc7b9bac0 bash 1201 1200 1201 0 S+ pause 0xc80e5058 csh 1200 1196 1200 1001 S+ wait 0xc7e7f000 su 1196 1195 1196 1001 Ss+ wait 0xc7fc9ac0 bash 1195 1193 1193 1001 S select 0xc7c0b9a4 sshd 1193 1076 1193 0 Ss sbwait 0xc80b83f0 sshd 1192 1 1192 0 Ss+ ttyin 0xc74f3070 getty 1191 1 1191 0 Ss+ ttyin 0xc74f3270 getty 1190 1 1190 0 Ss+ ttyin 0xc73f2a70 getty 1189 1 1189 0 Ss+ ttyin 0xc7382670 getty 1188 1 1188 0 Ss+ ttyin 0xc7382870 getty 1187 1 1187 0 Ss+ ttyin 0xc7382c70 getty 1186 1 1186 0 Ss+ ttyin 0xc73f2670 getty 1185 1 1185 0 Ss+ ttyin 0xc73f2870 getty 1184 1 1184 0 Ss+ ttyin 0xc7382a70 getty 1145 1 1145 0 Ss select 0xc7bb6ca4 inetd 1119 1 1119 0 Ss select 0xc811eda4 moused 1095 1 1095 0 Ss nanslp 0xc0dca004 cron 1088 1 1088 25 Ss pause 0xc7fc8868 sendmail 1084 1 1084 0 Rs sendmail 1076 1 1076 0 Ss select 0xc7b428a4 sshd 1031 1 1031 0 Ss select 0xc7ab14a4 ntpd 898 897 897 0 S (threaded) nfsd 100139 S rpcsvc 0xc7aaf4d0 nfsd: service 100138 S rpcsvc 0xc7af2410 nfsd: service 100137 S rpcsvc 0xc7af2310 nfsd: service 100105 S rpcsvc 0xc7af2510 nfsd: master 897 1 897 0 Ss select 0xc7b410e4 nfsd 888 1 888 0 Ss select 0xc7b429e4 mountd 791 1 791 0 Ss select 0xc7aaf8a4 rpcbind 765 1 765 0 Ss select 0xc7bb5924 syslogd 617 1 617 0 Ss select 0xc7b416e4 devd 21 0 0 0 SL c_flowcl 0xc0f371f0 [flowcleaner] 20 0 0 0 LL *FFS 0xc80eb280 [softdepflush] 19 0 0 0 SL syncer 0xc0f36ff8 [syncer] 18 0 0 0 SL vlruwt 0xc7ad22b0 [vnlru] 17 0 0 0 SL psleep 0xc0f36d28 [bufdaemon] 16 0 0 0 SL pgzero 0xc0f43574 [pagezero] 15 0 0 0 SL psleep 0xc0f4319c [vmdaemon] 9 0 0 0 SL psleep 0xc0f43164 [pagedaemon] 8 0 0 0 SL ccb_scan 0xc0d96554 [xpt_thrd] 7 0 0 0 SL waiting_ 0xc0f38a38 [sctp_iterator] 6 0 0 0 SL - 0xc73f243c [fdc0] 5 0 0 0 SL - 0xc73f9000 [fw0_probe] 14 0 0 0 SL (threaded) usb 100058 D - 0xc73dad34 [usbus5] 100057 D - 0xc73dad04 [usbus5] 100056 D - 0xc73dacd4 [usbus5] 100055 D - 0xc73daca4 [usbus5] 100053 D - 0xc73cdb5c [usbus4] 100052 D - 0xc73cdb2c [usbus4] 100051 D - 0xc73cdafc [usbus4] 100050 D - 0xc73cdacc [usbus4] 100049 D - 0xc73c9b5c [usbus3] 100048 D - 0xc73c9b2c [usbus3] 100047 D - 0xc73c9afc [usbus3] 100046 D - 0xc73c9acc [usbus3] 100045 D - 0xc73bcb5c [usbus2] 100044 D - 0xc73bcb2c [usbus2] 100043 D - 0xc73bcafc [usbus2] 100042 D - 0xc73bcacc [usbus2] 100040 D - 0xc73b9b5c [usbus1] 100039 D - 0xc73b9b2c [usbus1] 100038 D - 0xc73b9afc [usbus1] 100037 D - 0xc73b9acc [usbus1] 100035 D - 0xc73a8b5c [usbus0] 100034 D - 0xc73a8b2c [usbus0] 100033 D - 0xc73a8afc [usbus0] 100032 D - 0xc73a8acc [usbus0] 13 0 0 0 SL - 0xc0dc9e64 [yarrow] 4 0 0 0 SL - 0xc0dc7b64 [g_down] 3 0 0 0 SL - 0xc0dc7b60 [g_up] 2 0 0 0 SL - 0xc0dc7b58 [g_event] 12 0 0 0 WL (threaded) intr 100066 I [irq12: psm0] 100065 I [irq1: atkbd0] 100063 I [swi0: uart] 100060 I [irq20: fwohci0] 100059 I [irq14: ata0] 100054 I [irq19: ehci0] 100041 I [irq18: ohci2 ohci4] 100036 I [irq17: ohci1 ohci3] 100031 I [irq16: ohci0] 100030 I [irq22: atapci0] 100029 I [irq256: re0] 100028 I [irq9: acpi0] 100027 I [swi6: task queue] 100026 I [swi6: Giant taskq] 100023 I [swi5: +] 100022 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) idle 100006 CanRun [idle: cpu0] 100005 Run CPU 1 [idle: cpu1] 100004 Run CPU 2 [idle: cpu2] 100003 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc7171ac0 [init] 10 0 0 0 SL audit_wo 0xc0f421c0 [audit] 0 0 0 0 SLs (threaded) kernel 100061 D - 0xc73f8580 [fw0_taskq] 100025 D - 0xc733eac0 [thread taskq] 100024 D - 0xc733eb00 [ffs_trim taskq] 100021 D - 0xc733ee00 [acpi_task_2] 100020 D - 0xc733ee00 [acpi_task_1] 100019 D - 0xc733ee00 [acpi_task_0] 100018 D - 0xc733ee40 [kqueue taskq] 100016 D - 0xc7152880 [firmware taskq] 100000 D sched 0xc0dc7c40 [swapper] db:0:ps> allt Tracing command linger2 pid 2967 tid 100162 td 0xc7fda000 sched_switch(c7fda000,0,103,c0dce440,9a75ddd9,...) at sched_switch+0x28a mi_switch(103,0,c0c7dd56,2e1,c0ddcb38,...) at mi_switch+0x11a turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,16c8,...) at turnstile_wait+0x24d _mtx_lock_sleep(c7e81d48,c7fda000,0,c0c994a6,16c8,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c994a6,16c8,9004,...) at _mtx_lock_flags+0x6f softdep_request_cleanup(c83a6800,c87596b8,c8390300,0,9e4b,...) at softdep_request_cleanup+0x79 ffs_alloc(c84e7e0c,3,0,f18,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c87596b8,c000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x106c ffs_write(e9ca9b94,c0cacd5d,c8759710,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9ca9b94,c87596b8,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c89ce1f8,e9ca9c28,c8390300,0,c7fda000,...) at vn_write+0x1aa dofilewrite(e9ca9c28,ffffffff,ffffffff,0,c89ce1f8,...) at dofilewrite+0x95 kern_writev(c7fda000,3,e9ca9c28,e9ca9c48,1,...) at kern_writev+0x58 write(c7fda000,e9ca9cec,e9ca9d28,c0c7dba4,0,...) at write+0x4f syscallenter(c7fda000,e9ca9ce4,e9ca9ce4,0,c0dcf140,...) at syscallenter+0x246 syscall(e9ca9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2966 tid 100145 td 0xc7fda5c0 sched_switch(c7fda5c0,0,103,c0dce440,9a775297,...) at sched_switch+0x28a mi_switch(103,0,c0c7dd56,2e1,c0ddcb38,...) at mi_switch+0x11a turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,3b8,...) at turnstile_wait+0x24d _mtx_lock_sleep(c7e81d48,c7fda5c0,0,c0c9887b,3b8,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c9887b,3b8,c83ad158,...) at _mtx_lock_flags+0x6f ffs_valloc(c83ad158,81b0,c8390300,e9c7191c,c091041a,...) at ffs_valloc+0x47 ufs_makeinode(e9c71ba4,c0d7c400,e9c71b08,e9c71a64,c0bc0354,...) at ufs_makeinode+0x89 ufs_create(e9c71b08,c0cacd7d,0,e9c71b78,e9c71b30,...) at ufs_create+0x30 VOP_CREATE_APV(c0d7bf40,e9c71b08,e9c71ba4,e9c71aa0,0,...) at VOP_CREATE_APV+0x64 vn_open_cred(e9c71b78,e9c71c2c,1b0,0,c8390300,...) at vn_open_cred+0x205 vn_open(e9c71b78,e9c71c2c,1b0,c891a818,28,...) at vn_open+0x3b kern_openat(c7fda5c0,ffffff9c,bfbfe9fc,0,602,...) at kern_openat+0x125 kern_open(c7fda5c0,bfbfe9fc,0,601,1b0,...) at kern_open+0x35 open(c7fda5c0,e9c71cec,e9c71d28,c0c7dba4,0,...) at open+0x30 syscallenter(c7fda5c0,e9c71ce4,e9c71ce4,0,c727b000,...) at syscallenter+0x246 syscall(e9c71d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, open), eip = 0x2816ba23, esp = 0xbfbfe9bc, ebp = 0xbfbfe9d8 --- Tracing command linger2 pid 2965 tid 100172 td 0xc80ea000 sched_switch(c80ea000,0,103,c0dceac0,a0a7cdc3,...) at sched_switch+0x28a mi_switch(103,0,c0c7dd56,2e1,c0ddcb38,...) at mi_switch+0x11a turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,62e,...) at turnstile_wait+0x24d _mtx_lock_sleep(c7e81d48,c80ea000,0,c0c9887b,62e,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c9887b,62e,11500,...) at _mtx_lock_flags+0x6f ffs_alloccgblk(6d278,0,c0c9887b,5af,0,...) at ffs_alloccgblk+0x210 ffs_alloccg(c83939f8,4,6d278,0,4000,...) at ffs_alloccg+0x1bc ffs_hashalloc(6d278,0,4000,c0a958c0,9e63,...) at ffs_hashalloc+0x3a ffs_alloc(c83939f8,3d,0,6d278,0,...) at ffs_alloc+0x19b ffs_balloc_ufs2(c8819560,f4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cd4b94,c0cacd5d,c88195b8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cd4b94,c8819560,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7b9ea48,e9cd4c28,c8390300,0,c80ea000,...) at vn_write+0x1aa dofilewrite(e9cd4c28,ffffffff,ffffffff,0,c7b9ea48,...) at dofilewrite+0x95 kern_writev(c80ea000,3,e9cd4c28,e9cd4c48,1,...) at kern_writev+0x58 write(c80ea000,e9cd4cec,c08b85dc,c0dceaec,0,...) at write+0x4f syscallenter(c80ea000,e9cd4ce4,c80ea000,c73d5b80,c0dceac0,...) at syscallenter+0x246 syscall(e9cd4d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2964 tid 100108 td 0xc7f6b2e0 sched_switch(c7f6b2e0,0,103,c0dce440,9a777309,...) at sched_switch+0x28a mi_switch(103,0,c0c7dd56,2e1,c0ddcb38,...) at mi_switch+0x11a turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,356,...) at turnstile_wait+0x24d _mtx_lock_sleep(c7e81d48,c7f6b2e0,0,c0c98e5a,356,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c98e5a,356,0,...) at _mtx_lock_flags+0x6f ffs_balloc_ufs2(c8717810,f8000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x187c ffs_write(e9bf0b94,c0cacd5d,c8717868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9bf0b94,c8717810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7bb0070,e9bf0c28,c8390300,0,c7f6b2e0,...) at vn_write+0x1aa dofilewrite(e9bf0c28,ffffffff,ffffffff,0,c7bb0070,...) at dofilewrite+0x95 kern_writev(c7f6b2e0,3,e9bf0c28,e9bf0c48,1,...) at kern_writev+0x58 write(c7f6b2e0,e9bf0cec,c08b85dc,c0dceaec,0,...) at write+0x4f syscallenter(c7f6b2e0,e9bf0ce4,c7f6b2e0,c73d5b80,c0dceac0,...) at syscallenter+0x246 syscall(e9bf0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2963 tid 100194 td 0xc8826b80 sched_switch(c8826b80,0,104,c8826b80,854752af,...) at sched_switch+0x28a mi_switch(104,0,c8826b80,c8826b80,c8826b80,...) at mi_switch+0x11a sleepq_switch(c8826b80,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c8289e,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,81900,c83de3a4,c0c8289e,50,...) at __lockmgr_args+0x9af getblk(c83de2b0,16f940,0,4000,0,...) at getblk+0x167 breadn(c83de2b0,16f940,0,4000,0,...) at breadn+0x44 bread(c83de2b0,16f940,0,4000,0,...) at bread+0x4c ffs_blkfree_cg(68038,0,4000,35d,c0d61e94,...) at ffs_blkfree_cg+0x22c ffs_blkfree(c7e81d00,c83a6800,c83de2b0,68038,0,...) at ffs_blkfree+0x43 handle_workitem_freefrag(c0f42844,0,c0c994a6,857,c0d7b1d8,...) at handle_workitem_freefrag+0x43 setup_allocindir_phase2(c0f42844,0,c0c994a6,7e4,67ce8,...) at setup_allocindir_phase2+0x26d softdep_setup_allocindir_page(c8723c3c,36,0,db37bac4,2a,...) at softdep_setup_allocindir_page+0xc3 ffs_reallocblks(e9d31a08,c0cacce6,c8779c18,c84b231c,e9d31a3c,...) at ffs_reallocblks+0xcfb VOP_REALLOCBLKS_APV(c0d7bf40,e9d31a08,0,4000,0,...) at VOP_REALLOCBLKS_APV+0x6b cluster_write(c8779c18,db1e4668,dc000,0,41,...) at cluster_write+0x3a2 ffs_write(e9d31b94,c0cacd5d,c8779c70,0,c0bbd082,...) at ffs_write+0x56a VOP_WRITE_APV(c0d7bf40,e9d31b94,c8779c18,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c89ce3b8,e9d31c28,c8390300,0,c8826b80,...) at vn_write+0x1aa dofilewrite(e9d31c28,ffffffff,ffffffff,0,c89ce3b8,...) at dofilewrite+0x95 kern_writev(c8826b80,3,e9d31c28,e9d31c48,1,...) at kern_writev+0x58 write(c8826b80,e9d31cec,e9d31d28,c0c7dba4,0,...) at write+0x4f syscallenter(c8826b80,e9d31ce4,e9d31ce4,0,c0dce440,...) at syscallenter+0x246 syscall(e9d31d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2962 tid 100200 td 0xc7fcdb80 sched_switch(c7fcdb80,0,104,c7fcdb80,85470b0f,...) at sched_switch+0x28a mi_switch(104,0,c7fcdb80,c7fcdb80,c7fcdb80,...) at mi_switch+0x11a sleepq_switch(c7fcdb80,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c8289e,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,81900,c83de3a4,c0c8289e,50,...) at __lockmgr_args+0x9af getblk(c83de2b0,16f940,0,4000,0,...) at getblk+0x167 breadn(c83de2b0,16f940,0,4000,0,...) at breadn+0x44 bread(c83de2b0,16f940,0,4000,0,...) at bread+0x4c ffs_clusteralloc(c84bf15c,4,6aff8,0,5,...) at ffs_clusteralloc+0x118 ffs_hashalloc(6aff8,0,5,c0a95350,de7d5000,...) at ffs_hashalloc+0x3a ffs_reallocblks(e9d43a08,c0cacce6,c8759ac0,c8666824,e9d43a3c,...) at ffs_reallocblks+0xac4 VOP_REALLOCBLKS_APV(c0d7bf40,e9d43a08,0,4000,0,...) at VOP_REALLOCBLKS_APV+0x6b cluster_write(c8759ac0,db16db58,e4000,0,41,...) at cluster_write+0x3a2 ffs_write(e9d43b94,c0cacd5d,c8759b18,0,c0bbd082,...) at ffs_write+0x56a VOP_WRITE_APV(c0d7bf40,e9d43b94,c8759ac0,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891ad20,e9d43c28,c8390300,0,c7fcdb80,...) at vn_write+0x1aa dofilewrite(e9d43c28,ffffffff,ffffffff,0,c891ad20,...) at dofilewrite+0x95 kern_writev(c7fcdb80,3,e9d43c28,e9d43c48,1,...) at kern_writev+0x58 write(c7fcdb80,e9d43cec,e9d43d28,c0c7dba4,0,...) at write+0x4f syscallenter(c7fcdb80,e9d43ce4,e9d43ce4,0,c0dcddc0,...) at syscallenter+0x246 syscall(e9d43d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2961 tid 100181 td 0xc83e08a0 sched_switch(c83e08a0,0,104,c83e08a0,12c8c527,...) at sched_switch+0x28a mi_switch(104,0,c83e08a0,c83e08a0,c83e08a0,...) at mi_switch+0x11a sleepq_switch(c83e08a0,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c828d8,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,80900,c0f42844,0,0,...) at __lockmgr_args+0x9af getdirtybuf(c0f42844,0,c0c994a6,14c5,e9cfa730,...) at getdirtybuf+0xa9 softdep_sync_metadata(c84a4810,0,c0c9ad45,146,0,...) at softdep_sync_metadata+0x2fb ffs_syncvnode(c84a4810,1,c83e08a0,1710,fffffff4,...) at ffs_syncvnode+0x372 softdep_request_cleanup(c83a6800,c86d4d70,c8390300,0,9e43,...) at softdep_request_cleanup+0x579 ffs_alloc(c8822828,39,0,37a28,0,...) at ffs_alloc+0x29f ffs_balloc_ufs2(c86d4d70,e4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9cfab94,c0cacd5d,c86d4dc8,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cfab94,c86d4d70,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c891a508,e9cfac28,c8390300,0,c83e08a0,...) at vn_write+0x1aa dofilewrite(e9cfac28,ffffffff,ffffffff,0,c891a508,...) at dofilewrite+0x95 kern_writev(c83e08a0,3,e9cfac28,e9cfac48,1,...) at kern_writev+0x58 write(c83e08a0,e9cfacec,e9cfad28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e08a0,e9cface4,e9cface4,0,c0dce440,...) at syscallenter+0x246 syscall(e9cfad28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2960 tid 100136 td 0xc7fdb8a0 sched_switch(c7fdb8a0,0,104,c7fdb8a0,85472d8f,...) at sched_switch+0x28a mi_switch(104,0,c7fdb8a0,c7fdb8a0,c7fdb8a0,...) at mi_switch+0x11a sleepq_switch(c7fdb8a0,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c8289e,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,81900,c83de3a4,c0c8289e,50,...) at __lockmgr_args+0x9af getblk(c83de2b0,16f940,0,4000,0,...) at getblk+0x167 breadn(c83de2b0,16f940,0,4000,0,...) at breadn+0x44 bread(c83de2b0,16f940,0,4000,0,...) at bread+0x4c ffs_clusteralloc(c84e789c,4,6c5e8,0,3,...) at ffs_clusteralloc+0x118 ffs_hashalloc(6c5e8,0,3,c0a95350,e0065000,...) at ffs_hashalloc+0x3a ffs_reallocblks(e9c51a08,c0cacce6,c875f408,c865937c,e9c51a3c,...) at ffs_reallocblks+0xac4 VOP_REALLOCBLKS_APV(c0d7bf40,e9c51a08,0,4000,0,...) at VOP_REALLOCBLKS_APV+0x6b cluster_write(c875f408,db349fbc,c8000,0,41,...) at cluster_write+0x3a2 ffs_write(e9c51b94,c0cacd5d,c875f460,0,c0bbd082,...) at ffs_write+0x56a VOP_WRITE_APV(c0d7bf40,e9c51b94,c875f408,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7c0de00,e9c51c28,c8390300,0,c7fdb8a0,...) at vn_write+0x1aa dofilewrite(e9c51c28,ffffffff,ffffffff,0,c7c0de00,...) at dofilewrite+0x95 kern_writev(c7fdb8a0,3,e9c51c28,e9c51c48,1,...) at kern_writev+0x58 write(c7fdb8a0,e9c51cec,e9c51d28,c0c7dba4,0,...) at write+0x4f syscallenter(c7fdb8a0,e9c51ce4,e9c51ce4,0,c0dcf140,...) at syscallenter+0x246 syscall(e9c51d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2959 tid 100175 td 0xc83e1b80 sched_switch(c83e1b80,0,103,c0dce440,9a778919,...) at sched_switch+0x28a mi_switch(103,0,c0c7dd56,2e1,c0ddcb38,...) at mi_switch+0x11a turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,356,...) at turnstile_wait+0x24d _mtx_lock_sleep(c7e81d48,c83e1b80,0,c0c98e5a,356,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c98e5a,356,0,...) at _mtx_lock_flags+0x6f ffs_balloc_ufs2(c85ddc18,f0000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x187c ffs_write(e9cddb94,c0cacd5d,c85ddc70,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9cddb94,c85ddc18,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7c14070,e9cddc28,c8390300,0,c83e1b80,...) at vn_write+0x1aa dofilewrite(e9cddc28,ffffffff,ffffffff,0,c7c14070,...) at dofilewrite+0x95 kern_writev(c83e1b80,3,e9cddc28,e9cddc48,1,...) at kern_writev+0x58 write(c83e1b80,e9cddcec,e9cddd28,c0c7dba4,0,...) at write+0x4f syscallenter(c83e1b80,e9cddce4,e9cddce4,0,c73d5b80,...) at syscallenter+0x246 syscall(e9cddd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command linger2 pid 2958 tid 100089 td 0xc7be72e0 sched_switch(c7be72e0,0,104,c7be72e0,85477111,...) at sched_switch+0x28a mi_switch(104,0,c7be72e0,c7be72e0,c7be72e0,...) at mi_switch+0x11a sleepq_switch(c7be72e0,0,c0c7d7d6,260,50,...) at sleepq_switch+0xd3 sleepq_wait(db3a5708,50,c0c8289e,4,0,...) at sleepq_wait+0x39 __lockmgr_args(db3a5708,81900,c83de3a4,c0c8289e,50,...) at __lockmgr_args+0x9af getblk(c83de2b0,16f940,0,4000,0,...) at getblk+0x167 breadn(c83de2b0,16f940,0,4000,0,...) at breadn+0x44 bread(c83de2b0,16f940,0,4000,0,...) at bread+0x4c ffs_alloccg(c8650740,4,6a250,0,4000,...) at ffs_alloccg+0x125 ffs_hashalloc(6a250,0,4000,c0a958c0,9e73,...) at ffs_hashalloc+0x3a ffs_alloc(c8650740,29,0,6a250,0,...) at ffs_alloc+0x19b ffs_balloc_ufs2(c8758810,a4000,0,4000,c8390300,...) at ffs_balloc_ufs2+0x1908 ffs_write(e9b61b94,c0cacd5d,c8758868,0,c0bbd082,...) at ffs_write+0x33d VOP_WRITE_APV(c0d7bf40,e9b61b94,c8758810,25f,0,...) at VOP_WRITE_APV+0xcc vn_write(c7bb0690,e9b61c28,c8390300,0,c7be72e0,...) at vn_write+0x1aa dofilewrite(e9b61c28,ffffffff,ffffffff,0,c7bb0690,...) at dofilewrite+0x95 kern_writev(c7be72e0,3,e9b61c28,e9b61c48,1,...) at kern_writev+0x58 write(c7be72e0,e9b61cec,e9b61d28,c0c7dba4,0,...) at write+0x4f syscallenter(c7be72e0,e9b61ce4,e9b61ce4,0,c73d5b80,...) at syscallenter+0x246 syscall(e9b61d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x2817c5b3, esp = 0xbfbfe9dc, ebp = 0xbfbfea88 --- Tracing command sleep pid 2957 tid 100097 td 0xc74e7b80 sched_switch(c74e7b80,0,104,c74e7b80,985d5948,...) at sched_switch+0x28a mi_switch(104,0,c74e7b80,100,100,...) at mi_switch+0x11a sleepq_switch(c74e7b80,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c74e7d80,2711,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c0dca004,5c,c0c7ae7a,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0dca004,0,15c,c0c7ae7a,2711,...) at _sleep+0x288 kern_nanosleep(c74e7b80,e9b8fc34,e9b8fc3c,a,0,...) at kern_nanosleep+0xc1 nanosleep(c74e7b80,e9b8fcec,e9b8fd28,c0c7dba4,0,...) at nanosleep+0x6f syscallenter(c74e7b80,e9b8fce4,e9b8fce4,0,e9b8fd28,...) at syscallenter+0x246 syscall(e9b8fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2815ef57, esp = 0xbfbfecac, ebp = 0xbfbfecf8 --- Tracing command awk pid 1393 tid 100086 td 0xc7be78a0 sched_switch(c7be78a0,0,104,c7be78a0,982cc407,...) at sched_switch+0x28a mi_switch(104,0,c7be78a0,100,100,...) at mi_switch+0x11a sleepq_switch(c7be78a0,0,c0c7d7d6,1a0,4c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7ff2ab8,4c,c0c7ebc3,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7ff2ab8,c7ff2c28,14c,c0c7ebc3,0,...) at _sleep+0x2bc pipe_read(c7c0de38,e9b54c28,c862c880,0,c7be78a0,...) at pipe_read+0x3aa dofileread(e9b54c28,ffffffff,ffffffff,0,c7c0de38,...) at dofileread+0x96 kern_readv(c7be78a0,0,e9b54c28,e9b54c48,1,...) at kern_readv+0x58 read(c7be78a0,e9b54cec,e9b54d80,e9b54c88,0,...) at read+0x4f syscallenter(c7be78a0,e9b54ce4,c0b9ff6b,0,e9b54cb0,...) at syscallenter+0x246 syscall(e9b54d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x281b35d3, esp = 0xbfbfe96c, ebp = 0xbfbfe988 --- Tracing command sh pid 1392 tid 100120 td 0xc7e8ab80 sched_switch(c7e8ab80,0,104,c7e8ab80,9838e870,...) at sched_switch+0x28a mi_switch(104,0,c7e8ab80,100,100,...) at mi_switch+0x11a sleepq_switch(c7e8ab80,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7fc9000,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7fc9000,c7fc9088,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7e8ab80,ffffffff,e9c1bc44,2,0,...) at kern_wait+0xa76 wait4(c7e8ab80,e9c1bcec,e9c1bd28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c7e8ab80,e9c1bce4,e9c1bce4,0,e9c1bd28,...) at syscallenter+0x246 syscall(e9c1bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe95c, ebp = 0xbfbfe978 --- Tracing command sh pid 1391 tid 100210 td 0xc883a000 sched_switch(c883a000,0,104,c883a000,a4be0ab9,...) at sched_switch+0x28a mi_switch(104,0,c883a000,100,100,...) at mi_switch+0x11a sleepq_switch(c883a000,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c87e6810,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c87e6810,c87e6898,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c883a000,ffffffff,e9d61c44,2,0,...) at kern_wait+0xa76 wait4(c883a000,e9d61cec,281ff6e8,1,0,...) at wait4+0x3b syscallenter(c883a000,e9d61ce4,c0ba024e,c883a000,e9d61d28,...) at syscallenter+0x246 syscall(e9d61d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfeb5c, ebp = 0xbfbfeb78 --- Tracing command top pid 1390 tid 100144 td 0xc7fda8a0 sched_switch(c7fda8a0,0,104,c7fda8a0,7ab15e89,...) at sched_switch+0x28a mi_switch(104,0,c7fda8a0,c7fda8a0,c7fda8a0,...) at mi_switch+0x11a sleepq_switch(c7fda8a0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c8460210,e9c6ea14,c088cde9,c8460210,c7fda8a0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c8460224,0,e9c6ea4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c8460224,c8460210,3e9,627,c7b9f850,...) at _cv_timedwait_sig+0x1c0 seltdwait(e9c6ebf8,e9c6ec00,c8671800,c7fda8a0,30204830,...) at seltdwait+0x8a kern_select(c7fda8a0,2,bfbfebdc,0,0,e9c6ec40,20,1,0) at kern_select+0x4ee select(c7fda8a0,e9c6ecec,e9c6ed28,c0c7dba4,0,...) at select+0x66 syscallenter(c7fda8a0,e9c6ece4,e9c6ece4,0,a,...) at syscallenter+0x246 syscall(e9c6ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281e9553, esp = 0xbfbfeb7c, ebp = 0xbfbfecd8 --- Tracing command sshd pid 1389 tid 100094 td 0xc7be62e0 sched_switch(c7be62e0,0,104,c7be62e0,9cfb710c,...) at sched_switch+0x28a mi_switch(104,0,c7be62e0,c7be62e0,c7be62e0,...) at mi_switch+0x11a sleepq_switch(c7be62e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b7ba14,c088cde9,c86d6590,0,c7be62e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c86d65a4,0,e9b7ba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c86d65a4,c86d6590,c0c7eb30,627,c7bb0188,...) at _cv_wait_sig+0x1b0 seltdwait(c7bb0188,58,c74d6e80,c7be62e0,e9b7bab4,...) at seltdwait+0xa2 kern_select(c7be62e0,c,286030b4,286030d8,0,0,20,c7be12b0,c7be12b0) at kern_select+0x4ee select(c7be62e0,e9b7bcec,e9b7bd28,c0c7dba4,0,...) at select+0x66 syscallenter(c7be62e0,e9b7bce4,e9b7bce4,0,e9b7bd28,...) at syscallenter+0x246 syscall(e9b7bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command tail pid 1388 tid 100209 td 0xc883a2e0 sched_switch(c883a2e0,0,104,c883a2e0,5513b0d0,...) at sched_switch+0x28a mi_switch(104,0,c883a2e0,100,100,...) at mi_switch+0x11a sleepq_switch(c883a2e0,0,c0c7d7d6,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c883a4e0,3e9,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c860f000,58,c0c769d1,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c860f000,c860f000,158,c0c769d1,3e9,...) at _sleep+0x288 kern_kevent(c883a2e0,4,0,1,e9d5ec28,...) at kern_kevent+0x374 kevent(c883a2e0,e9d5ecec,e9d5ed28,c0c7dba4,0,...) at kevent+0x19b syscallenter(c883a2e0,e9d5ece4,e9d5ece4,0,c0dcf140,...) at syscallenter+0x246 syscall(e9d5ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (363, FreeBSD ELF32, kevent), eip = 0x2816304b, esp = 0xbfbfeb4c, ebp = 0xbfbfec08 --- Tracing command sshd pid 1387 tid 100111 td 0xc7f6a8a0 sched_switch(c7f6a8a0,0,104,c7f6a8a0,7ab3000f,...) at sched_switch+0x28a mi_switch(104,0,c7f6a8a0,c7f6a8a0,c7f6a8a0,...) at mi_switch+0x11a sleepq_switch(c7f6a8a0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9bfca14,c088cde9,c86884d0,0,c7f6a8a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c86884e4,0,e9bfca4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c86884e4,c86884d0,c0c7eb30,627,c7b9f9d8,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9f9d8,58,c84f5480,c7f6a8a0,246,...) at seltdwait+0xa2 kern_select(c7f6a8a0,a,286030b4,286030d8,0,0,20,c7f63810,c7f63810) at kern_select+0x4ee select(c7f6a8a0,e9bfccec,e9bfcd28,c0c7dba4,0,...) at select+0x66 syscallenter(c7f6a8a0,e9bfcce4,e9bfcce4,0,e9bfccb0,...) at syscallenter+0x246 syscall(e9bfcd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command sshd pid 1386 tid 100103 td 0xc7e8d8a0 sched_switch(c7e8d8a0,0,104,c7e8d8a0,12da875b,...) at sched_switch+0x28a mi_switch(104,0,c7e8d8a0,c7e8d8a0,c7e8d8a0,...) at mi_switch+0x11a sleepq_switch(c7e8d8a0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9ba4a14,c088cde9,c849b090,0,c7e8d8a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c849b0a4,0,e9ba4a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c849b0a4,c849b090,c0c7eb30,627,c7f62e70,...) at _cv_wait_sig+0x1b0 seltdwait(c7f62e70,58,c862d480,c7e8d8a0,246,...) at seltdwait+0xa2 kern_select(c7e8d8a0,c,286030b4,286030d8,0,0,20,c7e7d810,c7e7d810) at kern_select+0x4ee select(c7e8d8a0,e9ba4cec,e9ba4d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7e8d8a0,e9ba4ce4,e9ba4ce4,0,8f,...) at syscallenter+0x246 syscall(e9ba4d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command sshd pid 1382 tid 100163 td 0xc7fd7b80 sched_switch(c7fd7b80,0,104,c7fd7b80,9cb11e65,...) at sched_switch+0x28a mi_switch(104,0,c7fd7b80,100,100,...) at mi_switch+0x11a sleepq_switch(c7fd7b80,0,c0c7d7d6,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80b858c,58,c0c81ba2,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80b858c,c80b854c,158,c0c81ba2,0,...) at _sleep+0x2bc sbwait(c80b8528,0,c0c81c18,5a2,c80b854c,...) at sbwait+0x52 soreceive_generic(c80b84d4,0,e9cacc28,0,0,...) at soreceive_generic+0x2dc soreceive(c80b84d4,0,e9cacc28,0,0,0) at soreceive+0x38 soo_read(c7c0d1c0,e9cacc28,c845bc00,0,c7fd7b80,...) at soo_read+0x4e dofileread(e9cacc28,ffffffff,ffffffff,0,c7c0d1c0,...) at dofileread+0x96 kern_readv(c7fd7b80,5,e9cacc28,e9cacc48,1,...) at kern_readv+0x58 read(c7fd7b80,e9caccec,e9cacd28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fd7b80,e9cacce4,e9cacce4,0,e9cacd28,...) at syscallenter+0x246 syscall(e9cacd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command sshd pid 1381 tid 100140 td 0xc7fdb5c0 sched_switch(c7fdb5c0,0,104,c7fdb5c0,9c3341bf,...) at sched_switch+0x28a mi_switch(104,0,c7fdb5c0,100,100,...) at mi_switch+0x11a sleepq_switch(c7fdb5c0,0,c0c7d7d6,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c817e0b8,58,c0c81ba2,100,0,...) at sleepq_wait_sig+0x17 _sleep(c817e0b8,c817e078,158,c0c81ba2,0,...) at _sleep+0x2bc sbwait(c817e054,0,c0c81c18,5a2,c817e078,...) at sbwait+0x52 soreceive_generic(c817e000,0,e9c62c28,0,0,...) at soreceive_generic+0x2dc soreceive(c817e000,0,e9c62c28,0,0,0) at soreceive+0x38 soo_read(c7f62770,e9c62c28,c85d0c00,0,c7fdb5c0,...) at soo_read+0x4e dofileread(e9c62c28,ffffffff,ffffffff,0,c7f62770,...) at dofileread+0x96 kern_readv(c7fdb5c0,5,e9c62c28,e9c62c48,1,...) at kern_readv+0x58 read(c7fdb5c0,e9c62cec,e9c62d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fdb5c0,e9c62ce4,e9c62ce4,0,e9c62d28,...) at syscallenter+0x246 syscall(e9c62d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command sshd pid 1380 tid 100129 td 0xc7f67b80 sched_switch(c7f67b80,0,104,c7f67b80,9cb17915,...) at sched_switch+0x28a mi_switch(104,0,c7f67b80,100,100,...) at mi_switch+0x11a sleepq_switch(c7f67b80,0,c0c7d7d6,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80e40b8,58,c0c81ba2,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80e40b8,c80e4078,158,c0c81ba2,0,...) at _sleep+0x2bc sbwait(c80e4054,0,c0c81c18,5a2,c80e4078,...) at sbwait+0x52 soreceive_generic(c80e4000,0,e9c37c28,0,0,...) at soreceive_generic+0x2dc soreceive(c80e4000,0,e9c37c28,0,0,0) at soreceive+0x38 soo_read(c7c0d8f8,e9c37c28,c85ff900,0,c7f67b80,...) at soo_read+0x4e dofileread(e9c37c28,ffffffff,ffffffff,0,c7c0d8f8,...) at dofileread+0x96 kern_readv(c7f67b80,5,e9c37c28,e9c37c48,1,...) at kern_readv+0x58 read(c7f67b80,e9c37cec,2863a00c,1,0,...) at read+0x4f syscallenter(c7f67b80,e9c37ce4,c0ba024e,c7f67b80,e9c37d28,...) at syscallenter+0x246 syscall(e9c37d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command linger2 pid 1237 tid 100176 td 0xc83e18a0 sched_switch(c83e18a0,0,104,c83e18a0,97fbd400,...) at sched_switch+0x28a mi_switch(104,0,c83e18a0,100,100,...) at mi_switch+0x11a sleepq_switch(c83e18a0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c83b4810,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c83b4810,c83b4898,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c83e18a0,ffffffff,e9ce0c44,0,0,...) at kern_wait+0xa76 wait4(c83e18a0,e9ce0cec,e9ce0d28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c83e18a0,e9ce0ce4,e9ce0ce4,0,e9ce0d28,...) at syscallenter+0x246 syscall(e9ce0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280ecd5b, esp = 0xbfbfea6c, ebp = 0xbfbfea88 --- Tracing command bash pid 1236 tid 100156 td 0xc7f6b8a0 sched_switch(c7f6b8a0,0,104,c7f6b8a0,3e2aec2f,...) at sched_switch+0x28a mi_switch(104,0,c7f6b8a0,100,100,...) at mi_switch+0x11a sleepq_switch(c7f6b8a0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80e6000,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80e6000,c80e6088,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7f6b8a0,ffffffff,e9c97c44,0,0,...) at kern_wait+0xa76 wait4(c7f6b8a0,e9c97cec,283626e8,1,0,...) at wait4+0x3b syscallenter(c7f6b8a0,e9c97ce4,c0ba024e,c7f6b8a0,e9c97d28,...) at syscallenter+0x246 syscall(e9c97d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282bfd5b, esp = 0xbfbfe63c, ebp = 0xbfbfe658 --- Tracing command su pid 1235 tid 100177 td 0xc83e15c0 sched_switch(c83e15c0,0,104,c83e15c0,3d900ade,...) at sched_switch+0x28a mi_switch(104,0,c83e15c0,100,100,...) at mi_switch+0x11a sleepq_switch(c83e15c0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c83b4560,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c83b4560,c83b45e8,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c83e15c0,4d4,e9ce3c44,2,0,...) at kern_wait+0xa76 wait4(c83e15c0,e9ce3cec,281c16e8,1,0,...) at wait4+0x3b syscallenter(c83e15c0,e9ce3ce4,c0ba024e,c83e15c0,e9ce3d28,...) at syscallenter+0x246 syscall(e9ce3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811ed5b, esp = 0xbfbfe58c, ebp = 0xbfbfe5a8 --- Tracing command md5 pid 1230 tid 100078 td 0xc7b9d8a0 sched_switch(c7b9d8a0,0,104,c7b9d8a0,6880a4a4,...) at sched_switch+0x28a mi_switch(104,0,c7b9d8a0,c7b9d8a0,c7b9d8a0,...) at mi_switch+0x11a sleepq_switch(c7b9d8a0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c7b6a000,4c,c0c50354,0,0,...) at sleepq_wait+0x39 _sleep(c7b6a000,c7b6a020,24c,c0c50354,0,...) at _sleep+0x2d2 md_kthread(c7b6a000,e9b34d28,c0c76ce3,359,c7b9b810,...) at md_kthread+0x119 fork_exit(c06c86c0,c7b6a000,e9b34d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe9b34d60, ebp = 0 --- Tracing command sh pid 1216 tid 100169 td 0xc80ea8a0 sched_switch(c80ea8a0,0,104,c80ea8a0,3caf32a5,...) at sched_switch+0x28a mi_switch(104,0,c80ea8a0,100,100,...) at mi_switch+0x11a sleepq_switch(c80ea8a0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c83b6000,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c83b6000,c83b6088,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c80ea8a0,ffffffff,e9ccbc44,2,0,...) at kern_wait+0xa76 wait4(c80ea8a0,e9ccbcec,e9ccbd28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c80ea8a0,e9ccbce4,e9ccbce4,0,e9ccbd28,...) at syscallenter+0x246 syscall(e9ccbd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe7cc, ebp = 0xbfbfe7e8 --- Tracing command time pid 1215 tid 100143 td 0xc7fdab80 sched_switch(c7fdab80,0,104,c7fdab80,ef34ddc6,...) at sched_switch+0x28a mi_switch(104,0,c7fdab80,100,100,...) at mi_switch+0x11a sleepq_switch(c7fdab80,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7fd52b0,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7fd52b0,c7fd5338,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7fdab80,4c0,e9c6bc44,0,e9c6bbfc,...) at kern_wait+0xa76 wait4(c7fdab80,e9c6bcec,e9c6bd28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c7fdab80,e9c6bce4,e9c6bce4,0,e9c6bd28,...) at syscallenter+0x246 syscall(e9c6bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x280edd5b, esp = 0xbfbfea0c, ebp = 0xbfbfead8 --- Tracing command tee pid 1210 tid 100113 td 0xc7f6a2e0 sched_switch(c7f6a2e0,0,104,c7f6a2e0,3ab9aa3f,...) at sched_switch+0x28a mi_switch(104,0,c7f6a2e0,100,100,...) at mi_switch+0x11a sleepq_switch(c7f6a2e0,0,c0c7d7d6,1a0,4c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7bb4620,4c,c0c7ebc3,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7bb4620,c7bb4790,14c,c0c7ebc3,0,...) at _sleep+0x2bc pipe_read(c7f622a0,e9c04c28,c7b58180,0,c7f6a2e0,...) at pipe_read+0x3aa dofileread(e9c04c28,ffffffff,ffffffff,0,c7f622a0,...) at dofileread+0x96 kern_readv(c7f6a2e0,0,e9c04c28,e9c04c48,1,...) at kern_readv+0x58 read(c7f6a2e0,e9c04cec,e9c04d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7f6a2e0,e9c04ce4,e9c04ce4,0,e9c04d28,...) at syscallenter+0x246 syscall(e9c04d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2817c5d3, esp = 0xbfbfeaac, ebp = 0xbfbfeae8 --- Tracing command sh pid 1209 tid 100112 td 0xc7f6a5c0 sched_switch(c7f6a5c0,0,104,c7f6a5c0,ee90f812,...) at sched_switch+0x28a mi_switch(104,0,c7f6a5c0,100,100,...) at mi_switch+0x11a sleepq_switch(c7f6a5c0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7f63560,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7f63560,c7f635e8,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7f6a5c0,ffffffff,e9c00c44,2,0,...) at kern_wait+0xa76 wait4(c7f6a5c0,e9c00cec,e9c00d28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c7f6a5c0,e9c00ce4,e9c00ce4,0,e9c00d28,...) at syscallenter+0x246 syscall(e9c00d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2815cd5b, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command bash pid 1205 tid 100077 td 0xc7b9db80 sched_switch(c7b9db80,0,104,c7b9db80,e748586f,...) at sched_switch+0x28a mi_switch(104,0,c7b9db80,100,100,...) at mi_switch+0x11a sleepq_switch(c7b9db80,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7b9bac0,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7b9bac0,c7b9bb48,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7b9db80,ffffffff,e9b30c44,6,0,...) at kern_wait+0xa76 wait4(c7b9db80,e9b30cec,e9b30d28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c7b9db80,e9b30ce4,e9b30ce4,0,e9b30d28,...) at syscallenter+0x246 syscall(e9b30d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282bfd5b, esp = 0xbfbfe6cc, ebp = 0xbfbfe6e8 --- Tracing command csh pid 1201 tid 100161 td 0xc80edb80 sched_switch(c80edb80,0,104,c80edb80,698151d,...) at sched_switch+0x28a mi_switch(104,0,c80edb80,100,100,...) at mi_switch+0x11a sleepq_switch(c80edb80,0,c0c7d7d6,1a0,68,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80e5058,68,c0c30c68,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80e5058,c80e5088,168,c0c30c68,0,...) at _sleep+0x2bc kern_sigsuspend(c80edb80,0,0,0,0,...) at kern_sigsuspend+0xb2 sigsuspend(c80edb80,e9ca6cec,e9ca6d28,c0c7dba4,0,...) at sigsuspend+0x4d syscallenter(c80edb80,e9ca6ce4,e9ca6ce4,0,e9ca6d28,...) at syscallenter+0x246 syscall(e9ca6d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28179c0b, esp = 0xbfbfe60c, ebp = 0xbfbfe678 --- Tracing command su pid 1200 tid 100096 td 0xc7b9c000 sched_switch(c7b9c000,0,104,c7b9c000,77ff8ec7,...) at sched_switch+0x28a mi_switch(104,0,c7b9c000,100,100,...) at mi_switch+0x11a sleepq_switch(c7b9c000,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7e7f000,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7e7f000,c7e7f088,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7b9c000,4b1,e9b8cc44,2,0,...) at kern_wait+0xa76 wait4(c7b9c000,e9b8ccec,281c16e8,1,0,...) at wait4+0x3b syscallenter(c7b9c000,e9b8cce4,c0ba024e,c7b9c000,e9b8cd28,...) at syscallenter+0x246 syscall(e9b8cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x2811ed5b, esp = 0xbfbfe62c, ebp = 0xbfbfe648 --- Tracing command bash pid 1196 tid 100116 td 0xc7e8b8a0 sched_switch(c7e8b8a0,0,104,c7e8b8a0,6383cf47,...) at sched_switch+0x28a mi_switch(104,0,c7e8b8a0,100,100,...) at mi_switch+0x11a sleepq_switch(c7e8b8a0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7fc9ac0,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7fc9ac0,c7fc9b48,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7e8b8a0,ffffffff,e9c0fc44,6,0,...) at kern_wait+0xa76 wait4(c7e8b8a0,e9c0fcec,e9c0fd28,c0c7dba4,0,...) at wait4+0x3b syscallenter(c7e8b8a0,e9c0fce4,e9c0fce4,0,e9c0fd28,...) at syscallenter+0x246 syscall(e9c0fd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x282bfd5b, esp = 0xbfbfe9cc, ebp = 0xbfbfe9e8 --- Tracing command sshd pid 1195 tid 100159 td 0xc80ee2e0 sched_switch(c80ee2e0,0,104,c80ee2e0,3abbb7fb,...) at sched_switch+0x28a mi_switch(104,0,c80ee2e0,c80ee2e0,c80ee2e0,...) at mi_switch+0x11a sleepq_switch(c80ee2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9ca0a14,c088cde9,c7c0b990,0,c80ee2e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7c0b9a4,0,e9ca0a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7c0b9a4,c7c0b990,c0c7eb30,627,c7c14d58,...) at _cv_wait_sig+0x1b0 seltdwait(c7c14d58,58,c7c09a00,c80ee2e0,246,...) at seltdwait+0xa2 kern_select(c80ee2e0,a,286030b4,286030d8,0,0,20,c80e5560,c80e5560) at kern_select+0x4ee select(c80ee2e0,e9ca0cec,e9ca0d28,c0c7dba4,0,...) at select+0x66 syscallenter(c80ee2e0,e9ca0ce4,e9ca0ce4,0,e9ca0cb0,...) at syscallenter+0x246 syscall(e9ca0d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe1cc, ebp = 0xbfbfe218 --- Tracing command sshd pid 1193 tid 100101 td 0xc7e8e000 sched_switch(c7e8e000,0,104,c7e8e000,28c69a91,...) at sched_switch+0x28a mi_switch(104,0,c7e8e000,100,100,...) at mi_switch+0x11a sleepq_switch(c7e8e000,0,c0c7d7d6,1a0,58,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c80b83f0,58,c0c81ba2,100,0,...) at sleepq_wait_sig+0x17 _sleep(c80b83f0,c80b83b0,158,c0c81ba2,0,...) at _sleep+0x2bc sbwait(c80b838c,0,c0c81c18,5a2,c80b83b0,...) at sbwait+0x52 soreceive_generic(c80b8338,0,e9b9ec28,0,0,...) at soreceive_generic+0x2dc soreceive(c80b8338,0,e9b9ec28,0,0,0) at soreceive+0x38 soo_read(c7c0d0e0,e9b9ec28,c8390c00,0,c7e8e000,...) at soo_read+0x4e dofileread(e9b9ec28,ffffffff,ffffffff,0,c7c0d0e0,...) at dofileread+0x96 kern_readv(c7e8e000,5,e9b9ec28,e9b9ec48,1,...) at kern_readv+0x58 read(c7e8e000,e9b9ecec,e9b9ed28,c0c7dba4,0,...) at read+0x4f syscallenter(c7e8e000,e9b9ece4,e9b9ece4,0,e9b9ed28,...) at syscallenter+0x246 syscall(e9b9ed28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x284a95d3, esp = 0xbfbfdd9c, ebp = 0xbfbfddd8 --- Tracing command getty pid 1192 tid 100123 td 0xc7e8a2e0 sched_switch(c7e8a2e0,0,104,c7e8a2e0,5496dd57,...) at sched_switch+0x28a mi_switch(104,0,c7e8a2e0,c7e8a2e0,c7e8a2e0,...) at mi_switch+0x11a sleepq_switch(c7e8a2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7e8a2e0,c7e8a2e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c74f3070,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74f3070,c0dc97b0,0,c74f3000,e9c24b60,...) at _cv_wait_sig+0x1b0 tty_wait(c74f3000,c74f3070,e9c24c28,1,0,...) at tty_wait+0x23 ttydisc_read(c74f3000,e9c24c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c73edc00,e9c24c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9fcb0,e9c24c28,c716f100,0,c7e8a2e0,...) at devfs_read_f+0x7e dofileread(e9c24c28,ffffffff,ffffffff,0,c7b9fcb0,...) at dofileread+0x96 kern_readv(c7e8a2e0,0,e9c24c28,e9c24c48,1,...) at kern_readv+0x58 read(c7e8a2e0,e9c24cec,e9c24d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7e8a2e0,e9c24ce4,e9c24ce4,0,e9c24d28,...) at syscallenter+0x246 syscall(e9c24d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1191 tid 100104 td 0xc7e8d5c0 sched_switch(c7e8d5c0,0,104,c7e8d5c0,54b3c4df,...) at sched_switch+0x28a mi_switch(104,0,c7e8d5c0,c7e8d5c0,c7e8d5c0,...) at mi_switch+0x11a sleepq_switch(c7e8d5c0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7e8d5c0,c7e8d5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c74f3270,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c74f3270,c0dc97b0,0,c74f3200,e9ba9b60,...) at _cv_wait_sig+0x1b0 tty_wait(c74f3200,c74f3270,e9ba9c28,1,0,...) at tty_wait+0x23 ttydisc_read(c74f3200,e9ba9c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3000,e9ba9c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9fc08,e9ba9c28,c716f100,0,c7e8d5c0,...) at devfs_read_f+0x7e dofileread(e9ba9c28,ffffffff,ffffffff,0,c7b9fc08,...) at dofileread+0x96 kern_readv(c7e8d5c0,0,e9ba9c28,e9ba9c48,1,...) at kern_readv+0x58 read(c7e8d5c0,e9ba9cec,e9ba9d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7e8d5c0,e9ba9ce4,e9ba9ce4,0,e9ba9d28,...) at syscallenter+0x246 syscall(e9ba9d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1190 tid 100095 td 0xc7be6000 sched_switch(c7be6000,0,104,c7be6000,54b55986,...) at sched_switch+0x28a mi_switch(104,0,c7be6000,c7be6000,c7be6000,...) at mi_switch+0x11a sleepq_switch(c7be6000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7be6000,c7be6000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2a70,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2a70,c0dc97b0,0,c73f2a00,e9b80b60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2a00,c73f2a70,e9b80c28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2a00,e9b80c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3100,e9b80c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c0d7a8,e9b80c28,c716f100,0,c7be6000,...) at devfs_read_f+0x7e dofileread(e9b80c28,ffffffff,ffffffff,0,c7c0d7a8,...) at dofileread+0x96 kern_readv(c7be6000,0,e9b80c28,e9b80c48,1,...) at kern_readv+0x58 read(c7be6000,e9b80cec,e9b80d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7be6000,e9b80ce4,e9b80ce4,0,e9b80d28,...) at syscallenter+0x246 syscall(e9b80d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1189 tid 100090 td 0xc7be7000 sched_switch(c7be7000,0,104,c7be7000,54b27ad4,...) at sched_switch+0x28a mi_switch(104,0,c7be7000,c7be7000,c7be7000,...) at mi_switch+0x11a sleepq_switch(c7be7000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7be7000,c7be7000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382670,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382670,c0dc97b0,0,c7382600,e9b66b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382600,c7382670,e9b66c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382600,e9b66c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3200,e9b66c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7c14dc8,e9b66c28,c716f100,0,c7be7000,...) at devfs_read_f+0x7e dofileread(e9b66c28,ffffffff,ffffffff,0,c7c14dc8,...) at dofileread+0x96 kern_readv(c7be7000,0,e9b66c28,e9b66c48,1,...) at kern_readv+0x58 read(c7be7000,e9b66cec,e9b66d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7be7000,e9b66ce4,e9b66ce4,0,e9b66d28,...) at syscallenter+0x246 syscall(e9b66d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1188 tid 100151 td 0xc7fcb8a0 sched_switch(c7fcb8a0,0,104,c7fcb8a0,54a0fde2,...) at sched_switch+0x28a mi_switch(104,0,c7fcb8a0,c7fcb8a0,c7fcb8a0,...) at mi_switch+0x11a sleepq_switch(c7fcb8a0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7fcb8a0,c7fcb8a0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382870,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382870,c0dc97b0,0,c7382800,e9c88b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382800,c7382870,e9c88c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382800,e9c88c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3500,e9c88c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9e1c0,e9c88c28,c716f100,0,c7fcb8a0,...) at devfs_read_f+0x7e dofileread(e9c88c28,ffffffff,ffffffff,0,c7b9e1c0,...) at dofileread+0x96 kern_readv(c7fcb8a0,0,e9c88c28,e9c88c48,1,...) at kern_readv+0x58 read(c7fcb8a0,e9c88cec,e9c88d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fcb8a0,e9c88ce4,e9c88ce4,0,e9c88d28,...) at syscallenter+0x246 syscall(e9c88d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1187 tid 100147 td 0xc7fcc5c0 sched_switch(c7fcc5c0,0,104,c7fcc5c0,54a3b6c4,...) at sched_switch+0x28a mi_switch(104,0,c7fcc5c0,c7fcc5c0,c7fcc5c0,...) at mi_switch+0x11a sleepq_switch(c7fcc5c0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7fcc5c0,c7fcc5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382c70,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382c70,c0dc97b0,0,c7382c00,e9c79b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382c00,c7382c70,e9c79c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382c00,e9c79c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3600,e9c79c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9f188,e9c79c28,c716f100,0,c7fcc5c0,...) at devfs_read_f+0x7e dofileread(e9c79c28,ffffffff,ffffffff,0,c7b9f188,...) at dofileread+0x96 kern_readv(c7fcc5c0,0,e9c79c28,e9c79c48,1,...) at kern_readv+0x58 read(c7fcc5c0,e9c79cec,e9c79d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fcc5c0,e9c79ce4,e9c79ce4,0,e9c79d28,...) at syscallenter+0x246 syscall(e9c79d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1186 tid 100149 td 0xc7fcc000 sched_switch(c7fcc000,0,104,c7fcc000,54a55f61,...) at sched_switch+0x28a mi_switch(104,0,c7fcc000,c7fcc000,c7fcc000,...) at mi_switch+0x11a sleepq_switch(c7fcc000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7fcc000,c7fcc000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2670,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2670,c0dc97b0,0,c73f2600,e9c81b60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2600,c73f2670,e9c81c28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2600,e9c81c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3700,e9c81c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7f62310,e9c81c28,c716f100,0,c7fcc000,...) at devfs_read_f+0x7e dofileread(e9c81c28,ffffffff,ffffffff,0,c7f62310,...) at dofileread+0x96 kern_readv(c7fcc000,0,e9c81c28,e9c81c48,1,...) at kern_readv+0x58 read(c7fcc000,e9c81cec,e9c81d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fcc000,e9c81ce4,e9c81ce4,0,e9c81d28,...) at syscallenter+0x246 syscall(e9c81d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1185 tid 100154 td 0xc7fcb000 sched_switch(c7fcb000,0,104,c7fcb000,54b14767,...) at sched_switch+0x28a mi_switch(104,0,c7fcb000,c7fcb000,c7fcb000,...) at mi_switch+0x11a sleepq_switch(c7fcb000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,c7fcb000,c7fcb000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f2870,0,c0c80ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c73f2870,c0dc97b0,0,c73f2800,e9c91b60,...) at _cv_wait_sig+0x1b0 tty_wait(c73f2800,c73f2870,e9c91c28,1,0,...) at tty_wait+0x23 ttydisc_read(c73f2800,e9c91c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c74e3800,e9c91c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9e930,e9c91c28,c716f100,0,c7fcb000,...) at devfs_read_f+0x7e dofileread(e9c91c28,ffffffff,ffffffff,0,c7b9e930,...) at dofileread+0x96 kern_readv(c7fcb000,0,e9c91c28,e9c91c48,1,...) at kern_readv+0x58 read(c7fcb000,e9c91cec,e9c91d28,c0c7dba4,0,...) at read+0x4f syscallenter(c7fcb000,e9c91ce4,e9c91ce4,0,e9c91d28,...) at syscallenter+0x246 syscall(e9c91d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command getty pid 1184 tid 100160 td 0xc80ee000 sched_switch(c80ee000,0,104,c80ee000,ee9f26ba,...) at sched_switch+0x28a mi_switch(104,0,c80ee000,c80ee000,c80ee000,...) at mi_switch+0x11a sleepq_switch(c80ee000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9ca3aa8,c088cde9,c7382a04,0,c80ee000,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7382a70,0,e9ca3ae0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7382a70,c7382a04,0,c7382a00,e9ca3b60,...) at _cv_wait_sig+0x1b0 tty_wait(c7382a00,c7382a70,e9ca3c28,1,0,...) at tty_wait+0x23 ttydisc_read(c7382a00,e9ca3c28,0,9e,0,...) at ttydisc_read+0x1cc ttydev_read(c7161900,e9ca3c28,0,0,1,...) at ttydev_read+0xaa devfs_read_f(c7b9fa80,e9ca3c28,c716f100,0,c80ee000,...) at devfs_read_f+0x7e dofileread(e9ca3c28,ffffffff,ffffffff,0,c7b9fa80,...) at dofileread+0x96 kern_readv(c80ee000,0,e9ca3c28,e9ca3c48,1,...) at kern_readv+0x58 read(c80ee000,e9ca3cec,e9ca3d28,c0c7dba4,0,...) at read+0x4f syscallenter(c80ee000,e9ca3ce4,e9ca3ce4,0,e9ca3d28,...) at syscallenter+0x246 syscall(e9ca3d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, read), eip = 0x2818f5d3, esp = 0xbfbfedac, ebp = 0xbfbfedd8 --- Tracing command inetd pid 1145 tid 100083 td 0xc7be7b80 sched_switch(c7be7b80,0,104,c7be7b80,446dd7b3,...) at sched_switch+0x28a mi_switch(104,0,c7be7b80,c7be7b80,c7be7b80,...) at mi_switch+0x11a sleepq_switch(c7be7b80,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b48a14,c088cde9,c7bb6c90,0,c7be7b80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7bb6ca4,0,e9b48a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7bb6ca4,c7bb6c90,c0c7eb30,627,c7bb0850,...) at _cv_wait_sig+0x1b0 seltdwait(c7bb0850,58,c716f100,c7be7b80,0,...) at seltdwait+0xa2 kern_select(c7be7b80,6,bfbfdfc0,0,0,0,20,c7be2ac0,c7be2ac0) at kern_select+0x4ee select(c7be7b80,e9b48cec,e9b48d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7be7b80,e9b48ce4,e9b48ce4,0,e9b48d28,...) at syscallenter+0x246 syscall(e9b48d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281a3553, esp = 0xbfbfdf7c, ebp = 0xbfbfee08 --- Tracing command moused pid 1119 tid 100087 td 0xc7b9c2e0 sched_switch(c7b9c2e0,0,104,c7b9c2e0,38aad088,...) at sched_switch+0x28a mi_switch(104,0,c7b9c2e0,c7b9c2e0,c7b9c2e0,...) at mi_switch+0x11a sleepq_switch(c7b9c2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b58a14,c088cde9,c811ed90,0,c7b9c2e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c811eda4,0,e9b58a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c811eda4,c811ed90,c0c7eb30,627,c7b9eb98,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9eb98,58,c716f100,c7b9c2e0,c014630a,...) at seltdwait+0xa2 kern_select(c7b9c2e0,6,bfbfea24,0,0,0,20,c7ad32b0,c7ad32b0) at kern_select+0x4ee select(c7b9c2e0,e9b58cec,e9b58d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7b9c2e0,e9b58ce4,e9b58ce4,0,e9b58d28,...) at syscallenter+0x246 syscall(e9b58d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x281ac553, esp = 0xbfbfe9bc, ebp = 0xbfbfeb48 --- Tracing command cron pid 1095 tid 100118 td 0xc7e8b2e0 sched_switch(c7e8b2e0,0,104,c7e8b2e0,54f0fdef,...) at sched_switch+0x28a mi_switch(104,0,c7e8b2e0,100,100,...) at mi_switch+0x11a sleepq_switch(c7e8b2e0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(c08cf34b,c7e8b4e0,ea61,c08cec30,100,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c0dca004,5c,c0c7ae7a,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c0dca004,0,15c,c0c7ae7a,ea61,...) at _sleep+0x288 kern_nanosleep(c7e8b2e0,e9c15c34,e9c15c3c,3c,0,...) at kern_nanosleep+0xc1 nanosleep(c7e8b2e0,e9c15cec,e9c15d28,c0c7dba4,0,...) at nanosleep+0x6f syscallenter(c7e8b2e0,e9c15ce4,e9c15ce4,0,e9c15d28,...) at syscallenter+0x246 syscall(e9c15d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, nanosleep), eip = 0x2817bf57, esp = 0xbfbfec7c, ebp = 0xbfbfeca8 --- Tracing command sendmail pid 1088 tid 100122 td 0xc7e8a5c0 sched_switch(c7e8a5c0,0,104,c7e8a5c0,21c1f578,...) at sched_switch+0x28a mi_switch(104,0,c7e8a5c0,100,100,...) at mi_switch+0x11a sleepq_switch(c7e8a5c0,0,c0c7d7d6,1a0,68,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7fc8868,68,c0c30c68,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7fc8868,c7fc8898,168,c0c30c68,0,...) at _sleep+0x2bc kern_sigsuspend(c7e8a5c0,0,0,0,0,...) at kern_sigsuspend+0xb2 sigsuspend(c7e8a5c0,e9c21cec,e9c21d28,c0c7dba4,0,...) at sigsuspend+0x4d syscallenter(c7e8a5c0,e9c21ce4,e9c21ce4,0,c7e8a664,...) at syscallenter+0x246 syscall(e9c21d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, write), eip = 0x28334c0b, esp = 0xbfbfcf8c, ebp = 0xbfbfcfb8 --- Tracing command sendmail pid 1084 tid 100085 td 0xc7b9c5c0 sched_switch(c7b9c5c0,0,104,c7b9c5c0,b97caf2a,...) at sched_switch+0x28a mi_switch(104,0,c7b9c5c0,c7b9c5c0,c7b9c5c0,...) at mi_switch+0x11a sleepq_switch(c7b9c5c0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c7bb6b90,e9b50a14,c088cde9,c7bb6b90,c7b9c5c0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7bb6ba4,0,e9b50a4c,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7bb6ba4,c7bb6b90,1389,627,c7c14508,...) at _cv_timedwait_sig+0x1c0 seltdwait(e9b50bf8,e9b50c00,c7c0aa80,c7b9c5c0,246,...) at seltdwait+0x8a kern_select(c7b9c5c0,5,bfbfc500,0,0,e9b50c40,20,5,0) at kern_select+0x4ee select(c7b9c5c0,e9b50cec,e9b50d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7b9c5c0,e9b50ce4,e9b50ce4,0,e9b50cb0,...) at syscallenter+0x246 syscall(e9b50d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x283db553, esp = 0xbfbfc46c, ebp = 0xbfbfcf98 --- Tracing command sshd pid 1076 tid 100133 td 0xc7fdc2e0 sched_switch(c7fdc2e0,0,104,c7fdc2e0,9c50a726,...) at sched_switch+0x28a mi_switch(104,0,c7fdc2e0,c7fdc2e0,c7fdc2e0,...) at mi_switch+0x11a sleepq_switch(c7fdc2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c48a14,c088cde9,c7b42890,0,c7fdc2e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7b428a4,0,e9c48a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7b428a4,c7b42890,c0c7eb30,627,c7bb0e38,...) at _cv_wait_sig+0x1b0 seltdwait(c7bb0e38,58,c7b59e80,c7fdc2e0,8,...) at seltdwait+0xa2 kern_select(c7fdc2e0,5,286090ac,0,0,0,20,c7fd6810,c7fd6810) at kern_select+0x4ee select(c7fdc2e0,e9c48cec,e9c48d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7fdc2e0,e9c48ce4,e9c48ce4,0,e9c48cb0,...) at syscallenter+0x246 syscall(e9c48d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x284a9553, esp = 0xbfbfe28c, ebp = 0xbfbfee28 --- Tracing command ntpd pid 1031 tid 100152 td 0xc7fcb5c0 sched_switch(c7fcb5c0,0,104,c7fcb5c0,5da93736,...) at sched_switch+0x28a mi_switch(104,0,c7fcb5c0,c7fcb5c0,c7fcb5c0,...) at mi_switch+0x11a sleepq_switch(c7fcb5c0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c8ba14,c088cde9,c7ab1490,0,c7fcb5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7ab14a4,0,e9c8ba4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7ab14a4,c7ab1490,c0c7eb30,627,c7b9e620,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9e620,58,c716f100,c7fcb5c0,0,...) at seltdwait+0xa2 kern_select(c7fcb5c0,1b,bfbfed18,0,0,0,20,c80e6ac0,c80e6ac0) at kern_select+0x4ee select(c7fcb5c0,e9c8bcec,e9c8bd80,e9c8bc88,0,...) at select+0x66 syscallenter(c7fcb5c0,e9c8bce4,c0b9ff6b,fffffffe,3,...) at syscallenter+0x246 syscall(e9c8bd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28355553, esp = 0xbfbfecec, ebp = 0xbfbfedb8 --- Tracing command nfsd pid 898 tid 100139 td 0xc7fcc8a0 sched_switch(c7fcc8a0,0,104,c7fcc8a0,47583633,...) at sched_switch+0x28a mi_switch(104,0,c7fcc8a0,c7fcc8a0,c7fcc8a0,...) at mi_switch+0x11a sleepq_switch(c7fcc8a0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c5fbe0,c088cde9,c74d5a80,c7fcc8a0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7aaf4d0,0,e9c5fc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7aaf4d0,c74d5a80,1388,3b1,28313e24,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c5fd14,c0874e74,c74d5a80,e9c5fd28,c0c76ce3,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c5fd28,c0c76ce3,359,c7e7d2b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c5fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 898 tid 100138 td 0xc7fccb80 sched_switch(c7fccb80,0,104,c7fccb80,55ee5e59,...) at sched_switch+0x28a mi_switch(104,0,c7fccb80,c7fccb80,c7fccb80,...) at mi_switch+0x11a sleepq_switch(c7fccb80,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c5cbe0,c088cde9,c74d5a80,c7fccb80,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7af2410,0,e9c5cc18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7af2410,c74d5a80,1388,3b1,0,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c5cd14,c0874e74,c74d5a80,e9c5cd28,c0c76ce3,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c5cd28,c0c76ce3,359,c7e7d2b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c5cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 898 tid 100137 td 0xc7fcd000 sched_switch(c7fcd000,0,104,c7fcd000,5941e673,...) at sched_switch+0x28a mi_switch(104,0,c7fcd000,c7fcd000,c7fcd000,...) at mi_switch+0x11a sleepq_switch(c7fcd000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9c59be0,c088cde9,c74d5a80,c7fcd000,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7af2310,0,e9c59c18,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7af2310,c74d5a80,1388,3b1,7265746c,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(e9c59d14,c0874e74,c74d5a80,e9c59d28,c0c76ce3,...) at svc_run_internal+0x2bd svc_thread_start(c74d5a80,e9c59d28,c0c76ce3,359,c7e7d2b0,...) at svc_thread_start+0x10 fork_exit(c0a714c0,c74d5a80,e9c59d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0x804c72e, eip = 0xc, esp = 0x33, ebp = 0 --- Tracing command nfsd pid 898 tid 100105 td 0xc7e8d2e0 sched_switch(c7e8d2e0,0,104,c7e8d2e0,784660be,...) at sched_switch+0x28a mi_switch(104,0,c7e8d2e0,c7e8d2e0,c7e8d2e0,...) at mi_switch+0x11a sleepq_switch(c7e8d2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c74d5a80,e9badab0,c088cde9,c74d5a80,c7e8d2e0,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7af2510,0,e9badae8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7af2510,c74d5a80,1388,3b1,e9badb30,...) at _cv_timedwait_sig+0x1c0 svc_run_internal(c7e8d448,14,c0c97624,c0c9649a,e9badc0c,...) at svc_run_internal+0x2bd svc_run(c74d5a80,0,c0c9675c,1c2,0,...) at svc_run+0x7b nfssvc_nfsd(bfbfe890,e9badc0c,c,c716f100,e9badc20,...) at nfssvc_nfsd+0xad nfssvc_nfsserver(c7e8d2e0,e9badcec,c7e7d2b0,0,c7e8d2e0,...) at nfssvc_nfsserver+0x1ff nfssvc(c7e8d2e0,e9badcec,e9badd28,c0c7dba4,0,...) at nfssvc+0x63 syscallenter(c7e8d2e0,e9badce4,e9badce4,0,e9badd28,...) at syscallenter+0x246 syscall(e9badd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, nfssvc), eip = 0x280d980b, esp = 0xbfbfe84c, ebp = 0xbfbfeab8 --- Tracing command nfsd pid 897 tid 100127 td 0xc7fcd2e0 sched_switch(c7fcd2e0,0,104,c7fcd2e0,af242081,...) at sched_switch+0x28a mi_switch(104,0,c7fcd2e0,c7fcd2e0,c7fcd2e0,...) at mi_switch+0x11a sleepq_switch(c7fcd2e0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c30a14,c088cde9,c7b410d0,0,c7fcd2e0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7b410e4,0,e9c30a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7b410e4,c7b410d0,c0c7eb30,627,c7b9f8f8,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9f8f8,58,c716f100,c7fcd2e0,e9c30ab4,...) at seltdwait+0xa2 kern_select(c7fcd2e0,5,bfbfecd0,0,0,0,20,c7f64810,c7f64810) at kern_select+0x4ee select(c7fcd2e0,e9c30cec,bfbffff4,1,0,...) at select+0x66 syscallenter(c7fcd2e0,e9c30ce4,46,c0dca07c,e9c30cb0,...) at syscallenter+0x246 syscall(e9c30d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x2817f553, esp = 0xbfbfeabc, ebp = 0xbfbfee08 --- Tracing command mountd pid 888 tid 100115 td 0xc7e8bb80 sched_switch(c7e8bb80,0,104,c7e8bb80,3c78636d,...) at sched_switch+0x28a mi_switch(104,0,c7e8bb80,c7e8bb80,c7e8bb80,...) at mi_switch+0x11a sleepq_switch(c7e8bb80,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c0ca14,c088cde9,c7b429d0,0,c7e8bb80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7b429e4,0,e9c0ca4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7b429e4,c7b429d0,c0c7eb30,627,c7b9e540,...) at _cv_wait_sig+0x1b0 seltdwait(c7b9e540,58,c716f100,c7e8bb80,c08d68dc,...) at seltdwait+0xa2 kern_select(c7e8bb80,9,bfbfed6c,0,0,0,20,c7fca000,c7fca000) at kern_select+0x4ee select(c7e8bb80,e9c0ccec,e9c0cd28,c0c7dba4,0,...) at select+0x66 syscallenter(c7e8bb80,e9c0cce4,e9c0cce4,0,e9c0cd28,...) at syscallenter+0x246 syscall(e9c0cd28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28193553, esp = 0xbfbfed3c, ebp = 0xbfbfee08 --- Tracing command rpcbind pid 791 tid 100124 td 0xc7e8a000 sched_switch(c7e8a000,0,104,c7e8a000,f13d39e9,...) at sched_switch+0x28a mi_switch(104,0,c7e8a000,c7e8a000,c7e8a000,...) at mi_switch+0x11a sleepq_switch(c7e8a000,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(c7aaf890,e9c27a6c,c088cde9,c7aaf890,c7e8a000,...) at sleepq_catch_signals+0x51 sleepq_timedwait_sig(c7aaf8a4,0,e9c27aa4,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(c7aaf8a4,c7aaf890,7531,627,e9c27b5c,...) at _cv_timedwait_sig+0x1c0 seltdwait(e9c27c2c,e9c27c34,535,c7e8a000,e9c27b2c,...) at seltdwait+0x8a poll(c7e8a000,e9c27cec,e9c27d28,c0c7dba4,0,...) at poll+0x300 syscallenter(c7e8a000,e9c27ce4,e9c27ce4,0,e9c27d28,...) at syscallenter+0x246 syscall(e9c27d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, poll), eip = 0x28137eff, esp = 0xbfbfcbcc, ebp = 0xbfbfed98 --- Tracing command syslogd pid 765 tid 100117 td 0xc7e8b5c0 sched_switch(c7e8b5c0,0,104,c7e8b5c0,27cd2c21,...) at sched_switch+0x28a mi_switch(104,0,c7e8b5c0,c7e8b5c0,c7e8b5c0,...) at mi_switch+0x11a sleepq_switch(c7e8b5c0,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9c12a14,c088cde9,c7bb5910,0,c7e8b5c0,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7bb5924,0,e9c12a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7bb5924,c7bb5910,c0c7eb30,627,c7bb02a0,...) at _cv_wait_sig+0x1b0 seltdwait(c7bb02a0,58,c716f100,c7e8b5c0,58,...) at seltdwait+0xa2 kern_select(c7e8b5c0,9,2822c0a8,0,0,0,20,c7fc9810,c7fc9810) at kern_select+0x4ee select(c7e8b5c0,e9c12cec,e9c12d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7e8b5c0,e9c12ce4,e9c12ce4,0,c088cb6d,...) at syscallenter+0x246 syscall(e9c12d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x28192553, esp = 0xbfbfe29c, ebp = 0xbfbfee08 --- Tracing command devd pid 617 tid 100082 td 0xc7b9cb80 sched_switch(c7b9cb80,0,104,c7b9cb80,9c7002c2,...) at sched_switch+0x28a mi_switch(104,0,c7b9cb80,c7b9cb80,c7b9cb80,...) at mi_switch+0x11a sleepq_switch(c7b9cb80,0,c0c7d7d6,1a0,0,...) at sleepq_switch+0xd3 sleepq_catch_signals(e9b44a14,c088cde9,c7b416d0,0,c7b9cb80,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7b416e4,0,e9b44a4c,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c7b416e4,c7b416d0,c0c7eb30,627,c7c14ce8,...) at _cv_wait_sig+0x1b0 seltdwait(c7c14ce8,58,c716f100,c7b9cb80,1,...) at seltdwait+0xa2 kern_select(c7b9cb80,5,bfbfe990,0,0,0,20,c7ad3ac0,c7ad3ac0) at kern_select+0x4ee select(c7b9cb80,e9b44cec,e9b44d28,c0c7dba4,0,...) at select+0x66 syscallenter(c7b9cb80,e9b44ce4,e9b44ce4,0,e9b44d28,...) at syscallenter+0x246 syscall(e9b44d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, select), eip = 0x8088143, esp = 0xbfbfe95c, ebp = 0xbfbfee38 --- Tracing command flowcleaner pid 21 tid 100076 td 0xc73d58a0 sched_switch(c73d58a0,0,104,c73d58a0,882e533c,...) at sched_switch+0x28a mi_switch(104,0,c73d58a0,c73d58a0,c73d58a0,...) at mi_switch+0x11a sleepq_switch(c73d58a0,0,c0c7d7d6,283,c73d58a0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f371f0,0,e7940ca8,1,0,...) at sleepq_timedwait+0x3e _cv_timedwait(c0f371f0,c0f371f8,4e20,624,c73d58a0,...) at _cv_timedwait+0x1c0 flowtable_cleaner(0,e7940d28,c0c76ce3,359,c727c810,...) at flowtable_cleaner+0x215 fork_exit(c0937c70,0,e7940d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7940d60, ebp = 0 --- Tracing command softdepflush pid 20 tid 100075 td 0xc73d5b80 kdb_enter(c0c7a393,c0c7a393,c0c7ddb1,e793dba4,0,...) at kdb_enter+0x3a panic(c0c7ddb1,ffffffff,b91,cc,c7fda000,...) at panic+0x134 propagate_priority(c0ddcb3c,0,c0c7dd56,2e1,c0ddcb38,...) at propagate_priority+0xe3 turnstile_wait(c80eb280,c83e08a0,0,c7e81d48,e7e,...) at turnstile_wait+0x239 _mtx_lock_sleep(c7e81d48,c73d5b80,0,c0c994a6,e7e,...) at _mtx_lock_sleep+0x10c _mtx_lock_flags(c7e81d48,0,c0c994a6,e7e,8,...) at _mtx_lock_flags+0x6f handle_workitem_freefile(0,e793dc7c,2,3b6,8,...) at handle_workitem_freefile+0xab process_worklist_item(c0f42844,0,c0c994a6,34a,c73d5b80,...) at process_worklist_item+0x1d2 softdep_process_worklist(c83e8000,0,c0c994a6,2fa,3e8,...) at softdep_process_worklist+0x63 softdep_flush(0,e793dd28,c0c76ce3,359,c727cac0,...) at softdep_flush+0x287 fork_exit(c0aab850,0,e793dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793dd60, ebp = 0 --- Tracing command syncer pid 19 tid 100074 td 0xc74e5000 sched_switch(c74e5000,0,104,c74e5000,d3c2a898,...) at sched_switch+0x28a mi_switch(104,0,c74e5000,c74e5000,c74e5000,...) at mi_switch+0x11a sleepq_switch(c74e5000,0,c0c7d7d6,283,c74e5000,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f36ff8,0,e793ac74,1,0,...) at sleepq_timedwait+0x3e _cv_timedwait(c0f36ff8,c0f36fe4,3e8,766,4e20,...) at _cv_timedwait+0x1c0 sched_sync(0,e793ad28,c0c76ce3,359,c7ad2000,...) at sched_sync+0x4bd fork_exit(c0921d10,0,e793ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe793ad60, ebp = 0 --- Tracing command vnlru pid 18 tid 100073 td 0xc74e52e0 sched_switch(c74e52e0,0,104,c74e52e0,89e03fb8,...) at sched_switch+0x28a mi_switch(104,0,c74e52e0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e52e0,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c7ad22b0,50,c0c84b18,0,0,...) at sleepq_timedwait+0x3e _sleep(c7ad22b0,c0f36fb8,250,c0c84b18,3e8,...) at _sleep+0x2a2 vnlru_proc(0,e7937d28,c0c76ce3,359,c7ad22b0,...) at vnlru_proc+0xe7 fork_exit(c09229a0,0,e7937d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7937d60, ebp = 0 --- Tracing command bufdaemon pid 17 tid 100072 td 0xc74e55c0 sched_switch(c74e55c0,0,104,c74e55c0,bb23535f,...) at sched_switch+0x28a mi_switch(104,0,c74e55c0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e55c0,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f36d28,44,c0c826f4,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f36d28,c0f36d2c,44,c0c826f4,3e8,...) at _sleep+0x2a2 buf_daemon(0,e7934d28,c0c76ce3,359,c7ad2560,...) at buf_daemon+0x138 fork_exit(c0909f80,0,e7934d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7934d60, ebp = 0 --- Tracing command pagezero pid 16 tid 100071 td 0xc74e58a0 sched_switch(c74e58a0,0,104,c74e58a0,5d7d6cd3,...) at sched_switch+0x28a mi_switch(104,0,c74e58a0,0,0,...) at mi_switch+0x11a sleepq_switch(c74e58a0,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f43574,0,c0c9db8d,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f43574,c0f43130,0,c0c9db8d,493e0,...) at _sleep+0x2a2 vm_pagezero(0,e7931d28,c0c76ce3,359,c7ad2810,...) at vm_pagezero+0xb3 fork_exit(c0ae4460,0,e7931d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7931d60, ebp = 0 --- Tracing command vmdaemon pid 15 tid 100070 td 0xc74e5b80 sched_switch(c74e5b80,0,104,c74e5b80,ce260148,...) at sched_switch+0x28a mi_switch(104,0,c74e5b80,c74e5b80,c74e5b80,...) at mi_switch+0x11a sleepq_switch(c74e5b80,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0f4319c,68,c0c826f4,0,0,...) at sleepq_wait+0x39 _sleep(c0f4319c,c0f431a0,68,c0c826f4,0,...) at _sleep+0x2d2 vm_daemon(0,e792ed28,c0c76ce3,359,c7ad2ac0,...) at vm_daemon+0x59 fork_exit(c0adf960,0,e792ed28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe792ed60, ebp = 0 --- Tracing command pagedaemon pid 9 tid 100069 td 0xc74e6000 sched_switch(c74e6000,0,104,c74e6000,9bcf2a90,...) at sched_switch+0x28a mi_switch(104,0,c74e6000,0,0,...) at mi_switch+0x11a sleepq_switch(c74e6000,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0f43164,44,c0c826f4,0,0,...) at sleepq_timedwait+0x3e _sleep(c0f43164,c0f43130,44,c0c826f4,1388,...) at _sleep+0x2a2 vm_pageout(0,e792bd28,c0c76ce3,359,c7ad3000,...) at vm_pageout+0x2bb fork_exit(c0ae0710,0,e792bd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe792bd60, ebp = 0 --- Tracing command xpt_thrd pid 8 tid 100068 td 0xc74e62e0 sched_switch(c74e62e0,0,104,c74e62e0,cca4437d,...) at sched_switch+0x28a mi_switch(104,0,c74e62e0,c74e62e0,c74e62e0,...) at mi_switch+0x11a sleepq_switch(c74e62e0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0d96554,4c,c0c175c7,0,0,...) at sleepq_wait+0x39 _sleep(c0d96554,c0d96598,4c,c0c175c7,0,...) at _sleep+0x2d2 xpt_scanner_thread(0,e7928d28,c0c76ce3,359,c71722b0,...) at xpt_scanner_thread+0x47 fork_exit(c04846a0,0,e7928d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7928d60, ebp = 0 --- Tracing command sctp_iterator pid 7 tid 100067 td 0xc74e65c0 sched_switch(c74e65c0,0,104,c74e65c0,e597d8d0,...) at sched_switch+0x28a mi_switch(104,0,c74e65c0,c74e65c0,c74e65c0,...) at mi_switch+0x11a sleepq_switch(c74e65c0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0f38a38,0,c0c8ebbf,0,0,...) at sleepq_wait+0x39 _sleep(c0f38a38,c0f38a00,0,c0c8ebbf,0,...) at _sleep+0x2d2 sctp_iterator_thread(0,e7925d28,c0c76ce3,359,c7172560,...) at sctp_iterator_thread+0x5c fork_exit(c09a8480,0,e7925d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7925d60, ebp = 0 --- Tracing command fdc0 pid 6 tid 100064 td 0xc74e7000 sched_switch(c74e7000,0,104,c74e7000,87d630fc,...) at sched_switch+0x28a mi_switch(104,0,c74e7000,0,0,...) at mi_switch+0x11a sleepq_switch(c74e7000,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c73f243c,4c,c0c72775,0,0,...) at sleepq_timedwait+0x3e _sleep(c73f243c,c73f24f0,4c,c0c72775,3e8,...) at _sleep+0x2a2 fdc_thread(c73f2400,e791cd28,c0c76ce3,359,c7172810,...) at fdc_thread+0x2be fork_exit(c0b62990,c73f2400,e791cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe791cd60, ebp = 0 --- Tracing command fw0_probe pid 5 tid 100062 td 0xc73c35c0 sched_switch(c73c35c0,0,104,c73c35c0,df9ec814,...) at sched_switch+0x28a mi_switch(104,0,c73c35c0,100,100,...) at mi_switch+0x11a sleepq_switch(c73c35c0,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c73f9000,5c,c0c72775,100,0,...) at sleepq_wait_sig+0x17 _sleep(c73f9000,c73fd488,15c,c0c72775,0,...) at _sleep+0x2bc fw_bus_probe_thread(c73f9000,e790cd28,c0c76ce3,359,c7172ac0,...) at fw_bus_probe_thread+0xa08 fork_exit(c0672420,c73f9000,e790cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe790cd60, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xc73d32e0 sched_switch(c73d32e0,0,104,c73d32e0,bd303e11,...) at sched_switch+0x28a mi_switch(104,0,c73d32e0,c73d32e0,c73d32e0,...) at mi_switch+0x11a sleepq_switch(c73d32e0,0,c0c7d7d6,260,c73d32e0,...) at sleepq_switch+0xd3 sleepq_wait(c73dad34,0,e78f9cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dad34,c73dadd4,c0c6b357,6c,c73dad3c,...) at _cv_wait+0x1b0 usb_process(c73dad2c,e78f9d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dad2c,e78f9d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f9d60, ebp = 0 --- Tracing command usb pid 14 tid 100057 td 0xc73d35c0 sched_switch(c73d35c0,0,104,c73d35c0,182520e5,...) at sched_switch+0x28a mi_switch(104,0,c73d35c0,c73d35c0,c73d35c0,...) at mi_switch+0x11a sleepq_switch(c73d35c0,0,c0c7d7d6,260,c73d35c0,...) at sleepq_switch+0xd3 sleepq_wait(c73dad04,0,e78f6cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dad04,c73dadd4,c0c6b357,6c,c73dad0c,...) at _cv_wait+0x1b0 usb_process(c73dacfc,e78f6d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dacfc,e78f6d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f6d60, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc73d38a0 sched_switch(c73d38a0,0,104,c73d38a0,bccaf7ce,...) at sched_switch+0x28a mi_switch(104,0,c73d38a0,c73d38a0,c73d38a0,...) at mi_switch+0x11a sleepq_switch(c73d38a0,0,c0c7d7d6,260,c73d38a0,...) at sleepq_switch+0xd3 sleepq_wait(c73dacd4,0,e78f3cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73dacd4,c73dadd4,c0c6b357,6c,c73dacdc,...) at _cv_wait+0x1b0 usb_process(c73daccc,e78f3d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73daccc,e78f3d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f3d60, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc73d3b80 sched_switch(c73d3b80,0,104,c73d3b80,bccae7fb,...) at sched_switch+0x28a mi_switch(104,0,c73d3b80,c73d3b80,c73d3b80,...) at mi_switch+0x11a sleepq_switch(c73d3b80,0,c0c7d7d6,260,c73d3b80,...) at sleepq_switch+0xd3 sleepq_wait(c73daca4,0,e78f0cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73daca4,c73dadd4,c0c6b357,6c,c73dacac,...) at _cv_wait+0x1b0 usb_process(c73dac9c,e78f0d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73dac9c,e78f0d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78f0d60, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc73d52e0 sched_switch(c73d52e0,0,104,c73d52e0,bccad74d,...) at sched_switch+0x28a mi_switch(104,0,c73d52e0,c73d52e0,c73d52e0,...) at mi_switch+0x11a sleepq_switch(c73d52e0,0,c0c7d7d6,260,c73d52e0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdb5c,0,e78e7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdb5c,c73cdbfc,c0c6b357,6c,c73cdb64,...) at _cv_wait+0x1b0 usb_process(c73cdb54,e78e7d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdb54,e78e7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e7d60, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xc73d55c0 sched_switch(c73d55c0,0,104,c73d55c0,beae58d9,...) at sched_switch+0x28a mi_switch(104,0,c73d55c0,c73d55c0,c73d55c0,...) at mi_switch+0x11a sleepq_switch(c73d55c0,0,c0c7d7d6,260,c73d55c0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdb2c,0,e78e4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdb2c,c73cdbfc,c0c6b357,6c,c73cdb34,...) at _cv_wait+0x1b0 usb_process(c73cdb24,e78e4d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdb24,e78e4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e4d60, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc73c1000 sched_switch(c73c1000,0,104,c73c1000,bc67bc6c,...) at sched_switch+0x28a mi_switch(104,0,c73c1000,c73c1000,c73c1000,...) at mi_switch+0x11a sleepq_switch(c73c1000,0,c0c7d7d6,260,c73c1000,...) at sleepq_switch+0xd3 sleepq_wait(c73cdafc,0,e78e1cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdafc,c73cdbfc,c0c6b357,6c,c73cdb04,...) at _cv_wait+0x1b0 usb_process(c73cdaf4,e78e1d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdaf4,e78e1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78e1d60, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc73c12e0 sched_switch(c73c12e0,0,104,c73c12e0,bc67a9c5,...) at sched_switch+0x28a mi_switch(104,0,c73c12e0,c73c12e0,c73c12e0,...) at mi_switch+0x11a sleepq_switch(c73c12e0,0,c0c7d7d6,260,c73c12e0,...) at sleepq_switch+0xd3 sleepq_wait(c73cdacc,0,e78decac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73cdacc,c73cdbfc,c0c6b357,6c,c73cdad4,...) at _cv_wait+0x1b0 usb_process(c73cdac4,e78ded28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73cdac4,e78ded28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78ded60, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc73c15c0 sched_switch(c73c15c0,0,104,c73c15c0,bc6797aa,...) at sched_switch+0x28a mi_switch(104,0,c73c15c0,c73c15c0,c73c15c0,...) at mi_switch+0x11a sleepq_switch(c73c15c0,0,c0c7d7d6,260,c73c15c0,...) at sleepq_switch+0xd3 sleepq_wait(c73c9b5c,0,e78dacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9b5c,c73c9bfc,c0c6b357,6c,c73c9b64,...) at _cv_wait+0x1b0 usb_process(c73c9b54,e78dad28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9b54,e78dad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78dad60, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc73c18a0 sched_switch(c73c18a0,0,104,c73c18a0,bec9d679,...) at sched_switch+0x28a mi_switch(104,0,c73c18a0,c73c18a0,c73c18a0,...) at mi_switch+0x11a sleepq_switch(c73c18a0,0,c0c7d7d6,260,c73c18a0,...) at sleepq_switch+0xd3 sleepq_wait(c73c9b2c,0,e78d7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9b2c,c73c9bfc,c0c6b357,6c,c73c9b34,...) at _cv_wait+0x1b0 usb_process(c73c9b24,e78d7d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9b24,e78d7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d7d60, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc73c1b80 sched_switch(c73c1b80,0,104,c73c1b80,bc04cb58,...) at sched_switch+0x28a mi_switch(104,0,c73c1b80,c73c1b80,c73c1b80,...) at mi_switch+0x11a sleepq_switch(c73c1b80,0,c0c7d7d6,260,c73c1b80,...) at sleepq_switch+0xd3 sleepq_wait(c73c9afc,0,e78d4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9afc,c73c9bfc,c0c6b357,6c,c73c9b04,...) at _cv_wait+0x1b0 usb_process(c73c9af4,e78d4d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9af4,e78d4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d4d60, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc73c2000 sched_switch(c73c2000,0,104,c73c2000,bc04ba7d,...) at sched_switch+0x28a mi_switch(104,0,c73c2000,c73c2000,c73c2000,...) at mi_switch+0x11a sleepq_switch(c73c2000,0,c0c7d7d6,260,c73c2000,...) at sleepq_switch+0xd3 sleepq_wait(c73c9acc,0,e78d1cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73c9acc,c73c9bfc,c0c6b357,6c,c73c9ad4,...) at _cv_wait+0x1b0 usb_process(c73c9ac4,e78d1d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73c9ac4,e78d1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78d1d60, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc73c22e0 sched_switch(c73c22e0,0,104,c73c22e0,bc04a788,...) at sched_switch+0x28a mi_switch(104,0,c73c22e0,c73c22e0,c73c22e0,...) at mi_switch+0x11a sleepq_switch(c73c22e0,0,c0c7d7d6,260,c73c22e0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcb5c,0,e78cdcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcb5c,c73bcbfc,c0c6b357,6c,c73bcb64,...) at _cv_wait+0x1b0 usb_process(c73bcb54,e78cdd28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcb54,e78cdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78cdd60, ebp = 0 --- Tracing command usb pid 14 tid 100044 td 0xc73c25c0 sched_switch(c73c25c0,0,104,c73c25c0,bd9ba263,...) at sched_switch+0x28a mi_switch(104,0,c73c25c0,c73c25c0,c73c25c0,...) at mi_switch+0x11a sleepq_switch(c73c25c0,0,c0c7d7d6,260,c73c25c0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcb2c,0,e78cacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcb2c,c73bcbfc,c0c6b357,6c,c73bcb34,...) at _cv_wait+0x1b0 usb_process(c73bcb24,e78cad28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcb24,e78cad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78cad60, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc73c28a0 sched_switch(c73c28a0,0,104,c73c28a0,bba191ad,...) at sched_switch+0x28a mi_switch(104,0,c73c28a0,c73c28a0,c73c28a0,...) at mi_switch+0x11a sleepq_switch(c73c28a0,0,c0c7d7d6,260,c73c28a0,...) at sleepq_switch+0xd3 sleepq_wait(c73bcafc,0,e78c7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcafc,c73bcbfc,c0c6b357,6c,c73bcb04,...) at _cv_wait+0x1b0 usb_process(c73bcaf4,e78c7d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcaf4,e78c7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c7d60, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc73c2b80 sched_switch(c73c2b80,0,104,c73c2b80,bba17ffd,...) at sched_switch+0x28a mi_switch(104,0,c73c2b80,c73c2b80,c73c2b80,...) at mi_switch+0x11a sleepq_switch(c73c2b80,0,c0c7d7d6,260,c73c2b80,...) at sleepq_switch+0xd3 sleepq_wait(c73bcacc,0,e78c4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73bcacc,c73bcbfc,c0c6b357,6c,c73bcad4,...) at _cv_wait+0x1b0 usb_process(c73bcac4,e78c4d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73bcac4,e78c4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c4d60, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc73ae000 sched_switch(c73ae000,0,104,c73ae000,bba16df4,...) at sched_switch+0x28a mi_switch(104,0,c73ae000,c73ae000,c73ae000,...) at mi_switch+0x11a sleepq_switch(c73ae000,0,c0c7d7d6,260,c73ae000,...) at sleepq_switch+0xd3 sleepq_wait(c73b9b5c,0,e78bdcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9b5c,c73b9bfc,c0c6b357,6c,c73b9b64,...) at _cv_wait+0x1b0 usb_process(c73b9b54,e78bdd28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9b54,e78bdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78bdd60, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc73ae2e0 sched_switch(c73ae2e0,0,104,c73ae2e0,be24ffdc,...) at sched_switch+0x28a mi_switch(104,0,c73ae2e0,c73ae2e0,c73ae2e0,...) at mi_switch+0x11a sleepq_switch(c73ae2e0,0,c0c7d7d6,260,c73ae2e0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9b2c,0,e78bacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9b2c,c73b9bfc,c0c6b357,6c,c73b9b34,...) at _cv_wait+0x1b0 usb_process(c73b9b24,e78bad28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9b24,e78bad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78bad60, ebp = 0 --- Tracing command usb pid 14 tid 100038 td 0xc73ae5c0 sched_switch(c73ae5c0,0,104,c73ae5c0,bb3e8de9,...) at sched_switch+0x28a mi_switch(104,0,c73ae5c0,c73ae5c0,c73ae5c0,...) at mi_switch+0x11a sleepq_switch(c73ae5c0,0,c0c7d7d6,260,c73ae5c0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9afc,0,e78b7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9afc,c73b9bfc,c0c6b357,6c,c73b9b04,...) at _cv_wait+0x1b0 usb_process(c73b9af4,e78b7d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9af4,e78b7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b7d60, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc73ae8a0 sched_switch(c73ae8a0,0,104,c73ae8a0,bb3e7e50,...) at sched_switch+0x28a mi_switch(104,0,c73ae8a0,c73ae8a0,c73ae8a0,...) at mi_switch+0x11a sleepq_switch(c73ae8a0,0,c0c7d7d6,260,c73ae8a0,...) at sleepq_switch+0xd3 sleepq_wait(c73b9acc,0,e78b4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73b9acc,c73b9bfc,c0c6b357,6c,c73b9ad4,...) at _cv_wait+0x1b0 usb_process(c73b9ac4,e78b4d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73b9ac4,e78b4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b4d60, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc73b0000 sched_switch(c73b0000,0,104,c73b0000,bb3e6c78,...) at sched_switch+0x28a mi_switch(104,0,c73b0000,c73b0000,c73b0000,...) at mi_switch+0x11a sleepq_switch(c73b0000,0,c0c7d7d6,260,c73b0000,...) at sleepq_switch+0xd3 sleepq_wait(c73a8b5c,0,e78adcac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8b5c,c73a8bfc,c0c6b357,6c,c73a8b64,...) at _cv_wait+0x1b0 usb_process(c73a8b54,e78add28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8b54,e78add28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78add60, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc73b02e0 sched_switch(c73b02e0,0,104,c73b02e0,bcf6ead5,...) at sched_switch+0x28a mi_switch(104,0,c73b02e0,c73b02e0,c73b02e0,...) at mi_switch+0x11a sleepq_switch(c73b02e0,0,c0c7d7d6,260,c73b02e0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8b2c,0,e78aacac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8b2c,c73a8bfc,c0c6b357,6c,c73a8b34,...) at _cv_wait+0x1b0 usb_process(c73a8b24,e78aad28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8b24,e78aad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78aad60, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc73b05c0 sched_switch(c73b05c0,0,104,c73b05c0,bad54adb,...) at sched_switch+0x28a mi_switch(104,0,c73b05c0,c73b05c0,c73b05c0,...) at mi_switch+0x11a sleepq_switch(c73b05c0,0,c0c7d7d6,260,c73b05c0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8afc,0,e78a7cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8afc,c73a8bfc,c0c6b357,6c,c73a8b04,...) at _cv_wait+0x1b0 usb_process(c73a8af4,e78a7d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8af4,e78a7d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a7d60, ebp = 0 --- Tracing command usb pid 14 tid 100032 td 0xc73b08a0 sched_switch(c73b08a0,0,104,c73b08a0,bad53a45,...) at sched_switch+0x28a mi_switch(104,0,c73b08a0,c73b08a0,c73b08a0,...) at mi_switch+0x11a sleepq_switch(c73b08a0,0,c0c7d7d6,260,c73b08a0,...) at sleepq_switch+0xd3 sleepq_wait(c73a8acc,0,e78a4cac,1,0,...) at sleepq_wait+0x39 _cv_wait(c73a8acc,c73a8bfc,c0c6b357,6c,c73a8ad4,...) at _cv_wait+0x1b0 usb_process(c73a8ac4,e78a4d28,c0c76ce3,359,c727c000,...) at usb_process+0x156 fork_exit(c07d38c0,c73a8ac4,e78a4d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a4d60, ebp = 0 --- Tracing command yarrow pid 13 tid 100017 td 0xc727a5c0 sched_switch(c727a5c0,0,104,c727a5c0,ba62f479,...) at sched_switch+0x28a mi_switch(104,0,c727a5c0,2,2,...) at mi_switch+0x11a sleepq_switch(c727a5c0,0,c0c7d7d6,283,2,...) at sleepq_switch+0xd3 sleepq_timedwait(c0dc9e64,0,c0c72775,2,0,...) at sleepq_timedwait+0x3e _sleep(c0dc9e64,0,0,c0c72775,64,...) at _sleep+0x2a2 pause(c0c72775,64,c0c5ec37,111,0,...) at pause+0x30 random_kthread(0,c6f2fd28,c0c76ce3,359,c727c2b0,...) at random_kthread+0x1b4 fork_exit(c0746e50,0,c6f2fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f2fd60, ebp = 0 --- Tracing command g_down pid 4 tid 100015 td 0xc727ab80 sched_switch(c727ab80,0,104,c727ab80,687fb953,...) at sched_switch+0x28a mi_switch(104,0,c727ab80,c727ab80,c727ab80,...) at mi_switch+0x11a sleepq_switch(c727ab80,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7b64,4c,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7b64,c0dc7ac8,24c,c0c72775,0,...) at _sleep+0x2d2 g_io_schedule_down(c727ab80,0,c0c733dc,74,0,...) at g_io_schedule_down+0x58 g_down_procbody(0,c6f29d28,c0c76ce3,359,c727c560,...) at g_down_procbody+0x69 fork_exit(c083f3b0,0,c6f29d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f29d60, ebp = 0 --- Tracing command g_up pid 3 tid 100014 td 0xc727b000 sched_switch(c727b000,0,104,c727b000,68a8f26a,...) at sched_switch+0x28a mi_switch(104,0,c727b000,c727b000,c727b000,...) at mi_switch+0x11a sleepq_switch(c727b000,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7b60,4c,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7b60,c0dc7ae8,24c,c0c72775,0,...) at _sleep+0x2d2 g_io_schedule_up(c727b000,0,c0c733dc,5d,0,...) at g_io_schedule_up+0xae g_up_procbody(0,c6f26d28,c0c76ce3,359,c7171000,...) at g_up_procbody+0x69 fork_exit(c083f420,0,c6f26d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f26d60, ebp = 0 --- Tracing command g_event pid 2 tid 100013 td 0xc71752e0 sched_switch(c71752e0,0,104,c71752e0,3c533a22,...) at sched_switch+0x28a mi_switch(104,0,c71752e0,c71752e0,c71752e0,...) at mi_switch+0x11a sleepq_switch(c71752e0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c0dc7b58,4c,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c0dc7b58,c0dc7aa8,24c,c0c72775,0,...) at _sleep+0x2d2 g_run_events(c0dcddc0,0,c0c733dc,8b) at g_run_events+0x340 g_event_procbody(0,c6f23d28,c0c76ce3,359,c71712b0,...) at g_event_procbody+0x66 fork_exit(c083f490,0,c6f23d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f23d60, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc74e68a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100065 td 0xc74e6b80 sched_switch(c74e6b80,0,109,529,bad217df,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c716f070,...) at mi_switch+0x11a ithread_loop(c74e8310,e791fd28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c74e8310,e791fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe791fd60, ebp = 0 --- Tracing command intr pid 12 tid 100063 td 0xc73c32e0 sched_switch(c73c32e0,0,109,529,ee9f1056,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c73f1ef0,...) at mi_switch+0x11a ithread_loop(c74db3a0,e790fd28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c74db3a0,e790fd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe790fd60, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc73c3b80 sched_switch(c73c3b80,0,109,529,babd6300,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b70f0,...) at mi_switch+0x11a ithread_loop(c73d2610,e7903d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c73d2610,e7903d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7903d60, ebp = 0 --- Tracing command intr pid 12 tid 100059 td 0xc73d3000 sched_switch(c73d3000,0,109,529,c7932067,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b73f0,...) at mi_switch+0x11a ithread_loop(c739ca70,e78ffd28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739ca70,e78ffd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78ffd60, ebp = 0 --- Tracing command intr pid 12 tid 100054 td 0xc73d5000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100041 td 0xc73c3000 sched_switch(c73c3000,0,109,529,e202aa7b,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b71f0,...) at mi_switch+0x11a ithread_loop(c739c460,e78c1d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739c460,e78c1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78c1d60, ebp = 0 --- Tracing command intr pid 12 tid 100036 td 0xc73aeb80 sched_switch(c73aeb80,0,109,529,e28f0f07,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b7270,...) at mi_switch+0x11a ithread_loop(c739c7f0,e78b1d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c739c7f0,e78b1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78b1d60, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc73b0b80 sched_switch(c73b0b80,0,109,529,e15bff11,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b72f0,...) at mi_switch+0x11a ithread_loop(c7397610,e78a1d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7397610,e78a1d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe78a1d60, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc727b2e0 sched_switch(c727b2e0,0,109,529,91bd7081,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6ef0,...) at mi_switch+0x11a ithread_loop(c7388a70,e7792d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7388a70,e7792d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7792d60, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc727b5c0 sched_switch(c727b5c0,0,109,529,857ab77d,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c7387870,...) at mi_switch+0x11a ithread_loop(c7388bc0,e778ed28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7388bc0,e778ed28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe778ed60, ebp = 0 --- Tracing command intr pid 12 tid 100028 td 0xc727b8a0 sched_switch(c727b8a0,0,109,529,bad2b36f,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c716eb70,...) at mi_switch+0x11a ithread_loop(c71704f0,c6f77d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c71704f0,c6f77d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f77d60, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc727bb80 sched_switch(c727bb80,0,109,529,bdd75b93,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c734a670,...) at mi_switch+0x11a ithread_loop(c7170210,c6f4dd28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170210,c6f4dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f4dd60, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc734b000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc734b8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xc734bb80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc71755c0 sched_switch(c71755c0,0,109,529,9bcf2386,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6b70,...) at mi_switch+0x11a ithread_loop(c7170040,c6f20d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170040,c6f20d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f20d60, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc71758a0 sched_switch(c71758a0,0,109,529,784673dd,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6bf0,...) at mi_switch+0x11a ithread_loop(c7170050,c6f1dd28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170050,c6f1dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f1dd60, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7175b80 sched_switch(c7175b80,0,109,529,fb788887,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6c70,...) at mi_switch+0x11a ithread_loop(c7170060,c6f1ad28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170060,c6f1ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f1ad60, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc71b8000 sched_switch(c71b8000,0,109,529,c0133213,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6cf0,...) at mi_switch+0x11a ithread_loop(c7170070,c6f17d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170070,c6f17d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f17d60, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc71b82e0 sched_switch(c71b82e0,0,109,529,10af3e7,...) at sched_switch+0x28a mi_switch(109,0,c0c76e9f,529,c71b6d70,...) at mi_switch+0x11a ithread_loop(c7170080,c6f14d28,c0c76ce3,359,c7171560,...) at ithread_loop+0x177 fork_exit(c0877a50,c7170080,c6f14d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f14d60, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc71b85c0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc7173000 sched_switch(c7173000,0,60c,815,c0131605,...) at sched_switch+0x28a mi_switch(60c,0,c0c7b55a,815,0,...) at mi_switch+0x11a sched_preempt(c7173000,0,0,c6f0dc58,c0b87e5f,...) at sched_preempt+0x7c ipi_bitmap_handler(8,28,28,c7286018,c7286000,...) at ipi_bitmap_handler+0x34 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0xc0b7fd25, esp = 0xc6f0dc58, ebp = 0xc6f0dc58 --- acpi_cpu_c1(c6f0dc74,c0d967d0,0,ffffffff,c6f0dca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dcddc0,c6f0dca0,c0b931bb,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f0dce8,c08b995e,0,c6f0dcc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f0dcc4,c0c7b55a,a08,c7173000,...) at cpu_idle+0x1b sched_idletd(0,c6f0dd28,c0c76ce3,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f0dd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f0dd60, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc71732e0 cpustop_handler(2,c6f0ac0c,c0b9fb86,c0dca07c,c6f0aba0,...) at cpustop_handler+0x34 ipi_nmi_handler(c0dca07c,c6f0aba0,c088cb6d,c0dca07c,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f0ac18) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b7fd25, esp = 0xc6f0ac58, ebp = 0xc6f0ac58 --- acpi_cpu_c1(c6f0ac74,c0d967d0,1,ffffffff,c6f0aca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dce440,c6f0aca0,c0b931bb,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f0ace8,c08b995e,0,c6f0acc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f0acc4,c0c7b55a,a08,c71732e0,...) at cpu_idle+0x1b sched_idletd(0,c6f0ad28,c0c76ce3,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f0ad28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f0ad60, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc71735c0 cpustop_handler(4,c6f07bfc,c0b9fb86,c6f07b78,c08a1758,...) at cpustop_handler+0x34 ipi_nmi_handler(c6f07b78,c08a1758,c6f07bac,c08ba2fd,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f07c08) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc08b96cc, esp = 0xc6f07c48, ebp = 0xc6f07c70 --- cpu_search_highest(c0ddc650,c6f07c84,0,fffffffb,0,...) at cpu_search_highest+0xcc cpu_search_highest(c0ddc640,c6f07cc4,c0c7b55a,a08,c71735c0,...) at cpu_search_highest+0x71 sched_idletd(0,c6f07d28,c0c76ce3,359,c7171810,...) at sched_idletd+0xca fork_exit(c08b9730,0,c6f07d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f07d60, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc71738a0 cpustop_handler(8,c6f04c0c,c0b9fb86,c0dca0f4,c6f04ba0,...) at cpustop_handler+0x34 ipi_nmi_handler(c0dca0f4,c6f04ba0,c088cb6d,c0dca0f4,c7171810,...) at ipi_nmi_handler+0x2f trap(c6f04c18) at trap+0x36 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0b7fd25, esp = 0xc6f04c58, ebp = 0xc6f04c58 --- acpi_cpu_c1(c6f04c74,c0d967d0,3,ffffffff,c6f04ca0,...) at acpi_cpu_c1+0x5 acpi_cpu_idle(ffffffff,c0dcf140,c6f04ca0,c0b931bb,0,...) at acpi_cpu_idle+0xe9 cpu_idle_amdc1e(0,c6f04ce8,c08b995e,0,c6f04cc4,...) at cpu_idle_amdc1e+0x56 cpu_idle(0,c6f04cc4,c0c7b55a,a08,c71738a0,...) at cpu_idle+0x1b sched_idletd(0,c6f04d28,c0c76ce3,359,c7171810,...) at sched_idletd+0x22e fork_exit(c08b9730,0,c6f04d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f04d60, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7173b80 sched_switch(c7173b80,0,104,c7173b80,51c60f8a,...) at sched_switch+0x28a mi_switch(104,0,c7173b80,100,100,...) at mi_switch+0x11a sleepq_switch(c7173b80,0,c0c7d7d6,1a0,5c,...) at sleepq_switch+0xd3 sleepq_catch_signals(0,c0c7d7d6,160,100,100,...) at sleepq_catch_signals+0x51 sleepq_wait_sig(c7171ac0,5c,c0c7eeeb,100,0,...) at sleepq_wait_sig+0x17 _sleep(c7171ac0,c7171b48,15c,c0c7eeeb,0,...) at _sleep+0x2bc kern_wait(c7173b80,ffffffff,c6f00c44,0,0,...) at kern_wait+0xa76 wait4(c7173b80,c6f00cec,2811afdc,1,0,...) at wait4+0x3b syscallenter(c7173b80,c6f00ce4,c0ba024e,c7173b80,c6f00d28,...) at syscallenter+0x246 syscall(c6f00d28) at syscall+0x4f Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, wait4), eip = 0x8054d7b, esp = 0xbfbfe8fc, ebp = 0xbfbfe918 --- Tracing command audit pid 10 tid 100001 td 0xc7175000 sched_switch(c7175000,0,104,c7175000,bad3f943,...) at sched_switch+0x28a mi_switch(104,0,c7175000,c7175000,c7175000,...) at mi_switch+0x11a sleepq_switch(c7175000,0,c0c7d7d6,260,c7175000,...) at sleepq_switch+0xd3 sleepq_wait(c0f421c0,0,c6efdc8c,1,0,...) at sleepq_wait+0x39 _cv_wait(c0f421c0,c0f421a4,c0c97ef2,192,0,...) at _cv_wait+0x1b0 audit_worker(0,c6efdd28,c0c76ce3,359,c7172000,...) at audit_worker+0x50 fork_exit(c0a81a90,0,c6efdd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6efdd60, ebp = 0 --- Tracing command kernel pid 0 tid 100061 td 0xc73c38a0 sched_switch(c73c38a0,0,104,c73c38a0,b5aa4881,...) at sched_switch+0x28a mi_switch(104,0,c73c38a0,c73c38a0,c73c38a0,...) at mi_switch+0x11a sleepq_switch(c73c38a0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c73f8580,0,c0c7a95e,c0c72775,0,...) at sleepq_wait+0x39 msleep_spin(c73f8580,c73f8598,c0c72775,0,c0c76ce3,...) at msleep_spin+0x1ce taskqueue_thread_loop(c73fd49c,e7909d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c73fd49c,e7909d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe7909d60, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc734b2e0 sched_switch(c734b2e0,0,104,c734b2e0,ccad3078,...) at sched_switch+0x28a mi_switch(104,0,c734b2e0,c734b2e0,c734b2e0,...) at mi_switch+0x11a sleepq_switch(c734b2e0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733eac0,0,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c733eac0,c733ead8,0,c0c72775,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0ddc848,c6f47d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0ddc848,c6f47d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f47d60, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc734b5c0 sched_switch(c734b5c0,0,104,c734b5c0,bd56070e,...) at sched_switch+0x28a mi_switch(104,0,c734b5c0,c734b5c0,c734b5c0,...) at mi_switch+0x11a sleepq_switch(c734b5c0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733eb00,0,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c733eb00,c733eb18,0,c0c72775,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0f427a4,c6f44d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0f427a4,c6f44d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f44d60, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc71b88a0 sched_switch(c71b88a0,0,104,c71b88a0,bd55f587,...) at sched_switch+0x28a mi_switch(104,0,c71b88a0,c71b88a0,c71b88a0,...) at mi_switch+0x11a sleepq_switch(c71b88a0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a95e,c0c72775,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c72775,0,c0c76ce3,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d99420,c6f3bd28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d99420,c6f3bd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f3bd60, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc71b8b80 sched_switch(c71b8b80,0,104,c71b8b80,bd55e741,...) at sched_switch+0x28a mi_switch(104,0,c71b8b80,c71b8b80,c71b8b80,...) at mi_switch+0x11a sleepq_switch(c71b8b80,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a95e,c0c72775,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c72775,0,c0c76ce3,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d99420,c6f38d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d99420,c6f38d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f38d60, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc727a000 sched_switch(c727a000,0,104,c727a000,bd55d7ea,...) at sched_switch+0x28a mi_switch(104,0,c727a000,c727a000,c727a000,...) at mi_switch+0x11a sleepq_switch(c727a000,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee00,0,c0c7a95e,c0c72775,0,...) at sleepq_wait+0x39 msleep_spin(c733ee00,c733ee18,c0c72775,0,c0c76ce3,...) at msleep_spin+0x1ce taskqueue_thread_loop(c0d99420,c6f35d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0x8f fork_exit(c08d0ee0,c0d99420,c6f35d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f35d60, ebp = 0 --- Tracing command kernel pid 0 tid 100018 td 0xc727a2e0 sched_switch(c727a2e0,0,104,c727a2e0,bd5234be,...) at sched_switch+0x28a mi_switch(104,0,c727a2e0,c727a2e0,c727a2e0,...) at mi_switch+0x11a sleepq_switch(c727a2e0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c733ee40,0,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c733ee40,c733ee58,0,c0c72775,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0dc8584,c6f32d28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0dc8584,c6f32d28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f32d60, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc727a8a0 sched_switch(c727a8a0,0,104,c727a8a0,9aeead6c,...) at sched_switch+0x28a mi_switch(104,0,c727a8a0,c727a8a0,c727a8a0,...) at mi_switch+0x11a sleepq_switch(c727a8a0,0,c0c7d7d6,260,0,...) at sleepq_switch+0xd3 sleepq_wait(c7152880,0,c0c72775,0,0,...) at sleepq_wait+0x39 _sleep(c7152880,c7152898,0,c0c72775,0,...) at _sleep+0x2d2 taskqueue_thread_loop(c0ddb2e0,c6f2cd28,c0c76ce3,359,c0dc7c40,...) at taskqueue_thread_loop+0xb5 fork_exit(c08d0ee0,c0ddb2e0,c6f2cd28) at fork_exit+0x94 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc6f2cd60, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc0dc7ef0 sched_switch(c0dc7ef0,0,104,c0dc7ef0,a98a50ce,...) at sched_switch+0x28a mi_switch(104,0,c0dc7ef0,0,0,...) at mi_switch+0x11a sleepq_switch(c0dc7ef0,0,c0c7d7d6,283,0,...) at sleepq_switch+0xd3 sleepq_timedwait(c0dc7c40,44,c0c7bb35,0,0,...) at sleepq_timedwait+0x3e _sleep(c0dc7c40,0,44,c0c7bb35,2710,...) at _sleep+0x2a2 scheduler(0,141ec00,141ec00,141e000,1425000,...) at scheduler+0x217 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3439 MB Dumping 250 MB: 235 219 203 187 171 155 139 123 107 91 75 59 43 27 11 Dump complete = 0xf db:0:doadump> reset (kgdb) bt #0 doadump () at pcpu.h:231 #1 0xc04d2cd9 in db_fncall (dummy1=0xc08c603a, dummy2=0x0, dummy3=0xffffffff, dummy4=0xe793d848 "\\Ø\223ç") at ../../../ddb/db_command.c:548 #2 0xc04d310f in db_command (last_cmdp=0xc0d975fc, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:445 #3 0xc04d31c4 in db_command_script (command=0xc0d98508 "call doadump") at ../../../ddb/db_command.c:516 #4 0xc04d72e0 in db_script_exec (scriptname=0xc0d97e60 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc04d7371 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc0f951c0, modif=0xe793d980 "") at ../../../ddb/db_script.c:375 #6 0xc04d30d1 in db_command (last_cmdp=0xc0d975fc, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:445 #7 0xc04d322a in db_command_loop () at ../../../ddb/db_command.c:498 #8 0xc04d50ad in db_trap (type=0x3, code=0x0) at ../../../ddb/db_main.c:229 #9 0xc08c5e6e in kdb_trap (type=0x3, code=0x0, tf=0xe793db24) at ../../../kern/subr_kdb.c:546 #10 0xc0ba015c in trap (frame=0xe793db24) at ../../../i386/i386/trap.c:721 #11 0xc0b8770c in calltrap () at ../../../i386/i386/exception.s:168 #12 0xc08c603a in kdb_enter (why=0xc0c7a393 "panic", msg=0xc0c7a393 "panic") at cpufunc.h:71 #13 0xc089ad54 in panic (fmt=0xc0c7ddb1 "sleeping thread") at ../../../kern/kern_shutdown.c:575 #14 0xc08d2ea3 in propagate_priority (td=0xc83e08a0) at ../../../kern/subr_turnstile.c:222 #15 0xc08d3709 in turnstile_wait (ts=0xc80eb280, owner=0xc83e08a0, queue=0x0) at ../../../kern/subr_turnstile.c:738 #16 0xc088d00c in _mtx_lock_sleep (m=0xc7e81d48, tid=0xc73d5b80, opts=0x0, file=0xc0c994a6 "../../../ufs/ffs/ffs_softdep.c", line=0xe7e) at ../../../kern/kern_mutex.c:447 #17 0xc088d09f in _mtx_lock_flags (m=0xc7e81d48, opts=0x0, file=0xc0c994a6 "../../../ufs/ffs/ffs_softdep.c", line=0xe7e) at ../../../kern/kern_mutex.c:203 #18 0xc0aa632b in handle_workitem_freefile (freefile=0xc841a000) at ../../../ufs/ffs/ffs_softdep.c:3710 #19 0xc0aa5db2 in process_worklist_item (mp=0xc83e8000, flags=Variable "flags" is not available. ) at ../../../ufs/ffs/ffs_softdep.c:973 #20 0xc0aab743 in softdep_process_worklist (mp=0xc83e8000, full=0x0) at ../../../ufs/ffs/ffs_softdep.c:846 #21 0xc0aabad7 in softdep_flush () at ../../../ufs/ffs/ffs_softdep.c:757 #22 0xc0874e74 in fork_exit (callout=0xc0aab850 , arg=0x0, frame=0xe793dd28) at ../../../kern/kern_fork.c:865 #23 0xc0b87784 in fork_trampoline () at ../../../i386/i386/exception.s:275 (kgdb) f 14 #14 0xc08d2ea3 in propagate_priority (td=0xc83e08a0) at ../../../kern/subr_turnstile.c:222 222 panic("sleeping thread"); (kgdb) p/d td->td_tid $3 = 100181 (kgdb) f 18 #18 0xc0aa632b in handle_workitem_freefile (freefile=0xc841a000) at ../../../ufs/ffs/ffs_softdep.c:3710 3710 UFS_LOCK(ump); (kgdb) l 3705 error = inodedep_lookup(UFSTOVFS(ump), freefile->fx_oldinum, 0, &idp); 3706 FREE_LOCK(&lk); 3707 if (error) 3708 panic("handle_workitem_freefile: inodedep survived"); 3709 #endif 3710 UFS_LOCK(ump); 3711 fs->fs_pendinginodes -= 1; 3712 UFS_UNLOCK(ump); 3713 if ((error = ffs_freefile(ump, fs, freefile->fx_devvp, 3714 freefile->fx_oldinum, freefile->fx_mode)) != 0) (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -62,6 +62,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -338,9 +339,10 @@ softdep_releasefile(ip) } int -softdep_request_cleanup(fs, vp) +softdep_request_cleanup(fs, vp, cred) struct fs *fs; struct vnode *vp; + struct ucred *cred; { return (0); @@ -678,6 +680,7 @@ static int stat_indir_blk_ptrs; /* bufs redirtied static int stat_inode_bitmap; /* bufs redirtied as inode bitmap not written */ static int stat_direct_blk_ptrs;/* bufs redirtied as direct ptrs not written */ static int stat_dir_entry; /* bufs redirtied as dir entry cannot write */ +static int stat_high_cleanup_delay; /* Maximum cleanup delay (in ticks) */ SYSCTL_INT(_debug, OID_AUTO, max_softdeps, CTLFLAG_RW, &max_softdeps, 0, ""); SYSCTL_INT(_debug, OID_AUTO, tickdelay, CTLFLAG_RW, &tickdelay, 0, ""); @@ -692,6 +695,7 @@ SYSCTL_INT(_debug, OID_AUTO, indir_blk_ptrs, CTLFL SYSCTL_INT(_debug, OID_AUTO, inode_bitmap, CTLFLAG_RW, &stat_inode_bitmap, 0, ""); SYSCTL_INT(_debug, OID_AUTO, direct_blk_ptrs, CTLFLAG_RW, &stat_direct_blk_ptrs, 0, ""); SYSCTL_INT(_debug, OID_AUTO, dir_entry, CTLFLAG_RW, &stat_dir_entry, 0, ""); +SYSCTL_INT(_debug, OID_AUTO, high_cleanup_delay, CTLFLAG_RW, &stat_high_cleanup_delay, 0, ""); /* SYSCTL_INT(_debug, OID_AUTO, worklist_num, CTLFLAG_RD, &softdep_on_worklist, 0, ""); */ SYSCTL_DECL(_vfs_ffs); @@ -5797,20 +5801,26 @@ softdep_slowdown(vp) * If the worklist yields no free space, encourage the syncer daemon * to help us. In no event will we try for longer than tickdelay seconds. */ + +static void check_block_count(char *, struct fs *, struct ufsmount *, + ufs2_daddr_t); + int -softdep_request_cleanup(fs, vp) +softdep_request_cleanup(fs, vp, cred) struct fs *fs; struct vnode *vp; + struct ucred *cred; { struct ufsmount *ump; + struct mount *mp; + struct vnode *lvp, *mvp; long starttime; ufs2_daddr_t needed; int error; ump = VTOI(vp)->i_ump; + mp = vp->v_mount; mtx_assert(UFS_MTX(ump), MA_OWNED); - needed = fs->fs_cstotal.cs_nbfree + fs->fs_contigsumsize; - starttime = time_second + tickdelay; /* * If we are being called because of a process doing a * copy-on-write, then it is not safe to update the vnode @@ -5823,9 +5833,38 @@ int if (error != 0) return (0); } - while (fs->fs_pendingblocks > 0 && fs->fs_cstotal.cs_nbfree <= needed) { - if (time_second > starttime) - return (0); + /* + * If we are in need of resources, consider pausing for + * tickdelay to give ourselves some breathing room. + */ + UFS_UNLOCK(ump); + ACQUIRE_LOCK(&lk); + request_cleanup(UFSTOVFS(ump), FLUSH_REMOVE_WAIT); + FREE_LOCK(&lk); + UFS_LOCK(ump); + /* + * Now clean up at least as much space as we will need. + * + * The amount of space that we will need is enough blocks to + * allocate a full-sized segment (fs_contigsumsize). The number of + * such segments that will be needed is set by the number of + * simultaneous writers (mnt_writeopcount) plus a bit of slop (2) + * in case some more show up while we are cleaning. + * + * Additionally, if we are unpriviledged we will need to ensure + * that we clean up enough blocks to get to the above threshhold + * of the minimum number of blocks required to be kept free by the + * filesystem (fs_minfree). + */ + needed = (mp->mnt_writeopcount + 2) * fs->fs_contigsumsize; + if (priv_check_cred(cred, PRIV_VFS_BLOCKRESERVE, 0)) + needed += fragstoblks(fs, + roundup((fs->fs_dsize * fs->fs_minfree / 100) - + fs->fs_cstotal.cs_nffree, fs->fs_frag)); + starttime = time_second + tickdelay; +retry: + while (ump->softdep_on_worklist > 0 && + fs->fs_cstotal.cs_nbfree <= needed) { UFS_UNLOCK(ump); ACQUIRE_LOCK(&lk); if (ump->softdep_on_worklist > 0 && @@ -5835,14 +5874,124 @@ int UFS_LOCK(ump); continue; } - request_cleanup(UFSTOVFS(ump), FLUSH_REMOVE_WAIT); FREE_LOCK(&lk); UFS_LOCK(ump); } + /* + * If we still need resources and there are no more worklist + * entries to process to obtain them, we have to start flushing + * the dirty vnodes to force the release of additional requests + * to the worklist that we can then process to reap addition + * resources. We start by flushing our own vnode and if that + * does not produce enough resources we walk the vnodes + * associated with the mount point until we get the needed + * worklist requests that we can reap. + */ + if (fs->fs_cstotal.cs_nbfree <= needed) { + MNT_ILOCK(mp); + MNT_VNODE_FOREACH(lvp, mp, mvp) { + if (ump->softdep_on_worklist > 0) { + MNT_IUNLOCK(mp); + check_block_count("Retry", fs, ump, needed); + goto retry; + } + VI_LOCK(lvp); + if (TAILQ_FIRST(&lvp->v_bufobj.bo_dirty.bv_hd) == 0 || + VOP_ISLOCKED(lvp) != 0) { + VI_UNLOCK(lvp); + continue; + } + MNT_IUNLOCK(mp); + if (vget(lvp, LK_EXCLUSIVE | LK_INTERLOCK, curthread)) { + VI_UNLOCK(lvp); + MNT_ILOCK(mp); + continue; + } + if (lvp->v_vflag & VV_NOSYNC) { /* unlinked */ + vput(lvp); + MNT_ILOCK(mp); + continue; + } + (void) ffs_syncvnode(lvp, MNT_WAIT); + vput(lvp); + MNT_ILOCK(mp); + } + MNT_IUNLOCK(mp); + check_block_count("Failed", fs, ump, needed); + } + if (time_second - starttime > stat_high_cleanup_delay) + stat_high_cleanup_delay = time_second - starttime; return (1); } /* + * Check out counts above. + */ +static void +check_block_count(action, fs, ump, needed) + char *action; + struct fs *fs; + struct ufsmount *ump; + ufs2_daddr_t needed; +{ + struct worklist *wk; + static int maxFcount = 20, maxRcount = 20; + int blkcnt, dircnt, fragcnt, inocnt; + ufs2_daddr_t pending; + + if (action[0] == 'F' && maxFcount-- <= 0) + return; + if (action[0] == 'R' && maxRcount-- <= 0) + return; + dircnt = 0; + fragcnt = 0; + blkcnt = 0; + inocnt = 0; + pending = 0; + LIST_FOREACH(wk, &ump->softdep_workitem_pending, wk_list) { + switch (wk->wk_type) { + + case D_DIRREM: + /* removal of a directory entry */ + dircnt += 1; + continue; + + case D_FREEBLKS: + /* releasing blocks and/or fragments from a file */ + pending += WK_FREEBLKS(wk)->fb_chkcnt; + blkcnt += 1; + continue; + + case D_FREEFRAG: + /* releasing a fragment when replaced as a file grows */ + fragcnt += 1; + continue; + + case D_FREEFILE: + /* releasing an inode when its link count drops to 0 */ + inocnt += 1; + continue; + + default: + panic("check_block_count: Unknown type %s", + TYPENAME(wk->wk_type)); + /* NOTREACHED */ + } + } + printf("%s reclaim\n", action); + printf("Seeking %lld blocks\n", needed); + printf("Free inodes %lld, free blocks %lld, free fragments %lld\n", + fs->fs_cstotal.cs_nifree, fs->fs_cstotal.cs_nbfree, + fs->fs_cstotal.cs_nffree); + printf("Pending workitems %d, Allocated inodes %lld\n", + ump->softdep_on_worklist, + (fs->fs_ncg * fs->fs_ipg) - fs->fs_cstotal.cs_nifree); + printf("Found %d files with %lld blocks pending\n", blkcnt, pending); + printf("Other types: dirrem %d, freefrag %d, freefile %d\n", + dircnt, fragcnt, inocnt); +} + +/* * If memory utilization has gotten too high, deliberately slow things * down and speed up the I/O processing. */ Index: /usr/src/sys/ufs/ffs/ffs_alloc.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_alloc.c (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_alloc.c (working copy) @@ -215,9 +215,9 @@ nospace: (void) chkdq(ip, -btodb(size), cred, FORCE); UFS_LOCK(ump); #endif - if (fs->fs_pendingblocks > 0 && reclaimed == 0) { + if (reclaimed == 0) { reclaimed = 1; - softdep_request_cleanup(fs, ITOV(ip)); + softdep_request_cleanup(fs, ITOV(ip), cred); goto retry; } UFS_UNLOCK(ump); @@ -430,9 +430,9 @@ nospace: /* * no space available */ - if (fs->fs_pendingblocks > 0 && reclaimed == 0) { + if (reclaimed == 0) { reclaimed = 1; - softdep_request_cleanup(fs, vp); + softdep_request_cleanup(fs, vp, cred); UFS_UNLOCK(ump); if (bp) { brelse(bp); Index: /usr/src/sys/ufs/ffs/ffs_extern.h =================================================================== --- /usr/src/sys/ufs/ffs/ffs_extern.h (revision 220001) +++ /usr/src/sys/ufs/ffs/ffs_extern.h (working copy) @@ -114,7 +114,7 @@ int softdep_flushfiles(struct mount *, int, struct void softdep_update_inodeblock(struct inode *, struct buf *, int); void softdep_load_inodeblock(struct inode *); void softdep_freefile(struct vnode *, ino_t, int); -int softdep_request_cleanup(struct fs *, struct vnode *); +int softdep_request_cleanup(struct fs *, struct vnode *, struct ucred *); void softdep_setup_freeblocks(struct inode *, off_t, int); void softdep_setup_inomapdep(struct buf *, struct inode *, ino_t); void softdep_setup_blkmapdep(struct buf *, struct mount *, ufs2_daddr_t); -- Tets scenario: linger2.sh