Script started on Mon Dec 31 10:27:46 2012 bash-3.2$ sudo cu -s 115200 -l /dev/cu.PL2303-00001004 Password: Connected. GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #1 r244869M: Mon Dec 31 10:17:29 CET 2012 root@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3527593984 (3364 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: <060508 APIC1048> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 random device not loaded; using insecure entropy ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 hpt27xx: RocketRAID 27xx controller driver v1.0 (Dec 30 2012 22:20:51) ctl: CAM Target Layer loaded acpi0: <060508 RSDT1048> on motherboard acpi0: Power Button (fixed) acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, d7f00000 (3) failed cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 hdac0: mem 0xfe9e8000-0xfe9ebfff irq 19 at device 5.2 on pci1 pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:21:85:15:33:7d ahci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 usbus0 on ohci0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 usbus1 on ohci1 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 usbus2 on ohci2 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 usbus3 on ohci3 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 usbus4 on ohci4 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5 on ehci0 pci0: at device 20.0 (no driver attached) atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 hdac1: mem 0xfe7f4000-0xfe7f7fff irq 16 at device 20.2 on pci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 fwohci0: port 0xe800-0xe87f mem 0xfebff800-0xfebfffff irq 20 at device 6.0 on pci3 fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:dc:10:00:01:62:ad:eb fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:dc:10:62:ad:eb fwe0: Ethernet address: 02:dc:10:62:ad:eb fwip0: on firewire0 fwip0: Firewire address: 00:dc:10:00:01:62:ad:eb @ 0xfffe00000000, S400, maxrec 2048 dcons_crom0: on firewire0 dcons_crom0: bus_addr 0x12090c8 fwohci0: Initiate bus reset fwohci0: fwohci_intr_core: BUS reset fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model MouseMan+, device ID 0 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: parallel port not found. acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 hwpstate0: on cpu0 firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me) firewire0: bus manager 0 Timecounters tick every 1.000 msec hpt27xx: no controller detected. hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 3 on hdaa0 hdacc1: at cad 3 on hdac1 hdaa1: at nid 1 on hdacc1 pcm1: at nid 20,22,21,23 and 24,26 on hdaa1 pcm2: at nid 27 and 25 on hdaa1 pcm3: at nid 30 on hdaa1 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 Expensive timeout(9) function: 0xc0ae2a10(0xc971b000) 0.010522286 s ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 (aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich0:0:15:0): CAM status: Command timeout (aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 uhub0: cd0 at ata0 bus 0 scbus4 target 1 lun 0 cd0: <_NEC DVD_RW ND-4550A 1.06> Removable CD-ROM SCSI-0 device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present 2 ports with 2 removable, self powered Expensive timeout(9) function: 0xc0ae2a10(0xc971b000) 0.029538949 s uhub1: 2 ports with 2 removable, self powered SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC-low" frequency 14062623 Hz quality 800 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub2: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 uhub5: 10 ports with 10 removable, self powered Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (3890432 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 593272 free (1960 frags, 73914 blocks, 0.2% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 139056 free (5376 frags, 16710 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 64147121 free (8481 frags, 8017330 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 2237380 free (224884 frags, 251562 blocks, 2.2% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 13859728 free (83496 frags, 1722029 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN ifa_del_loopback_route: deletion failed: 3 re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe1cd7b40 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xcaade000 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c108e4b8,e1cd7ae0,f329b7f0,c0a8e347,cae17ad0,...) at db_trace_self_wrapper+0x2d/frame 0xf329b7b0 kdb_backtrace(c109155e,caade000,c10c2ca9,c7d968e8,c10c28ee,...) at kdb_backtrace+0x30/frame 0xf329b818 witness_checkorder(caade000,9,c10c28e5,11c,0,...) at witness_checkorder+0xbad/frame 0xf329b868 _sx_xlock(caade000,0,c10c28e5,11c,cae6f800,...) at _sx_xlock+0x75/frame 0xf329b898 ufsdirhash_add(cab405e4,f329b990,364c,f329b918,f329b91c,...) at ufsdirhash_add+0x4a/frame 0xf329b8c8 ufs_direnter(cae179d8,cb0075a0,f329b990,f329bb68,e1cdb700,...) at ufs_direnter+0x63b/frame 0xf329b948 ufs_mkdir(f329bc00,c10e587d,cae179d8,f329bbfc,0,...) at ufs_mkdir+0x880/frame 0xf329bae4 VOP_MKDIR_APV(c11e7948,f329bc00,f329bb68,f329bb90,28803020,...) at VOP_MKDIR_APV+0x103/frame 0xf329bb10 kern_mkdirat(ca9705e0,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1ef/frame 0xf329bc24 sys_mkdir(ca9705e0,f329bcc8,f329bd08,1,1,...) at sys_mkdir+0x31/frame 0xf329bc40 syscall(f329bd08) at syscall+0x2ed/frame 0xf329bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf329bcfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28167483, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcb16d8c8 ufs (ufs) @ kern/vfs_lookup.c:516 2nd 0xe1cdfee0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xcb16d5f8 ufs (ufs) @ kern/vfs_subr.c:2162 KDB: stack backtrace: db_trace_self_wrapper(c108e4b8,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf32322c8 kdb_backtrace(c1091577,cb16d5f8,c1079edc,c7d96880,c109a6c0,...) at kdb_backtrace+0x30/frame 0xf3232330 witness_checkorder(cb16d5f8,9,c109a6b7,872,cb16d664,...) at witness_checkorder+0xbad/frame 0xf3232380 __lockmgr_args(cb16d5f8,80100,cb16d664,0,0,...) at __lockmgr_args+0x81d/frame 0xf3232460 ffs_lock(f32324e0,c7d94db0,c7d8f1e0,c7d94db0,c1384440,...) at ffs_lock+0xad/frame 0xf32324a0 VOP_LOCK1_APV(c11e7948,f32324e0,c11bd300,200246,c11fb970,...) at VOP_LOCK1_APV+0xe5/frame 0xf32324c8 _vn_lock(cb16d5a0,80100,c109a6b7,872,c109990d,...) at _vn_lock+0xca/frame 0xf3232508 vget(cb16d5a0,80100,cab585e0,50,0,...) at vget+0x77/frame 0xf3232540 vfs_hash_get(caa955d8,15ec47,80000,cab585e0,f3232620,...) at vfs_hash_get+0xfc/frame 0xf323256c ffs_vgetf(caa955d8,15ec47,80000,f3232620,1,...) at ffs_vgetf+0x47/frame 0xf32325c8 softdep_sync_buf(cb16d870,e1cdfe80,1,107,0,...) at softdep_sync_buf+0x977/frame 0xf3232630 ffs_syncvnode(cb16d870,1,0,cab58694,c1384440,...) at ffs_syncvnode+0x2a3/frame 0xf3232688 ffs_truncate(cb16d870,200,0,880,caadcb00,...) at ffs_truncate+0x6a4/frame 0xf3232838 ufs_direnter(cb16d870,cb16d5a0,f32328f8,f3232bc8,0,...) at ufs_direnter+0x7ed/frame 0xf32328b8 ufs_makeinode(f3232bb4,f3232bc8) at ufs_makeinode+0x533/frame 0xf3232a30 ufs_create(f3232b18,c10e526b,caa955e8,2,2,...) at ufs_create+0x2f/frame 0xf3232a44 VOP_CREATE_APV(c11e7948,f3232b18,f3232bc8,f3232aa8,c11fbae0,...) at VOP_CREATE_APV+0x103/frame 0xf3232a70 vn_open_cred(f3232b88,f3232bfc,1b0,0,caadcb00,cab07ab8) at vn_open_cred+0x2cf/frame 0xf3232b40 vn_open(f3232b88,f3232bfc,1b0,cab07ab8,0,...) at vn_open+0x3b/frame 0xf3232b60 kern_openat(cab585e0,ffffff9c,28c57f60,0,a02,1b0) at kern_openat+0x1da/frame 0xf3232c20 sys_open(cab585e0,f3232cc8,f3232d08,1,1,...) at sys_open+0x38/frame 0xf3232c40 syscall(f3232d08) at syscall+0x2ed/frame 0xf3232cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3232cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28404757, esp = 0xbfbfb50c, ebp = 0xbfbfb598 --- . Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcae68760 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xcab19490 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c108e4b8,246,c1079edc,650,c7d8f998,...) at db_trace_self_wrapper+0x2d/frame 0xf328a850 kdb_backtrace(c109155e,cab19490,c1085735,c7d966e0,c10befdf,...) at kdb_backtrace+0x30/frame 0xf328a8b8 witness_checkorder(cab19490,9,c10befd6,74a,cab194fc,...) at witness_checkorder+0xbad/frame 0xf328a908 __lockmgr_args(cab19490,80400,cab194fc,0,0,0,c10befd6,74a) at __lockmgr_args+0x81d/frame 0xf328a9e8 vop_stdlock(f328aa58,f328aa54,c0a8e347,c13b46b4,8,...) at vop_stdlock+0x53/frame 0xf328aa18 VOP_LOCK1_APV(c11ad7d0,f328aa58,4,f328aa80,c11fb970,...) at VOP_LOCK1_APV+0xe5/frame 0xf328aa40 _vn_lock(cab19438,80400,c10befd6,74a,f328aac0,...) at _vn_lock+0xca/frame 0xf328aa80 softdep_flushworklist(caa95bb0,f328ab14,cab575e0,61e,0,...) at softdep_flushworklist+0x6e/frame 0xf328aac0 ffs_sync(caa95bb0,1,f328ab70,50e,cb2a7280,...) at ffs_sync+0x2e5/frame 0xf328ab48 dounmount(caa95bb0,8080000,cab575e0,493,0,...) at dounmount+0x38a/frame 0xf328ab98 sys_unmount(cab575e0,f328acc8,f328ad08,1,1,...) at sys_unmount+0x3dd/frame 0xf328ac40 syscall(f328ad08) at syscall+0x2ed/frame 0xf328acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf328acfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d47, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23765 files, 54166860 used, 64147121 free (8481 frags, 8017330 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23765 files, 54166860 used, 64147121 free (8481 frags, 8017330 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Mon Dec 31 10:33:30 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: root Password: Dec 31 10:33:35 x4 login: ROOT LOGIN (root) ON console Last login: Mon Dec 31 10:15:20 on ttyv0 FreeBSD 10.0-CURRENT (PHO) #1 r244869M: Mon Dec 31 10:17:29 CET 2012 You have new mail. x4# bash $ cd ~pho/stress2/wip $ ./all.sh gjournal3.sh 20121231 10:33:55 all: gjournal3.sh 20121231 10:33:55 all: gjournal3.sh GEOM_JOURNAL: Journal 4083165182: md5 contains data. GEOM_JOURNAL: Journal 4083165182: md5 contains journal. GEOM_JOURNAL: Journal md5 clean. GEOM_JOURNAL: BIO_FLUSH not supported by md5. lock order reversal: 1st 0xcb17e61c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xcae95760 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1629 KDB: stack backtrace: db_trace_self_wrapper(c108e4b8,c1255d30,46,c0ac5d1b,0,...) at db_trace_self_wrapper+0x2d/frame 0xf32b5490 kdb_backtrace(c109155e,cae95760,c1079edc,c7d96880,c10be747,...) at kdb_backtrace+0x30/frame 0xf32b54f8 witness_checkorder(cae95760,9,c10be73e,65d,0,...) at witness_checkorder+0xbad/frame 0xf32b5548 __lockmgr_args(cae95760,80000,0,0,0,0,c10be73e,65d,0,0,80000,cae95760,80000,65d,65d,c10be73e,0,0,0,0,80000,cae95760) at __lockmgr_args+0x81d/frame 0xf32b5624 _lockmgr_args(cae95760,80000,0,0,0,...) at _lockmgr_args+0xb8/frame 0xf32b5690 ffs_snapremove(cae95708,c10be60f,0,cae8e8d0,0,...) at ffs_snapremove+0x277/frame 0xf32b5878 ffs_truncate(cae95708,0,0,c00,0,...) at ffs_truncate+0x28a/frame 0xf32b5a24 ufs_inactive(f32b5aa8,c10e5a19,9c2,c11f8e38,cae95708,...) at ufs_inactive+0x1fc/frame 0xf32b5a54 VOP_INACTIVE_APV(c11e7948,f32b5aa8,c109a6b7,9c2,c0b2f968,...) at VOP_INACTIVE_APV+0x103/frame 0xf32b5a80 vinactive(cae95708,cae8e8d0,c109a6b7,8c0,cae957dc,...) at vinactive+0x191/frame 0xf32b5ac8 vputx(cae95708,ffffffdf,cae95708,f32b5bd0,0,...) at vputx+0x382/frame 0xf32b5b10 kern_unlinkat(cae8e8d0,ffffff9c,bfbfdb62,0,0) at kern_unlinkat+0x29f/frame 0xf32b5c24 sys_unlink(cae8e8d0,f32b5cc8,f32b5d08,1,1,...) at sys_unlink+0x32/frame 0xf32b5c40 syscall(f32b5d08) at syscall+0x2ed/frame 0xf32b5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32b5cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28166a03, esp = 0xbfbfd8bc, ebp = 0xbfbfd944 --- load: 0.14 cmd: rw 1512 [nanslp] 1.99r 0.00u 0.00s 0% 9700k lock order reversal: 1st 0xe1dd1580 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xcb17e61c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:1765 KDB: stack backtrace: db_trace_self_wrapper(c108e4b8,60,0,c7d94d48,0,...) at db_trace_self_wrapper+0x2d/frame 0xf325a2c0 kdb_backtrace(c109155e,cb17e61c,c10beb40,c7d970a0,c10be747,...) at kdb_backtrace+0x30/frame 0xf325a328 witness_checkorder(cb17e61c,9,c10be73e,6e5,cbcf3664,...) at witness_checkorder+0xbad/frame 0xf325a378 __lockmgr_args(cb17e61c,80900,cbcf3664,0,0,0,c10be73e,6e5,cbcf3664,cbcf3664,80900,cb17e61c,80900,6e5,6e5,c10be73e,0,0,0,cbcf3664,80900,cb17e61c) at __lockmgr_args+0x81d/frame 0xf325a454 _lockmgr_args(cb17e61c,80900,cbcf3664,0,0,...) at _lockmgr_args+0xb8/frame 0xf325a4c0 ffs_snapblkfree(cbee2000,cbcf35a0,10842,0,1000,...) at ffs_snapblkfree+0x2a9/frame 0xf325a6c8 ffs_blkfree(c7de1800,cbee2000,cbcf35a0,10842,0,...) at ffs_blkfree+0x57/frame 0xf325a704 ffs_realloccg(cbc2cd98,0,0,10842,0,...) at ffs_realloccg+0xbb5/frame 0xf325a7b0 ffs_balloc_ufs2(cbc3a870,1000,0,1000,caaa5680,...) at ffs_balloc_ufs2+0xef8/frameload: 0.14 cmd: rw 1513 [running] 3.29r 0.00u 0.05s 3% 9704 0k xf325a8f0 ffs_write(f325aa80,c10e55d5,c11e7948,f325a9a0,f325a9d8,...) at ffs_write+0x333/frame 0xf325a980 VOP_WRITE_APV(c11e7948,f325aa80,cbc3a870,31b,cab71bc0,...) at VOP_WRITE_APV+0x178/frame 0xf325aa40 vn_write(cab18cb0,f325ac10,caaa5680,1,cab71bc0,...) at vn_write+0x36f/frame 0xf325aab0 vn_io_fault(cab18cb0,f325ac10,caaa5680,0,cab71bc0,...) at vn_io_fault+0x247/frame 0xf325ab8c dofilewrite(cab18cb0,f325ac10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf325abc4 kern_writev(cab71bc0,4,f325ac10,0,bfbfc800,...) at kern_writev+0x66/frame 0xf325abf0 sys_write(cab71bc0,f325acc8,f325ad08,1,1,...) at sys_write+0x5c/frame 0xf325ac40 syscall(f325ad08) at syscall+0x2ed/frame 0xf325acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf325acfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- load: 0.29 cmd: rw 1513 [suspfs] 4.25r 0.00u 0.94s 9% 9704k load: 0.29 cmd: rw 1513 [snaplk] 5.02r 0.00u 1.06s 9% 9704k load: 0.29 cmd: rw 1518 [runnable] 5.81r 0.00u 1.31s 12% 9704k load: 0.29 cmd: rw 1513 [runnable] 6.42r 0.00u 1.86s 15% 9704k load: 0.34 cmd: rw 1514 [suspfs] 10.15r 0.02u 2.40s 18% 9704k load: 0.34 cmd: rw 1514 [wdrain] 12.17r 0.02u 2.54s 16% 9704k load: 0.34 cmd: rw 1512 [running] 12.86r 0.00u 0.71s 6% 9704k load: 1.26 cmd: rw 1513 [runnable] 25.63r 0.03u 5.37s 18% 9704k load: 2.94 cmd: rw 1518 [suspfs] 43.71r 0.05u 8.08s 19% 9704k load: 2.94 cmd: rw 1513 [suspfs] 47.15r 0.06u 9.35s 19% 9704k load: 3.24 cmd: rw 1518 [running] 64.51r 0.06u 11.53s 16% 9704k 20121231 10:36:02 all: gjournal3.sh 20121231 10:36:02 all: gjournal3.sh GEOM_JOURNAL: Journal 2817492483: md5 contains data. GEOM_JOURNAL: Journal 2817492483: md5 contains journal. GEOM_JOURNAL: Journal md5 clean. GEOM_JOURNAL: BIO_FLUSH not supported by md5. load: 0.17 cmd: rw 1972 [snaplk] 267.16r 0.22u 23.15s 0% 9704k load: 0.16 cmd: rw 1972 [snaplk] 273.36r 0.22u 23.15s 0% 9704k load: 0.00 cmd: rw 1972 [snaplk] 676.45r 0.22u 23.15s 0% 9704k KDB: enter: Break to debugger [ thread pid 12 tid 100026 ] Stopped at kdb_break+0x4e: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 12 tid 100026 td 0xc8233000 kdb_break(c7b6cba0,4,1,0,1,...) at kdb_break+0x4e/frame 0xc7b6cb68 scgetc(c1401334,0,c105ab3b,2d4,246,...) at scgetc+0x498/frame 0xc7b6cbb0 sckbdevent(c81a1000,0,c13c83e8,c81a3000,c7b6cc08,...) at sckbdevent+0x8c/frame 0xc7b6cbdc kbdmux_intr(c81a1000,0,c7dc3a40,c7b6cc44,c0ae6401,...) at kbdmux_intr+0x2b/frame 0xc7b6cbf4 kbdmux_kbd_intr(c81a1000,1,c10905c0,136,c10905c0,...) at kbdmux_kbd_intr+0x26/frame 0xc7b6cc08 taskqueue_run_locked(c7dc3a68,0,c10905c0,145,0,...) at taskqueue_run_locked+0x101/frame 0xc7b6cc44 taskqueue_run(c7dc3a40) at taskqueue_run+0x5d/frame 0xc7b6cc64 taskqueue_swi_giant_run(0,0,c1084105,4f7,c7dc9c48,...) at taskqueue_swi_giant_run+0x11/frame 0xc7b6cc70 intr_event_execute_handlers(c1246490,c7dc9c00,c1084105,56d,c8233000,...) at intr_event_execute_handlers+0x88/frame 0xc7b6cc98 ithread_loop(c7df5b10,c7b6cd08,c1083e68,3d7,0,...) at ithread_loop+0x177/frame 0xc7b6cccc fork_exit(c0a73fa0,c7df5b10,c7b6cd08) at fork_exit+0x7f/frame 0xc7b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6ccf4 --- trap 0, eip = 0, esp = 0xc7b6cd40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 0 cpuid = 0 dynamic pcpu = 0x624100 curthread = 0xc8233000: pid 12 "swi6: Giant taskq" curpcb = 0xc7b6cd60 fpcurthread = none idlethread = 0xc7dfb8d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x6914100 curthread = 0xc7dfb5e0: pid 11 "idle: cpu1" curpcb = 0xc7b28d60 fpcurthread = none idlethread = 0xc7dfb5e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x6917100 curthread = 0xc7dfb2f0: pid 11 "idle: cpu2" curpcb = 0xc7b2bd60 fpcurthread = none idlethread = 0xc7dfb2f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x691a100 curthread = 0xc7dfb000: pid 11 "idle: cpu3" curpcb = 0xc7b2ed60 fpcurthread = none idlethread = 0xc7dfb000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 2210 (mksnap_ffs) thread 0xcb502000 (100136) exclusive lockmgr snaplk (snaplk) r = 0 (0xcb17e61c) locked @ ufs/ffs/ffs_snapshot.c:2677 Process 1972 (rw) thread 0xcbec05e0 (100182) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d33500) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1da4260) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcbef9d00) locked @ kern/vfs_vnops.c:795 Process 1971 (rw) thread 0xcbec02f0 (100183) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1ddc500) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1e59d80) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcbfdf8c8) locked @ kern/vfs_vnops.c:795 Process 1970 (rw) thread 0xcb5005e0 (100173) exclusive lockmgr ufs (ufs) r = 0 (0xcbf88058) locked @ kern/vfs_vnops.c:795 Process 1969 (rw) thread 0xcb5305e0 (100145) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1ce0f20) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1e3fa40) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcbefa5f8) locked @ kern/vfs_vnops.c:795 Process 1968 (rw) thread 0xcbe835e0 (100167) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1db1c20) locked @ kern/vfs_bio.c:1898 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1e4d8e0) locked @ kern/vfs_bio.c:1898 exclusive lockmgr ufs (ufs) r = 0 (0xcb63fb98) locked @ kern/vfs_subr.c:2162 Process 1956 (g_journal switcher) thread 0xcbec15e0 (100177) exclusive lockmgr ufs (ufs) r = 0 (0xcbef85f8) locked @ kern/vfs_subr.c:2162 Process 18 (syncer) thread 0xca972bc0 (100077) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d32b40) locked @ kern/vfs_bio.c:2631 exclusive lockmgr syncer (syncer) r = 0 (0xcbefab98) locked @ kern/vfs_subr.c:1781 Process 12 (intr) thread 0xc8233000 (100026) exclusive sleep mutex Giant (Giant) r = 1 (0xc1401324) locked @ dev/syscons/syscons.c:724 db:0:alllocks> show lockedvnods Locked vnodes 0xcbefab40: tag syncer, type VNON usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type syncer: EXCL by thread 0xca972bc0 (pid 18, syncer, tid 100077) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0b2fb63 at vop_stdlock+0x53 #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b47350 at sched_sync+0x330 #5 0xc0a7124f at fork_exit+0x7f #6 0xc0e96344 at fork_trampoline+0x8 0xcbef85a0: tag ufs, type VDIR usecount 3, writecount 0, refcount 5 mountedhere 0 flags (VI_ACTIVE) v_object 0xcbf2cafc ref 0 pages 1 lock type ufs: EXCL by thread 0xcbec15e0 (pid 1956, g_journal switcher, tid 100177) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b40267 at vget+0x77 #5 0xc0cff142 at ffs_sync+0x222 #6 0xcbf9592d at g_journal_switcher+0x85d #7 0xc0a7124f at fork_exit+0x7f #8 0xc0e96344 at fork_trampoline+0x8 ino 32769, on dev md5.journal 0xcb63fb40: tag ufs, type VREG usecount 0, writecount 0, refcount 5 mountedhere 0 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xcbf6965c ref 0 pages 29 lock type ufs: EXCL by thread 0xcbe835e0 (pid 1968, rw, tid 100167) with exclusive waiters pending #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b40267 at vget+0x77 #5 0xc0b33a5c at vfs_hash_get+0xfc #6 0xc0cfb407 at ffs_vgetf+0x47 #7 0xc0cfb3ae at ffs_vget+0x2e #8 0xc0d0a242 at ufs_lookup_ino+0xe82 #9 0xc0d093ba at ufs_lookup+0x2a #10 0xc0ed03a3 at VOP_CACHEDLOOKUP_APV+0x103 #11 0xc0b2c6ec at vfs_cache_lookup+0xec #12 0xc0ed01e3 at VOP_LOOKUP_APV+0x103 #13 0xc0b3529e at lookup+0x52e #14 0xc0b3498d at namei+0x47d #15 0xc0b4b8a3 at kern_unlinkat+0xb3 #16 0xc0b4b532 at sys_unlink+0x32 #17 0xc0eadb1d at syscall+0x2ed ino 32778, on dev md5.journal 0xcbfdf870: tag ufs, type VREG usecount 1, writecount 1, refcount 56 mountedhere 0 flags (VI_ACTIVE) v_object 0xcbf2d65c ref 0 pages 20048 lock type ufs: EXCL by thread 0xcbec02f0 (pid 1971, rw, tid 100183) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b545d7 at vn_write+0x237 #5 0xc0b50c17 at vn_io_fault+0x247 #6 0xc0af2266 at dofilewrite+0x86 #7 0xc0af1f76 at kern_writev+0x66 #8 0xc0af1efc at sys_write+0x5c #9 0xc0eadb1d at syscall+0x2ed #10 0xc0e96331 at Xint0x80_syscall+0x21 ino 32776, on dev md5.journal 0xcbf88000: tag ufs, type VREG usecount 1, writecount 1, refcount 142 mountedhere 0 flags (VI_ACTIVE) v_object 0xcbf334a0 ref 0 pages 20912 lock type ufs: EXCL by thread 0xcb5005e0 (pid 1970, rw, tid 100173) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b545d7 at vn_write+0x237 #5 0xc0b50c17 at vn_io_fault+0x247 #6 0xc0af2266 at dofilewrite+0x86 #7 0xc0af1f76 at kern_writev+0x66 #8 0xc0af1efc at sys_write+0x5c #9 0xc0eadb1d at syscall+0x2ed #10 0xc0e96331 at Xint0x80_syscall+0x21 ino 32777, on dev md5.journal 0xcbef9ca8: tag ufs, type VREG usecount 1, writecount 1, refcount 80 mountedhere 0 flags (VI_ACTIVE) v_object 0xcbe87afc ref 0 pages 20040 lock type ufs: EXCL by thread 0xcbec05e0 (pid 1972, rw, tid 100182) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b545d7 at vn_write+0x237 #5 0xc0b50c17 at vn_io_fault+0x247 #6 0xc0af2266 at dofilewrite+0x86 #7 0xc0af1f76 at kern_writev+0x66 #8 0xc0af1efc at sys_write+0x5c #9 0xc0eadb1d at syscall+0x2ed #10 0xc0e96331 at Xint0x80_syscall+0x21 ino 32774, on dev md5.journal 0xcbefa5a0: tag ufs, type VREG usecount 1, writecount 1, refcount 98 mountedhere 0 flags (VI_ACTIVE) v_object 0xcbf33cb8 ref 0 pages 2752 lock type ufs: EXCL by thread 0xcb5305e0 (pid 1969, rw, tid 100145) #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0d00a7d at ffs_lock+0xad #2 0xc0ed3355 at VOP_LOCK1_APV+0xe5 #3 0xc0b521ba at _vn_lock+0xca #4 0xc0b545d7 at vn_write+0x237 #5 0xc0b50c17 at vn_io_fault+0x247 #6 0xc0af2266 at dofilewrite+0x86 #7 0xc0af1f76 at kern_writev+0x66 #8 0xc0af1efc at sys_write+0x5c #9 0xc0eadb1d at syscall+0x2ed #10 0xc0e96331 at Xint0x80_syscall+0x21 ino 32775, on dev md5.journal 0xcbc3a168: tag ufs, type VREG usecount 1, writecount 0, refcount 11 mountedhere 0 flags (VV_SYSTEM|VI_ACTIVE) lock type snaplk: EXCL by thread 0xcb502000 (pid 2210, mksnap_ffs, tid 100136) with exclusive waiters pending #0 0xc0a85ce8 at __lockmgr_args+0xfa8 #1 0xc0cd8778 at _lockmgr_args+0xb8 #2 0xc0cd8690 at ffs_snapdata_acquire+0xf0 #3 0xc0cd3c56 at ffs_snapshot+0x2ee6 #4 0xc0cfd199 at ffs_mount+0x1359 #5 0xc0b378a2 at vfs_donmount+0xf12 #6 0xc0b36968 at sys_nmount+0x78 #7 0xc0eadb1d at syscall+0x2ed #8 0xc0e96331 at Xint0x80_syscall+0x21 ino 4, on dev md5.journal db:0:lockedvnods> show mount 0xcaaa45d8 /dev/ad4s1a on / (ufs) 0xcaa96000 devfs on /dev (devfs) 0xcae6e000 /dev/ad4s1f on /home (ufs) 0xcaa958c4 /dev/ad4s1d on /usr (ufs) 0xcaa955d8 /dev/ad4s1e on /var (ufs) 0xcaa952ec procfs on /proc (procfs) 0xcae6dbb0 /dev/label/tmp on /tmp (ufs) 0xcaa95bb0 /dev/md5.journal on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2210 1941 1378 0 D+ ufs 0xcb63fb98 mksnap_ffs 1972 1967 1965 1004 D+ snaplk 0xcb17e61c rw 1971 1967 1965 1004 D+ snaplk 0xcb17e61c rw 1970 1967 1965 1004 D+ snaplk 0xcb17e61c rw 1969 1967 1965 1004 D+ snaplk 0xcb17e61c rw 1968 1967 1965 1004 D+ snaplk 0xcb17e61c rw 1967 1965 1965 1004 S+ wait 0xcb4b0b40 rw 1965 1963 1965 1004 S+ wait 0xcbfa5b40 rw 1963 1941 1378 0 S+ wait 0xcb6625a0 su 1958 0 0 0 DL gj:work 0xcbf1ac00 [g_journal md5] 1956 0 0 0 DL snaplk 0xcb17e61c [g_journal switcher] 1954 0 0 0 DL mdwait 0xca956000 [md5] 1941 1378 1378 0 S+ wait 0xcab70870 sh 1378 1374 1378 0 S+ wait 0xcb51e5a0 sh 1374 1371 1374 0 S+ wait 0xcab53000 bash 1371 1352 1371 0 S+ pause 0xcb51e328 csh 1360 1 1360 0 Ss+ ttyin 0xc8172670 getty 1359 1 1359 0 Ss+ ttyin 0xc8172870 getty 1358 1 1358 0 Ss+ ttyin 0xc8172a70 getty 1357 1 1357 0 Ss+ ttyin 0xc8172c70 getty 1356 1 1356 0 Ss+ ttyin 0xc8172e70 getty 1355 1 1355 0 Ss+ ttyin 0xc9892070 getty 1354 1 1354 0 Ss+ ttyin 0xc9892270 getty 1353 1 1353 0 Ss+ ttyin 0xc9892470 getty 1352 1 1352 0 Ss+ wait 0xca96e2d0 login 1335 1 1335 0 Ss select 0xca95b5e4 inetd 1310 1 1310 0 Ss nanslp 0xc123a2c0 watchdogd 1183 1 1183 0 Ss nanslp 0xc123a2c0 cron 1178 1 1178 25 Ss pause 0xcab6f5f8 sendmail 1175 1 1175 0 Ss select 0xcab8c1a4 sendmail 1172 1 1172 0 Ss select 0xcab8c024 sshd 1140 1 1140 0 Ss select 0xca95a664 moused 1136 1122 1122 0 S select 0xcab8c0a4 winbindd 1131 1120 1120 0 S select 0xca95a524 smbd 1122 1 1122 0 Ss select 0xca95a464 winbindd 1120 1 1120 0 Ss select 0xca9bfc24 smbd 1118 1 1118 0 Ss select 0xca95b9a4 nmbd 1094 1 1094 0 Ss select 0xca95a3a4 ntpd 1036 1033 1033 0 S (threaded) nfsd 100125 S rpcsvc 0xcab49990 nfsd: service 100124 S rpcsvc 0xcab139d0 nfsd: service 100123 S rpcsvc 0xcab13a50 nfsd: service 100101 S rpcsvc 0xcb002390 nfsd: master 1033 1 1033 0 Ss select 0xcaa32a64 nfsd 1031 1027 1027 0 S select 0xca9bf764 nfsuserd 1030 1027 1027 0 S select 0xca95b024 nfsuserd 1029 1027 1027 0 S select 0xcab8cd64 nfsuserd 1028 1027 1027 0 S select 0xcaa32aa4 nfsuserd 1027 1 1027 0 Ss pause 0xca96e8c8 nfsuserd 1011 1 1011 0 Ss select 0xcaa32ae4 mountd 978 1 978 0 Ss select 0xca9bf7a4 rpcbind 963 1 963 0 Ss select 0xcaa32b24 syslogd 840 1 840 0 Ss select 0xcab8d3e4 devd 19 0 0 0 DL sdflush 0xc13b4728 [softdepflush] 18 0 0 0 DL snaplk 0xcb17e61c [syncer] 17 0 0 0 DL vlruwt 0xca96d5a0 [vnlru] 16 0 0 0 DL psleep 0xc13b02e8 [bufdaemon] 9 0 0 0 DL pgzero 0xc13b514c [pagezero] 8 0 0 0 DL psleep 0xc13b4d18 [vmdaemon] 7 0 0 0 DL psleep 0xc1408b84 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc1201c24 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc140487c [sctp_iterator] 4 0 0 0 DL - 0xc96f083c [fdc0] 3 0 0 0 SL - 0xc9785000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xc975dd34 [usbus5] 100058 D - 0xc975dd04 [usbus5] 100057 D - 0xc975dcd4 [usbus5] 100056 D - 0xc975dca4 [usbus5] 100054 D - 0xc9750b5c [usbus4] 100053 D - 0xc9750b2c [usbus4] 100052 D - 0xc9750afc [usbus4] 100051 D - 0xc9750acc [usbus4] 100050 D - 0xc974cb5c [usbus3] 100049 D - 0xc974cb2c [usbus3] 100048 D - 0xc974cafc [usbus3] 100047 D - 0xc974cacc [usbus3] 100046 D - 0xc9747b5c [usbus2] 100045 D - 0xc9747b2c [usbus2] 100044 D - 0xc9747afc [usbus2] 100043 D - 0xc9747acc [usbus2] 100041 D - 0xc973eb5c [usbus1] 100040 D - 0xc973eb2c [usbus1] 100039 D - 0xc973eafc [usbus1] 100038 D - 0xc973eacc [usbus1] 100036 D - 0xc9735b5c [usbus0] 100035 D - 0xc9735b2c [usbus0] 100034 D - 0xc9735afc [usbus0] 100033 D - 0xc9735acc [usbus0] 2 0 0 0 DL ctl_work 0xc8236000 [ctl_thrd] 14 0 0 0 DL - 0xc12391e0 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc1400998 [g_down] 100014 D - 0xc1400994 [g_up] 100013 D - 0xc1400990 [g_event] 12 0 0 0 RL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100026 Run CPU 0 [swi6: Giant taskq] 100025 I [swi6: task queue] 100023 I [swi2: cambio] 100018 I [swi5: fast taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc7df9b40 [init] 10 0 0 0 DL audit_wo 0xc1407644 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xc12391e0 [deadlkres] 100068 D - 0xc9744140 [mca taskq] 100062 D - 0xc9744700 [fw0_taskq] 100027 D - 0xc7dc3a00 [thread taskq] 100024 D - 0xc7dc3ac0 [ffs_trim taskq] 100022 D - 0xc7dc3c40 [acpi_task_2] 100021 D - 0xc7dc3c40 [acpi_task_1] 100020 D - 0xc7dc3c40 [acpi_task_0] 100019 D - 0xc7dc3c80 [kqueue taskq] 100016 D - 0xc7dc3e40 [firmware taskq] 100000 D sched 0xc1400a14 [swapper] db:0:ps> allt Tracing command mksnap_ffs pid 2210 tid 100136 td 0xcb502000 sched_switch(cb502000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3334f38 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf3334f6c sleepq_switch(cb502000,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3334fa0 sleepq_wait(cb63fb98,60,c1079edc,4,0,...) at sleepq_wait+0x48/frame 0xf3334fc4 sleeplk(cb63fc04,c1079edc,60,33,0,...) at sleeplk+0x11e/frame 0xf3335000 __lockmgr_args(cb63fb98,80100,cb63fc04,0,0,...) at __lockmgr_args+0xa44/frame 0xf33350e0 ffs_lock(f3335160,f3335200,f3335160,c0a8e347,caa95bb0,...) at ffs_lock+0xad/frame 0xf3335120 VOP_LOCK1_APV(c11e7948,f3335160,caa95bb0,f3335200,c11fb970,...) at VOP_LOCK1_APV+0xe5/frame 0xf3335148 _vn_lock(cb63fb40,80100,c10be73e,9f7,cb5020b4,...) at _vn_lock+0xca/frame 0xf3335188 process_deferred_inactive(caa95bb0,1,c10be73e,2ab,0,...) at process_deferred_inactive+0x13f/frame 0xf3335210 ffs_snapshot(caa95bb0,ca9b6140,0,0,0,...) at ffs_snapshot+0x398d/frame 0xf3335900 ffs_mount(caa95bb0,caae2900,ff,3ab,caaa45d8,...) at ffs_mount+0x1359/frame 0xf3335a48 vfs_donmount(cb502000,2001340,0,cae6b800,cae6b800,...) at vfs_donmount+0xf12/frame 0xf3335c18 sys_nmount(cb502000,f3335cc8,f3335d08,1,1,...) at sys_nmount+0x78/frame 0xf3335c40 syscall(f3335d08) at syscall+0x2ed/frame 0xf3335cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3335cfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280bf347, esp = 0xbfbfd1dc, ebp = 0xbfbfd954 --- Tracing command rw pid 1972 tid 100182 td 0xcbec05e0 sched_switch(cbec05e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33d82b8 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33d82ec sleepq_switch(cbec05e0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf33d8320 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf33d8344 sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf33d8380 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,6e5,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,6e5,6e5,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf33d845c _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33d84c8 ffs_snapblkfree(cbfd5000,cbc379d8,16810,0,8000,...) at ffs_snapblkfree+0x2a9/frame 0xf33d86cc ffs_blkfree(cbeedc00,cbfd5000,cbc379d8,16810,0,...) at ffs_blkfree+0x57/frame 0xf33d8708 ffs_reallocblks(f33d88b8,c10e5e13,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf33d8824 VOP_REALLOCBLKS_APV(c11e7948,f33d88b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf33d8850 cluster_write(cbef9ca8,e1da4200,4e40000,0,7f,...) at cluster_write+0x524/frame 0xf33d88f0 ffs_write(f33d8a80,c10e55d5,c11e7948,f33d89a0,f33d89d8,...) at ffs_write+0x524/frame 0xf33d8980 VOP_WRITE_APV(c11e7948,f33d8a80,cbef9ca8,31b,cbec05e0,...) at VOP_WRITE_APV+0x178/frame 0xf33d8a40 vn_write(caab8e00,f33d8c10,c7dd4200,1,cbec05e0,...) at vn_write+0x36f/frame 0xf33d8ab0 vn_io_fault(caab8e00,f33d8c10,c7dd4200,0,cbec05e0,...) at vn_io_fault+0x247/frame 0xf33d8b8c dofilewrite(caab8e00,f33d8c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf33d8bc4 kern_writev(cbec05e0,4,f33d8c10,0,bfbfd800,...) at kern_writev+0x66/frame 0xf33d8bf0 sys_write(cbec05e0,f33d8cc8,14,c108c75d,7b3,...) at sys_write+0x5c/frame 0xf33d8c40 syscall(f33d8d08) at syscall+0x2ed/frame 0xf33d8cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf33d8cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- Tracing command rw pid 1971 tid 100183 td 0xcbec02f0 sched_switch(cbec02f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33e02b8 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33e02ec sleepq_switch(cbec02f0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf33e0320 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf33e0344 sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf33e0380 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,6e5,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,6e5,6e5,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf33e045c _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33e04c8 ffs_snapblkfree(cbfd5000,cbc379d8,37c48,0,8000,...) at ffs_snapblkfree+0x2a9/frame 0xf33e06cc ffs_blkfree(cbeedc00,cbfd5000,cbc379d8,37c48,0,...) at ffs_blkfree+0x57/frame 0xf33e0708 ffs_reallocblks(f33e08b8,c10e5e13,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf33e0824 VOP_REALLOCBLKS_APV(c11e7948,f33e08b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf33e0850 cluster_write(cbfdf870,e1e59d20,4e48000,0,7f,...) at cluster_write+0x524/frame 0xf33e08f0 ffs_write(f33e0a80,c10e55d5,c11e7948,f33e09a0,f33e09d8,...) at ffs_write+0x524/frame 0xf33e0980 VOP_WRITE_APV(c11e7948,f33e0a80,cbfdf870,31b,cbec02f0,...) at VOP_WRITE_APV+0x178/frame 0xf33e0a40 vn_write(cbe980a8,f33e0c10,c7dd4200,1,cbec02f0,...) at vn_write+0x36f/frame 0xf33e0ab0 vn_io_fault(cbe980a8,f33e0c10,c7dd4200,0,cbec02f0,...) at vn_io_fault+0x247/frame 0xf33e0b8c dofilewrite(cbe980a8,f33e0c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf33e0bc4 kern_writev(cbec02f0,4,f33e0c10,0,bfbfd800,...) at kern_writev+0x66/frame 0xf33e0bf0 sys_write(cbec02f0,f33e0cc8,14,c108c75d,7b3,...) at sys_write+0x5c/frame 0xf33e0c40 syscall(f33e0d08) at syscall+0x2ed/frame 0xf33e0cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf33e0cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- Tracing command rw pid 1970 tid 100173 td 0xcb5005e0 sched_switch(cb5005e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33bd330 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33bd364 sleepq_switch(cb5005e0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf33bd398 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf33bd3bc sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf33bd3f8 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,8fc,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,8fc,8fc,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf33bd4d4 _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33bd540 ffs_copyonwrite(cbc379d8,e1ccafc0,e1ccafc0,1bef74,0,...) at ffs_copyonwrite+0x586/frame 0xf33bd6fc ffs_geom_strategy(cbc37ad0,e1ccafc0,c0ea991c,cbf334b0,cbf88000,...) at ffs_geom_strategy+0xbf/frame 0xf33bd718 ufs_strategy(f33bd7a8,c10e5b8f,c0ae5659,e1ccb040,4c,...) at ufs_strategy+0xce/frame 0xf33bd764 VOP_STRATEGY_APV(c11e7948,f33bd7a8,c0a8627b,e1ccb040,c11fbdc0,...) at VOP_STRATEGY_APV+0x111/frame 0xf33bd790 bufstrategy(cbf880f8,e1ccafc0,39f,f33,4,...) at bufstrategy+0x4c/frame 0xf33bd7c0 bufwrite(e1ccafc0,80300,cbf880f8,0,0,...) at bufwrite+0x161/frame 0xf33bd7f0 cluster_wbuild(cbf88000,8000,a31,0,4,...) at cluster_wbuild+0x7ce/frame 0xf33bd850 cluster_write(cbf88000,e1ccafc0,51a8000,0,7f,...) at cluster_write+0x16a/frame 0xf33bd8f0 ffs_write(f33bda80,c10e55d5,c11e7948,f33bd9a0,f33bd9d8,...) at ffs_write+0x524/frame 0xf33bd980 VOP_WRITE_APV(c11e7948,f33bda80,cbf88000,31b,cb5005e0,...) at VOP_WRITE_APV+0x178/frame 0xf33bda40 vn_write(cb4ade38,f33bdc10,c7dd4200,1,cb5005e0,...) at vn_write+0x36f/frame 0xf33bdab0 vn_io_fault(cb4ade38,f33bdc10,c7dd4200,0,cb5005e0,...) at vn_io_fault+0x247/frame 0xf33bdb8c dofilewrite(cb4ade38,f33bdc10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf33bdbc4 kern_writev(cb5005e0,4,f33bdc10,0,bfbfd800,...) at kern_writev+0x66/frame 0xf33bdbf0 sys_write(cb5005e0,f33bdcc8,14,c108c75d,7b3,...) at sys_write+0x5c/frame 0xf33bdc40 syscall(f33bdd08) at syscall+0x2ed/frame 0xf33bdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf33bdcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- Tracing command rw pid 1969 tid 100145 td 0xcb5305e0 sched_switch(cb5305e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33502b8 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33502ec sleepq_switch(cb5305e0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3350320 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf3350344 sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf3350380 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,6e5,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,6e5,6e5,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf335045c _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33504c8 ffs_snapblkfree(cbfd5000,cbc379d8,16808,0,8000,...) at ffs_snapblkfree+0x2a9/frame 0xf33506cc ffs_blkfree(cbeedc00,cbfd5000,cbc379d8,16808,0,...) at ffs_blkfree+0x57/frame 0xf3350708 ffs_reallocblks(f33508b8,c10e5e13,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf3350824 VOP_REALLOCBLKS_APV(c11e7948,f33508b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf3350850 cluster_write(cbefa5a0,e1e3f9e0,ab8000,0,7f,...) at cluster_write+0x524/frame 0xf33508f0 ffs_write(f3350a80,c10e55d5,c11e7948,f33509a0,f33509d8,...) at ffs_write+0x524/frame 0xf3350980 VOP_WRITE_APV(c11e7948,f3350a80,cbefa5a0,31b,cb5305e0,...) at VOP_WRITE_APV+0x178/frame 0xf3350a40 vn_write(cbe98118,f3350c10,c7dd4200,1,cb5305e0,...) at vn_write+0x36f/frame 0xf3350ab0 vn_io_fault(cbe98118,f3350c10,c7dd4200,0,cb5305e0,...) at vn_io_fault+0x247/frame 0xf3350b8c dofilewrite(cbe98118,f3350c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf3350bc4 kern_writev(cb5305e0,4,f3350c10,0,bfbfd800,...) at kern_writev+0x66/frame 0xf3350bf0 sys_write(cb5305e0,f3350cc8,14,c108c75d,7b3,...) at sys_write+0x5c/frame 0xf3350c40 syscall(f3350d08) at syscall+0x2ed/frame 0xf3350cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3350cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- Tracing command rw pid 1968 tid 100167 td 0xcbe835e0 sched_switch(cbe835e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33922c8 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33922fc sleepq_switch(cbe835e0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3392330 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf3392354 sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf3392390 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,6e5,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,6e5,6e5,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf339246c _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33924d8 ffs_snapblkfree(cbfd5000,cbc379d8,4828,0,8000,...) at ffs_snapblkfree+0x2a9/frame 0xf33926dc ffs_blkfree(cbeedc00,cbfd5000,cbc379d8,4828,0,...) at ffs_blkfree+0x57/frame 0xf3392718 ffs_indirtrunc(ffffffff,48c0,0,ffffffff,ffffffff,...) at ffs_indirtrunc+0x5b0/frame 0xf33927c8 ffs_indirtrunc(ffffffff,4880,0,ffffffff,ffffffff,...) at ffs_indirtrunc+0x50b/frame 0xf3392878 ffs_truncate(cb63fb40,0,0,c00,0,...) at ffs_truncate+0x1185/frame 0xf3392a24 ufs_inactive(f3392aa8,c10e5a19,9c2,c11f8e38,cb63fb40,...) at ufs_inactive+0x1fc/frame 0xf3392a54 VOP_INACTIVE_APV(c11e7948,f3392aa8,c109a6b7,9c2,c0b2f968,...) at VOP_INACTIVE_APV+0x103/frame 0xf3392a80 vinactive(cb63fb40,cbe835e0,c109a6b7,8c0,cb63fc14,...) at vinactive+0x191/frame 0xf3392ac8 vputx(cb63fb40,ffffffdf,cb63fb40,f3392bd0,c10c44d8,...) at vputx+0x382/frame 0xf3392b10 kern_unlinkat(cbe835e0,ffffff9c,bfbfd800,0,0) at kern_unlinkat+0x29f/frame 0xf3392c24 sys_unlink(cbe835e0,f3392cc8,c7b15cb4,97c5400,f3392c9c,...) at sys_unlink+0x32/frame 0xf3392c40 syscall(f3392d08) at syscall+0x2ed/frame 0xf3392cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3392cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28179a03, esp = 0xbfbfc7e8, ebp = 0xbfbfd890 --- Tracing command rw pid 1967 tid 100132 td 0xcb502bc0 sched_switch(cb502bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3329978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33299ac sleepq_switch(cb502bc0,0,c108fd1c,1ad,f3329a24,...) at sleepq_switch+0x1b9/frame 0xf33299e0 sleepq_catch_signals(0,c108fd1c,166,108,cb502bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3329a28 sleepq_wait_sig(cb4b0b40,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3329a4c _sleep(cb4b0b40,cb4b0bc8,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf3329aa4 kern_wait6(cb502bc0,0,7b0,0,f3329bec,...) at kern_wait6+0x3ec/frame 0xf3329b00 kern_wait(cb502bc0,7b0,f3329bec,0,0,...) at kern_wait+0xd8/frame 0xf3329bd0 sys_wait4(cb502bc0,f3329cc8,0,0,cb502bc0,...) at sys_wait4+0x41/frame 0xf3329c40 syscall(f3329d08) at syscall+0x2ed/frame 0xf3329cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3329cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eae5f, esp = 0xbfbfd878, ebp = 0xbfbfd890 --- Tracing command rw pid 1965 tid 100169 td 0xcb5012f0 sched_switch(cb5012f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33b1978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33b19ac sleepq_switch(cb5012f0,0,c108fd1c,1ad,f33b1a24,...) at sleepq_switch+0x1b9/frame 0xf33b19e0 sleepq_catch_signals(0,c108fd1c,166,888,cb5012f0,...) at sleepq_catch_signals+0x3b1/frame 0xf33b1a28 sleepq_wait_sig(cbfa5b40,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf33b1a4c _sleep(cbfa5b40,cbfa5bc8,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf33b1aa4 kern_wait6(cb5012f0,0,7af,0,f33b1bec,...) at kern_wait6+0x3ec/frame 0xf33b1b00 kern_wait(cb5012f0,7af,f33b1bec,0,0,...) at kern_wait+0xd8/frame 0xf33b1bd0 sys_wait4(cb5012f0,f33b1cc8,f33b1d08,1,1,...) at sys_wait4+0x41/frame 0xf33b1c40 syscall(f33b1d08) at syscall+0x2ed/frame 0xf33b1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf33b1cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eae5f, esp = 0xbfbfd878, ebp = 0xbfbfd890 --- Tracing command su pid 1963 tid 100165 td 0xcbe83bc0 sched_switch(cbe83bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf338c978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf338c9ac sleepq_switch(cbe83bc0,0,c108fd1c,1ad,f338ca24,...) at sleepq_switch+0x1b9/frame 0xf338c9e0 sleepq_catch_signals(0,c108fd1c,166,378,cbe83bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf338ca28 sleepq_wait_sig(cb6625a0,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf338ca4c _sleep(cb6625a0,cb662628,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf338caa4 kern_wait6(cbe83bc0,0,7ad,0,f338cbec,...) at kern_wait6+0x3ec/frame 0xf338cb00 kern_wait(cbe83bc0,7ad,f338cbec,2,0,...) at kern_wait+0xd8/frame 0xf338cbd0 sys_wait4(cbe83bc0,f338ccc8,f338cd08,1,1,...) at sys_wait4+0x41/frame 0xf338cc40 syscall(f338cd08) at syscall+0x2ed/frame 0xf338ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf338ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810ce5f, esp = 0xbfbfd420, ebp = 0xbfbfd438 --- Tracing command g_journal md5 pid 1958 tid 100176 td 0xcae8ebc0 sched_switch(cae8ebc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33c68ec mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33c6920 sleepq_switch(cae8ebc0,0,c108fd1c,26f,cae8ebc0,...) at sleepq_switch+0x1b9/frame 0xf33c6954 sleepq_wait(cbf1ac00,5c,cbf9db36,0,0,...) at sleepq_wait+0x48/frame 0xf33c6978 _sleep(cbf1ac00,cbf1ac10,25c,cbf9db36,0,...) at _sleep+0x34e/frame 0xf33c69d0 g_journal_worker(cbf1ac00,f33c6d08,c1083e68,3d7,0,...) at g_journal_worker+0x18e8/frame 0xf33c6ccc fork_exit(cbf99f00,cbf1ac00,f33c6d08) at fork_exit+0x7f/frame 0xf33c6cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf33c6cf4 --- trap 0, eip = 0, esp = 0xf33c6d40, ebp = 0 --- Tracing command g_journal switcher pid 1956 tid 100177 td 0xcbec15e0 sched_switch(cbec15e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33c9660 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33c9694 sleepq_switch(cbec15e0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf33c96c8 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xf33c96ec sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xf33c9728 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,8fc,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,8fc,8fc,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xf33c9804 _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xf33c9870 ffs_copyonwrite(cbc379d8,e1d0b940,e1d0b940,841c8,0,...) at ffs_copyonwrite+0x586/frame 0xf33c9a2c ffs_geom_strategy(cbc37ad0,e1d0b940,c0ea991c,cbf2cb0c,cbef85a0,...) at ffs_geom_strategy+0xbf/frame 0xf33c9a48 ufs_strategy(f33c9ad8,c10e5b8f,c0ae5659,e1d0b9c0,4c,...) at ufs_strategy+0xce/frame 0xf33c9a94 VOP_STRATEGY_APV(c11e7948,f33c9ad8,c0a8627b,e1d0b9c0,c11fbdc0,...) at VOP_STRATEGY_APV+0x111/frame 0xf33c9ac0 bufstrategy(cbef8698,e1d0b940,39f,f33,889,...) at bufstrategy+0x4c/frame 0xf33c9af0 bufwrite(e1d0b940,0,c10c2378,107,0,...) at bufwrite+0x161/frame 0xf33c9b20 ffs_syncvnode(cbef85a0,2,0,61e,f33c9bb8,...) at ffs_syncvnode+0x32c/frame 0xf33c9b78 ffs_sync(caa95bb0,2,1,b5d,2710,...) at ffs_sync+0x23e/frame 0xf33c9c00 g_journal_switcher(cbf9fb68,f33c9d08,c1083e68,3d7,0,...) at g_journal_switcher+0x85d/frame 0xf33c9ccc fork_exit(cbf950d0,cbf9fb68,f33c9d08) at fork_exit+0x7f/frame 0xf33c9cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf33c9cf4 --- trap 0, eip = 0, esp = 0xf33c9d40, ebp = 0 --- Tracing command md5 pid 1954 tid 100110 td 0xcab575e0 sched_switch(cab575e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf328abb4 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xf328abe8 sleepq_switch(cab575e0,0,c108fd1c,26f,cab575e0,...) at sleepq_switch+0x1b9/frame 0xf328ac1c sleepq_wait(ca956000,5c,c10255ad,0,0,...) at sleepq_wait+0x48/frame 0xf328ac40 _sleep(ca956000,ca956020,25c,c10255ad,0,...) at _sleep+0x34e/frame 0xf328ac98 md_kthread(ca956000,f328ad08,c1083e68,3d7,0,...) at md_kthread+0xf8/frame 0xf328accc fork_exit(c0789100,ca956000,f328ad08) at fork_exit+0x7f/frame 0xf328acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf328acf4 --- trap 0, eip = 0, esp = 0xf328ad40, ebp = 0 --- Tracing command sh pid 1941 tid 100120 td 0xc98882f0 sched_switch(c98882f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf32b2978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf32b29ac sleepq_switch(c98882f0,0,c108fd1c,1ad,f32b2a24,...) at sleepq_switch+0x1b9/frame 0xf32b29e0 sleepq_catch_signals(0,c108fd1c,166,c0,c98882f0,...) at sleepq_catch_signals+0x3b1/frame 0xf32b2a28 sleepq_wait_sig(cab70870,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf32b2a4c _sleep(cab70870,cab708f8,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf32b2aa4 kern_wait6(c98882f0,7,0,0,f32b2bec,...) at kern_wait6+0x3ec/frame 0xf32b2b00 kern_wait(c98882f0,ffffffff,f32b2bec,0,0,...) at kern_wait+0xd8/frame 0xf32b2bd0 sys_wait4(c98882f0,f32b2cc8,c10deadf,e9,f32b2cc4,...) at sys_wait4+0x41/frame 0xf32b2c40 syscall(f32b2d08) at syscall+0x2ed/frame 0xf32b2cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32b2cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2814fe5f, esp = 0xbfbfd7d8, ebp = 0xbfbfd7f0 --- Tracing command sh pid 1378 tid 100146 td 0xcb5302f0 sched_switch(cb5302f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3353978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33539ac sleepq_switch(cb5302f0,0,c108fd1c,1ad,f3353a24,...) at sleepq_switch+0x1b9/frame 0xf33539e0 sleepq_catch_signals(0,c108fd1c,166,978,cb5302f0,...) at sleepq_catch_signals+0x3b1/frame 0xf3353a28 sleepq_wait_sig(cb51e5a0,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3353a4c _sleep(cb51e5a0,cb51e628,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf3353aa4 kern_wait6(cb5302f0,7,0,0,f3353bec,...) at kern_wait6+0x3ec/frame 0xf3353b00 kern_wait(cb5302f0,ffffffff,f3353bec,0,0,...) at kern_wait+0xd8/frame 0xf3353bd0 sys_wait4(cb5302f0,f3353cc8,c10deadf,e9,1,...) at sys_wait4+0x41/frame 0xf3353c40 syscall(f3353d08) at syscall+0x2ed/frame 0xf3353cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3353cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2814fe5f, esp = 0xbfbfd7c8, ebp = 0xbfbfd7e0 --- Tracing command bash pid 1374 tid 100105 td 0xcab582f0 sched_switch(cab582f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf326f978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf326f9ac sleepq_switch(cab582f0,0,c108fd1c,1ad,f326fa24,...) at sleepq_switch+0x1b9/frame 0xf326f9e0 sleepq_catch_signals(0,c108fd1c,166,480,cab582f0,...) at sleepq_catch_signals+0x3b1/frame 0xf326fa28 sleepq_wait_sig(cab53000,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf326fa4c _sleep(cab53000,cab53088,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf326faa4 kern_wait6(cab582f0,7,0,0,f326fbec,...) at kern_wait6+0x3ec/frame 0xf326fb00 kern_wait(cab582f0,ffffffff,f326fbec,6,0,...) at kern_wait+0xd8/frame 0xf326fbd0 sys_wait4(cab582f0,f326fcc8,f326fd08,1,1,...) at sys_wait4+0x41/frame 0xf326fc40 syscall(f326fd08) at syscall+0x2ed/frame 0xf326fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf326fcfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282aee5f, esp = 0xbfbfd9b0, ebp = 0xbfbfd9c8 --- Tracing command csh pid 1371 tid 100147 td 0xcb530000 sched_switch(cb530000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3356ab4 mi_switch(104,0,c108fd1c,1f9,c108fd1c,...) at mi_switch+0x1c9/frame 0xf3356ae8 sleepq_switch(cb530000,0,c108fd1c,1ad,f3356b60,...) at sleepq_switch+0x1b9/frame 0xf3356b1c sleepq_catch_signals(0,c108fd1c,166,948,cb530000,...) at sleepq_catch_signals+0x3b1/frame 0xf3356b64 sleepq_wait_sig(cb51e328,74,c0f07be0,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3356b88 _sleep(cb51e328,cb51e358,174,c0f07be0,0,...) at _sleep+0x32d/frame 0xf3356be0 kern_sigsuspend(cb530000,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf3356c10 sys_sigsuspend(cb530000,f3356cc8,c10deadf,e9,1,...) at sys_sigsuspend+0x58/frame 0xf3356c40 syscall(f3356d08) at syscall+0x2ed/frame 0xf3356cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3356cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816a497, esp = 0xbfbfd27c, ebp = 0xbfbfd2e4 --- Tracing command getty pid 1360 tid 100153 td 0xcb52ebc0 sched_switch(cb52ebc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33689b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33689ec sleepq_switch(cb52ebc0,0,c108fd1c,1ad,f3368a64,...) at sleepq_switch+0x1b9/frame 0xf3368a20 sleepq_catch_signals(0,c108fd1c,166,390,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3368a68 sleepq_wait_sig(c8172670,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3368a8c _cv_wait_sig(c8172670,c1401324,c1094a4d,531,f3368c10,...) at _cv_wait_sig+0x200/frame 0xf3368ad4 tty_wait(c8172600,c8172670,f3368c10,1,0,...) at tty_wait+0x4b/frame 0xf3368af8 ttydisc_read(c8172600,f3368c10,0,a1,f3368c10,...) at ttydisc_read+0x377/frame 0xf3368b3c ttydev_read(c973bb00,f3368c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3368b5c devfs_read_f(caab77a8,f3368c10,c7dd4e80,0,cb52ebc0,...) at devfs_read_f+0x87/frame 0xf3368b90 dofileread(caab77a8,f3368c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3368bc4 kern_readv(cb52ebc0,0,f3368c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3368bf0 sys_read(cb52ebc0,f3368cc8,f3368d08,1,1,...) at sys_read+0x5c/frame 0xf3368c40 syscall(f3368d08) at syscall+0x2ed/frame 0xf3368cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3368cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1359 tid 100148 td 0xcb52fbc0 sched_switch(cb52fbc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33599b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33599ec sleepq_switch(cb52fbc0,0,c108fd1c,1ad,f3359a64,...) at sleepq_switch+0x1b9/frame 0xf3359a20 sleepq_catch_signals(0,c108fd1c,166,3c0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3359a68 sleepq_wait_sig(c8172870,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3359a8c _cv_wait_sig(c8172870,c1401324,c1094a4d,531,f3359c10,...) at _cv_wait_sig+0x200/frame 0xf3359ad4 tty_wait(c8172800,c8172870,f3359c10,1,0,...) at tty_wait+0x4b/frame 0xf3359af8 ttydisc_read(c8172800,f3359c10,0,a1,f3359c10,...) at ttydisc_read+0x377/frame 0xf3359b3c ttydev_read(c973bc00,f3359c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3359b5c devfs_read_f(cab18540,f3359c10,c7dd4e80,0,cb52fbc0,...) at devfs_read_f+0x87/frame 0xf3359b90 dofileread(cab18540,f3359c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3359bc4 kern_readv(cb52fbc0,0,f3359c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3359bf0 sys_read(cb52fbc0,f3359cc8,f3359d08,1,1,...) at sys_read+0x5c/frame 0xf3359c40 syscall(f3359d08) at syscall+0x2ed/frame 0xf3359cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3359cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1358 tid 100139 td 0xcaae65e0 sched_switch(caae65e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf333e9b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf333e9ec sleepq_switch(caae65e0,0,c108fd1c,1ad,f333ea64,...) at sleepq_switch+0x1b9/frame 0xf333ea20 sleepq_catch_signals(0,c108fd1c,166,3f0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf333ea68 sleepq_wait_sig(c8172a70,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf333ea8c _cv_wait_sig(c8172a70,c1401324,c1094a4d,531,f333ec10,...) at _cv_wait_sig+0x200/frame 0xf333ead4 tty_wait(c8172a00,c8172a70,f333ec10,1,0,...) at tty_wait+0x4b/frame 0xf333eaf8 ttydisc_read(c8172a00,f333ec10,0,a1,f333ec10,...) at ttydisc_read+0x377/frame 0xf333eb3c ttydev_read(c973bd00,f333ec10,0,1,0,...) at ttydev_read+0x81/frame 0xf333eb5c devfs_read_f(caab7038,f333ec10,c7dd4e80,0,caae65e0,...) at devfs_read_f+0x87/frame 0xf333eb90 dofileread(caab7038,f333ec10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf333ebc4 kern_readv(caae65e0,0,f333ec10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf333ebf0 sys_read(caae65e0,f333ecc8,f333ed08,1,1,...) at sys_read+0x5c/frame 0xf333ec40 syscall(f333ed08) at syscall+0x2ed/frame 0xf333ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf333ecfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1357 tid 100140 td 0xcaae62f0 sched_switch(caae62f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33419b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33419ec sleepq_switch(caae62f0,0,c108fd1c,1ad,f3341a64,...) at sleepq_switch+0x1b9/frame 0xf3341a20 sleepq_catch_signals(0,c108fd1c,166,420,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3341a68 sleepq_wait_sig(c8172c70,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3341a8c _cv_wait_sig(c8172c70,c1401324,c1094a4d,531,f3341c10,...) at _cv_wait_sig+0x200/frame 0xf3341ad4 tty_wait(c8172c00,c8172c70,f3341c10,1,0,...) at tty_wait+0x4b/frame 0xf3341af8 ttydisc_read(c8172c00,f3341c10,0,a1,f3341c10,...) at ttydisc_read+0x377/frame 0xf3341b3c ttydev_read(c973be00,f3341c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3341b5c devfs_read_f(cab18af0,f3341c10,c7dd4e80,0,caae62f0,...) at devfs_read_f+0x87/frame 0xf3341b90 dofileread(cab18af0,f3341c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3341bc4 kern_readv(caae62f0,0,f3341c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3341bf0 sys_read(caae62f0,f3341cc8,f3341d08,1,1,...) at sys_read+0x5c/frame 0xf3341c40 syscall(f3341d08) at syscall+0x2ed/frame 0xf3341cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3341cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1356 tid 100141 td 0xcaae6000 sched_switch(caae6000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33449b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33449ec sleepq_switch(caae6000,0,c108fd1c,1ad,f3344a64,...) at sleepq_switch+0x1b9/frame 0xf3344a20 sleepq_catch_signals(0,c108fd1c,166,450,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3344a68 sleepq_wait_sig(c8172e70,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3344a8c _cv_wait_sig(c8172e70,c1401324,c1094a4d,531,f3344c10,...) at _cv_wait_sig+0x200/frame 0xf3344ad4 tty_wait(c8172e00,c8172e70,f3344c10,1,0,...) at tty_wait+0x4b/frame 0xf3344af8 ttydisc_read(c8172e00,f3344c10,0,a1,f3344c10,...) at ttydisc_read+0x377/frame 0xf3344b3c ttydev_read(c988f000,f3344c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3344b5c devfs_read_f(caab7b60,f3344c10,c7dd4e80,0,caae6000,...) at devfs_read_f+0x87/frame 0xf3344b90 dofileread(caab7b60,f3344c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3344bc4 kern_readv(caae6000,0,f3344c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3344bf0 sys_read(caae6000,f3344cc8,f3344d08,1,1,...) at sys_read+0x5c/frame 0xf3344c40 syscall(f3344d08) at syscall+0x2ed/frame 0xf3344cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3344cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1355 tid 100142 td 0xcb531000 sched_switch(cb531000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf33479b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33479ec sleepq_switch(cb531000,0,c108fd1c,1ad,f3347a64,...) at sleepq_switch+0x1b9/frame 0xf3347a20 sleepq_catch_signals(0,c108fd1c,166,300,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3347a68 sleepq_wait_sig(c9892070,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3347a8c _cv_wait_sig(c9892070,c1401324,c1094a4d,531,f3347c10,...) at _cv_wait_sig+0x200/frame 0xf3347ad4 tty_wait(c9892000,c9892070,f3347c10,1,0,...) at tty_wait+0x4b/frame 0xf3347af8 ttydisc_read(c9892000,f3347c10,0,a1,f3347c10,...) at ttydisc_read+0x377/frame 0xf3347b3c ttydev_read(c988f100,f3347c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3347b5c devfs_read_f(cab18888,f3347c10,c7dd4e80,0,cb531000,...) at devfs_read_f+0x87/frame 0xf3347b90 dofileread(cab18888,f3347c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3347bc4 kern_readv(cb531000,0,f3347c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3347bf0 sys_read(cb531000,f3347cc8,f3347d08,1,1,...) at sys_read+0x5c/frame 0xf3347c40 syscall(f3347d08) at syscall+0x2ed/frame 0xf3347cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3347cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1354 tid 100143 td 0xcb530bc0 sched_switch(cb530bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf334a9b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf334a9ec sleepq_switch(cb530bc0,0,c108fd1c,1ad,f334aa64,...) at sleepq_switch+0x1b9/frame 0xf334aa20 sleepq_catch_signals(0,c108fd1c,166,330,1,...) at sleepq_catch_signals+0x3b1/frame 0xf334aa68 sleepq_wait_sig(c9892270,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf334aa8c _cv_wait_sig(c9892270,c1401324,c1094a4d,531,f334ac10,...) at _cv_wait_sig+0x200/frame 0xf334aad4 tty_wait(c9892200,c9892270,f334ac10,1,0,...) at tty_wait+0x4b/frame 0xf334aaf8 ttydisc_read(c9892200,f334ac10,0,a1,f334ac10,...) at ttydisc_read+0x377/frame 0xf334ab3c ttydev_read(c988f200,f334ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf334ab5c devfs_read_f(caab76c8,f334ac10,c7dd4e80,0,cb530bc0,...) at devfs_read_f+0x87/frame 0xf334ab90 dofileread(caab76c8,f334ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf334abc4 kern_readv(cb530bc0,0,f334ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf334abf0 sys_read(cb530bc0,f334acc8,f334ad08,1,1,...) at sys_read+0x5c/frame 0xf334ac40 syscall(f334ad08) at syscall+0x2ed/frame 0xf334acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf334acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1353 tid 100098 td 0xcab788d0 sched_switch(cab788d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf324a9b8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf324a9ec sleepq_switch(cab788d0,0,c108fd1c,1ad,f324aa64,...) at sleepq_switch+0x1b9/frame 0xf324aa20 sleepq_catch_signals(0,c108fd1c,166,360,1,...) at sleepq_catch_signals+0x3b1/frame 0xf324aa68 sleepq_wait_sig(c9892470,0,c1094a61,101,0,...) at sleepq_wait_sig+0x14/frame 0xf324aa8c _cv_wait_sig(c9892470,c1401324,c1094a4d,531,f324ac10,...) at _cv_wait_sig+0x200/frame 0xf324aad4 tty_wait(c9892400,c9892470,f324ac10,1,0,...) at tty_wait+0x4b/frame 0xf324aaf8 ttydisc_read(c9892400,f324ac10,0,a1,f324ac10,...) at ttydisc_read+0x377/frame 0xf324ab3c ttydev_read(c988f300,f324ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf324ab5c devfs_read_f(caab72a0,f324ac10,c7dd4e80,0,cab788d0,...) at devfs_read_f+0x87/frame 0xf324ab90 dofileread(caab72a0,f324ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf324abc4 kern_readv(cab788d0,0,f324ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf324abf0 sys_read(cab788d0,f324acc8,63,c11a8d08,c8171400,...) at sys_read+0x5c/frame 0xf324ac40 syscall(f324ad08) at syscall+0x2ed/frame 0xf324acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf324acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command login pid 1352 tid 100091 td 0xcaae92f0 sched_switch(caae92f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf322a978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xf322a9ac sleepq_switch(caae92f0,0,c108fd1c,1ad,f322aa24,...) at sleepq_switch+0x1b9/frame 0xf322a9e0 sleepq_catch_signals(0,c108fd1c,166,930,caae92f0,...) at sleepq_catch_signals+0x3b1/frame 0xf322aa28 sleepq_wait_sig(ca96e2d0,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xf322aa4c _sleep(ca96e2d0,ca96e358,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xf322aaa4 kern_wait6(caae92f0,0,55b,0,f322abec,...) at kern_wait6+0x3ec/frame 0xf322ab00 kern_wait(caae92f0,55b,f322abec,0,0,...) at kern_wait+0xd8/frame 0xf322abd0 sys_wait4(caae92f0,f322acc8,f322ad08,1,1,...) at sys_wait4+0x41/frame 0xf322ac40 syscall(f322ad08) at syscall+0x2ed/frame 0xf322acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf322acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810ee5f, esp = 0xbfbfdd58, ebp = 0xbfbfdd70 --- Tracing command inetd pid 1335 tid 100088 td 0xcab59000 sched_switch(cab59000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf321e918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf321e94c sleepq_switch(cab59000,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf321e980 sleepq_catch_signals(f321e9ec,c0a8dcc9,ca95b5e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf321e9c8 sleepq_wait_sig(ca95b5e4,0,f321ea20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf321e9ec _cv_wait_sig(ca95b5e4,ca95b5d0,c1092a9c,677,8,...) at _cv_wait_sig+0x200/frame 0xf321ea34 seltdwait(cb4ad268,58,c7dd4e80,cab59000,cab53bc8,...) at seltdwait+0x8c/frame 0xf321ea58 kern_select(cab59000,8,bfbfd008,0,0,...) at kern_select+0x85f/frame 0xf321ebf8 sys_select(cab59000,f321ecc8,f321ed08,1,1,...) at sys_select+0x69/frame 0xf321ec40 syscall(f321ed08) at syscall+0x2ed/frame 0xf321ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf321ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a2217, esp = 0xbfbfcf84, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 1310 tid 100103 td 0xcab718d0 sched_switch(cab718d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf325ea80 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf325eab4 sleepq_switch(cab718d0,0,c108fd1c,1ad,f325eb2c,...) at sleepq_switch+0x1b9/frame 0xf325eae8 sleepq_catch_signals(ea61,c0ae2a10,cab718d0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf325eb30 sleepq_timedwait_sig(c123a2c0,6c,c108b916,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf325eb58 _sleep(c123a2c0,0,16c,c108b916,ea61,...) at _sleep+0x303/frame 0xf325ebb0 kern_nanosleep(bfbfdd08,f325ec18,f325ec20,c98e9770,3c,...) at kern_nanosleep+0xd9/frame 0xf325ec00 sys_nanosleep(cab718d0,f325ecc8,c7b1bc80,c7b1bccc,0,...) at sys_nanosleep+0x6b/frame 0xf325ec40 syscall(f325ed08) at syscall+0x2ed/frame 0xf325ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf325ecfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281698af, esp = 0xbfbfdcfc, ebp = 0xbfbfdd40 --- Tracing command cron pid 1183 tid 100126 td 0xcab57000 sched_switch(cab57000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3317a80 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf3317ab4 sleepq_switch(cab57000,0,c108fd1c,1ad,f3317b2c,...) at sleepq_switch+0x1b9/frame 0xf3317ae8 sleepq_catch_signals(ea53,c0ae2a10,cab57000,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3317b30 sleepq_timedwait_sig(c123a2c0,6c,c108b916,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3317b58 _sleep(c123a2c0,0,16c,c108b916,ea53,...) at _sleep+0x303/frame 0xf3317bb0 kern_nanosleep(bfbfde28,f3317c18,f3317c20,f3317cc8,3b,...) at kern_nanosleep+0xd9/frame 0xf3317c00 sys_nanosleep(cab57000,f3317cc8,f3317d08,1,1,...) at sys_nanosleep+0x6b/frame 0xf3317c40 syscall(f3317d08) at syscall+0x2ed/frame 0xf3317cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3317cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281788af, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 1178 tid 100097 td 0xcab78bc0 sched_switch(cab78bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3245ab4 mi_switch(104,0,c108fd1c,1f9,c108fd1c,...) at mi_switch+0x1c9/frame 0xf3245ae8 sleepq_switch(cab78bc0,0,c108fd1c,1ad,f3245b60,...) at sleepq_switch+0x1b9/frame 0xf3245b1c sleepq_catch_signals(0,c108fd1c,166,af8,cab78bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3245b64 sleepq_wait_sig(cab6f5f8,74,c0f07be0,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3245b88 _sleep(cab6f5f8,cab6f628,174,c0f07be0,0,...) at _sleep+0x32d/frame 0xf3245be0 kern_sigsuspend(cab78bc0,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf3245c10 sys_sigsuspend(cab78bc0,f3245cc8,1,0,cab78bc0,...) at sys_sigsuspend+0x58/frame 0xf3245c40 syscall(f3245d08) at syscall+0x2ed/frame 0xf3245cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3245cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28352497, esp = 0xbfbfbf8c, ebp = 0xbfbfbfb8 --- Tracing command sendmail pid 1175 tid 100112 td 0xca970bc0 sched_switch(ca970bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3293914 mi_switch(104,0,c108fd1c,1f9,c1402000,...) at mi_switch+0x1c9/frame 0xf3293948 sleepq_switch(ca970bc0,0,c108fd1c,1ad,cab8c190,...) at sleepq_switch+0x1b9/frame 0xf329397c sleepq_catch_signals(c11bd300,f32939ec,c0a8dcc9,cab8c1a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32939c4 sleepq_timedwait_sig(cab8c1a4,0,f3293a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32939ec _cv_timedwait_sig(cab8c1a4,cab8c190,1389,677,f3293ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3293a34 seltdwait(f3293ac0,f3293ac8,c7dd5c80,ca970bc0,f3293aa0,...) at seltdwait+0x7e/frame 0xf3293a58 kern_select(ca970bc0,5,bfbfb478,0,0,...) at kern_select+0x85f/frame 0xf3293bf8 sys_select(ca970bc0,f3293cc8,f3293d08,1,1,...) at sys_select+0x69/frame 0xf3293c40 syscall(f3293d08) at syscall+0x2ed/frame 0xf3293cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3293cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2840d217, esp = 0xbfbfb36c, ebp = 0xbfbfbf98 --- Tracing command sshd pid 1172 tid 100099 td 0xcab785e0 sched_switch(cab785e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf324e918 mi_switch(104,0,c108fd1c,1f9,200046,...) at mi_switch+0x1c9/frame 0xf324e94c sleepq_switch(cab785e0,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf324e980 sleepq_catch_signals(f324e9ec,c0a8dcc9,cab8c020,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf324e9c8 sleepq_wait_sig(cab8c024,0,f324ea20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf324e9ec _cv_wait_sig(cab8c024,cab8c010,c1092a9c,677,5,...) at _cv_wait_sig+0x200/frame 0xf324ea34 seltdwait(caab7e70,58,c7dd5e80,cab785e0,c109a6b7,...) at seltdwait+0x8c/frame 0xf324ea58 kern_select(cab785e0,5,28c0c140,0,0,...) at kern_select+0x85f/frame 0xf324ebf8 sys_select(cab785e0,f324ecc8,f324ed08,1,1,...) at sys_select+0x69/frame 0xf324ec40 syscall(f324ed08) at syscall+0x2ed/frame 0xf324ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf324ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28515217, esp = 0xbfbfd47c, ebp = 0xbfbfde44 --- Tracing command moused pid 1140 tid 100094 td 0xcab795e0 sched_switch(cab795e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3238918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf323894c sleepq_switch(cab795e0,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3238980 sleepq_catch_signals(f32389ec,c0a8dcc9,ca95a660,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32389c8 sleepq_wait_sig(ca95a664,0,f3238a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32389ec _cv_wait_sig(ca95a664,ca95a650,c1092a9c,677,6,...) at _cv_wait_sig+0x200/frame 0xf3238a34 seltdwait(caad8930,58,c7dd4e80,cab795e0,0,...) at seltdwait+0x8c/frame 0xf3238a58 kern_select(cab795e0,400,bfbfdcb0,0,0,...) at kern_select+0x85f/frame 0xf3238bf8 sys_select(cab795e0,f3238cc8,f3238d08,1,1,...) at sys_select+0x69/frame 0xf3238c40 syscall(f3238d08) at syscall+0x2ed/frame 0xf3238cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3238cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b0217, esp = 0xbfbfd88c, ebp = 0xbfbfde24 --- Tracing command winbindd pid 1136 tid 100104 td 0xcab715e0 sched_switch(cab715e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3267984 mi_switch(104,0,c108fd1c,1f9,c1402100,...) at mi_switch+0x1c9/frame 0xf32679b8 sleepq_switch(cab715e0,0,c108fd1c,1ad,cab8c090,...) at sleepq_switch+0x1b9/frame 0xf32679ec sleepq_catch_signals(c11bd300,f3267a5c,c0a8dcc9,cab8c0a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3267a34 sleepq_timedwait_sig(cab8c0a4,0,f3267a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3267a5c _cv_timedwait_sig(cab8c0a4,cab8c090,5265c00,677,cab715e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3267aa4 seltdwait(f3267b10,f3267b18,5ac,cab715e0,cb168e20,...) at seltdwait+0x7e/frame 0xf3267ac8 sys_poll(cab715e0,f3267cc8,f3267d08,1,1,...) at sys_poll+0x3e5/frame 0xf3267c40 syscall(f3267d08) at syscall+0x2ed/frame 0xf3267cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3267cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192bbaf, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 1131 tid 100086 td 0xca9722f0 sched_switch(ca9722f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3215984 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf32159b8 sleepq_switch(ca9722f0,0,c108fd1c,1ad,ca95a510,...) at sleepq_switch+0x1b9/frame 0xf32159ec sleepq_catch_signals(c11bd300,f3215a5c,c0a8dcc9,ca95a520,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3215a34 sleepq_timedwait_sig(ca95a524,0,f3215a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3215a5c _cv_timedwait_sig(ca95a524,ca95a510,5265c00,677,ca9722f0,...) at _cv_timedwait_sig+0x20c/frame 0xf3215aa4 seltdwait(f3215b10,f3215b18,5ac,ca9722f0,caafee80,...) at seltdwait+0x7e/frame 0xf3215ac8 sys_poll(ca9722f0,f3215cc8,f3215d08,1,1,...) at sys_poll+0x3e5/frame 0xf3215c40 syscall(f3215d08) at syscall+0x2ed/frame 0xf3215cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3215cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b54baf, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 1122 tid 100093 td 0xcab585e0 sched_switch(cab585e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3232984 mi_switch(104,0,c108fd1c,1f9,c1401f00,...) at mi_switch+0x1c9/frame 0xf32329b8 sleepq_switch(cab585e0,0,c108fd1c,1ad,ca95a450,...) at sleepq_switch+0x1b9/frame 0xf32329ec sleepq_catch_signals(c11bd300,f3232a5c,c0a8dcc9,ca95a460,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3232a34 sleepq_timedwait_sig(ca95a464,0,f3232a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3232a5c _cv_timedwait_sig(ca95a464,ca95a450,493e1,677,cab585e0,...) at _cv_timedwait_sig+0x20c/frame 0xf3232aa4 seltdwait(f3232b10,f3232b18,5ac,cab585e0,caf882b8,...) at seltdwait+0x7e/frame 0xf3232ac8 sys_poll(cab585e0,f3232cc8,14,c108c75d,7b3,...) at sys_poll+0x3e5/frame 0xf3232c40 syscall(f3232d08) at syscall+0x2ed/frame 0xf3232cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3232cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192bbaf, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 1120 tid 100114 td 0xca9705e0 sched_switch(ca9705e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf329b984 mi_switch(104,0,c108fd1c,1f9,c1402000,...) at mi_switch+0x1c9/frame 0xf329b9b8 sleepq_switch(ca9705e0,0,c108fd1c,1ad,ca9bfc10,...) at sleepq_switch+0x1b9/frame 0xf329b9ec sleepq_catch_signals(c11bd300,f329ba5c,c0a8dcc9,ca9bfc20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf329ba34 sleepq_timedwait_sig(ca9bfc24,0,f329ba90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf329ba5c _cv_timedwait_sig(ca9bfc24,ca9bfc10,ea61,677,ca9705e0,...) at _cv_timedwait_sig+0x20c/frame 0xf329baa4 seltdwait(f329bb10,f329bb18,5ac,ca9705e0,0,...) at seltdwait+0x7e/frame 0xf329bac8 sys_poll(ca9705e0,f329bcc8,0,0,ca9705e0,...) at sys_poll+0x3e5/frame 0xf329bc40 syscall(f329bd08) at syscall+0x2ed/frame 0xf329bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf329bcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b54baf, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 1118 tid 100083 td 0xcaaeb2f0 sched_switch(caaeb2f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3209984 mi_switch(104,0,c108fd1c,1f9,c1401f00,...) at mi_switch+0x1c9/frame 0xf32099b8 sleepq_switch(caaeb2f0,0,c108fd1c,1ad,ca95b990,...) at sleepq_switch+0x1b9/frame 0xf32099ec sleepq_catch_signals(c11bd300,f3209a5c,c0a8dcc9,ca95b9a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3209a34 sleepq_timedwait_sig(ca95b9a4,0,f3209a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3209a5c _cv_timedwait_sig(ca95b9a4,ca95b990,2711,677,caaeb2f0,...) at _cv_timedwait_sig+0x20c/frame 0xf3209aa4 seltdwait(f3209b10,f3209b18,5ac,caaeb2f0,0,...) at seltdwait+0x7e/frame 0xf3209ac8 sys_poll(caaeb2f0,f3209cc8,f3209d08,1,1,...) at sys_poll+0x3e5/frame 0xf3209c40 syscall(f3209d08) at syscall+0x2ed/frame 0xf3209cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3209cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21556baf, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 1094 tid 100113 td 0xca9708d0 sched_switch(ca9708d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3297918 mi_switch(104,0,c108fd1c,1f9,200046,...) at mi_switch+0x1c9/frame 0xf329794c sleepq_switch(ca9708d0,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3297980 sleepq_catch_signals(f32979ec,c0a8dcc9,ca95a3a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32979c8 sleepq_wait_sig(ca95a3a4,0,f3297a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32979ec _cv_wait_sig(ca95a3a4,ca95a390,c1092a9c,677,1c,...) at _cv_wait_sig+0x200/frame 0xf3297a34 seltdwait(caab8540,58,c7dd4e80,ca9708d0,0,...) at seltdwait+0x8c/frame 0xf3297a58 kern_select(ca9708d0,1c,bfbfdd48,0,0,...) at kern_select+0x85f/frame 0xf3297bf8 sys_select(ca9708d0,f3297cc8,0,0,ca9708d0,...) at sys_select+0x69/frame 0xf3297c40 syscall(f3297d08) at syscall+0x2ed/frame 0xf3297cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3297cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28389217, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 1036 tid 100125 td 0xcaae68d0 sched_switch(caae68d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf330aa90 mi_switch(104,0,c108fd1c,1f9,c1402000,...) at mi_switch+0x1c9/frame 0xf330aac4 sleepq_switch(caae68d0,0,c108fd1c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf330aaf8 sleepq_catch_signals(c11bd300,f330ab68,c0a8dcc9,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf330ab40 sleepq_timedwait_sig(cab49990,0,f330ab9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf330ab68 _cv_timedwait_sig(cab49990,c9777a80,1388,3b1,3,...) at _cv_timedwait_sig+0x20c/frame 0xf330abb0 svc_run_internal(f330acf4,c0a7124f,c9777a80,f330ad08,c1083e68,...) at svc_run_internal+0xa30/frame 0xf330acc4 svc_thread_start(c9777a80,f330ad08,c1083e68,3d7,0,...) at svc_thread_start+0xd/frame 0xf330accc fork_exit(c0c9a780,c9777a80,f330ad08) at fork_exit+0x7f/frame 0xf330acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf330acf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100124 td 0xcaae6bc0 sched_switch(caae6bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3307a90 mi_switch(104,0,c108fd1c,1f9,c1401f00,...) at mi_switch+0x1c9/frame 0xf3307ac4 sleepq_switch(caae6bc0,0,c108fd1c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3307af8 sleepq_catch_signals(c11bd300,f3307b68,c0a8dcc9,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3307b40 sleepq_timedwait_sig(cab139d0,0,f3307b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3307b68 _cv_timedwait_sig(cab139d0,c9777a80,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3307bb0 svc_run_internal(f3307cf4,c0a7124f,c9777a80,f3307d08,c1083e68,...) at svc_run_internal+0xa30/frame 0xf3307cc4 svc_thread_start(c9777a80,f3307d08,c1083e68,3d7,0,...) at svc_thread_start+0xd/frame 0xf3307ccc fork_exit(c0c9a780,c9777a80,f3307d08) at fork_exit+0x7f/frame 0xf3307cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3307cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100123 td 0xcaae9000 sched_switch(caae9000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3304a90 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf3304ac4 sleepq_switch(caae9000,0,c108fd1c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3304af8 sleepq_catch_signals(c11bd300,f3304b68,c0a8dcc9,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3304b40 sleepq_timedwait_sig(cab13a50,0,f3304b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3304b68 _cv_timedwait_sig(cab13a50,c9777a80,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3304bb0 svc_run_internal(f3304cf4,c0a7124f,c9777a80,f3304d08,c1083e68,...) at svc_run_internal+0xa30/frame 0xf3304cc4 svc_thread_start(c9777a80,f3304d08,c1083e68,3d7,0,...) at svc_thread_start+0xd/frame 0xf3304ccc fork_exit(c0c9a780,c9777a80,f3304d08) at fork_exit+0x7f/frame 0xf3304cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3304cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100101 td 0xcab78000 sched_switch(cab78000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3256318 mi_switch(104,0,c108fd1c,1f9,c1401f00,...) at mi_switch+0x1c9/frame 0xf325634c sleepq_switch(cab78000,0,c108fd1c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3256380 sleepq_catch_signals(c11bd300,f32563f0,c0a8dcc9,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32563c8 sleepq_timedwait_sig(cb002390,0,f3256424,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32563f0 _cv_timedwait_sig(cb002390,c9777a80,1388,3b1,c7d8e340,...) at _cv_timedwait_sig+0x20c/frame 0xf3256438 svc_run_internal(c0c9a780,c9777a80,cab6d870,f3256578,0,...) at svc_run_internal+0xa30/frame 0xf3256550 svc_run(c9777a80,0,c1075f57,1b3,f32565d0,...) at svc_run+0xc6/frame 0xf3256588 nfsrvd_nfsd(cab78000,f32566e0,c,246,c1ba4048,...) at nfsrvd_nfsd+0x1a2/frame 0xf32566c0 nfssvc_nfsd(cab78000,f3256cc8,0,cab78000,f3256cfc,...) at nfssvc_nfsd+0xf4/frame 0xf3256c28 sys_nfssvc(cab78000,f3256cc8,f3256d08,1,1,...) at sys_nfssvc+0xbf/frame 0xf3256c40 syscall(f3256d08) at syscall+0x2ed/frame 0xf3256cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3256cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2ac7, esp = 0xbfbfd89c, ebp = 0xbfbfdb10 --- Tracing command nfsd pid 1033 tid 100080 td 0xcaaebbc0 sched_switch(caaebbc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf31fd918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf31fd94c sleepq_switch(caaebbc0,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf31fd980 sleepq_catch_signals(f31fd9ec,c0a8dcc9,caa32a60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf31fd9c8 sleepq_wait_sig(caa32a64,0,f31fda20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf31fd9ec _cv_wait_sig(caa32a64,caa32a50,c1092a9c,677,7,...) at _cv_wait_sig+0x200/frame 0xf31fda34 seltdwait(cab18118,58,c7dd4e80,caaebbc0,f31fda90,...) at seltdwait+0x8c/frame 0xf31fda58 kern_select(caaebbc0,7,bfbfdcf8,0,0,...) at kern_select+0x85f/frame 0xf31fdbf8 sys_select(caaebbc0,f31fdcc8,f31fdd08,1,1,...) at sys_select+0x69/frame 0xf31fdc40 syscall(f31fdd08) at syscall+0x2ed/frame 0xf31fdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf31fdcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817d217, esp = 0xbfbfdb14, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 1031 tid 100109 td 0xcab578d0 sched_switch(cab578d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3286914 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf3286948 sleepq_switch(cab578d0,0,c108fd1c,1ad,ca9bf750,...) at sleepq_switch+0x1b9/frame 0xf328697c sleepq_catch_signals(c11bd300,f32869ec,c0a8dcc9,ca9bf760,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32869c4 sleepq_timedwait_sig(ca9bf764,0,f3286a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32869ec _cv_timedwait_sig(ca9bf764,ca9bf750,7531,677,f3286ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3286a34 seltdwait(f3286ac0,f3286ac8,c7dd4e80,cab578d0,f3286a90,...) at seltdwait+0x7e/frame 0xf3286a58 kern_select(cab578d0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3286bf8 sys_select(cab578d0,f3286cc8,f3286d08,1,1,...) at sys_select+0x69/frame 0xf3286c40 syscall(f3286d08) at syscall+0x2ed/frame 0xf3286cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3286cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1030 tid 100115 td 0xca9702f0 sched_switch(ca9702f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf32a1914 mi_switch(104,0,c108fd1c,1f9,c1401f00,...) at mi_switch+0x1c9/frame 0xf32a1948 sleepq_switch(ca9702f0,0,c108fd1c,1ad,ca95b010,...) at sleepq_switch+0x1b9/frame 0xf32a197c sleepq_catch_signals(c11bd300,f32a19ec,c0a8dcc9,ca95b020,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32a19c4 sleepq_timedwait_sig(ca95b024,0,f32a1a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32a19ec _cv_timedwait_sig(ca95b024,ca95b010,7531,677,f32a1ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf32a1a34 seltdwait(f32a1ac0,f32a1ac8,c7dd4e80,ca9702f0,f32a1a90,...) at seltdwait+0x7e/frame 0xf32a1a58 kern_select(ca9702f0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf32a1bf8 sys_select(ca9702f0,f32a1cc8,f32a1d08,1,1,...) at sys_select+0x69/frame 0xf32a1c40 syscall(f32a1d08) at syscall+0x2ed/frame 0xf32a1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32a1cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1029 tid 100119 td 0xc98885e0 sched_switch(c98885e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf32af914 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf32af948 sleepq_switch(c98885e0,0,c108fd1c,1ad,cab8cd50,...) at sleepq_switch+0x1b9/frame 0xf32af97c sleepq_catch_signals(c11bd300,f32af9ec,c0a8dcc9,cab8cd60,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32af9c4 sleepq_timedwait_sig(cab8cd64,0,f32afa20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32af9ec _cv_timedwait_sig(cab8cd64,cab8cd50,7531,677,f32afac0,...) at _cv_timedwait_sig+0x20c/frame 0xf32afa34 seltdwait(f32afac0,f32afac8,c7dd4e80,c98885e0,f32afa90,...) at seltdwait+0x7e/frame 0xf32afa58 kern_select(c98885e0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf32afbf8 sys_select(c98885e0,f32afcc8,f32afd08,1,1,...) at sys_select+0x69/frame 0xf32afc40 syscall(f32afd08) at syscall+0x2ed/frame 0xf32afcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32afcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1028 tid 100096 td 0xcab79000 sched_switch(cab79000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3241914 mi_switch(104,0,c108fd1c,1f9,c1402100,...) at mi_switch+0x1c9/frame 0xf3241948 sleepq_switch(cab79000,0,c108fd1c,1ad,caa32a90,...) at sleepq_switch+0x1b9/frame 0xf324197c sleepq_catch_signals(c11bd300,f32419ec,c0a8dcc9,caa32aa0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32419c4 sleepq_timedwait_sig(caa32aa4,0,f3241a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32419ec _cv_timedwait_sig(caa32aa4,caa32a90,7531,677,f3241ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3241a34 seltdwait(f3241ac0,f3241ac8,c7dd4e80,cab79000,f3241a90,...) at seltdwait+0x7e/frame 0xf3241a58 kern_select(cab79000,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3241bf8 sys_select(cab79000,f3241cc8,f3241d08,1,1,...) at sys_select+0x69/frame 0xf3241c40 syscall(f3241d08) at syscall+0x2ed/frame 0xf3241cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3241cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1027 tid 100087 td 0xcaae98d0 sched_switch(caae98d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf321aab4 mi_switch(104,0,c108fd1c,1f9,c108fd1c,...) at mi_switch+0x1c9/frame 0xf321aae8 sleepq_switch(caae98d0,0,c108fd1c,1ad,f321ab60,...) at sleepq_switch+0x1b9/frame 0xf321ab1c sleepq_catch_signals(0,c108fd1c,166,9c0,caae98d0,...) at sleepq_catch_signals+0x3b1/frame 0xf321ab64 sleepq_wait_sig(ca96e8c8,74,c0f07be0,100,0,...) at sleepq_wait_sig+0x14/frame 0xf321ab88 _sleep(ca96e8c8,ca96e8f8,174,c0f07be0,0,...) at _sleep+0x32d/frame 0xf321abe0 kern_sigsuspend(caae98d0,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf321ac10 sys_sigsuspend(caae98d0,f321acc8,f321ad08,1,1,...) at sys_sigsuspend+0x58/frame 0xf321ac40 syscall(f321ad08) at syscall+0x2ed/frame 0xf321acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf321acfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c0497, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command mountd pid 1011 tid 100085 td 0xcaae9bc0 sched_switch(caae9bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3211918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf321194c sleepq_switch(caae9bc0,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3211980 sleepq_catch_signals(f32119ec,c0a8dcc9,caa32ae0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32119c8 sleepq_wait_sig(caa32ae4,0,f3211a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32119ec _cv_wait_sig(caa32ae4,caa32ad0,c1092a9c,677,9,...) at _cv_wait_sig+0x200/frame 0xf3211a34 seltdwait(caad8e38,58,c7dd4e80,caae9bc0,c109a6b7,...) at seltdwait+0x8c/frame 0xf3211a58 kern_select(caae9bc0,9,bfbfdd50,0,0,...) at kern_select+0x85f/frame 0xf3211bf8 sys_select(caae9bc0,f3211cc8,f3211d08,1,1,...) at sys_select+0x69/frame 0xf3211c40 syscall(f3211d08) at syscall+0x2ed/frame 0xf3211cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3211cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28193217, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command rpcbind pid 978 tid 100081 td 0xcaaeb8d0 sched_switch(caaeb8d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf3201984 mi_switch(104,0,c108fd1c,1f9,c1401e00,...) at mi_switch+0x1c9/frame 0xf32019b8 sleepq_switch(caaeb8d0,0,c108fd1c,1ad,ca9bf790,...) at sleepq_switch+0x1b9/frame 0xf32019ec sleepq_catch_signals(c11bd300,f3201a5c,c0a8dcc9,ca9bf7a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3201a34 sleepq_timedwait_sig(ca9bf7a4,0,f3201a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3201a5c _cv_timedwait_sig(ca9bf7a4,ca9bf790,7531,677,caaeb8d0,...) at _cv_timedwait_sig+0x20c/frame 0xf3201aa4 seltdwait(f3201b10,f3201b18,5ac,caaeb8d0,a3a,...) at seltdwait+0x7e/frame 0xf3201ac8 sys_poll(caaeb8d0,f3201cc8,f3201d08,1,1,...) at sys_poll+0x3e5/frame 0xf3201c40 syscall(f3201d08) at syscall+0x2ed/frame 0xf3201cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3201cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28132baf, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 963 tid 100084 td 0xcaaeb000 sched_switch(caaeb000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf320d918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf320d94c sleepq_switch(caaeb000,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf320d980 sleepq_catch_signals(f320d9ec,c0a8dcc9,caa32b20,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf320d9c8 sleepq_wait_sig(caa32b24,0,f320da20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf320d9ec _cv_wait_sig(caa32b24,caa32b10,c1092a9c,677,9,...) at _cv_wait_sig+0x200/frame 0xf320da34 seltdwait(caab7ce8,58,c7dd4e80,caaeb000,0,...) at seltdwait+0x8c/frame 0xf320da58 kern_select(caaeb000,9,28849100,0,0,...) at kern_select+0x85f/frame 0xf320dbf8 sys_select(caaeb000,f320dcc8,0,0,caaeb000,...) at sys_select+0x69/frame 0xf320dc40 syscall(f320dd08) at syscall+0x2ed/frame 0xf320dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf320dcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192217, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 840 tid 100107 td 0xcab58000 sched_switch(cab58000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xf327e918 mi_switch(104,0,c108fd1c,1f9,46,...) at mi_switch+0x1c9/frame 0xf327e94c sleepq_switch(cab58000,0,c108fd1c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf327e980 sleepq_catch_signals(f327e9ec,c0a8dcc9,cab8d3e0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf327e9c8 sleepq_wait_sig(cab8d3e4,0,f327ea20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf327e9ec _cv_wait_sig(cab8d3e4,cab8d3d0,c1092a9c,677,5,...) at _cv_wait_sig+0x200/frame 0xf327ea34 seltdwait(cab07af0,58,c7dd4e80,cab58000,ca68ecb8,...) at seltdwait+0x8c/frame 0xf327ea58 kern_select(cab58000,5,bfbfd998,0,0,...) at kern_select+0x85f/frame 0xf327ebf8 sys_select(cab58000,f327ecc8,f327ed08,1,1,...) at sys_select+0x69/frame 0xf327ec40 syscall(f327ed08) at syscall+0x2ed/frame 0xf327ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf327ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x808c2a3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 19 tid 100078 td 0xca9728d0 sched_switch(ca9728d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee1dbb8 mi_switch(104,0,c108fd1c,1f9,3,...) at mi_switch+0x1c9/frame 0xeee1dbec sleepq_switch(ca9728d0,0,c108fd1c,292,ca9728d0,...) at sleepq_switch+0x1b9/frame 0xeee1dc20 sleepq_timedwait(c13b4728,54,c10c1878,0,0,...) at sleepq_timedwait+0x48/frame 0xeee1dc44 _sleep(c13b4728,c13b46b4,54,c10c1878,3e8,...) at _sleep+0x317/frame 0xeee1dc9c softdep_flush(0,eee1dd08,c1083e68,3d7,0,...) at softdep_flush+0x23e/frame 0xeee1dccc fork_exit(c0cf9d90,0,eee1dd08) at fork_exit+0x7f/frame 0xeee1dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee1dcf4 --- trap 0, eip = 0, esp = 0xeee1dd40, ebp = 0 --- Tracing command syncer pid 18 tid 100077 td 0xca972bc0 sched_switch(ca972bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee1a6f0 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xeee1a724 sleepq_switch(ca972bc0,0,c108fd1c,26f,0,...) at sleepq_switch+0x1b9/frame 0xeee1a758 sleepq_wait(cb17e61c,60,c10beb40,4,0,...) at sleepq_wait+0x48/frame 0xeee1a77c sleeplk(cbc37a9c,c10beb40,60,33,0,...) at sleeplk+0x11e/frame 0xeee1a7b8 __lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,0,c10be73e,8fc,cbc37a9c,cbc37a9c,80900,cb17e61c,80900,8fc,8fc,c10be73e,0,0,0,cbc37a9c,80900,cb17e61c) at __lockmgr_args+0xa44/frame 0xeee1a894 _lockmgr_args(cb17e61c,80900,cbc37a9c,0,0,...) at _lockmgr_args+0xb8/frame 0xeee1a900 ffs_copyonwrite(cbc379d8,e1d01d40,ca972bc0,e1d01d40,4,...) at ffs_copyonwrite+0x586/frame 0xeee1aac0 ffs_geom_strategy(cbc37ad0,e1d01d40,39f,f33,c1097a6c,...) at ffs_geom_strategy+0xbf/frame 0xeee1aadc bufwrite(e1d01d40,0,c10c1c01,817,4140) at bufwrite+0x161/frame 0xeee1ab0c ffs_bufwrite(e1d01d40,e2144000,1000,1000,0,...) at ffs_bufwrite+0x13b/frame 0xeee1ab30 ffs_sbupdate(cbeedc00,3,0,5ad,eee1abb8,...) at ffs_sbupdate+0x1e8/frame 0xeee1ab78 ffs_sync(caa95bb0,3,2,e6c,0,...) at ffs_sync+0x585/frame 0xeee1ac00 sync_fsync(eee1aca8,c10e5758,c109a6b7,6f5,c13b052c,...) at sync_fsync+0x146/frame 0xeee1ac2c VOP_FSYNC_APV(c11c7d58,eee1aca8,c109a6b7,6f5,4e20,...) at VOP_FSYNC_APV+0x103/frame 0xeee1ac58 sched_sync(0,eee1ad08,c1083e68,3d7,0,...) at sched_sync+0x35f/frame 0xeee1accc fork_exit(c0b47020,0,eee1ad08) at fork_exit+0x7f/frame 0xeee1acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee1acf4 --- trap 0, eip = 0, esp = 0xeee1ad40, ebp = 0 --- Tracing command vnlru pid 17 tid 100076 td 0xc97578d0 sched_switch(c97578d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee17b8c mi_switch(104,0,c108fd1c,1f9,2,...) at mi_switch+0x1c9/frame 0xeee17bc0 sleepq_switch(c97578d0,0,c108fd1c,292,c97578d0,...) at sleepq_switch+0x1b9/frame 0xeee17bf4 sleepq_timedwait(ca96d5a0,60,c109ba2d,0,0,...) at sleepq_timedwait+0x48/frame 0xeee17c18 _sleep(ca96d5a0,c13b0508,260,c109ba2d,3e8,...) at _sleep+0x317/frame 0xeee17c70 vnlru_proc(0,eee17d08,c1083e68,3d7,0,...) at vnlru_proc+0x95/frame 0xeee17ccc fork_exit(c0b47810,0,eee17d08) at fork_exit+0x7f/frame 0xeee17cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee17cf4 --- trap 0, eip = 0, esp = 0xeee17d40, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xc9757bc0 sched_switch(c9757bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee14bc8 mi_switch(104,0,c108fd1c,1f9,0,...) at mi_switch+0x1c9/frame 0xeee14bfc sleepq_switch(c9757bc0,0,c108fd1c,292,c9757bc0,...) at sleepq_switch+0x1b9/frame 0xeee14c30 sleepq_timedwait(c13b02e8,54,c1098652,0,0,...) at sleepq_timedwait+0x48/frame 0xeee14c54 _sleep(c13b02e8,c13b02d0,54,c1098652,3e8,...) at _sleep+0x317/frame 0xeee14cac buf_daemon(0,eee14d08,c1083e68,3d7,0,...) at buf_daemon+0x8c/frame 0xeee14ccc fork_exit(c0b2add0,0,eee14d08) at fork_exit+0x7f/frame 0xeee14cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee14cf4 --- trap 0, eip = 0, esp = 0xeee14d40, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xc9886000 sched_switch(c9886000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee11bc0 mi_switch(104,0,c108fd1c,1f9,1,...) at mi_switch+0x1c9/frame 0xeee11bf4 sleepq_switch(c9886000,0,c108fd1c,292,c9886000,...) at sleepq_switch+0x1b9/frame 0xeee11c28 sleepq_timedwait(c13b514c,0,c10c87b0,0,0,...) at sleepq_timedwait+0x48/frame 0xeee11c4c _sleep(c13b514c,c1408b00,0,c10c87b0,493e0,...) at _sleep+0x317/frame 0xeee11ca4 vm_pagezero(0,eee11d08,c1083e68,3d7,0,...) at vm_pagezero+0x89/frame 0xeee11ccc fork_exit(c0d3fae0,0,eee11d08) at fork_exit+0x7f/frame 0xeee11cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee11cf4 --- trap 0, eip = 0, esp = 0xeee11d40, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xc98862f0 sched_switch(c98862f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee0eb8c mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xeee0ebc0 sleepq_switch(c98862f0,0,c108fd1c,26f,c98862f0,...) at sleepq_switch+0x1b9/frame 0xeee0ebf4 sleepq_wait(c13b4d18,74,c1098652,0,0,...) at sleepq_wait+0x48/frame 0xeee0ec18 _sleep(c13b4d18,c13b4d00,74,c1098652,0,...) at _sleep+0x34e/frame 0xeee0ec70 vm_daemon(0,eee0ed08,c1083e68,3d7,0,...) at vm_daemon+0x8c/frame 0xeee0eccc fork_exit(c0d38c30,0,eee0ed08) at fork_exit+0x7f/frame 0xeee0ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee0ecf4 --- trap 0, eip = 0, esp = 0xeee0ed40, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xc98865e0 sched_switch(c98865e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeee0bb3c mi_switch(104,0,c108fd1c,1f9,1,...) at mi_switch+0x1c9/frame 0xeee0bb70 sleepq_switch(c98865e0,0,c108fd1c,292,c98865e0,...) at sleepq_switch+0x1b9/frame 0xeee0bba4 sleepq_timedwait(c1408b84,54,c1098652,0,0,...) at sleepq_timedwait+0x48/frame 0xeee0bbc8 _sleep(c1408b84,c1408b00,54,c1098652,1388,...) at _sleep+0x317/frame 0xeee0bc20 vm_pageout(0,eee0bd08,c1083e68,3d7,0,...) at vm_pageout+0x256/frame 0xeee0bccc fork_exit(c0d39490,0,eee0bd08) at fork_exit+0x7f/frame 0xeee0bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee0bcf4 --- trap 0, eip = 0, esp = 0xeee0bd40, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xc98868d0 sched_switch(c98868d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec88bc4 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xeec88bf8 sleepq_switch(c98868d0,0,c108fd1c,26f,c98868d0,...) at sleepq_switch+0x1b9/frame 0xeec88c2c sleepq_wait(c1201c24,5c,c0edb220,0,0,...) at sleepq_wait+0x48/frame 0xeec88c50 _sleep(c1201c24,c1201c68,5c,c0edb220,0,...) at _sleep+0x34e/frame 0xeec88ca8 xpt_scanner_thread(0,eec88d08,c1083e68,3d7,0,...) at xpt_scanner_thread+0xfc/frame 0xeec88ccc fork_exit(c04b2ad0,0,eec88d08) at fork_exit+0x7f/frame 0xeec88cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec88cf4 --- trap 0, eip = 0, esp = 0xeec88d40, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xc9886bc0 sched_switch(c9886bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec85bcc mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xeec85c00 sleepq_switch(c9886bc0,0,c108fd1c,26f,c9886bc0,...) at sleepq_switch+0x1b9/frame 0xeec85c34 sleepq_wait(c140487c,0,c10aebc5,0,0,...) at sleepq_wait+0x48/frame 0xeec85c58 _sleep(c140487c,c1404844,0,c10aebc5,0,...) at _sleep+0x34e/frame 0xeec85cb0 sctp_iterator_thread(0,eec85d08,c1083e68,3d7,0,...) at sctp_iterator_thread+0x5c/frame 0xeec85ccc fork_exit(c0be25a0,0,eec85d08) at fork_exit+0x7f/frame 0xeec85cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec85cf4 --- trap 0, eip = 0, esp = 0xeec85d40, ebp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xc9887bc0 sched_switch(c9887bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec75b50 mi_switch(104,0,c108fd1c,1f9,2,...) at mi_switch+0x1c9/frame 0xeec75b84 sleepq_switch(c9887bc0,0,c108fd1c,292,c9887bc0,...) at sleepq_switch+0x1b9/frame 0xeec75bb8 sleepq_timedwait(c96f083c,5c,c107694a,0,0,...) at sleepq_timedwait+0x48/frame 0xeec75bdc _sleep(c96f083c,c96f08f0,5c,c107694a,3e8,...) at _sleep+0x317/frame 0xeec75c34 fdc_thread(c96f0800,eec75d08,c1083e68,3d7,0,...) at fdc_thread+0x74a/frame 0xeec75ccc fork_exit(c0e496f0,c96f0800,eec75d08) at fork_exit+0x7f/frame 0xeec75cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec75cf4 --- trap 0, eip = 0, esp = 0xeec75d40, ebp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xc97462f0 sched_switch(c97462f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec656b4 mi_switch(104,0,c108fd1c,1f9,c108fd1c,...) at mi_switch+0x1c9/frame 0xeec656e8 sleepq_switch(c97462f0,0,c108fd1c,1ad,eec65760,...) at sleepq_switch+0x1b9/frame 0xeec6571c sleepq_catch_signals(0,c108fd1c,166,780,c97462f0,...) at sleepq_catch_signals+0x3b1/frame 0xeec65764 sleepq_wait_sig(c9785000,6c,c107694a,100,0,...) at sleepq_wait_sig+0x14/frame 0xeec65788 _sleep(c9785000,c9789488,16c,c107694a,0,...) at _sleep+0x32d/frame 0xeec657e0 fw_bus_probe_thread(c9785000,eec65d08,c1083e68,3d7,0,...) at fw_bus_probe_thread+0x88/frame 0xeec65ccc fork_exit(c07070f0,c9785000,eec65d08) at fork_exit+0x7f/frame 0xeec65cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec65cf4 --- trap 0, eip = 0, esp = 0xeec65d40, ebp = 0 --- Tracing command usb pid 15 tid 100059 td 0xc9754000 sched_switch(c9754000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec44bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec44c08 sleepq_switch(c9754000,0,c108fd1c,26f,c9754000,...) at sleepq_switch+0x1b9/frame 0xeec44c3c sleepq_wait(c975dd34,0,eec44c90,1,0,...) at sleepq_wait+0x48/frame 0xeec44c60 _cv_wait(c975dd34,c975de4c,c10681cb,73,c975dd3c,...) at _cv_wait+0x1f9/frame 0xeec44ca4 usb_process(c975dd2c,eec44d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec44ccc fork_exit(c0957a80,c975dd2c,eec44d08) at fork_exit+0x7f/frame 0xeec44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec44cf4 --- trap 0, eip = 0, esp = 0xeec44d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc97542f0 sched_switch(c97542f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec41bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec41c08 sleepq_switch(c97542f0,0,c108fd1c,26f,c97542f0,...) at sleepq_switch+0x1b9/frame 0xeec41c3c sleepq_wait(c975dd04,0,eec41c90,1,0,...) at sleepq_wait+0x48/frame 0xeec41c60 _cv_wait(c975dd04,c975de4c,c10681cb,73,c975dd0c,...) at _cv_wait+0x1f9/frame 0xeec41ca4 usb_process(c975dcfc,eec41d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec41ccc fork_exit(c0957a80,c975dcfc,eec41d08) at fork_exit+0x7f/frame 0xeec41cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec41cf4 --- trap 0, eip = 0, esp = 0xeec41d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc97545e0 sched_switch(c97545e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec3ebd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec3ec08 sleepq_switch(c97545e0,0,c108fd1c,26f,c97545e0,...) at sleepq_switch+0x1b9/frame 0xeec3ec3c sleepq_wait(c975dcd4,0,eec3ec90,1,0,...) at sleepq_wait+0x48/frame 0xeec3ec60 _cv_wait(c975dcd4,c975de4c,c10681cb,73,c975dcdc,...) at _cv_wait+0x1f9/frame 0xeec3eca4 usb_process(c975dccc,eec3ed08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec3eccc fork_exit(c0957a80,c975dccc,eec3ed08) at fork_exit+0x7f/frame 0xeec3ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec3ecf4 --- trap 0, eip = 0, esp = 0xeec3ed40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc97548d0 sched_switch(c97548d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec3bbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec3bc08 sleepq_switch(c97548d0,0,c108fd1c,26f,c97548d0,...) at sleepq_switch+0x1b9/frame 0xeec3bc3c sleepq_wait(c975dca4,0,eec3bc90,1,0,...) at sleepq_wait+0x48/frame 0xeec3bc60 _cv_wait(c975dca4,c975de4c,c10681cb,73,c975dcac,...) at _cv_wait+0x1f9/frame 0xeec3bca4 usb_process(c975dc9c,eec3bd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec3bccc fork_exit(c0957a80,c975dc9c,eec3bd08) at fork_exit+0x7f/frame 0xeec3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec3bcf4 --- trap 0, eip = 0, esp = 0xeec3bd40, ebp = 0 --- Tracing command usb pid 15 tid 100054 td 0xc9757000 sched_switch(c9757000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec32bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec32c08 sleepq_switch(c9757000,0,c108fd1c,26f,c9757000,...) at sleepq_switch+0x1b9/frame 0xeec32c3c sleepq_wait(c9750b5c,0,eec32c90,1,0,...) at sleepq_wait+0x48/frame 0xeec32c60 _cv_wait(c9750b5c,c9750c74,c10681cb,73,c9750b64,...) at _cv_wait+0x1f9/frame 0xeec32ca4 usb_process(c9750b54,eec32d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec32ccc fork_exit(c0957a80,c9750b54,eec32d08) at fork_exit+0x7f/frame 0xeec32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec32cf4 --- trap 0, eip = 0, esp = 0xeec32d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc97572f0 sched_switch(c97572f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec2fbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec2fc08 sleepq_switch(c97572f0,0,c108fd1c,26f,c97572f0,...) at sleepq_switch+0x1b9/frame 0xeec2fc3c sleepq_wait(c9750b2c,0,eec2fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec2fc60 _cv_wait(c9750b2c,c9750c74,c10681cb,73,c9750b34,...) at _cv_wait+0x1f9/frame 0xeec2fca4 usb_process(c9750b24,eec2fd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec2fccc fork_exit(c0957a80,c9750b24,eec2fd08) at fork_exit+0x7f/frame 0xeec2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec2fcf4 --- trap 0, eip = 0, esp = 0xeec2fd40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc97575e0 sched_switch(c97575e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec2cbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec2cc08 sleepq_switch(c97575e0,0,c108fd1c,26f,c97575e0,...) at sleepq_switch+0x1b9/frame 0xeec2cc3c sleepq_wait(c9750afc,0,eec2cc90,1,0,...) at sleepq_wait+0x48/frame 0xeec2cc60 _cv_wait(c9750afc,c9750c74,c10681cb,73,c9750b04,...) at _cv_wait+0x1f9/frame 0xeec2cca4 usb_process(c9750af4,eec2cd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec2cccc fork_exit(c0957a80,c9750af4,eec2cd08) at fork_exit+0x7f/frame 0xeec2ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec2ccf4 --- trap 0, eip = 0, esp = 0xeec2cd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc9742000 sched_switch(c9742000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec29bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec29c08 sleepq_switch(c9742000,0,c108fd1c,26f,c9742000,...) at sleepq_switch+0x1b9/frame 0xeec29c3c sleepq_wait(c9750acc,0,eec29c90,1,0,...) at sleepq_wait+0x48/frame 0xeec29c60 _cv_wait(c9750acc,c9750c74,c10681cb,73,c9750ad4,...) at _cv_wait+0x1f9/frame 0xeec29ca4 usb_process(c9750ac4,eec29d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec29ccc fork_exit(c0957a80,c9750ac4,eec29d08) at fork_exit+0x7f/frame 0xeec29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec29cf4 --- trap 0, eip = 0, esp = 0xeec29d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc97422f0 sched_switch(c97422f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec25bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec25c08 sleepq_switch(c97422f0,0,c108fd1c,26f,c97422f0,...) at sleepq_switch+0x1b9/frame 0xeec25c3c sleepq_wait(c974cb5c,0,eec25c90,1,0,...) at sleepq_wait+0x48/frame 0xeec25c60 _cv_wait(c974cb5c,c974cc74,c10681cb,73,c974cb64,...) at _cv_wait+0x1f9/frame 0xeec25ca4 usb_process(c974cb54,eec25d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec25ccc fork_exit(c0957a80,c974cb54,eec25d08) at fork_exit+0x7f/frame 0xeec25cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec25cf4 --- trap 0, eip = 0, esp = 0xeec25d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc97425e0 sched_switch(c97425e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec22bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec22c08 sleepq_switch(c97425e0,0,c108fd1c,26f,c97425e0,...) at sleepq_switch+0x1b9/frame 0xeec22c3c sleepq_wait(c974cb2c,0,eec22c90,1,0,...) at sleepq_wait+0x48/frame 0xeec22c60 _cv_wait(c974cb2c,c974cc74,c10681cb,73,c974cb34,...) at _cv_wait+0x1f9/frame 0xeec22ca4 usb_process(c974cb24,eec22d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec22ccc fork_exit(c0957a80,c974cb24,eec22d08) at fork_exit+0x7f/frame 0xeec22cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec22cf4 --- trap 0, eip = 0, esp = 0xeec22d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc97428d0 sched_switch(c97428d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec1fbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec1fc08 sleepq_switch(c97428d0,0,c108fd1c,26f,c97428d0,...) at sleepq_switch+0x1b9/frame 0xeec1fc3c sleepq_wait(c974cafc,0,eec1fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec1fc60 _cv_wait(c974cafc,c974cc74,c10681cb,73,c974cb04,...) at _cv_wait+0x1f9/frame 0xeec1fca4 usb_process(c974caf4,eec1fd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec1fccc fork_exit(c0957a80,c974caf4,eec1fd08) at fork_exit+0x7f/frame 0xeec1fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec1fcf4 --- trap 0, eip = 0, esp = 0xeec1fd40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc9742bc0 sched_switch(c9742bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec1cbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec1cc08 sleepq_switch(c9742bc0,0,c108fd1c,26f,c9742bc0,...) at sleepq_switch+0x1b9/frame 0xeec1cc3c sleepq_wait(c974cacc,0,eec1cc90,1,0,...) at sleepq_wait+0x48/frame 0xeec1cc60 _cv_wait(c974cacc,c974cc74,c10681cb,73,c974cad4,...) at _cv_wait+0x1f9/frame 0xeec1cca4 usb_process(c974cac4,eec1cd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec1cccc fork_exit(c0957a80,c974cac4,eec1cd08) at fork_exit+0x7f/frame 0xeec1ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec1ccf4 --- trap 0, eip = 0, esp = 0xeec1cd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc9743000 sched_switch(c9743000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec18bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec18c08 sleepq_switch(c9743000,0,c108fd1c,26f,c9743000,...) at sleepq_switch+0x1b9/frame 0xeec18c3c sleepq_wait(c9747b5c,0,eec18c90,1,0,...) at sleepq_wait+0x48/frame 0xeec18c60 _cv_wait(c9747b5c,c9747c74,c10681cb,73,c9747b64,...) at _cv_wait+0x1f9/frame 0xeec18ca4 usb_process(c9747b54,eec18d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec18ccc fork_exit(c0957a80,c9747b54,eec18d08) at fork_exit+0x7f/frame 0xeec18cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec18cf4 --- trap 0, eip = 0, esp = 0xeec18d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc97432f0 sched_switch(c97432f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec15bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec15c08 sleepq_switch(c97432f0,0,c108fd1c,26f,c97432f0,...) at sleepq_switch+0x1b9/frame 0xeec15c3c sleepq_wait(c9747b2c,0,eec15c90,1,0,...) at sleepq_wait+0x48/frame 0xeec15c60 _cv_wait(c9747b2c,c9747c74,c10681cb,73,c9747b34,...) at _cv_wait+0x1f9/frame 0xeec15ca4 usb_process(c9747b24,eec15d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec15ccc fork_exit(c0957a80,c9747b24,eec15d08) at fork_exit+0x7f/frame 0xeec15cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec15cf4 --- trap 0, eip = 0, esp = 0xeec15d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc97435e0 sched_switch(c97435e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec12bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec12c08 sleepq_switch(c97435e0,0,c108fd1c,26f,c97435e0,...) at sleepq_switch+0x1b9/frame 0xeec12c3c sleepq_wait(c9747afc,0,eec12c90,1,0,...) at sleepq_wait+0x48/frame 0xeec12c60 _cv_wait(c9747afc,c9747c74,c10681cb,73,c9747b04,...) at _cv_wait+0x1f9/frame 0xeec12ca4 usb_process(c9747af4,eec12d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec12ccc fork_exit(c0957a80,c9747af4,eec12d08) at fork_exit+0x7f/frame 0xeec12cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec12cf4 --- trap 0, eip = 0, esp = 0xeec12d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc97438d0 sched_switch(c97438d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec0fbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec0fc08 sleepq_switch(c97438d0,0,c108fd1c,26f,c97438d0,...) at sleepq_switch+0x1b9/frame 0xeec0fc3c sleepq_wait(c9747acc,0,eec0fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec0fc60 _cv_wait(c9747acc,c9747c74,c10681cb,73,c9747ad4,...) at _cv_wait+0x1f9/frame 0xeec0fca4 usb_process(c9747ac4,eec0fd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec0fccc fork_exit(c0957a80,c9747ac4,eec0fd08) at fork_exit+0x7f/frame 0xeec0fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec0fcf4 --- trap 0, eip = 0, esp = 0xeec0fd40, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xc9746000 sched_switch(c9746000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec08bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec08c08 sleepq_switch(c9746000,0,c108fd1c,26f,c9746000,...) at sleepq_switch+0x1b9/frame 0xeec08c3c sleepq_wait(c973eb5c,0,eec08c90,1,0,...) at sleepq_wait+0x48/frame 0xeec08c60 _cv_wait(c973eb5c,c973ec74,c10681cb,73,c973eb64,...) at _cv_wait+0x1f9/frame 0xeec08ca4 usb_process(c973eb54,eec08d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec08ccc fork_exit(c0957a80,c973eb54,eec08d08) at fork_exit+0x7f/frame 0xeec08cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec08cf4 --- trap 0, eip = 0, esp = 0xeec08d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc9719000 sched_switch(c9719000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec05bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec05c08 sleepq_switch(c9719000,0,c108fd1c,26f,c9719000,...) at sleepq_switch+0x1b9/frame 0xeec05c3c sleepq_wait(c973eb2c,0,eec05c90,1,0,...) at sleepq_wait+0x48/frame 0xeec05c60 _cv_wait(c973eb2c,c973ec74,c10681cb,73,c973eb34,...) at _cv_wait+0x1f9/frame 0xeec05ca4 usb_process(c973eb24,eec05d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec05ccc fork_exit(c0957a80,c973eb24,eec05d08) at fork_exit+0x7f/frame 0xeec05cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec05cf4 --- trap 0, eip = 0, esp = 0xeec05d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc97192f0 sched_switch(c97192f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec02bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec02c08 sleepq_switch(c97192f0,0,c108fd1c,26f,c97192f0,...) at sleepq_switch+0x1b9/frame 0xeec02c3c sleepq_wait(c973eafc,0,eec02c90,1,0,...) at sleepq_wait+0x48/frame 0xeec02c60 _cv_wait(c973eafc,c973ec74,c10681cb,73,c973eb04,...) at _cv_wait+0x1f9/frame 0xeec02ca4 usb_process(c973eaf4,eec02d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeec02ccc fork_exit(c0957a80,c973eaf4,eec02d08) at fork_exit+0x7f/frame 0xeec02cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec02cf4 --- trap 0, eip = 0, esp = 0xeec02d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc97195e0 sched_switch(c97195e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeebffbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebffc08 sleepq_switch(c97195e0,0,c108fd1c,26f,c97195e0,...) at sleepq_switch+0x1b9/frame 0xeebffc3c sleepq_wait(c973eacc,0,eebffc90,1,0,...) at sleepq_wait+0x48/frame 0xeebffc60 _cv_wait(c973eacc,c973ec74,c10681cb,73,c973ead4,...) at _cv_wait+0x1f9/frame 0xeebffca4 usb_process(c973eac4,eebffd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeebffccc fork_exit(c0957a80,c973eac4,eebffd08) at fork_exit+0x7f/frame 0xeebffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebffcf4 --- trap 0, eip = 0, esp = 0xeebffd40, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xc9719bc0 sched_switch(c9719bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeebf8bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf8c08 sleepq_switch(c9719bc0,0,c108fd1c,26f,c9719bc0,...) at sleepq_switch+0x1b9/frame 0xeebf8c3c sleepq_wait(c9735b5c,0,eebf8c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf8c60 _cv_wait(c9735b5c,c9735c74,c10681cb,73,c9735b64,...) at _cv_wait+0x1f9/frame 0xeebf8ca4 usb_process(c9735b54,eebf8d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeebf8ccc fork_exit(c0957a80,c9735b54,eebf8d08) at fork_exit+0x7f/frame 0xeebf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf8cf4 --- trap 0, eip = 0, esp = 0xeebf8d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc971b000 sched_switch(c971b000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeebf5bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf5c08 sleepq_switch(c971b000,0,c108fd1c,26f,c971b000,...) at sleepq_switch+0x1b9/frame 0xeebf5c3c sleepq_wait(c9735b2c,0,eebf5c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf5c60 _cv_wait(c9735b2c,c9735c74,c10681cb,73,c9735b34,...) at _cv_wait+0x1f9/frame 0xeebf5ca4 usb_process(c9735b24,eebf5d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeebf5ccc fork_exit(c0957a80,c9735b24,eebf5d08) at fork_exit+0x7f/frame 0xeebf5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf5cf4 --- trap 0, eip = 0, esp = 0xeebf5d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc971b2f0 sched_switch(c971b2f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeebf2bd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf2c08 sleepq_switch(c971b2f0,0,c108fd1c,26f,c971b2f0,...) at sleepq_switch+0x1b9/frame 0xeebf2c3c sleepq_wait(c9735afc,0,eebf2c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf2c60 _cv_wait(c9735afc,c9735c74,c10681cb,73,c9735b04,...) at _cv_wait+0x1f9/frame 0xeebf2ca4 usb_process(c9735af4,eebf2d08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeebf2ccc fork_exit(c0957a80,c9735af4,eebf2d08) at fork_exit+0x7f/frame 0xeebf2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf2cf4 --- trap 0, eip = 0, esp = 0xeebf2d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc971b5e0 sched_switch(c971b5e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeebefbd4 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebefc08 sleepq_switch(c971b5e0,0,c108fd1c,26f,c971b5e0,...) at sleepq_switch+0x1b9/frame 0xeebefc3c sleepq_wait(c9735acc,0,eebefc90,1,0,...) at sleepq_wait+0x48/frame 0xeebefc60 _cv_wait(c9735acc,c9735c74,c10681cb,73,c9735ad4,...) at _cv_wait+0x1f9/frame 0xeebefca4 usb_process(c9735ac4,eebefd08,c1083e68,3d7,0,...) at usb_process+0xe6/frame 0xeebefccc fork_exit(c0957a80,c9735ac4,eebefd08) at fork_exit+0x7f/frame 0xeebefcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebefcf4 --- trap 0, eip = 0, esp = 0xeebefd40, ebp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xc81498d0 sched_switch(c81498d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b7264c mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b72680 sleepq_switch(c81498d0,0,c108fd1c,26f,c81498d0,...) at sleepq_switch+0x1b9/frame 0xc7b726b4 sleepq_wait(c8236000,5c,c0ee5dff,0,0,...) at sleepq_wait+0x48/frame 0xc7b726d8 _sleep(c8236000,c8236000,5c,c0ee5dff,0,...) at _sleep+0x34e/frame 0xc7b72730 ctl_work_thread(c8236000,c7b72d08,c1083e68,3d7,0,...) at ctl_work_thread+0x110/frame 0xc7b72ccc fork_exit(c04d57b0,c8236000,c7b72d08) at fork_exit+0x7f/frame 0xc7b72cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b72cf4 --- trap 0, eip = 0, esp = 0xc7b72d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc81485e0 sched_switch(c81485e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b51b90 mi_switch(104,0,c108fd1c,1f9,1,...) at mi_switch+0x1c9/frame 0xc7b51bc4 sleepq_switch(c81485e0,0,c108fd1c,292,c81485e0,...) at sleepq_switch+0x1b9/frame 0xc7b51bf8 sleepq_timedwait(c12391e0,0,c107694a,2,0,...) at sleepq_timedwait+0x48/frame 0xc7b51c1c _sleep(c12391e0,0,0,c107694a,64) at _sleep+0x317/frame 0xc7b51c74 pause(c107694a,64,c1043f8e,111,0,...) at pause+0x85/frame 0xc7b51c98 random_kthread(0,c7b51d08,c1083e68,3d7,0,...) at random_kthread+0x30f/frame 0xc7b51ccc fork_exit(c0847e40,0,c7b51d08) at fork_exit+0x7f/frame 0xc7b51cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b51cf4 --- trap 0, eip = 0, esp = 0xc7b51d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8148bc0 sched_switch(c8148bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b4ab88 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b4abbc sleepq_switch(c8148bc0,0,c108fd1c,26f,c8148bc0,...) at sleepq_switch+0x1b9/frame 0xc7b4abf0 sleepq_wait(c1400998,5c,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4ac14 _sleep(c1400998,c1237530,25c,c107694a,0,...) at _sleep+0x34e/frame 0xc7b4ac6c g_io_schedule_down(c8148bc0,0,c10783d4,6c,c7b4acf4,...) at g_io_schedule_down+0x3c/frame 0xc7b4acb4 g_down_procbody(0,c7b4ad08,c1083e68,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7b4accc fork_exit(c0a03e70,0,c7b4ad08) at fork_exit+0x7f/frame 0xc7b4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4acf4 --- trap 0, eip = 0, esp = 0xc7b4ad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8149000 sched_switch(c8149000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b47bac mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b47be0 sleepq_switch(c8149000,0,c108fd1c,26f,c8149000,...) at sleepq_switch+0x1b9/frame 0xc7b47c14 sleepq_wait(c1400994,5c,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b47c38 _sleep(c1400994,c1237550,25c,c107694a,0,...) at _sleep+0x34e/frame 0xc7b47c90 g_io_schedule_up(c8149000,0,c10783d4,5f,c7b47cf4,...) at g_io_schedule_up+0x8f/frame 0xc7b47cb4 g_up_procbody(0,c7b47d08,c1083e68,3d7,0,...) at g_up_procbody+0x9d/frame 0xc7b47ccc fork_exit(c0a03dd0,0,c7b47d08) at fork_exit+0x7f/frame 0xc7b47cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b47cf4 --- trap 0, eip = 0, esp = 0xc7b47d40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dfc2f0 sched_switch(c7dfc2f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b44bbc mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b44bf0 sleepq_switch(c7dfc2f0,0,c108fd1c,26f,c7dfc2f0,...) at sleepq_switch+0x1b9/frame 0xc7b44c24 sleepq_wait(c1400990,5c,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b44c48 _sleep(c1400990,c1237508,25c,c107694a,0,...) at _sleep+0x34e/frame 0xc7b44ca0 g_run_events(0,c7b44d08,c1083e68,3d7,0,...) at g_run_events+0x4f3/frame 0xc7b44ccc fork_exit(c0a03d30,0,c7b44d08) at fork_exit+0x7f/frame 0xc7b44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b44cf4 --- trap 0, eip = 0, esp = 0xc7b44d40, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xc98875e0 sched_switch(c98875e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec7bc64 mi_switch(109,0,c1084105,563,c98875e0,...) at mi_switch+0x1c9/frame 0xeec7bc98 ithread_loop(c7df5940,eec7bd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec7bccc fork_exit(c0a73fa0,c7df5940,eec7bd08) at fork_exit+0x7f/frame 0xeec7bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec7bcf4 --- trap 0, eip = 0, esp = 0xeec7bd40, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc98878d0 sched_switch(c98878d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec78c64 mi_switch(109,0,c1084105,563,c98878d0,...) at mi_switch+0x1c9/frame 0xeec78c98 ithread_loop(c7df5990,eec78d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec78ccc fork_exit(c0a73fa0,c7df5990,eec78d08) at fork_exit+0x7f/frame 0xeec78cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec78cf4 --- trap 0, eip = 0, esp = 0xeec78d40, ebp = 0 --- Tracing command intr pid 12 tid 100064 td 0xc9888000 sched_switch(c9888000,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec68c64 mi_switch(109,0,c1084105,563,c9888000,...) at mi_switch+0x1c9/frame 0xeec68c98 ithread_loop(c7df5a30,eec68d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec68ccc fork_exit(c0a73fa0,c7df5a30,eec68d08) at fork_exit+0x7f/frame 0xeec68cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec68cf4 --- trap 0, eip = 0, esp = 0xeec68d40, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xc97468d0 sched_switch(c97468d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec5cc64 mi_switch(109,0,c1084105,563,c97468d0,...) at mi_switch+0x1c9/frame 0xeec5cc98 ithread_loop(c7df5960,eec5cd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec5cccc fork_exit(c0a73fa0,c7df5960,eec5cd08) at fork_exit+0x7f/frame 0xeec5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec5ccf4 --- trap 0, eip = 0, esp = 0xeec5cd40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc9746bc0 sched_switch(c9746bc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec4ac64 mi_switch(109,0,c1084105,563,c9746bc0,...) at mi_switch+0x1c9/frame 0xeec4ac98 ithread_loop(c7df5a40,eec4ad08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec4accc fork_exit(c0a73fa0,c7df5a40,eec4ad08) at fork_exit+0x7f/frame 0xeec4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec4acf4 --- trap 0, eip = 0, esp = 0xeec4ad40, ebp = 0 --- Tracing command intr pid 12 tid 100055 td 0xc9754bc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xc9743bc0 sched_switch(c9743bc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec0cc64 mi_switch(109,0,c1084105,563,c9743bc0,...) at mi_switch+0x1c9/frame 0xeec0cc98 ithread_loop(c7df5970,eec0cd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeec0cccc fork_exit(c0a73fa0,c7df5970,eec0cd08) at fork_exit+0x7f/frame 0xeec0ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec0ccf4 --- trap 0, eip = 0, esp = 0xeec0cd40, ebp = 0 --- Tracing command intr pid 12 tid 100037 td 0xc97198d0 sched_switch(c97198d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeebfcc64 mi_switch(109,0,c1084105,563,c97198d0,...) at mi_switch+0x1c9/frame 0xeebfcc98 ithread_loop(c7df5920,eebfcd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeebfcccc fork_exit(c0a73fa0,c7df5920,eebfcd08) at fork_exit+0x7f/frame 0xeebfccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebfccf4 --- trap 0, eip = 0, esp = 0xeebfcd40, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc971b8d0 sched_switch(c971b8d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeebecc64 mi_switch(109,0,c1084105,563,c971b8d0,...) at mi_switch+0x1c9/frame 0xeebecc98 ithread_loop(c7df5830,eebecd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeebecccc fork_exit(c0a73fa0,c7df5830,eebecd08) at fork_exit+0x7f/frame 0xeebeccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebeccf4 --- trap 0, eip = 0, esp = 0xeebecd40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc971bbc0 sched_switch(c971bbc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeea96c64 mi_switch(109,0,c1084105,563,c971bbc0,...) at mi_switch+0x1c9/frame 0xeea96c98 ithread_loop(c7df5ab0,eea96d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeea96ccc fork_exit(c0a73fa0,c7df5ab0,eea96d08) at fork_exit+0x7f/frame 0xeea96cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea96cf4 --- trap 0, eip = 0, esp = 0xeea96d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc81492f0 sched_switch(c81492f0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeea92c64 mi_switch(109,0,c1084105,563,c81492f0,...) at mi_switch+0x1c9/frame 0xeea92c98 ithread_loop(c7df6100,eea92d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xeea92ccc fork_exit(c0a73fa0,c7df6100,eea92d08) at fork_exit+0x7f/frame 0xeea92cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea92cf4 --- trap 0, eip = 0, esp = 0xeea92d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc81495e0 sched_switch(c81495e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7ba4c64 mi_switch(109,0,c1084105,563,c81495e0,...) at mi_switch+0x1c9/frame 0xc7ba4c98 ithread_loop(c7df5a50,c7ba4d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7ba4ccc fork_exit(c0a73fa0,c7df5a50,c7ba4d08) at fork_exit+0x7f/frame 0xc7ba4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7ba4cf4 --- trap 0, eip = 0, esp = 0xc7ba4d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc8233000 kdb_break(c7b6cba0,4,1,0,1,...) at kdb_break+0x4e/frame 0xc7b6cb68 scgetc(c1401334,0,c105ab3b,2d4,246,...) at scgetc+0x498/frame 0xc7b6cbb0 sckbdevent(c81a1000,0,c13c83e8,c81a3000,c7b6cc08,...) at sckbdevent+0x8c/frame 0xc7b6cbdc kbdmux_intr(c81a1000,0,c7dc3a40,c7b6cc44,c0ae6401,...) at kbdmux_intr+0x2b/frame 0xc7b6cbf4 kbdmux_kbd_intr(c81a1000,1,c10905c0,136,c10905c0,...) at kbdmux_kbd_intr+0x26/frame 0xc7b6cc08 taskqueue_run_locked(c7dc3a68,0,c10905c0,145,0,...) at taskqueue_run_locked+0x101/frame 0xc7b6cc44 taskqueue_run(c7dc3a40) at taskqueue_run+0x5d/frame 0xc7b6cc64 taskqueue_swi_giant_run(0,0,c1084105,4f7,c7dc9c48,...) at taskqueue_swi_giant_run+0x11/frame 0xc7b6cc70 intr_event_execute_handlers(c1246490,c7dc9c00,c1084105,56d,c8233000,...) at intr_event_execute_handlers+0x88/frame 0xc7b6cc98 ithread_loop(c7df5b10,c7b6cd08,c1083e68,3d7,0,...) at ithread_loop+0x177/frame 0xc7b6cccc fork_exit(c0a73fa0,c7df5b10,c7b6cd08) at fork_exit+0x7f/frame 0xc7b6ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6ccf4 --- trap 0, eip = 0, esp = 0xc7b6cd40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc82332f0 sched_switch(c82332f0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b69c64 mi_switch(109,0,c1084105,563,c82332f0,...) at mi_switch+0x1c9/frame 0xc7b69c98 ithread_loop(c7df5b20,c7b69d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b69ccc fork_exit(c0a73fa0,c7df5b20,c7b69d08) at fork_exit+0x7f/frame 0xc7b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b69cf4 --- trap 0, eip = 0, esp = 0xc7b69d40, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc82338d0 sched_switch(c82338d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b63c64 mi_switch(109,0,c1084105,563,c82338d0,...) at mi_switch+0x1c9/frame 0xc7b63c98 ithread_loop(c7df5b30,c7b63d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b63ccc fork_exit(c0a73fa0,c7df5b30,c7b63d08) at fork_exit+0x7f/frame 0xc7b63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b63cf4 --- trap 0, eip = 0, esp = 0xc7b63d40, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc81482f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc7dfc5e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dfc8d0 sched_switch(c7dfc8d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b3ec64 mi_switch(109,0,c1084105,563,c7dfc8d0,...) at mi_switch+0x1c9/frame 0xc7b3ec98 ithread_loop(c7df5b90,c7b3ed08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b3eccc fork_exit(c0a73fa0,c7df5b90,c7b3ed08) at fork_exit+0x7f/frame 0xc7b3ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b3ecf4 --- trap 0, eip = 0, esp = 0xc7b3ed40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dfcbc0 sched_switch(c7dfcbc0,0,109,1b3,c1084105,...) at sched_switch+0x4ba/frame 0xc7b3bc64 mi_switch(109,0,c1084105,563,c7dfcbc0,...) at mi_switch+0x1c9/frame 0xc7b3bc98 ithread_loop(c7df5ba0,c7b3bd08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b3bccc fork_exit(c0a73fa0,c7df5ba0,c7b3bd08) at fork_exit+0x7f/frame 0xc7b3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b3bcf4 --- trap 0, eip = 0, esp = 0xc7b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e40000 sched_switch(c7e40000,0,109,1b3,c1084105,...) at sched_switch+0x4ba/frame 0xc7b38c64 mi_switch(109,0,c1084105,563,c7e40000,...) at mi_switch+0x1c9/frame 0xc7b38c98 ithread_loop(c7df5bb0,c7b38d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b38ccc fork_exit(c0a73fa0,c7df5bb0,c7b38d08) at fork_exit+0x7f/frame 0xc7b38cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b38cf4 --- trap 0, eip = 0, esp = 0xc7b38d40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e402f0 sched_switch(c7e402f0,0,109,1b3,c1084105,...) at sched_switch+0x4ba/frame 0xc7b35c64 mi_switch(109,0,c1084105,563,c7e402f0,...) at mi_switch+0x1c9/frame 0xc7b35c98 ithread_loop(c7df5bc0,c7b35d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b35ccc fork_exit(c0a73fa0,c7df5bc0,c7b35d08) at fork_exit+0x7f/frame 0xc7b35cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b35cf4 --- trap 0, eip = 0, esp = 0xc7b35d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e405e0 sched_switch(c7e405e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b32c64 mi_switch(109,0,c1084105,563,c7e405e0,...) at mi_switch+0x1c9/frame 0xc7b32c98 ithread_loop(c7df5bd0,c7b32d08,c1083e68,3d7,0,...) at ithread_loop+0x100/frame 0xc7b32ccc fork_exit(c0a73fa0,c7df5bd0,c7b32d08) at fork_exit+0x7f/frame 0xc7b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b32cf4 --- trap 0, eip = 0, esp = 0xc7b32d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dfb000 cpustop_handler(3,13,c7b2eba8,c0eac70b,c7b2eaa8,...) at cpustop_handler+0x2f/frame 0xc7b2ea58 ipi_nmi_handler(c7b2eaa8,405c9d,c7b2eb68,e4630101,c7b2ead8,...) at ipi_nmi_handler+0x37/frame 0xc7b2ea68 trap(c7b2ebb4) at trap+0x3b/frame 0xc7b2eba8 calltrap() at calltrap+0x6/frame 0xc7b2eba8 --- trap 0x13, eip = 0xc0e92272, esp = 0xc7b2ebf4, ebp = 0xc7b2ec34 --- acpi_cpu_c1(0,c7b2ec50,c0e9c4bd,0,4,...) at acpi_cpu_c1+0x2/frame 0xc7b2ec34 cpu_idle_acpi(0,4,c7b2eccc,c0ac8d7a,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2ec40 cpu_idle(0,2,c108c75d,a46,c1247a08,...) at cpu_idle+0x7d/frame 0xc7b2ec50 sched_idletd(0,c7b2ed08,c1083e68,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2eccc fork_exit(c0ac8b80,0,c7b2ed08) at fork_exit+0x7f/frame 0xc7b2ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2ecf4 --- trap 0, eip = 0, esp = 0xc7b2ed40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dfb2f0 cpustop_handler(2,13,c7b2bba8,c0eac70b,c7b2baa8,...) at cpustop_handler+0x2f/frame 0xc7b2ba58 ipi_nmi_handler(c7b2baa8,40579c,c7b2bb68,e6670101,c7b2bad8,...) at ipi_nmi_handler+0x37/frame 0xc7b2ba68 trap(c7b2bbb4) at trap+0x3b/frame 0xc7b2bba8 calltrap() at calltrap+0x6/frame 0xc7b2bba8 --- trap 0x13, eip = 0xc0e92272, esp = 0xc7b2bbf4, ebp = 0xc7b2bc34 --- acpi_cpu_c1(0,c7b2bc50,c0e9c4bd,0,4,...) at acpi_cpu_c1+0x2/frame 0xc7b2bc34 cpu_idle_acpi(0,4,c7b2bccc,c0ac8d7a,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2bc40 cpu_idle(0,2,c108c75d,a46,c1247308,...) at cpu_idle+0x7d/frame 0xc7b2bc50 sched_idletd(0,c7b2bd08,c1083e68,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2bccc fork_exit(c0ac8b80,0,c7b2bd08) at fork_exit+0x7f/frame 0xc7b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2bcf4 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dfb5e0 cpustop_handler(1,13,c7b28ba8,c0eac70b,c7b28a80,...) at cpustop_handler+0x2f/frame 0xc7b28a58 ipi_nmi_handler(c7b28a80,c0ab1a13,c7b28aa0,c1100b28,c7b28b08,...) at ipi_nmi_handler+0x37/frame 0xc7b28a68 trap(c7b28bb4) at trap+0x3b/frame 0xc7b28ba8 calltrap() at calltrap+0x6/frame 0xc7b28ba8 --- trap 0x13, eip = 0xc0e92272, esp = 0xc7b28bf4, ebp = 0xc7b28c34 --- acpi_cpu_c1(0,c7b28c50,c0e9c4bd,0,4,...) at acpi_cpu_c1+0x2/frame 0xc7b28c34 cpu_idle_acpi(0,4,c7b28ccc,c0ac8d7a,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b28c40 cpu_idle(0,2,c108c75d,a46,c1246c08,...) at cpu_idle+0x7d/frame 0xc7b28c50 sched_idletd(0,c7b28d08,c1083e68,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b28ccc fork_exit(c0ac8b80,0,c7b28d08) at fork_exit+0x7f/frame 0xc7b28cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b28cf4 --- trap 0, eip = 0, esp = 0xc7b28d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dfb8d0 sched_switch(c7dfb8d0,0,608,1ae,c7b25c40,...) at sched_switch+0x4ba/frame 0xc7b25c00 mi_switch(608,0,c108a98c,d3,1,...) at mi_switch+0x1c9/frame 0xc7b25c34 critical_exit(0,2,c108c75d,a46,c1246508,...) at critical_exit+0xa3/frame 0xc7b25c50 sched_idletd(0,c7b25d08,c1083e68,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b25ccc fork_exit(c0ac8b80,0,c7b25d08) at fork_exit+0x7f/frame 0xc7b25cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b25cf4 --- trap 0, eip = 0, esp = 0xc7b25d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dfbbc0 sched_switch(c7dfbbc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b21978 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xc7b219ac sleepq_switch(c7dfbbc0,0,c108fd1c,1ad,c7b21a24,...) at sleepq_switch+0x1b9/frame 0xc7b219e0 sleepq_catch_signals(0,c108fd1c,166,288,c7dfbbc0,...) at sleepq_catch_signals+0x3b1/frame 0xc7b21a28 sleepq_wait_sig(c7df9b40,6c,c10931d1,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7b21a4c _sleep(c7df9b40,c7df9bc8,16c,c10931d1,0,...) at _sleep+0x32d/frame 0xc7b21aa4 kern_wait6(c7dfbbc0,7,0,0,c7b21bec,...) at kern_wait6+0x3ec/frame 0xc7b21b00 kern_wait(c7dfbbc0,ffffffff,c7b21bec,0,0,...) at kern_wait+0xd8/frame 0xc7b21bd0 sys_wait4(c7dfbbc0,c7b21cc8,c7b21d08,1,1,...) at sys_wait4+0x41/frame 0xc7b21c40 syscall(c7b21d08) at syscall+0x2ed/frame 0xc7b21cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7b21cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805dce7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc7dfc000 sched_switch(c7dfc000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b1eba8 mi_switch(104,0,c108fd1c,1f9,8,...) at mi_switch+0x1c9/frame 0xc7b1ebdc sleepq_switch(c7dfc000,0,c108fd1c,26f,c7dfc000,...) at sleepq_switch+0x1b9/frame 0xc7b1ec10 sleepq_wait(c1407644,0,c7b1ec64,1,0,...) at sleepq_wait+0x48/frame 0xc7b1ec34 _cv_wait(c1407644,c14075d0,c10bad82,18d,0,...) at _cv_wait+0x1f9/frame 0xc7b1ec78 audit_worker(0,c7b1ed08,c1083e68,3d7,0,...) at audit_worker+0x94/frame 0xc7b1eccc fork_exit(c0ca8440,0,c7b1ed08) at fork_exit+0x7f/frame 0xc7b1ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b1ecf4 --- trap 0, eip = 0, esp = 0xc7b1ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xc9887000 sched_switch(c9887000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec81b8c mi_switch(104,0,c108fd1c,1f9,1,...) at mi_switch+0x1c9/frame 0xeec81bc0 sleepq_switch(c9887000,0,c108fd1c,292,c9887000,...) at sleepq_switch+0x1b9/frame 0xeec81bf4 sleepq_timedwait(c12391e0,0,c107694a,2,0,...) at sleepq_timedwait+0x48/frame 0xeec81c18 _sleep(c12391e0,0,0,c107694a,bb8) at _sleep+0x317/frame 0xeec81c70 pause(c107694a,bb8,12b,129,c1400a14,...) at pause+0x85/frame 0xeec81c94 deadlkres(0,eec81d08,c1083e68,3d7,0,...) at deadlkres+0x48/frame 0xeec81ccc fork_exit(c0a53500,0,eec81d08) at fork_exit+0x7f/frame 0xeec81cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec81cf4 --- trap 0, eip = 0, esp = 0xeec81d40, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc98872f0 sched_switch(c98872f0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec7ebd8 mi_switch(104,0,c108fd1c,1f9,c1255704,...) at mi_switch+0x1c9/frame 0xeec7ec0c sleepq_switch(c98872f0,0,c108fd1c,26f,c9744140,...) at sleepq_switch+0x1b9/frame 0xeec7ec40 sleepq_wait(c9744140,0,c108af2d,c107694a,0,...) at sleepq_wait+0x48/frame 0xeec7ec64 msleep_spin(c9744140,c9744158,c107694a,0,c98872f0,...) at msleep_spin+0x216/frame 0xeec7eca4 taskqueue_thread_loop(c13fd0c8,eec7ed08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xeec7eccc fork_exit(c0ae6b90,c13fd0c8,eec7ed08) at fork_exit+0x7f/frame 0xeec7ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec7ecf4 --- trap 0, eip = 0, esp = 0xeec7ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xc97465e0 sched_switch(c97465e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xeec62bd8 mi_switch(104,0,c108fd1c,1f9,c1255794,...) at mi_switch+0x1c9/frame 0xeec62c0c sleepq_switch(c97465e0,0,c108fd1c,26f,c9744700,...) at sleepq_switch+0x1b9/frame 0xeec62c40 sleepq_wait(c9744700,0,c108af2d,c107694a,0,...) at sleepq_wait+0x48/frame 0xeec62c64 msleep_spin(c9744700,c9744718,c107694a,0,c97465e0,...) at msleep_spin+0x216/frame 0xeec62ca4 taskqueue_thread_loop(c978949c,eec62d08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xeec62ccc fork_exit(c0ae6b90,c978949c,eec62d08) at fork_exit+0x7f/frame 0xeec62cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec62cf4 --- trap 0, eip = 0, esp = 0xeec62d40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc8149bc0 sched_switch(c8149bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b6fbc0 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b6fbf4 sleepq_switch(c8149bc0,0,c108fd1c,26f,c8149bc0,...) at sleepq_switch+0x1b9/frame 0xc7b6fc28 sleepq_wait(c7dc3a00,0,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b6fc4c _sleep(c7dc3a00,c7dc3a18,0,c107694a,0,...) at _sleep+0x34e/frame 0xc7b6fca4 taskqueue_thread_loop(c1404038,c7b6fd08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b6fccc fork_exit(c0ae6b90,c1404038,c7b6fd08) at fork_exit+0x7f/frame 0xc7b6fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6fcf4 --- trap 0, eip = 0, esp = 0xc7b6fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc82335e0 sched_switch(c82335e0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b66bc0 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b66bf4 sleepq_switch(c82335e0,0,c108fd1c,26f,c82335e0,...) at sleepq_switch+0x1b9/frame 0xc7b66c28 sleepq_wait(c7dc3ac0,0,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b66c4c _sleep(c7dc3ac0,c7dc3ad8,0,c107694a,0,...) at _sleep+0x34e/frame 0xc7b66ca4 taskqueue_thread_loop(c1407680,c7b66d08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b66ccc fork_exit(c0ae6b90,c1407680,c7b66d08) at fork_exit+0x7f/frame 0xc7b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b66cf4 --- trap 0, eip = 0, esp = 0xc7b66d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8233bc0 sched_switch(c8233bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b60bd8 mi_switch(104,0,c108fd1c,1f9,c125568c,...) at mi_switch+0x1c9/frame 0xc7b60c0c sleepq_switch(c8233bc0,0,c108fd1c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b60c40 sleepq_wait(c7dc3c40,0,c108af2d,c107694a,0,...) at sleepq_wait+0x48/frame 0xc7b60c64 msleep_spin(c7dc3c40,c7dc3c58,c107694a,0,c8233bc0,...) at msleep_spin+0x216/frame 0xc7b60ca4 taskqueue_thread_loop(c13fdce0,c7b60d08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b60ccc fork_exit(c0ae6b90,c13fdce0,c7b60d08) at fork_exit+0x7f/frame 0xc7b60cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b60cf4 --- trap 0, eip = 0, esp = 0xc7b60d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e408d0 sched_switch(c7e408d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b5dbd8 mi_switch(104,0,c108fd1c,1f9,c125568c,...) at mi_switch+0x1c9/frame 0xc7b5dc0c sleepq_switch(c7e408d0,0,c108fd1c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b5dc40 sleepq_wait(c7dc3c40,0,c108af2d,c107694a,0,...) at sleepq_wait+0x48/frame 0xc7b5dc64 msleep_spin(c7dc3c40,c7dc3c58,c107694a,0,c7e408d0,...) at msleep_spin+0x216/frame 0xc7b5dca4 taskqueue_thread_loop(c13fdce0,c7b5dd08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b5dccc fork_exit(c0ae6b90,c13fdce0,c7b5dd08) at fork_exit+0x7f/frame 0xc7b5dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b5dcf4 --- trap 0, eip = 0, esp = 0xc7b5dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e40bc0 sched_switch(c7e40bc0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b5abd8 mi_switch(104,0,c108fd1c,1f9,c125568c,...) at mi_switch+0x1c9/frame 0xc7b5ac0c sleepq_switch(c7e40bc0,0,c108fd1c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b5ac40 sleepq_wait(c7dc3c40,0,c108af2d,c107694a,0,...) at sleepq_wait+0x48/frame 0xc7b5ac64 msleep_spin(c7dc3c40,c7dc3c58,c107694a,0,c7e40bc0,...) at msleep_spin+0x216/frame 0xc7b5aca4 taskqueue_thread_loop(c13fdce0,c7b5ad08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b5accc fork_exit(c0ae6b90,c13fdce0,c7b5ad08) at fork_exit+0x7f/frame 0xc7b5acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b5acf4 --- trap 0, eip = 0, esp = 0xc7b5ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc8148000 sched_switch(c8148000,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b57bc0 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b57bf4 sleepq_switch(c8148000,0,c108fd1c,26f,c8148000,...) at sleepq_switch+0x1b9/frame 0xc7b57c28 sleepq_wait(c7dc3c80,0,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b57c4c _sleep(c7dc3c80,c7dc3c98,0,c107694a,0,...) at _sleep+0x34e/frame 0xc7b57ca4 taskqueue_thread_loop(c1401168,c7b57d08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b57ccc fork_exit(c0ae6b90,c1401168,c7b57d08) at fork_exit+0x7f/frame 0xc7b57cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b57cf4 --- trap 0, eip = 0, esp = 0xc7b57d40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc81488d0 sched_switch(c81488d0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc7b4dbc0 mi_switch(104,0,c108fd1c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b4dbf4 sleepq_switch(c81488d0,0,c108fd1c,26f,c81488d0,...) at sleepq_switch+0x1b9/frame 0xc7b4dc28 sleepq_wait(c7dc3e40,0,c107694a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4dc4c _sleep(c7dc3e40,c7dc3e58,0,c107694a,0,...) at _sleep+0x34e/frame 0xc7b4dca4 taskqueue_thread_loop(c12545c0,c7b4dd08,c1083e68,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b4dccc fork_exit(c0ae6b90,c12545c0,c7b4dd08) at fork_exit+0x7f/frame 0xc7b4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4dcf4 --- trap 0, eip = 0, esp = 0xc7b4dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1400cf0 sched_switch(c1400cf0,0,104,1b3,c0a8f2ae,...) at sched_switch+0x4ba/frame 0xc1820c20 mi_switch(104,0,c108fd1c,1f9,2,...) at mi_switch+0x1c9/frame 0xc1820c54 sleepq_switch(c1400cf0,0,c108fd1c,292,c1400cf0,...) at sleepq_switch+0x1b9/frame 0xc1820c88 sleepq_timedwait(c1400a14,54,c10bbf45,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cac _sleep(c1400a14,0,54,c10bbf45,2710,...) at _sleep+0x317/frame 0xc1820d04 scheduler(0,0,c10ec27c,181e000,1825000,...) at scheduler+0x274/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 338 MB: 323 307 291 275 259 243 227 211 195 179 163 147 131 115 99 83 67 51 35 19 3 Dump complete = 0 db:0:doadump> reset x4# ./gdb.sh /usr/src/sys/i386/compile/PHO kgdb kernel.debug /var/crash/vmcore.531 /usr/src/sys/i386/compile/PHO/kernel.debug: FreeBSD 10.0-CURRENT #1 r244869M: Mon Dec 31 10:17:29 CET 2012 Uptime: 10:58AM up 10 mins, 1 user, load averages: 0.11, 0.26, 0.22 GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd"... Unread portion of the kernel message buffer: KDB: enter: Break to debugger Reading symbols from /boot/kernel/linux.ko...Reading symbols from /boot/kernel/linux.ko.symbols...done. done. Loaded symbols for /boot/kernel/linux.ko Reading symbols from /boot/kernel/nfsserver.ko...Reading symbols from /boot/kernel/nfsserver.ko.symbols...done. done. Loaded symbols for /boot/kernel/nfsserver.ko Reading symbols from /boot/kernel/nfs_common.ko...Reading symbols from /boot/kernel/nfs_common.ko.symbols...done. done. Loaded symbols for /boot/kernel/nfs_common.ko Reading symbols from /boot/kernel/geom_journal.ko...Reading symbols from /boot/kernel/geom_journal.ko.symbols...done. done. Loaded symbols for /boot/kernel/geom_journal.ko #0 doadump (textdump=0xa) at pcpu.h:249 249 __asm("movl %%fs:%1,%0" : "=r" (td) (kgdb) proc 2210 [Switching to thread 131 (Thread 100136)]#0 sched_switch (td=0xcb502000, newtd=0xc7dfb5e0, flags=0xf3334ee8) at ../../../kern/sched_ule.c:1954 1954 cpuid = PCPU_GET(cpuid); Current language: auto; currently minimal (kgdb) bt #0 sched_switch (td=0xcb502000, newtd=0xc7dfb5e0, flags=0xf3334ee8) at ../../../kern/sched_ule.c:1954 #1 0xc0aad029 in mi_switch (flags=) at ../../../kern/kern_synch.c:485 #2 0xc0ae2f89 in sleepq_switch (wchan=, pri=0x60) at ../../../kern/subr_sleepqueue.c:545 #3 0xc0ae2d78 in sleepq_wait (wchan=0xcb63fb98, pri=0x60) at ../../../kern/subr_sleepqueue.c:624 #4 0xc0a85f8e in sleeplk (lk=0xcb63fb98, flags=0x80000, ilk=, wmesg=, pri=0x60, timo=) at ../../../kern/kern_lock.c:226 #5 0xc0a85784 in __lockmgr_args (lk=0xcb63fb98, flags=, wmesg=0xc1079edc "ufs", pri=0x60, timo=0x33, file=0x80000000
, line=0x1) at ../../../kern/kern_lock.c:914 #6 0xc0d00a7d in ffs_lock (ap=0xf3335160) at lockmgr.h:97 #7 0xc0ed3355 in VOP_LOCK1_APV (vop=, a=0xf3335160) at vnode_if.c:2022 #8 0xc0b521ba in _vn_lock (vp=, flags=) at vnode_if.h:859 #9 0xc0cdec2f in process_deferred_inactive (mp=0xcaa95bb0) at ../../../ufs/ffs/ffs_snapshot.c:2551 #10 0xc0cd46fd in ffs_snapshot (mp=0xcaa95bb0, ---Type to continue, or q to quit--- snapfile=0xca9b6140 "/mnt/.snap/snap") at ../../../ufs/ffs/ffs_snapshot.c:692 #11 0xc0cfd199 in ffs_mount (mp=0xcaa95bb0) at ../../../ufs/ffs/ffs_vfsops.c:483 #12 0xc0b378a2 in vfs_donmount (td=, fsflags=0xcaaa45d8000003ab, fsoptions=) at ../../../kern/vfs_mount.c:948 #13 0xc0b36968 in sys_nmount (td=0x0, uap=) at ../../../kern/vfs_mount.c:417 #14 0xc0eadb1d in syscall (frame=) at subr_syscall.c:134 #15 0xc0e96331 in Xint0x80_syscall () at exception.s:267 #16 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 9 #9 0xc0cdec2f in process_deferred_inactive (mp=0xcaa95bb0) at ../../../ufs/ffs/ffs_snapshot.c:2551 2551 error = vn_lock(vp, LK_EXCLUSIVE | LK_INTERLOCK); (kgdb) l 2546 ((vp->v_iflag & VI_OWEINACT) == 0 || vp->v_usecount > 0))) { 2547 VI_UNLOCK(vp); 2548 continue; 2549 } 2550 vholdl(vp); 2551 error = vn_lock(vp, LK_EXCLUSIVE | LK_INTERLOCK); 2552 if (error != 0) { 2553 vdrop(vp); 2554 if (error == ENOENT) 2555 continue; /* vnode recycled */ (kgdb) info loc vp = (struct vnode *) 0xcb63fb40 mvp = (struct vnode *) 0xca966600 td = (struct thread *) 0xcb502000 ip = (struct inode *) 0xc109c02c error = 0xcaa95bc0 (kgdb) p *vp $1 = {v_type = VREG, v_tag = 0xc1079edc "ufs", v_op = 0xc11e7948, v_data = 0xcbc3315c, v_mount = 0xcaa95bb0, v_nmntvnodes = { tqe_next = 0xca966600, tqe_prev = 0xcbe7bcbc}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = { le_next = 0x0, le_prev = 0xca72cf60}, v_hash = 0x800a, v_cache_src = { lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xcb63fb70}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc1079edc "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d96880}, lk_lock = 0xcbe835e4, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x12, pcs = {0xc0a85ce8, 0xc0d00a7d, 0xc0ed3355, 0xc0b521ba, 0xc0b40267, 0xc0b33a5c, 0xc0cfb407, 0xc0cfb3ae, 0xc0d0a242, 0xc0d093ba, 0xc0ed03a3, 0xc0b2c6ec, 0xc0ed01e3, 0xc0b3529e, 0xc0b3498d, 0xc0b4b8a3, 0xc0b4b532, 0xc0eadb1d}}}, v_interlock = {lock_object = {lo_name = 0xc1092240 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d8f1e0}, mtx_lock = 0x4}, v_vnlock = 0xcb63fb98, v_holdcnt = 0x5, v_usecount = 0x0, v_iflag = 0xa00, v_vflag = 0x4, v_writecount = 0x0, v_actfreelist = { tqe_next = 0xcbe7bca8, tqe_prev = 0xcbfdf960}, v_bufobj = {bo_mtx = { lock_object = {lo_name = 0xc109a721 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d94d48}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe1e4d880, tqh_last = 0xe1db1bf8}, bv_root = 0xe1db1bc0, bv_cnt = 0x2}, ---Type to continue, or q to quit--- bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xcb63fc5c}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_ops = 0xc11c5bec, bo_bsize = 0x8000, bo_object = 0xcbf6965c, bo_synclist = {le_next = 0xcbfdf968, le_prev = 0xcbf88140}, bo_private = 0xcb63fb40, __bo_vnode = 0xcb63fb40}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xcb63fc9c}, rl_currdep = 0x0}} (kgdb) p *vp $2 = {v_type = VREG, v_tag = 0xc1079edc "ufs", v_op = 0xc11e7948, v_data = 0xcbc3315c, v_mount = 0xcaa95bb0, v_nmntvnodes = { tqe_next = 0xca966600, tqe_prev = 0xcbe7bcbc}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = { le_next = 0x0, le_prev = 0xca72cf60}, v_hash = 0x800a, v_cache_src = { lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0xcb63fb70}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = {lock_object = {lo_name = 0xc1079edc "ufs", lo_flags = 0x57b0000, lo_data = 0x0, lo_witness = 0xc7d96880}, lk_lock = 0xcbe835e4, lk_exslpfail = 0x0, lk_timo = 0x33, lk_pri = 0x60, lk_stack = {depth = 0x12, pcs = {0xc0a85ce8, 0xc0d00a7d, 0xc0ed3355, 0xc0b521ba, 0xc0b40267, 0xc0b33a5c, 0xc0cfb407, 0xc0cfb3ae, 0xc0d0a242, 0xc0d093ba, 0xc0ed03a3, 0xc0b2c6ec, 0xc0ed01e3, 0xc0b3529e, 0xc0b3498d, 0xc0b4b8a3, 0xc0b4b532, 0xc0eadb1d}}}, v_interlock = {lock_object = {lo_name = 0xc1092240 "vnode interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d8f1e0}, mtx_lock = 0x4}, v_vnlock = 0xcb63fb98, v_holdcnt = 0x5, v_usecount = 0x0, v_iflag = 0xa00, v_vflag = 0x4, v_writecount = 0x0, v_actfreelist = { tqe_next = 0xcbe7bca8, tqe_prev = 0xcbfdf960}, v_bufobj = {bo_mtx = { lock_object = {lo_name = 0xc109a721 "bufobj interlock", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xc7d94d48}, mtx_lock = 0x4}, bo_clean = {bv_hd = {tqh_first = 0xe1e4d880, tqh_last = 0xe1db1bf8}, bv_root = 0xe1db1bc0, bv_cnt = 0x2}, ---Type to continue, or q to quit--- bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0xcb63fc5c}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_ops = 0xc11c5bec, bo_bsize = 0x8000, bo_object = 0xcbf6965c, bo_synclist = {le_next = 0xcbfdf968, le_prev = 0xcbf88140}, bo_private = 0xcb63fb40, __bo_vnode = 0xcb63fb40}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0xcb63fc9c}, rl_currdep = 0x0}} (kgdb) p *ip $3 = {i_nextsnap = {tqe_next = 0x2e2f2e2e, tqe_prev = 0x2e2e2f2e}, i_vnode = 0x72656b2f, i_ump = 0x66762f6e, i_flag = 0x6e765f73, i_dev = 0x2e73706f, i_number = 0x6e760063, i_effnlink = 0x65706f5f, i_fs = 0x6e765f6e, i_dquot = {0x65646f, 0x775f6e76}, i_count = 0x65746972, i_endoff = 0x6b6863, i_diroff = 0x635f6e76, i_offset = 0x65736f6c, i_un = { dirhash = 0x656e203a, snapblklist = 0x656e203a}, i_ea_area = 0x69746167
, i_ea_len = 0x77206576, i_ea_error = 0x65746972, i_ea_refs = 0x6e756f63, i_mode = 0x74, i_nlink = 0x4f49, i_size = 0x434f4c45444f4e5f, i_flags = 0x2044454b, i_gen = 0x206f6e2068746977, i_uid = 0x6c207076, i_gid = 0x206b636f, dinode_u = {din1 = 0x646c6568, din2 = 0x646c6568}} (kgdb) p *mvp $4 = {v_type = VMARKER, v_tag = 0x0, v_op = 0x0, v_data = 0x0, v_mount = 0xcaa95bb0, v_nmntvnodes = {tqe_next = 0xcbfdf870, tqe_prev = 0xcb63fb54}, v_un = {vu_mount = 0x0, vu_socket = 0x0, vu_cdev = 0x0, vu_fifoinfo = 0x0}, v_hashlist = {le_next = 0x0, le_prev = 0x0}, v_hash = 0x0, v_cache_src = {lh_first = 0x0}, v_cache_dst = {tqh_first = 0x0, tqh_last = 0x0}, v_cache_dd = 0x0, v_cstart = 0x0, v_lasta = 0x0, v_lastw = 0x0, v_clen = 0x0, v_lock = { lock_object = {lo_name = 0x0, lo_flags = 0x0, lo_data = 0x0, lo_witness = 0x0}, lk_lock = 0x0, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x0, lk_stack = {depth = 0x0, pcs = {0x0 }}}, v_interlock = {lock_object = {lo_name = 0x0, lo_flags = 0x0, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, v_vnlock = 0x0, v_holdcnt = 0x0, v_usecount = 0x0, v_iflag = 0x0, v_vflag = 0x0, v_writecount = 0x0, v_actfreelist = {tqe_next = 0x0, tqe_prev = 0x0}, v_bufobj = {bo_mtx = { lock_object = {lo_name = 0x0, lo_flags = 0x0, lo_data = 0x0, lo_witness = 0x0}, mtx_lock = 0x0}, bo_clean = {bv_hd = { tqh_first = 0x0, tqh_last = 0x0}, bv_root = 0x0, bv_cnt = 0x0}, bo_dirty = {bv_hd = {tqh_first = 0x0, tqh_last = 0x0}, bv_root = 0x0, bv_cnt = 0x0}, bo_numoutput = 0x0, bo_flag = 0x0, bo_ops = 0x0, bo_bsize = 0x0, bo_object = 0x0, bo_synclist = {le_next = 0x0, le_prev = 0x0}, bo_private = 0x0, __bo_vnode = 0x0}, v_pollinfo = 0x0, v_label = 0x0, v_lockf = 0x0, v_rl = {rl_waiters = {tqh_first = 0x0, tqh_last = 0x0}, rl_currdep = 0x0}} (kgdb) quit x4# exit Index: /usr/src/sys/ufs/ffs/ffs_snapshot.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_snapshot.c (revision 244869) +++ /usr/src/sys/ufs/ffs/ffs_snapshot.c (working copy) @@ -192,6 +192,8 @@ SYSCTL_INT(_debug, OID_AUTO, collectsnapstats, CTL 0, ""); #endif /* DEBUG */ +void process_deferred_inactive1(struct mount *mp, struct vnode *vp) __noinline; + /* * Create a snapshot file and initialize it for the filesystem. */ @@ -858,7 +860,7 @@ out: VOP_UNLOCK(vp, 0); vrele(nd.ni_dvp); vn_finished_write(wrtmp); - process_deferred_inactive(mp); + process_deferred_inactive1(mp, vp); return (error); } @@ -2509,6 +2511,14 @@ readblock(vp, bp, lbn) #endif +void +process_deferred_inactive1(struct mount *mp, struct vnode *vp) +{ + + ASSERT_VOP_UNLOCKED(vp, "process_deferred_inactive1"); + process_deferred_inactive(mp); +} + /* * Process file deletes that were deferred by ufs_inactive() due to * the file system being suspended. Transfer IN_LAZYACCESS into