Script started on Sun Dec 30 13:50:18 2012 bash-3.2$ cu -s 115200 -l /dev/cu.PL2303-00001004 Password: Connected. KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r244771M: Sat Dec 29 19:45:22 CET 2012 root@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 0x10 Model = 0x2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3527593984 (3364 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: <060508 APIC1048> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 random device not loaded; using insecure entropy ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 hpt27xx: RocketRAID 27xx controller driver v1.0 (Dec 29 2012 19:43:52) ctl: CAM Target Layer loaded acpi0: <060508 RSDT1048> on motherboard acpi0: Power Button (fixed) acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of ffb80000, 80000 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, d7f00000 (3) failed cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xc000-0xc0ff mem 0xf0000000-0xf7ffffff,0xfe9f0000-0xfe9fffff,0xfe800000-0xfe8fffff irq 18 at device 5.0 on pci1 hdac0: mem 0xfe9e8000-0xfe9ebfff irq 19 at device 5.2 on pci1 pcib2: at device 7.0 on pci0 pci2: on pcib2 re0: port 0xd800-0xd8ff mem 0xfeaff000-0xfeafffff irq 19 at device 0.0 on pci2 re0: Using 1 MSI message re0: Chip rev. 0x38000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 00:21:85:15:33:7d ahci0: port 0xb000-0xb007,0xa000-0xa003,0x9000-0x9007,0x8000-0x8003,0x7000-0x700f mem 0xfe7ff800-0xfe7ffbff irq 22 at device 18.0 on pci0 ahci0: AHCI v1.10 with 4 3Gbps ports, Port Multiplier supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ohci0: mem 0xfe7fe000-0xfe7fefff irq 16 at device 19.0 on pci0 usbus0 on ohci0 ohci1: mem 0xfe7fd000-0xfe7fdfff irq 17 at device 19.1 on pci0 usbus1 on ohci1 ohci2: mem 0xfe7fc000-0xfe7fcfff irq 18 at device 19.2 on pci0 usbus2 on ohci2 ohci3: mem 0xfe7fb000-0xfe7fbfff irq 17 at device 19.3 on pci0 usbus3 on ohci3 ohci4: mem 0xfe7fa000-0xfe7fafff irq 18 at device 19.4 on pci0 usbus4 on ohci4 ehci0: mem 0xfe7ff000-0xfe7ff0ff irq 19 at device 19.5 on pci0 ehci0: AMD SB600/700 quirk applied usbus5: EHCI version 1.0 usbus5 on ehci0 pci0: at device 20.0 (no driver attached) atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on pci0 ata0: at channel 0 on atapci0 hdac1: mem 0xfe7f4000-0xfe7f7fff irq 16 at device 20.2 on pci0 isab0: at device 20.3 on pci0 isa0: on isab0 pcib3: at device 20.4 on pci0 pci3: on pcib3 fwohci0: port 0xe800-0xe87f mem 0xfebff800-0xfebfffff irq 20 at device 6.0 on pci3 fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:dc:10:00:01:62:ad:eb fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:dc:10:62:ad:eb fwe0: Ethernet address: 02:dc:10:62:ad:eb fwip0: on firewire0 fwip0: Firewire address: 00:dc:10:00:01:62:ad:eb @ 0xfffe00000000, S400, maxrec 2048 dcons_crom0: on firewire0 dcons_crom0: bus_addr 0x1200ec8 fwohci0: Initiate bus reset fwohci0: fwohci_intr_core: BUS reset fwohci0: fwohci_intr_core: node_id=0x00000000, SelfID Count=1, CYCLEMASTER mode acpi_button0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model MouseMan+, device ID 0 pmtimer0 on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ppc0: parallel port not found. acpi_throttle0: on cpu0 acpi_throttle0: CLK_VAL field overlaps THT_EN bit device_attach: acpi_throttle0 attach returned 6 hwpstate0: on cpu0 firewire0: 1 nodes, maxhop <= 0 cable IRM irm(0) (me) firewire0: bus manager 0 Timecounters tick every 1.000 msec hpt27xx: no controller detected. hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 3 on hdaa0 hdacc1: at cad 3 on hdac1 hdaa1: at nid 1 on hdacc1 pcm1: at nid 20,22,21,23 and 24,26 on hdaa1 pcm2: at nid 27 and 25 on hdaa1 pcm3: at nid 30 on hdaa1 usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 Expensive timeout(9) function: 0xc0ae2960(0xc971b000) 0.010660852 s ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 480Mbps High Speed USB v2.0 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 (aprobe0:ahcich0:0:15:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich0:0:15:0): CAM status: Command timeout (aprobe0:ahcich0:0:15:0): Error 5, Retries exhausted ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-8 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors: 16H 63S/T 16383C) uhub0: 2 ports with 2 removable, self powered ada0: Previously was known as ad4 cd0 at ata0 bus 0 scbus4 target 1 lun 0 cd0: <_NEC DVD_RW ND-4550A 1.06> Removable CD-ROM SCSI-0 device cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered SMP: AP CPU #3 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #1 Launched! Timecounter "TSC-low" frequency 14062645 Hz quality 800 uhub3: 2 ports with 2 removable, self powered WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. uhub4: 2 ports with 2 removable, self powered Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 Root mount waiting for: usbus5 uhub5: 10 ports with 10 removable, self powered Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. warning: total configured swap (4194304 pages) exceeds maximum recommended amount (3890432 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 593338 free (1962 frags, 73922 blocks, 0.2% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 139058 free (5370 frags, 16711 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 64147126 free (8462 frags, 8017333 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 2239732 free (225132 frags, 251825 blocks, 2.2% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 14151072 free (83496 frags, 1758447 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN ifa_del_loopback_route: deletion failed: 3 re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe1cd7b40 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xc9780a00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c1086af8,e1cd7ae0,f32c17f0,c0a8e2a7,cab79c38,...) at db_trace_self_wrapper+0x2d/frame 0xf32c17b0 kdb_backtrace(c1089b9e,c9780a00,c10bb2d1,c7d968e8,c10baf16,...) at kdb_backtrace+0x30/frame 0xf32c1818 witness_checkorder(c9780a00,9,c10baf0d,11c,0,...) at witness_checkorder+0xbad/frame 0xf32c1868 _sx_xlock(c9780a00,0,c10baf0d,11c,caa69000,...) at _sx_xlock+0x75/frame 0xf32c1898 ufsdirhash_add(caaff15c,f32c1990,364c,f32c1918,f32c191c,...) at ufsdirhash_add+0x4a/frame 0xf32c18c8 ufs_direnter(cab79b40,caf36ca8,f32c1990,f32c1b68,e1cdb700,...) at ufs_direnter+0x63b/frame 0xf32c1948 ufs_mkdir(f32c1c00,c10dde9d,cab79b40,f32c1bfc,0,...) at ufs_mkdir+0x880/frame 0xf32c1ae4 VOP_MKDIR_APV(c11df748,f32c1c00,f32c1b68,f32c1b90,28803020,...) at VOP_MKDIR_APV+0x103/frame 0xf32c1b10 kern_mkdirat(cab2c8d0,ffffff9c,28803020,0,1c0) at kern_mkdirat+0x1ef/frame 0xf32c1c24 sys_mkdir(cab2c8d0,f32c1cc8,f32c1d08,1,1,...) at sys_mkdir+0x31/frame 0xf32c1c40 syscall(f32c1d08) at syscall+0x2ed/frame 0xf32c1cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32c1cfc --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28167483, esp = 0xbfbfd92c, ebp = 0xbfbfddd0 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcb170490 ufs (ufs) @ kern/vfs_lookup.c:516 2nd 0xe1cdfee0 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:261 3rd 0xcb119a30 ufs (ufs) @ kern/vfs_subr.c:2162 KDB: stack backtrace: db_trace_self_wrapper(c1086af8,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf32262c8 kdb_backtrace(c1089bb7,cb119a30,c107251c,c7d96880,c1092d00,...) at kdb_backtrace+0x30/frame 0xf3226330 witness_checkorder(cb119a30,9,c1092cf7,872,cb119a9c,...) at witness_checkorder+0xbad/frame 0xf3226380 __lockmgr_args(cb119a30,80100,cb119a9c,0,0,...) at __lockmgr_args+0x81d/frame 0xf3226460 ffs_lock(f32264e0,c7d94db0,c7d8f1e0,c7d94db0,c137c240,...) at ffs_lock+0xad/frame 0xf32264a0 VOP_LOCK1_APV(c11df748,f32264e0,c11b5100,200246,c11f3770,...) at VOP_LOCK1_APV+0xe5/frame 0xf32264c8 _vn_lock(cb1199d8,80100,c1092cf7,872,c1091f4d,...) at _vn_lock+0xca/frame 0xf3226508 vget(cb1199d8,80100,cab322f0,50,0,...) at vget+0x77/frame 0xf3226540 vfs_hash_get(caa502ec,15ec47,80000,cab322f0,f3226620,...) at vfs_hash_get+0xfc/frame 0xf322656c ffs_vgetf(caa502ec,15ec47,80000,f3226620,1,...) at ffs_vgetf+0x47/frame 0xf32265c8 softdep_sync_buf(cb170438,e1cdfe80,1,107,0,...) at softdep_sync_buf+0x977/frame 0xf3226630 ffs_syncvnode(cb170438,1,0,cab323a4,c137c240,...) at ffs_syncvnode+0x2a3/frame 0xf3226688 ffs_truncate(cb170438,200,0,880,c7dd4680,...) at ffs_truncate+0x6a4/frame 0xf3226838 ufs_direnter(cb170438,cb1199d8,f32268f8,f3226bc8,0,...) at ufs_direnter+0x7ed/frame 0xf32268b8 ufs_makeinode(f3226bb4,f3226bc8) at ufs_makeinode+0x533/frame 0xf3226a30 ufs_create(f3226b18,c10dd88b,caa502fc,2,2,...) at ufs_create+0x2f/frame 0xf3226a44 VOP_CREATE_APV(c11df748,f3226b18,f3226bc8,f3226aa8,c11f38e0,...) at VOP_CREATE_APV+0x103/frame 0xf3226a70 vn_open_cred(f3226b88,f3226bfc,1b0,0,c7dd4680,caa93540) at vn_open_cred+0x2cf/frame 0xf3226b40 vn_open(f3226b88,f3226bfc,1b0,caa93540,0,...) at vn_open+0x3b/frame 0xf3226b60 kern_openat(cab322f0,ffffff9c,28c57f60,0,a02,1b0) at kern_openat+0x1da/frame 0xf3226c20 sys_open(cab322f0,f3226cc8,f3226d08,1,1,...) at sys_open+0x38/frame 0xf3226c40 syscall(f3226d08) at syscall+0x2ed/frame 0xf3226cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3226cfc --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x28404757, esp = 0xbfbfb50c, ebp = 0xbfbfb598 --- . Updating motd:. Starting ntpd. Removing stale Samba tdb files: ....... done Starting nmbd. Starting smbd. Starting winbindd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcab42e68 ufs (ufs) @ kern/vfs_mount.c:1236 2nd 0xcadb18c8 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1866 KDB: stack backtrace: db_trace_self_wrapper(c1086af8,246,c107251c,650,c7d8f998,...) at db_trace_self_wrapper+0x2d/frame 0xf3294850 kdb_backtrace(c1089b9e,cadb18c8,c107dd75,c7d966e0,c10b7607,...) at kdb_backtrace+0x30/frame 0xf32948b8 witness_checkorder(cadb18c8,9,c10b75fe,74a,cadb1934,...) at witness_checkorder+0xbad/frame 0xf3294908 __lockmgr_args(cadb18c8,80400,cadb1934,0,0,0,c10b75fe,74a) at __lockmgr_args+0x81d/frame 0xf32949e8 vop_stdlock(f3294a58,f3294a54,c0a8e2a7,c13ac4b4,8,...) at vop_stdlock+0x53/frame 0xf3294a18 VOP_LOCK1_APV(c11a55d0,f3294a58,4,f3294a80,c11f3770,...) at VOP_LOCK1_APV+0xe5/frame 0xf3294a40 _vn_lock(cadb1870,80400,c10b75fe,74a,f3294ac0,...) at _vn_lock+0xca/frame 0xf3294a80 softdep_flushworklist(caa508c4,f3294b14,cae455e0,61e,0,...) at softdep_flushworklist+0x6e/frame 0xf3294ac0 ffs_sync(caa508c4,1,f3294b70,50e,cab0e300,...) at ffs_sync+0x2e5/frame 0xf3294b48 dounmount(caa508c4,8080000,cae455e0,493,0,...) at dounmount+0x38a/frame 0xf3294b98 sys_unmount(cae455e0,f3294cc8,f3294d08,1,1,...) at sys_unmount+0x3dd/frame 0xf3294c40 syscall(f3294d08) at syscall+0x2ed/frame 0xf3294cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3294cfc --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c0d47, esp = 0xbfbfd6a4, ebp = 0xbfbfd770 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23759 files, 54166855 used, 64147126 free (8470 frags, 8017332 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 23759 files, 54166855 used, 64147126 free (8470 frags, 8017332 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun Dec 30 13:59:10 CET 2012 FreeBSD/i386 (x4.osted.lan) (console) login: root Password: Dec 30 13:59:20 x4 login: ROOT LOGIN (root) ON console Last login: Sun Dec 30 13:10:55 on ttyv0 FreeBSD 10.0-CURRENT (PHO) #0 r244771M: Sat Dec 29 19:45:22 CET 2012 You have new mail. x4# cd /usr/src x4# svn diff -x -p . > /tmp/diff x4# cd ~pho/stress2/wip x4# ./all.sh gjournal3.sh 20121230 14:01:12 all: gjournal3.sh 20121230 14:01:12 all: gjournal3.sh GEOM_JOURNAL: Journal 2850356608: md5 contains data. GEOM_JOURNAL: Journal 2850356608: md5 contains journal. GEOM_JOURNAL: Journal md5 clean. GEOM_JOURNAL: BIO_FLUSH not supported by md5. lock order reversal: 1st 0xc7de121c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xcc273760 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1627 KDB: stack backtrace: db_trace_self_wrapper(c1086af8,c8148bc0,0,c1084d9d,7e9,...) at db_trace_self_wrapper+0x2d/frame 0xf32bd680 kdb_backtrace(c1089b9e,cc273760,c107251c,c7d96880,c10b6d87,...) at kdb_backtrace+0x30/frame 0xf32bd6e8 witness_checkorder(cc273760,9,c10b6d7e,65b,0,...) at witness_checkorder+0xbad/frame 0xf32bd738 __lockmgr_args(cc273760,80000,0,0,0,...) at __lockmgr_args+0x81d/frame 0xf32bd818 ffs_snapremove(cc273708,c10b6c4f,0,cab2cbc0,0,...) at ffs_snapremove+0x118/frame 0xf32bd878 ffs_truncate(cc273708,0,0,c00,0,...) at ffs_truncate+0x28a/frame 0xf32bda24 ufs_inactive(f32bdaa8,c10de039,9c2,c11f0c38,cc273708,...) at ufs_inactive+0x1fc/frame 0xf32bda54 VOP_INACTIVE_APV(c11df748,f32bdaa8,c1092cf7,9c2,c0b2f8b8,...) at VOP_INACTIVE_APV+0x103/frame 0xf32bda80 vinactive(cc273708,cab2cbc0,c1092cf7,8c0,cc2737dc,...) at vinactive+0x191/frame 0xf32bdac8 vputx(cc273708,ffffffdf,cc273708,f32bdbd0,0,...) at vputx+0x382/frame 0xf32bdb10 kern_unlinkat(cab2cbc0,ffffff9c,bfbfdcb6,0,0) at kern_unlinkat+0x29f/frame 0xf32bdc24 sys_unlink(cab2cbc0,f32bdcc8,f32bdd08,1,1,...) at sys_unlink+0x32/frame 0xf32bdc40 syscall(f32bdd08) at syscall+0x2ed/frame 0xf32bdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32bdcfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28166a03, esp = 0xbfbfda3c, ebp = 0xbfbfdac4 --- 20121230 14:01:16 all: gjournal3.sh 20121230 14:01:16 all: gjournal3.sh GEOM_JOURNAL: Journal 1255375094: md5 contains data. GEOM_JOURNAL: Journal 1255375094: md5 contains journal. GEOM_JOURNAL: Journal md5 clean. GEOM_JOURNAL: BIO_FLUSH not supported by md5. rw: run time 0+00:02:00, incarnations 7, load 70, verbose 2 rw(size=13331, incarnations=7). Free(933340k, 131066), reserve(96965k, 15) lock order reversal: 1st 0xe1eb4700 bufwait (bufwait) @ kern/vfs_bio.c:2631 2nd 0xc7de121c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:1763 KDB: stack backtrace: db_trace_self_wrapper(c1086af8,0,0,0,0,...) at db_trace_self_wrapper+0x2d/frame 0xf3381580 kdb_backtrace(c1089b9e,c7de121c,c10b7165,c7d970a0,c10b6d87,...) at kdb_backtrace+0x30/frame 0xf33815e8 witness_checkorder(c7de121c,9,c10b6d7e,6e3,cc273394,...) at witness_checkorder+0xbad/frame 0xf3381638 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0x81d/frame 0xf3381714 ffs_snapblkfree(cd8a3000,cc2732d0,11548,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf338178c ffs_blkfree(caa68000,cd8a3000,cc2732d0,11548,0,...) at ffs_blkfree+0x57/frame 0xf33817c8 ffs_indirtrunc(ffffffff,84500,0,ffffffff,ffffffff,...) at ffs_indirtrunc+0x5b0/frame 0xf3381878 ffs_truncate(cd542000,0,0,c00,0,...) at ffs_truncate+0x1185/frame 0xf3381a24 ufs_inactive(f3381aa8,c10de039,9c2,c11f0c38,cd542000,...) at ufs_inactive+0x1fc/frame 0xf3381a54 VOP_INACTIVE_APV(c11df748,f3381aa8,c1092cf7,9c2,c0b2f8b8,...) at VOP_INACTIVE_APV+0x103/frame 0xf3381a80 vinactive(cd542000,cab2c2f0,c1092cf7,8c0,cd5420d4,...) at vinactive+0x191/frame 0xf3381ac8 vputx(cd542000,ffffffdf,cd542000,f3381bd0,c10bcb00,...) at vputx+0x382/frame 0xf3381b10 kern_unlinkat(cab2c2f0,ffffff9c,bfbfd980,0,0) at kern_unlinkat+0x29f/frame 0xf3381c24 sys_unlink(cab2c2f0,f3381cc8,f3381c70,c1084d9d,7b3,...) at sys_unlink+0x32/frame 0xf3381c40 syscall(f3381d08) at syscall+0x2ed/frame 0xf3381cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3381cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28179a03, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- load: 0.00 cmd: rw 1581 [snaplk] 1348.67r 0.08u 15.09s 0% 9704k ~# ~#KDB: enter: Break to debugger [ thread pid 11 tid 100005 ] Stopped at kdb_break+0x4e: movl $0,kdb_why db> bt Tracing pid 11 tid 100005 td 0xc7dfb2f0 kdb_break(c8171400,c7b2bb68,691f300,6fd,59a510bb,...) at kdb_break+0x4e/frame 0xc7b2bb0c uart_intr(c8171400,100,c124db30,0,0,...) at uart_intr+0x8e/frame 0xc7b2bb38 intr_event_handle(c7dc8a00,c7b2bbb4,0,c7b2bbb4,2,...) at intr_event_handle+0x7a/frame 0xc7b2bb64 intr_execute_handlers(c7e3d0d0,c7b2bbb4,2) at intr_execute_handlers+0x42/frame 0xc7b2bb84 lapic_handle_intr(30,c7b2bbb4) at lapic_handle_intr+0x6f/frame 0xc7b2bba4 Xapic_isr1() at Xapic_isr1+0x35/frame 0xc7b2bba4 --- interrupt, eip = 0xc0e8a902, esp = 0xc7b2bbf4, ebp = 0xc7b2bc34 --- acpi_cpu_c1(0,c7b2bc50,c0e94b4d,0,3,...) at acpi_cpu_c1+0x2/frame 0xc7b2bc34 cpu_idle_acpi(0,3,c7b2bccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2bc40 cpu_idle(0,2,c1084d9d,a46,c123f108,...) at cpu_idle+0x7d/frame 0xc7b2bc50 sched_idletd(0,c7b2bd08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2bccc fork_exit(c0ac8ae0,0,c7b2bd08) at fork_exit+0x7f/frame 0xc7b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2bcf4 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- db> run pho db:0:pho> bt Tracing pid 11 tid 100005 td 0xc7dfb2f0 kdb_break(c8171400,c7b2bb68,691f300,6fd,59a510bb,...) at kdb_break+0x4e/frame 0xc7b2bb0c uart_intr(c8171400,100,c124db30,0,0,...) at uart_intr+0x8e/frame 0xc7b2bb38 intr_event_handle(c7dc8a00,c7b2bbb4,0,c7b2bbb4,2,...) at intr_event_handle+0x7a/frame 0xc7b2bb64 intr_execute_handlers(c7e3d0d0,c7b2bbb4,2) at intr_execute_handlers+0x42/frame 0xc7b2bb84 lapic_handle_intr(30,c7b2bbb4) at lapic_handle_intr+0x6f/frame 0xc7b2bba4 Xapic_isr1() at Xapic_isr1+0x35/frame 0xc7b2bba4 --- interrupt, eip = 0xc0e8a902, esp = 0xc7b2bbf4, ebp = 0xc7b2bc34 --- acpi_cpu_c1(0,c7b2bc50,c0e94b4d,0,3,...) at acpi_cpu_c1+0x2/frame 0xc7b2bc34 cpu_idle_acpi(0,3,c7b2bccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2bc40 cpu_idle(0,2,c1084d9d,a46,c123f108,...) at cpu_idle+0x7d/frame 0xc7b2bc50 sched_idletd(0,c7b2bd08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2bccc fork_exit(c0ac8ae0,0,c7b2bd08) at fork_exit+0x7f/frame 0xc7b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2bcf4 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x62c300 curthread = 0xc7dfb8d0: pid 11 "idle: cpu0" curpcb = 0xc7b25d60 fpcurthread = none idlethread = 0xc7dfb8d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x691c300 curthread = 0xc7dfb5e0: pid 11 "idle: cpu1" curpcb = 0xc7b28d60 fpcurthread = none idlethread = 0xc7dfb5e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x691f300 curthread = 0xc7dfb2f0: pid 11 "idle: cpu2" curpcb = 0xc7b2bd60 fpcurthread = none idlethread = 0xc7dfb2f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x6922300 curthread = 0xc7dfb000: pid 11 "idle: cpu3" curpcb = 0xc7b2ed60 fpcurthread = none idlethread = 0xc7dfb000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 1810 (mksnap_ffs) thread 0xcdacd5e0 (100163) exclusive lockmgr snaplk (snaplk) r = 0 (0xc7de121c) locked @ ufs/ffs/ffs_snapshot.c:2667 Process 1581 (rw) thread 0xcab2c2f0 (100153) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1db70a0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcd88aa30) locked @ kern/vfs_subr.c:2162 Process 1580 (rw) thread 0xcab2cbc0 (100119) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1edd780) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1df9c40) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1cf81a0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcc20a490) locked @ kern/vfs_vnops.c:795 Process 1579 (rw) thread 0xcab31bc0 (100091) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d0f0e0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1dbbea0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d59b40) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcc270e68) locked @ kern/vfs_vnops.c:795 Process 1578 (rw) thread 0xcab32000 (100090) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1f6e180) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcc10e5f8) locked @ kern/vfs_subr.c:2162 Process 1577 (rw) thread 0xc9888bc0 (100108) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1e64ea0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d91aa0) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcd88a5f8) locked @ kern/vfs_vnops.c:795 Process 1576 (rw) thread 0xcb5c7bc0 (100139) exclusive lockmgr ufs (ufs) r = 0 (0xcc2008c8) locked @ kern/vfs_vnops.c:795 Process 1575 (rw) thread 0xca96f5e0 (100105) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d46d00) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1d6c640) locked @ kern/vfs_bio.c:2631 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1e0c400) locked @ kern/vfs_bio.c:2631 exclusive lockmgr ufs (ufs) r = 0 (0xcd8b1328) locked @ kern/vfs_vnops.c:795 Process 1563 (g_journal switcher) thread 0xcab328d0 (100149) exclusive lockmgr ufs (ufs) r = 0 (0xcd889a30) locked @ kern/vfs_subr.c:2162 Process 18 (syncer) thread 0xca971bc0 (100077) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1f14500) locked @ kern/vfs_bio.c:2631 exclusive lockmgr syncer (syncer) r = 0 (0xcc10ea30) locked @ kern/vfs_subr.c:1781 db:0:alllocks> show lockedvnods Locked vnodes 0xcc10e9d8: tag syncer, type VNON usecount 1, writecount 0, refcount 2 mountedhere 0 flags (VI_ACTIVE) lock type syncer: EXCL by thread 0xca971bc0 (pid 18, syncer, tid 100077) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0b2fab3 at vop_stdlock+0x53 #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b472a0 at sched_sync+0x330 #5 0xc0a711af at fork_exit+0x7f #6 0xc0e8e9d4 at fork_trampoline+0x8 0xcd8899d8: tag ufs, type VDIR usecount 3, writecount 0, refcount 4 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd84c250 ref 0 pages 0 lock type ufs: EXCL by thread 0xcab328d0 (pid 1563, g_journal switcher, tid 100149) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b401b7 at vget+0x77 #5 0xc0cf77d2 at ffs_sync+0x222 #6 0xcd89792d at g_journal_switcher+0x85d #7 0xc0a711af at fork_exit+0x7f #8 0xc0e8e9d4 at fork_trampoline+0x8 ino 32771, on dev md5.journal 0xcc10e5a0: tag ufs, type VREG usecount 0, writecount 0, refcount 3 mountedhere 0 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xd04859d4 ref 0 pages 11 lock type ufs: EXCL by thread 0xcab32000 (pid 1578, rw, tid 100090) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b401b7 at vget+0x77 #5 0xc0b339ac at vfs_hash_get+0xfc #6 0xc0cf3a97 at ffs_vgetf+0x47 #7 0xc0cf3a3e at ffs_vget+0x2e #8 0xc0d028d2 at ufs_lookup_ino+0xe82 #9 0xc0d01a4a at ufs_lookup+0x2a #10 0xc0ec8a33 at VOP_CACHEDLOOKUP_APV+0x103 #11 0xc0b2c63c at vfs_cache_lookup+0xec #12 0xc0ec8873 at VOP_LOOKUP_APV+0x103 #13 0xc0b351ee at lookup+0x52e #14 0xc0b348dd at namei+0x47d #15 0xc0b4b7f3 at kern_unlinkat+0xb3 #16 0xc0b4b482 at sys_unlink+0x32 #17 0xc0ea61ad at syscall+0x2ed ino 32779, on dev md5.journal 0xcd88a9d8: tag ufs, type VREG usecount 0, writecount 0, refcount 4 mountedhere 0 flags (VV_NOSYNC|VI_ACTIVE|VI_DOINGINACT) v_object 0xcc01c784 ref 0 pages 11 lock type ufs: EXCL by thread 0xcab2c2f0 (pid 1581, rw, tid 100153) with exclusive waiters pending #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b401b7 at vget+0x77 #5 0xc0b339ac at vfs_hash_get+0xfc #6 0xc0cf3a97 at ffs_vgetf+0x47 #7 0xc0cf3a3e at ffs_vget+0x2e #8 0xc0d028d2 at ufs_lookup_ino+0xe82 #9 0xc0d01a4a at ufs_lookup+0x2a #10 0xc0ec8a33 at VOP_CACHEDLOOKUP_APV+0x103 #11 0xc0b2c63c at vfs_cache_lookup+0xec #12 0xc0ec8873 at VOP_LOOKUP_APV+0x103 #13 0xc0b351ee at lookup+0x52e #14 0xc0b348dd at namei+0x47d #15 0xc0b4b7f3 at kern_unlinkat+0xb3 #16 0xc0b4b482 at sys_unlink+0x32 #17 0xc0ea61ad at syscall+0x2ed ino 32777, on dev md5.journal 0xcc270e10: tag ufs, type VREG usecount 1, writecount 1, refcount 259 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd8282e4 ref 0 pages 2056 lock type ufs: EXCL by thread 0xcab31bc0 (pid 1579, rw, tid 100091) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b54527 at vn_write+0x237 #5 0xc0b50b67 at vn_io_fault+0x247 #6 0xc0af21b6 at dofilewrite+0x86 #7 0xc0af1ec6 at kern_writev+0x66 #8 0xc0af1e4c at sys_write+0x5c #9 0xc0ea61ad at syscall+0x2ed #10 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 32780, on dev md5.journal 0xcd8b12d0: tag ufs, type VREG usecount 1, writecount 1, refcount 409 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd82840c ref 0 pages 3256 lock type ufs: EXCL by thread 0xca96f5e0 (pid 1575, rw, tid 100105) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b54527 at vn_write+0x237 #5 0xc0b50b67 at vn_io_fault+0x247 #6 0xc0af21b6 at dofilewrite+0x86 #7 0xc0af1ec6 at kern_writev+0x66 #8 0xc0af1e4c at sys_write+0x5c #9 0xc0ea61ad at syscall+0x2ed #10 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 32778, on dev md5.journal 0xcc20a168: tag ufs, type VREG usecount 1, writecount 0, refcount 17 mountedhere 0 flags (VV_SYSTEM|VI_ACTIVE) lock type snaplk: EXCL by thread 0xcdacd5e0 (pid 1810, mksnap_ffs, tid 100163) with exclusive waiters pending #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cd4ec9 at ffs_snapdata_acquire+0x199 #2 0xc0cd2a1b at ffs_snapshot+0x1d5b #3 0xc0cf5829 at ffs_mount+0x1359 #4 0xc0b377f2 at vfs_donmount+0xf12 #5 0xc0b368b8 at sys_nmount+0x78 #6 0xc0ea61ad at syscall+0x2ed #7 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 4, on dev md5.journal 0xcd88a5a0: tag ufs, type VREG usecount 1, writecount 1, refcount 106 mountedhere 0 flags (VI_ACTIVE) v_object 0xd0486534 ref 0 pages 832 lock type ufs: EXCL by thread 0xc9888bc0 (pid 1577, rw, tid 100108) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b54527 at vn_write+0x237 #5 0xc0b50b67 at vn_io_fault+0x247 #6 0xc0af21b6 at dofilewrite+0x86 #7 0xc0af1ec6 at kern_writev+0x66 #8 0xc0af1e4c at sys_write+0x5c #9 0xc0ea61ad at syscall+0x2ed #10 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 32781, on dev md5.journal 0xcc20a438: tag ufs, type VREG usecount 1, writecount 1, refcount 114 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd840940 ref 0 pages 896 lock type ufs: EXCL by thread 0xcab2cbc0 (pid 1580, rw, tid 100119) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b54527 at vn_write+0x237 #5 0xc0b50b67 at vn_io_fault+0x247 #6 0xc0af21b6 at dofilewrite+0x86 #7 0xc0af1ec6 at kern_writev+0x66 #8 0xc0af1e4c at sys_write+0x5c #9 0xc0ea61ad at syscall+0x2ed #10 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 32782, on dev md5.journal 0xcc200870: tag ufs, type VREG usecount 1, writecount 1, refcount 13 mountedhere 0 flags (VI_ACTIVE) v_object 0xcd83fe74 ref 0 pages 88 lock type ufs: EXCL by thread 0xcb5c7bc0 (pid 1576, rw, tid 100139) #0 0xc0a85c48 at __lockmgr_args+0xfa8 #1 0xc0cf910d at ffs_lock+0xad #2 0xc0ecb9e5 at VOP_LOCK1_APV+0xe5 #3 0xc0b5210a at _vn_lock+0xca #4 0xc0b54527 at vn_write+0x237 #5 0xc0b50b67 at vn_io_fault+0x247 #6 0xc0af21b6 at dofilewrite+0x86 #7 0xc0af1ec6 at kern_writev+0x66 #8 0xc0af1e4c at sys_write+0x5c #9 0xc0ea61ad at syscall+0x2ed #10 0xc0e8e9c1 at Xint0x80_syscall+0x21 ino 32776, on dev md5.journal db:0:lockedvnods> show mount 0xcaa50bb0 /dev/ad4s1a on / (ufs) 0xcaa51000 devfs on /dev (devfs) 0xcae245d8 /dev/ad4s1f on /home (ufs) 0xcaa505d8 /dev/ad4s1d on /usr (ufs) 0xcaa502ec /dev/ad4s1e on /var (ufs) 0xcaa50000 procfs on /proc (procfs) 0xcbea0000 /dev/label/tmp on /tmp (ufs) 0xcd8798c4 /dev/md5.journal on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 1810 1548 1305 0 D+ ufs 0xcd88aa30 mksnap_ffs 1581 1574 1572 1004 D+ snaplk 0xc7de121c rw 1580 1574 1572 1004 D+ snaplk 0xc7de121c rw 1579 1574 1572 1004 D+ snaplk 0xc7de121c rw 1578 1574 1572 1004 D+ snaplk 0xc7de121c rw 1577 1574 1572 1004 D+ snaplk 0xc7de121c rw 1576 1574 1572 1004 D+ snaplk 0xc7de121c rw 1575 1574 1572 1004 D+ snaplk 0xc7de121c rw 1574 1572 1572 1004 S+ wait 0xcb40fb40 rw 1572 1570 1572 1004 S+ wait 0xcadae870 rw 1570 1548 1305 0 S+ wait 0xcab0a000 su 1565 0 0 0 DL gj:work 0xca99d400 [g_journal md5] 1563 0 0 0 DL snaplk 0xc7de121c [g_journal switcher] 1561 0 0 0 DL mdwait 0xcb57f800 [md5] 1548 1305 1305 0 S+ wait 0xcb56eb40 sh 1305 1299 1305 0 S+ wait 0xcb40e000 sh 1299 1290 1299 0 S+ pause 0xcab2b058 csh 1298 1 1298 0 Ss+ ttyin 0xc8172670 getty 1297 1 1297 0 Ss+ ttyin 0xc8172870 getty 1296 1 1296 0 Ss+ ttyin 0xc8172a70 getty 1295 1 1295 0 Ss+ ttyin 0xc8172c70 getty 1294 1 1294 0 Ss+ ttyin 0xc8172e70 getty 1293 1 1293 0 Ss+ ttyin 0xc9892070 getty 1292 1 1292 0 Ss+ ttyin 0xc9892270 getty 1291 1 1291 0 Ss+ ttyin 0xc9892470 getty 1290 1 1290 0 Ss+ wait 0xcb56d000 login 1273 1 1273 0 Ss select 0xcab4c324 inetd 1248 1 1248 0 Ss nanslp 0xc12320c0 watchdogd 1181 1 1181 0 Ss nanslp 0xc12320c0 cron 1176 1 1176 25 Ss pause 0xcab288c8 sendmail 1173 1 1173 0 Ss select 0xcab4b7a4 sendmail 1170 1 1170 0 Ss select 0xcab4b724 sshd 1138 1 1138 0 Ss select 0xca95a7a4 moused 1137 1120 1120 0 S select 0xca95b964 winbindd 1133 1118 1118 0 S select 0xca95a7e4 smbd 1120 1 1120 0 Ss select 0xca95aa24 winbindd 1118 1 1118 0 Ss select 0xcab4bb24 smbd 1116 1 1116 0 Ss select 0xca95bde4 nmbd 1092 1 1092 0 Ss select 0xcaa17c64 ntpd 1036 1033 1033 0 S (threaded) nfsd 100125 S rpcsvc 0xcaa80e10 nfsd: service 100124 S rpcsvc 0xc82086d0 nfsd: service 100123 S rpcsvc 0xcaa80c90 nfsd: service 100102 S rpcsvc 0xc8208810 nfsd: master 1033 1 1033 0 Ss select 0xcaa30ae4 nfsd 1031 1027 1027 0 S select 0xcaa17524 nfsuserd 1030 1027 1027 0 S select 0xcab4c1e4 nfsuserd 1029 1027 1027 0 S select 0xca95ad64 nfsuserd 1028 1027 1027 0 S select 0xcaa30b24 nfsuserd 1027 1 1027 0 Ss pause 0xcab08b98 nfsuserd 1011 1 1011 0 Ss select 0xcaa17564 mountd 978 1 978 0 Ss select 0xca95ae24 rpcbind 963 1 963 0 Ss select 0xca95b124 syslogd 840 1 840 0 Ss select 0xcab4c424 devd 19 0 0 0 DL sdflush 0xc13ac528 [softdepflush] 18 0 0 0 DL snaplk 0xc7de121c [syncer] 17 0 0 0 DL vlruwt 0xca96c5a0 [vnlru] 16 0 0 0 DL psleep 0xc13a80e8 [bufdaemon] 9 0 0 0 DL pgzero 0xc13acf4c [pagezero] 8 0 0 0 DL psleep 0xc13acb18 [vmdaemon] 7 0 0 0 DL psleep 0xc1400984 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc11f9a24 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc13fc67c [sctp_iterator] 4 0 0 0 DL - 0xc96f083c [fdc0] 3 0 0 0 SL - 0xc9785000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xc975dd34 [usbus5] 100058 D - 0xc975dd04 [usbus5] 100057 D - 0xc975dcd4 [usbus5] 100056 D - 0xc975dca4 [usbus5] 100054 D - 0xc9750b5c [usbus4] 100053 D - 0xc9750b2c [usbus4] 100052 D - 0xc9750afc [usbus4] 100051 D - 0xc9750acc [usbus4] 100050 D - 0xc974cb5c [usbus3] 100049 D - 0xc974cb2c [usbus3] 100048 D - 0xc974cafc [usbus3] 100047 D - 0xc974cacc [usbus3] 100046 D - 0xc9747b5c [usbus2] 100045 D - 0xc9747b2c [usbus2] 100044 D - 0xc9747afc [usbus2] 100043 D - 0xc9747acc [usbus2] 100041 D - 0xc973eb5c [usbus1] 100040 D - 0xc973eb2c [usbus1] 100039 D - 0xc973eafc [usbus1] 100038 D - 0xc973eacc [usbus1] 100036 D - 0xc9735b5c [usbus0] 100035 D - 0xc9735b2c [usbus0] 100034 D - 0xc9735afc [usbus0] 100033 D - 0xc9735acc [usbus0] 2 0 0 0 DL ctl_work 0xc8236000 [ctl_thrd] 14 0 0 0 DL - 0xc1230fe0 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc13f8798 [g_down] 100014 D - 0xc13f8794 [g_up] 100013 D - 0xc13f8790 [g_event] 12 0 0 0 WL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100026 I [swi6: Giant taskq] 100025 I [swi6: task queue] 100023 I [swi2: cambio] 100018 I [swi5: fast taskq] 100012 I [swi3: vm] 100011 I [swi1: netisr 0] 100010 I [swi4: clock] 100009 I [swi4: clock] 100008 I [swi4: clock] 100007 I [swi4: clock] 11 0 0 0 RL (threaded) [idle] 100006 Run CPU 3 [idle: cpu3] 100005 Run CPU 2 [idle: cpu2] 100004 Run CPU 1 [idle: cpu1] 100003 Run CPU 0 [idle: cpu0] 1 0 1 0 SLs wait 0xc7df9b40 [init] 10 0 0 0 DL audit_wo 0xc13ff444 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xc1230fe0 [deadlkres] 100068 D - 0xc9744140 [mca taskq] 100062 D - 0xc9744700 [fw0_taskq] 100027 D - 0xc7dc3a00 [thread taskq] 100024 D - 0xc7dc3ac0 [ffs_trim taskq] 100022 D - 0xc7dc3c40 [acpi_task_2] 100021 D - 0xc7dc3c40 [acpi_task_1] 100020 D - 0xc7dc3c40 [acpi_task_0] 100019 D - 0xc7dc3c80 [kqueue taskq] 100016 D - 0xc7dc3e40 [firmware taskq] 100000 D sched 0xc13f8814 [swapper] db:0:ps> allt Tracing command mksnap_ffs pid 1810 tid 100163 td 0xcdacd5e0 sched_switch(cdacd5e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf339f468 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf339f49c sleepq_switch(cdacd5e0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf339f4d0 sleepq_wait(cd88aa30,60,c107251c,4,0,...) at sleepq_wait+0x48/frame 0xf339f4f4 sleeplk(cd88aa9c,c107251c,60,33,0,...) at sleeplk+0x11e/frame 0xf339f530 __lockmgr_args(cd88aa30,80100,cd88aa9c,0,0,...) at __lockmgr_args+0xa44/frame 0xf339f610 ffs_lock(f339f690,f339f6d8,f339f690,c0a8e2a7,cd8798c4,...) at ffs_lock+0xad/frame 0xf339f650 VOP_LOCK1_APV(c11df748,f339f690,cd8798c4,f339f6d8,c11f3770,...) at VOP_LOCK1_APV+0xe5/frame 0xf339f678 _vn_lock(cd88a9d8,80100,c10b6d7e,9ed,cd8798c4,...) at _vn_lock+0xca/frame 0xf339f6b8 process_deferred_inactive(cd8798c4,1,c10b6d7e,2a9,0,...) at process_deferred_inactive+0x160/frame 0xf339f700 ffs_snapshot(cd8798c4,cadbb4e0,0,0,0,...) at ffs_snapshot+0x230b/frame 0xf339f900 ffs_mount(cd8798c4,caa5ea00,ff,3ab,caa50bb0,...) at ffs_mount+0x1359/frame 0xf339fa48 vfs_donmount(cdacd5e0,2001340,0,c9781680,c9781680,...) at vfs_donmount+0xf12/frame 0xf339fc18 sys_nmount(cdacd5e0,f339fcc8,14,c1084d9d,7b3,...) at sys_nmount+0x78/frame 0xf339fc40 syscall(f339fd08) at syscall+0x2ed/frame 0xf339fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf339fcfc --- syscall (378, FreeBSD ELF32, sys_nmount), eip = 0x280bf347, esp = 0xbfbfd36c, ebp = 0xbfbfdae4 --- Tracing command rw pid 1581 tid 100153 td 0xcab2c2f0 sched_switch(cab2c2f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3381570 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf33815a4 sleepq_switch(cab2c2f0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf33815d8 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf33815fc sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf3381638 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf3381714 ffs_snapblkfree(cd8a3000,cc2732d0,13888,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf338178c ffs_blkfree(caa68000,cd8a3000,cc2732d0,13888,0,...) at ffs_blkfree+0x57/frame 0xf33817c8 ffs_indirtrunc(ffffffff,80040,0,ffffffff,ffffffff,...) at ffs_indirtrunc+0x5b0/frame 0xf3381878 ffs_truncate(cd88a9d8,0,0,c00,0,...) at ffs_truncate+0x1185/frame 0xf3381a24 ufs_inactive(f3381aa8,c10de039,9c2,c11f0c38,cd88a9d8,...) at ufs_inactive+0x1fc/frame 0xf3381a54 VOP_INACTIVE_APV(c11df748,f3381aa8,c1092cf7,9c2,c0b2f8b8,...) at VOP_INACTIVE_APV+0x103/frame 0xf3381a80 vinactive(cd88a9d8,cab2c2f0,c1092cf7,8c0,cd88aaac,...) at vinactive+0x191/frame 0xf3381ac8 vputx(cd88a9d8,ffffffdf,cd88a9d8,f3381bd0,c10bcb00,...) at vputx+0x382/frame 0xf3381b10 kern_unlinkat(cab2c2f0,ffffff9c,bfbfd980,0,0) at kern_unlinkat+0x29f/frame 0xf3381c24 sys_unlink(cab2c2f0,f3381cc8,c7b18c80,c7b18ccc,0,...) at sys_unlink+0x32/frame 0xf3381c40 syscall(f3381d08) at syscall+0x2ed/frame 0xf3381cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3381cfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28179a03, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1580 tid 100119 td 0xcab2cbc0 sched_switch(cab2cbc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32bd4b0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf32bd4e4 sleepq_switch(cab2cbc0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf32bd518 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf32bd53c sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf32bd578 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf32bd654 ffs_snapblkfree(cd8a3000,cc2732d0,13300,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf32bd6cc ffs_blkfree(caa68000,cd8a3000,cc2732d0,13300,0,...) at ffs_blkfree+0x57/frame 0xf32bd708 ffs_reallocblks(f32bd8b8,c10de433,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf32bd824 VOP_REALLOCBLKS_APV(c11df748,f32bd8b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf32bd850 cluster_write(cc20a438,e1cf8140,378000,0,7f,...) at cluster_write+0x524/frame 0xf32bd8f0 ffs_write(f32bda80,c10ddbf5,c11df748,f32bd9a0,f32bd9d8,...) at ffs_write+0x524/frame 0xf32bd980 VOP_WRITE_APV(c11df748,f32bda80,cc20a438,31b,cab2cbc0,...) at VOP_WRITE_APV+0x178/frame 0xf32bda40 vn_write(cb20bcb0,f32bdc10,caad2100,1,cab2cbc0,...) at vn_write+0x36f/frame 0xf32bdab0 vn_io_fault(cb20bcb0,f32bdc10,caad2100,0,cab2cbc0,...) at vn_io_fault+0x247/frame 0xf32bdb8c dofilewrite(cb20bcb0,f32bdc10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf32bdbc4 kern_writev(cab2cbc0,4,f32bdc10,0,bfbfd980,...) at kern_writev+0x66/frame 0xf32bdbf0 sys_write(cab2cbc0,f32bdcc8,14,c1084d9d,7b3,...) at sys_write+0x5c/frame 0xf32bdc40 syscall(f32bdd08) at syscall+0x2ed/frame 0xf32bdcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32bdcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1579 tid 100091 td 0xcab31bc0 sched_switch(cab31bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32304b0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf32304e4 sleepq_switch(cab31bc0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3230518 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf323053c sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf3230578 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf3230654 ffs_snapblkfree(cd8a3000,cc2732d0,139a8,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf32306cc ffs_blkfree(caa68000,cd8a3000,cc2732d0,139a8,0,...) at ffs_blkfree+0x57/frame 0xf3230708 ffs_reallocblks(f32308b8,c10de433,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf3230824 VOP_REALLOCBLKS_APV(c11df748,f32308b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf3230850 cluster_write(cc270e10,e1d59ae0,800000,0,7f,...) at cluster_write+0x524/frame 0xf32308f0 ffs_write(f3230a80,c10ddbf5,c11df748,f32309a0,f32309d8,...) at ffs_write+0x524/frame 0xf3230980 VOP_WRITE_APV(c11df748,f3230a80,cc270e10,31b,cab31bc0,...) at VOP_WRITE_APV+0x178/frame 0xf3230a40 vn_write(caa93e00,f3230c10,caad2100,1,cab31bc0,...) at vn_write+0x36f/frame 0xf3230ab0 vn_io_fault(caa93e00,f3230c10,caad2100,0,cab31bc0,...) at vn_io_fault+0x247/frame 0xf3230b8c dofilewrite(caa93e00,f3230c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf3230bc4 kern_writev(cab31bc0,4,f3230c10,0,bfbfd980,...) at kern_writev+0x66/frame 0xf3230bf0 sys_write(cab31bc0,f3230cc8,f3230d08,1,1,...) at sys_write+0x5c/frame 0xf3230c40 syscall(f3230d08) at syscall+0x2ed/frame 0xf3230cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3230cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1578 tid 100090 td 0xcab32000 sched_switch(cab32000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf322c570 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf322c5a4 sleepq_switch(cab32000,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf322c5d8 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf322c5fc sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf322c638 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf322c714 ffs_snapblkfree(cd8a3000,cc2732d0,17f88,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf322c78c ffs_blkfree(caa68000,cd8a3000,cc2732d0,17f88,0,...) at ffs_blkfree+0x57/frame 0xf322c7c8 ffs_indirtrunc(ffffffff,84580,0,ffffffff,ffffffff,...) at ffs_indirtrunc+0x5b0/frame 0xf322c878 ffs_truncate(cc10e5a0,0,0,c00,0,...) at ffs_truncate+0x1185/frame 0xf322ca24 ufs_inactive(f322caa8,c10de039,9c2,c11f0c38,cc10e5a0,...) at ufs_inactive+0x1fc/frame 0xf322ca54 VOP_INACTIVE_APV(c11df748,f322caa8,c1092cf7,9c2,c0b2f8b8,...) at VOP_INACTIVE_APV+0x103/frame 0xf322ca80 vinactive(cc10e5a0,cab32000,c1092cf7,8c0,cc10e674,...) at vinactive+0x191/frame 0xf322cac8 vputx(cc10e5a0,ffffffdf,cc10e5a0,f322cbd0,c10bcb00,...) at vputx+0x382/frame 0xf322cb10 kern_unlinkat(cab32000,ffffff9c,bfbfd980,0,0) at kern_unlinkat+0x29f/frame 0xf322cc24 sys_unlink(cab32000,f322ccc8,c7b15cb4,8a1800,f322cc9c,...) at sys_unlink+0x32/frame 0xf322cc40 syscall(f322cd08) at syscall+0x2ed/frame 0xf322ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf322ccfc --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28179a03, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1577 tid 100108 td 0xc9888bc0 sched_switch(c9888bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32844b0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf32844e4 sleepq_switch(c9888bc0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3284518 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf328453c sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf3284578 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf3284654 ffs_snapblkfree(cd8a3000,cc2732d0,12c18,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf32846cc ffs_blkfree(caa68000,cd8a3000,cc2732d0,12c18,0,...) at ffs_blkfree+0x57/frame 0xf3284708 ffs_reallocblks(f32848b8,c10de433,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf3284824 VOP_REALLOCBLKS_APV(c11df748,f32848b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf3284850 cluster_write(cd88a5a0,e1d91a40,338000,0,7f,...) at cluster_write+0x524/frame 0xf32848f0 ffs_write(f3284a80,c10ddbf5,c11df748,f32849a0,f32849d8,...) at ffs_write+0x524/frame 0xf3284980 VOP_WRITE_APV(c11df748,f3284a80,cd88a5a0,31b,c9888bc0,...) at VOP_WRITE_APV+0x178/frame 0xf3284a40 vn_write(caa93498,f3284c10,caad2100,1,c9888bc0,...) at vn_write+0x36f/frame 0xf3284ab0 vn_io_fault(caa93498,f3284c10,caad2100,0,c9888bc0,...) at vn_io_fault+0x247/frame 0xf3284b8c dofilewrite(caa93498,f3284c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf3284bc4 kern_writev(c9888bc0,4,f3284c10,0,bfbfd980,...) at kern_writev+0x66/frame 0xf3284bf0 sys_write(c9888bc0,f3284cc8,14,c1084d9d,7b3,...) at sys_write+0x5c/frame 0xf3284c40 syscall(f3284d08) at syscall+0x2ed/frame 0xf3284cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3284cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1576 tid 100139 td 0xcb5c7bc0 sched_switch(cb5c7bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf33574e8 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf335751c sleepq_switch(cb5c7bc0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3357550 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf3357574 sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf33575b0 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf335768c ffs_copyonwrite(cc2732d0,e1df2f00,e1df2f00,8d1ca,0,...) at ffs_copyonwrite+0x1d1/frame 0xf33576fc ffs_geom_strategy(cc2733c8,e1df2f00,c0ea1fac,cd83fe84,cc200870,...) at ffs_geom_strategy+0xbf/frame 0xf3357718 ufs_strategy(f33577a8,c10de1af,c0ae55a9,e1df2f80,4c,...) at ufs_strategy+0xce/frame 0xf3357764 VOP_STRATEGY_APV(c11df748,f33577a8,c0a861db,e1df2f80,c11f3bc0,...) at VOP_STRATEGY_APV+0x111/frame 0xf3357790 bufstrategy(cc200968,e1df2f00,39f,f33,4,...) at bufstrategy+0x4c/frame 0xf33577c0 bufwrite(e1df2f00,80300,cc200968,0,0,...) at bufwrite+0x161/frame 0xf33577f0 cluster_wbuild(cc200870,8000,7,0,4,...) at cluster_wbuild+0x7ce/frame 0xf3357850 cluster_write(cc200870,e1df2f00,58000,0,59,...) at cluster_write+0x16a/frame 0xf33578f0 ffs_write(f3357a80,c10ddbf5,c11df748,f33579a0,f33579d8,...) at ffs_write+0x524/frame 0xf3357980 VOP_WRITE_APV(c11df748,f3357a80,cc200870,31b,cb5c7bc0,...) at VOP_WRITE_APV+0x178/frame 0xf3357a40 vn_write(caa93b28,f3357c10,caad2100,1,cb5c7bc0,...) at vn_write+0x36f/frame 0xf3357ab0 vn_io_fault(caa93b28,f3357c10,caad2100,0,cb5c7bc0,...) at vn_io_fault+0x247/frame 0xf3357b8c dofilewrite(caa93b28,f3357c10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf3357bc4 kern_writev(cb5c7bc0,4,f3357c10,0,bfbfd980,...) at kern_writev+0x66/frame 0xf3357bf0 sys_write(cb5c7bc0,f3357cc8,14,c1084d9d,7b3,...) at sys_write+0x5c/frame 0xf3357c40 syscall(f3357d08) at syscall+0x2ed/frame 0xf3357cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3357cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1575 tid 100105 td 0xca96f5e0 sched_switch(ca96f5e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf327b4b0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf327b4e4 sleepq_switch(ca96f5e0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf327b518 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf327b53c sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf327b578 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf327b654 ffs_snapblkfree(cd8a3000,cc2732d0,139b8,0,8000,...) at ffs_snapblkfree+0xc0/frame 0xf327b6cc ffs_blkfree(caa68000,cd8a3000,cc2732d0,139b8,0,...) at ffs_blkfree+0x57/frame 0xf327b708 ffs_reallocblks(f327b8b8,c10de433,0,0,0,...) at ffs_reallocblks+0x14e2/frame 0xf327b824 VOP_REALLOCBLKS_APV(c11df748,f327b8b8,0,8000,0,...) at VOP_REALLOCBLKS_APV+0x109/frame 0xf327b850 cluster_write(cd8b12d0,e1e0c3a0,cb0000,0,7f,...) at cluster_write+0x524/frame 0xf327b8f0 ffs_write(f327ba80,c10ddbf5,c11df748,f327b9a0,f327b9d8,...) at ffs_write+0x524/frame 0xf327b980 VOP_WRITE_APV(c11df748,f327ba80,cd8b12d0,31b,ca96f5e0,...) at VOP_WRITE_APV+0x178/frame 0xf327ba40 vn_write(caabddc8,f327bc10,caad2100,1,ca96f5e0,...) at vn_write+0x36f/frame 0xf327bab0 vn_io_fault(caabddc8,f327bc10,caad2100,0,ca96f5e0,...) at vn_io_fault+0x247/frame 0xf327bb8c dofilewrite(caabddc8,f327bc10,ffffffff,ffffffff,0,...) at dofilewrite+0x86/frame 0xf327bbc4 kern_writev(ca96f5e0,4,f327bc10,0,bfbfd980,...) at kern_writev+0x66/frame 0xf327bbf0 sys_write(ca96f5e0,f327bcc8,14,c1084d9d,7b3,...) at sys_write+0x5c/frame 0xf327bc40 syscall(f327bd08) at syscall+0x2ed/frame 0xf327bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf327bcfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2818e247, esp = 0xbfbfc968, ebp = 0xbfbfda10 --- Tracing command rw pid 1574 tid 100127 td 0xcaa81bc0 sched_switch(caa81bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3333978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33339ac sleepq_switch(caa81bc0,0,c108835c,1ad,f3333a24,...) at sleepq_switch+0x1b9/frame 0xf33339e0 sleepq_catch_signals(0,c108835c,166,b88,caa81bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3333a28 sleepq_wait_sig(cb40fb40,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3333a4c _sleep(cb40fb40,cb40fbc8,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf3333aa4 kern_wait6(caa81bc0,0,627,0,f3333bec,...) at kern_wait6+0x3ec/frame 0xf3333b00 kern_wait(caa81bc0,627,f3333bec,0,0,...) at kern_wait+0xd8/frame 0xf3333bd0 sys_wait4(caa81bc0,f3333cc8,0,0,caa81bc0,...) at sys_wait4+0x41/frame 0xf3333c40 syscall(f3333d08) at syscall+0x2ed/frame 0xf3333cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3333cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eae5f, esp = 0xbfbfd9f8, ebp = 0xbfbfda10 --- Tracing command rw pid 1572 tid 100140 td 0xcb5c78d0 sched_switch(cb5c78d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf335a978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf335a9ac sleepq_switch(cb5c78d0,0,c108835c,1ad,f335aa24,...) at sleepq_switch+0x1b9/frame 0xf335a9e0 sleepq_catch_signals(0,c108835c,166,9c0,cb5c78d0,...) at sleepq_catch_signals+0x3b1/frame 0xf335aa28 sleepq_wait_sig(cadae870,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf335aa4c _sleep(cadae870,cadae8f8,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf335aaa4 kern_wait6(cb5c78d0,0,626,0,f335abec,...) at kern_wait6+0x3ec/frame 0xf335ab00 kern_wait(cb5c78d0,626,f335abec,0,0,...) at kern_wait+0xd8/frame 0xf335abd0 sys_wait4(cb5c78d0,f335acc8,f335ad08,1,1,...) at sys_wait4+0x41/frame 0xf335ac40 syscall(f335ad08) at syscall+0x2ed/frame 0xf335acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf335acfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280eae5f, esp = 0xbfbfd9f8, ebp = 0xbfbfda10 --- Tracing command su pid 1570 tid 100092 td 0xcab122f0 sched_switch(cab122f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3235978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf32359ac sleepq_switch(cab122f0,0,c108835c,1ad,f3235a24,...) at sleepq_switch+0x1b9/frame 0xf32359e0 sleepq_catch_signals(0,c108835c,166,300,cab122f0,...) at sleepq_catch_signals+0x3b1/frame 0xf3235a28 sleepq_wait_sig(cab0a000,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3235a4c _sleep(cab0a000,cab0a088,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf3235aa4 kern_wait6(cab122f0,0,624,0,f3235bec,...) at kern_wait6+0x3ec/frame 0xf3235b00 kern_wait(cab122f0,624,f3235bec,2,0,...) at kern_wait+0xd8/frame 0xf3235bd0 sys_wait4(cab122f0,f3235cc8,f3235d08,1,1,...) at sys_wait4+0x41/frame 0xf3235c40 syscall(f3235d08) at syscall+0x2ed/frame 0xf3235cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3235cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810ce5f, esp = 0xbfbfd5c0, ebp = 0xbfbfd5d8 --- Tracing command g_journal md5 pid 1565 tid 100080 td 0xca9715e0 sched_switch(ca9715e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf31fd8ec mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf31fd920 sleepq_switch(ca9715e0,0,c108835c,26f,ca9715e0,...) at sleepq_switch+0x1b9/frame 0xf31fd954 sleepq_wait(ca99d400,5c,cd89fb36,0,0,...) at sleepq_wait+0x48/frame 0xf31fd978 _sleep(ca99d400,ca99d410,25c,cd89fb36,0,...) at _sleep+0x34e/frame 0xf31fd9d0 g_journal_worker(ca99d400,f31fdd08,c107c4a8,3d7,0,...) at g_journal_worker+0x18e8/frame 0xf31fdccc fork_exit(cd89bf00,ca99d400,f31fdd08) at fork_exit+0x7f/frame 0xf31fdcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf31fdcf4 --- trap 0, eip = 0, esp = 0xf31fdd40, ebp = 0 --- Tracing command g_journal switcher pid 1563 tid 100149 td 0xcab328d0 sched_switch(cab328d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3375818 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf337584c sleepq_switch(cab328d0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xf3375880 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xf33758a4 sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xf33758e0 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xf33759bc ffs_copyonwrite(cc2732d0,e1ea79e0,e1ea79e0,841d8,0,...) at ffs_copyonwrite+0x1d1/frame 0xf3375a2c ffs_geom_strategy(cc2733c8,e1ea79e0,c7d94d48,c7d92440,cd8899d8,...) at ffs_geom_strategy+0xbf/frame 0xf3375a48 ufs_strategy(f3375ad8,c10de1af,c0ae55a9,e1ea7a60,4c,...) at ufs_strategy+0xce/frame 0xf3375a94 VOP_STRATEGY_APV(c11df748,f3375ad8,c0a861db,e1ea7a60,c11f3bc0,...) at VOP_STRATEGY_APV+0x111/frame 0xf3375ac0 bufstrategy(cd889ad0,e1ea79e0,39f,f33,889,...) at bufstrategy+0x4c/frame 0xf3375af0 bufwrite(e1ea79e0,0,c10ba9a0,107,0,...) at bufwrite+0x161/frame 0xf3375b20 ffs_syncvnode(cd8899d8,2,0,61e,f3375bb8,...) at ffs_syncvnode+0x32c/frame 0xf3375b78 ffs_sync(cd8798c4,2,1,b5d,2710,...) at ffs_sync+0x23e/frame 0xf3375c00 g_journal_switcher(cd8a1b68,f3375d08,c107c4a8,3d7,0,...) at g_journal_switcher+0x85d/frame 0xf3375ccc fork_exit(cd8970d0,cd8a1b68,f3375d08) at fork_exit+0x7f/frame 0xf3375cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3375cf4 --- trap 0, eip = 0, esp = 0xf3375d40, ebp = 0 --- Tracing command md5 pid 1561 tid 100134 td 0xcb5c8bc0 sched_switch(cb5c8bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3348bb4 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xf3348be8 sleepq_switch(cb5c8bc0,0,c108835c,26f,cb5c8bc0,...) at sleepq_switch+0x1b9/frame 0xf3348c1c sleepq_wait(cb57f800,5c,c101dbed,0,0,...) at sleepq_wait+0x48/frame 0xf3348c40 _sleep(cb57f800,cb57f820,25c,c101dbed,0,...) at _sleep+0x34e/frame 0xf3348c98 md_kthread(cb57f800,f3348d08,c107c4a8,3d7,0,...) at md_kthread+0xf8/frame 0xf3348ccc fork_exit(c0789060,cb57f800,f3348d08) at fork_exit+0x7f/frame 0xf3348cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3348cf4 --- trap 0, eip = 0, esp = 0xf3348d40, ebp = 0 --- Tracing command sh pid 1548 tid 100130 td 0xcae438d0 sched_switch(cae438d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf333c978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf333c9ac sleepq_switch(cae438d0,0,c108835c,1ad,f333ca24,...) at sleepq_switch+0x1b9/frame 0xf333c9e0 sleepq_catch_signals(0,c108835c,166,a08,cae438d0,...) at sleepq_catch_signals+0x3b1/frame 0xf333ca28 sleepq_wait_sig(cb56eb40,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf333ca4c _sleep(cb56eb40,cb56ebc8,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf333caa4 kern_wait6(cae438d0,7,0,0,f333cbec,...) at kern_wait6+0x3ec/frame 0xf333cb00 kern_wait(cae438d0,ffffffff,f333cbec,0,0,...) at kern_wait+0xd8/frame 0xf333cbd0 sys_wait4(cae438d0,f333ccc8,c10d70ff,e9,f333ccc4,...) at sys_wait4+0x41/frame 0xf333cc40 syscall(f333cd08) at syscall+0x2ed/frame 0xf333ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf333ccfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2814fe5f, esp = 0xbfbfd958, ebp = 0xbfbfd970 --- Tracing command sh pid 1305 tid 100138 td 0xcb5c8000 sched_switch(cb5c8000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3354978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33549ac sleepq_switch(cb5c8000,0,c108835c,1ad,f3354a24,...) at sleepq_switch+0x1b9/frame 0xf33549e0 sleepq_catch_signals(0,c108835c,166,900,cb5c8000,...) at sleepq_catch_signals+0x3b1/frame 0xf3354a28 sleepq_wait_sig(cb40e000,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3354a4c _sleep(cb40e000,cb40e088,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf3354aa4 kern_wait6(cb5c8000,7,0,0,f3354bec,...) at kern_wait6+0x3ec/frame 0xf3354b00 kern_wait(cb5c8000,ffffffff,f3354bec,0,0,...) at kern_wait+0xd8/frame 0xf3354bd0 sys_wait4(cb5c8000,f3354cc8,c10d70ff,e9,1,...) at sys_wait4+0x41/frame 0xf3354c40 syscall(f3354d08) at syscall+0x2ed/frame 0xf3354cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3354cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2814fe5f, esp = 0xbfbfd958, ebp = 0xbfbfd970 --- Tracing command csh pid 1299 tid 100088 td 0xcab325e0 sched_switch(cab325e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3222ab4 mi_switch(104,0,c108835c,1f9,c108835c,...) at mi_switch+0x1c9/frame 0xf3222ae8 sleepq_switch(cab325e0,0,c108835c,1ad,f3222b60,...) at sleepq_switch+0x1b9/frame 0xf3222b1c sleepq_catch_signals(0,c108835c,166,480,cab325e0,...) at sleepq_catch_signals+0x3b1/frame 0xf3222b64 sleepq_wait_sig(cab2b058,74,c0f00260,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3222b88 _sleep(cab2b058,cab2b088,174,c0f00260,0,...) at _sleep+0x32d/frame 0xf3222be0 kern_sigsuspend(cab325e0,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf3222c10 sys_sigsuspend(cab325e0,f3222cc8,c10d70ff,e9,1,...) at sys_sigsuspend+0x58/frame 0xf3222c40 syscall(f3222d08) at syscall+0x2ed/frame 0xf3222cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3222cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816a497, esp = 0xbfbfd27c, ebp = 0xbfbfd2e4 --- Tracing command getty pid 1298 tid 100114 td 0xcab118d0 sched_switch(cab118d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf329b9b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf329b9ec sleepq_switch(cab118d0,0,c108835c,1ad,f329ba64,...) at sleepq_switch+0x1b9/frame 0xf329ba20 sleepq_catch_signals(0,c108835c,166,390,1,...) at sleepq_catch_signals+0x3b1/frame 0xf329ba68 sleepq_wait_sig(c8172670,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf329ba8c _cv_wait_sig(c8172670,c13f9124,c108d08d,531,f329bc10,...) at _cv_wait_sig+0x200/frame 0xf329bad4 tty_wait(c8172600,c8172670,f329bc10,1,0,...) at tty_wait+0x4b/frame 0xf329baf8 ttydisc_read(c8172600,f329bc10,0,a1,f329bc10,...) at ttydisc_read+0x377/frame 0xf329bb3c ttydev_read(c973bb00,f329bc10,0,1,0,...) at ttydev_read+0x81/frame 0xf329bb5c devfs_read_f(caab7d90,f329bc10,c7dd4e80,0,cab118d0,...) at devfs_read_f+0x87/frame 0xf329bb90 dofileread(caab7d90,f329bc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf329bbc4 kern_readv(cab118d0,0,f329bc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf329bbf0 sys_read(cab118d0,f329bcc8,f329bd08,1,1,...) at sys_read+0x5c/frame 0xf329bc40 syscall(f329bd08) at syscall+0x2ed/frame 0xf329bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf329bcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1297 tid 100086 td 0xcaa858d0 sched_switch(caa858d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf321a9b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf321a9ec sleepq_switch(caa858d0,0,c108835c,1ad,f321aa64,...) at sleepq_switch+0x1b9/frame 0xf321aa20 sleepq_catch_signals(0,c108835c,166,3c0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf321aa68 sleepq_wait_sig(c8172870,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf321aa8c _cv_wait_sig(c8172870,c13f9124,c108d08d,531,f321ac10,...) at _cv_wait_sig+0x200/frame 0xf321aad4 tty_wait(c8172800,c8172870,f321ac10,1,0,...) at tty_wait+0x4b/frame 0xf321aaf8 ttydisc_read(c8172800,f321ac10,0,a1,f321ac10,...) at ttydisc_read+0x377/frame 0xf321ab3c ttydev_read(c973bc00,f321ac10,0,1,0,...) at ttydev_read+0x81/frame 0xf321ab5c devfs_read_f(caab7e00,f321ac10,c7dd4e80,0,caa858d0,...) at devfs_read_f+0x87/frame 0xf321ab90 dofileread(caab7e00,f321ac10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf321abc4 kern_readv(caa858d0,0,f321ac10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf321abf0 sys_read(caa858d0,f321acc8,f321ad08,1,1,...) at sys_read+0x5c/frame 0xf321ac40 syscall(f321ad08) at syscall+0x2ed/frame 0xf321acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf321acfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1296 tid 100128 td 0xcaa818d0 sched_switch(caa818d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf33369b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33369ec sleepq_switch(caa818d0,0,c108835c,1ad,f3336a64,...) at sleepq_switch+0x1b9/frame 0xf3336a20 sleepq_catch_signals(0,c108835c,166,3f0,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3336a68 sleepq_wait_sig(c8172a70,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3336a8c _cv_wait_sig(c8172a70,c13f9124,c108d08d,531,f3336c10,...) at _cv_wait_sig+0x200/frame 0xf3336ad4 tty_wait(c8172a00,c8172a70,f3336c10,1,0,...) at tty_wait+0x4b/frame 0xf3336af8 ttydisc_read(c8172a00,f3336c10,0,a1,f3336c10,...) at ttydisc_read+0x377/frame 0xf3336b3c ttydev_read(c973bd00,f3336c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3336b5c devfs_read_f(caa942a0,f3336c10,c7dd4e80,0,caa818d0,...) at devfs_read_f+0x87/frame 0xf3336b90 dofileread(caa942a0,f3336c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3336bc4 kern_readv(caa818d0,0,f3336c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3336bf0 sys_read(caa818d0,f3336cc8,f3336d08,1,1,...) at sys_read+0x5c/frame 0xf3336c40 syscall(f3336d08) at syscall+0x2ed/frame 0xf3336cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3336cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1295 tid 100112 td 0xcae458d0 sched_switch(cae458d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32919b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf32919ec sleepq_switch(cae458d0,0,c108835c,1ad,f3291a64,...) at sleepq_switch+0x1b9/frame 0xf3291a20 sleepq_catch_signals(0,c108835c,166,420,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3291a68 sleepq_wait_sig(c8172c70,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3291a8c _cv_wait_sig(c8172c70,c13f9124,c108d08d,531,f3291c10,...) at _cv_wait_sig+0x200/frame 0xf3291ad4 tty_wait(c8172c00,c8172c70,f3291c10,1,0,...) at tty_wait+0x4b/frame 0xf3291af8 ttydisc_read(c8172c00,f3291c10,0,a1,f3291c10,...) at ttydisc_read+0x377/frame 0xf3291b3c ttydev_read(c973be00,f3291c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3291b5c devfs_read_f(caab7af0,f3291c10,c7dd4e80,0,cae458d0,...) at devfs_read_f+0x87/frame 0xf3291b90 dofileread(caab7af0,f3291c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3291bc4 kern_readv(cae458d0,0,f3291c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3291bf0 sys_read(cae458d0,f3291cc8,f3291d08,1,1,...) at sys_read+0x5c/frame 0xf3291c40 syscall(f3291d08) at syscall+0x2ed/frame 0xf3291cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3291cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1294 tid 100143 td 0xcae41bc0 sched_switch(cae41bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf33639b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33639ec sleepq_switch(cae41bc0,0,c108835c,1ad,f3363a64,...) at sleepq_switch+0x1b9/frame 0xf3363a20 sleepq_catch_signals(0,c108835c,166,450,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3363a68 sleepq_wait_sig(c8172e70,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3363a8c _cv_wait_sig(c8172e70,c13f9124,c108d08d,531,f3363c10,...) at _cv_wait_sig+0x200/frame 0xf3363ad4 tty_wait(c8172e00,c8172e70,f3363c10,1,0,...) at tty_wait+0x4b/frame 0xf3363af8 ttydisc_read(c8172e00,f3363c10,0,a1,f3363c10,...) at ttydisc_read+0x377/frame 0xf3363b3c ttydev_read(c988f000,f3363c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3363b5c devfs_read_f(caa947a8,f3363c10,c7dd4e80,0,cae41bc0,...) at devfs_read_f+0x87/frame 0xf3363b90 dofileread(caa947a8,f3363c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3363bc4 kern_readv(cae41bc0,0,f3363c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3363bf0 sys_read(cae41bc0,f3363cc8,f3363d08,1,1,...) at sys_read+0x5c/frame 0xf3363c40 syscall(f3363d08) at syscall+0x2ed/frame 0xf3363cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3363cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1293 tid 100145 td 0xcae415e0 sched_switch(cae415e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf33699b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33699ec sleepq_switch(cae415e0,0,c108835c,1ad,f3369a64,...) at sleepq_switch+0x1b9/frame 0xf3369a20 sleepq_catch_signals(0,c108835c,166,300,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3369a68 sleepq_wait_sig(c9892070,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3369a8c _cv_wait_sig(c9892070,c13f9124,c108d08d,531,f3369c10,...) at _cv_wait_sig+0x200/frame 0xf3369ad4 tty_wait(c9892000,c9892070,f3369c10,1,0,...) at tty_wait+0x4b/frame 0xf3369af8 ttydisc_read(c9892000,f3369c10,0,a1,f3369c10,...) at ttydisc_read+0x377/frame 0xf3369b3c ttydev_read(c988f100,f3369c10,0,1,0,...) at ttydev_read+0x81/frame 0xf3369b5c devfs_read_f(caab7888,f3369c10,c7dd4e80,0,cae415e0,...) at devfs_read_f+0x87/frame 0xf3369b90 dofileread(caab7888,f3369c10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf3369bc4 kern_readv(cae415e0,0,f3369c10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf3369bf0 sys_read(cae415e0,f3369cc8,c1825cb4,281a3e80,f3369c9c,...) at sys_read+0x5c/frame 0xf3369c40 syscall(f3369d08) at syscall+0x2ed/frame 0xf3369cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3369cfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1292 tid 100146 td 0xcae412f0 sched_switch(cae412f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf336c9b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf336c9ec sleepq_switch(cae412f0,0,c108835c,1ad,f336ca64,...) at sleepq_switch+0x1b9/frame 0xf336ca20 sleepq_catch_signals(0,c108835c,166,330,1,...) at sleepq_catch_signals+0x3b1/frame 0xf336ca68 sleepq_wait_sig(c9892270,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf336ca8c _cv_wait_sig(c9892270,c13f9124,c108d08d,531,f336cc10,...) at _cv_wait_sig+0x200/frame 0xf336cad4 tty_wait(c9892200,c9892270,f336cc10,1,0,...) at tty_wait+0x4b/frame 0xf336caf8 ttydisc_read(c9892200,f336cc10,0,a1,f336cc10,...) at ttydisc_read+0x377/frame 0xf336cb3c ttydev_read(c988f200,f336cc10,0,1,0,...) at ttydev_read+0x81/frame 0xf336cb5c devfs_read_f(caad6770,f336cc10,c7dd4e80,0,cae412f0,...) at devfs_read_f+0x87/frame 0xf336cb90 dofileread(caad6770,f336cc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf336cbc4 kern_readv(cae412f0,0,f336cc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf336cbf0 sys_read(cae412f0,f336ccc8,f336cd08,1,1,...) at sys_read+0x5c/frame 0xf336cc40 syscall(f336cd08) at syscall+0x2ed/frame 0xf336ccfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf336ccfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command getty pid 1291 tid 100147 td 0xcae41000 sched_switch(cae41000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf336f9b8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf336f9ec sleepq_switch(cae41000,0,c108835c,1ad,f336fa64,...) at sleepq_switch+0x1b9/frame 0xf336fa20 sleepq_catch_signals(0,c108835c,166,360,1,...) at sleepq_catch_signals+0x3b1/frame 0xf336fa68 sleepq_wait_sig(c9892470,0,c108d0a1,101,0,...) at sleepq_wait_sig+0x14/frame 0xf336fa8c _cv_wait_sig(c9892470,c13f9124,c108d08d,531,f336fc10,...) at _cv_wait_sig+0x200/frame 0xf336fad4 tty_wait(c9892400,c9892470,f336fc10,1,0,...) at tty_wait+0x4b/frame 0xf336faf8 ttydisc_read(c9892400,f336fc10,0,a1,f336fc10,...) at ttydisc_read+0x377/frame 0xf336fb3c ttydev_read(c988f300,f336fc10,0,1,0,...) at ttydev_read+0x81/frame 0xf336fb5c devfs_read_f(caab7b28,f336fc10,c7dd4e80,0,cae41000,...) at devfs_read_f+0x87/frame 0xf336fb90 dofileread(caab7b28,f336fc10,ffffffff,ffffffff,0,...) at dofileread+0x99/frame 0xf336fbc4 kern_readv(cae41000,0,f336fc10,0,bfbfddfb,...) at kern_readv+0x66/frame 0xf336fbf0 sys_read(cae41000,f336fcc8,f336fd08,1,1,...) at sys_read+0x5c/frame 0xf336fc40 syscall(f336fd08) at syscall+0x2ed/frame 0xf336fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf336fcfc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f257, esp = 0xbfbfdde0, ebp = 0xbfbfde08 --- Tracing command login pid 1290 tid 100148 td 0xcab32bc0 sched_switch(cab32bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3372978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xf33729ac sleepq_switch(cab32bc0,0,c108835c,1ad,f3372a24,...) at sleepq_switch+0x1b9/frame 0xf33729e0 sleepq_catch_signals(0,c108835c,166,780,cab32bc0,...) at sleepq_catch_signals+0x3b1/frame 0xf3372a28 sleepq_wait_sig(cb56d000,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3372a4c _sleep(cb56d000,cb56d088,16c,c108b811,0,...) at _sleep+0x32d/frame 0xf3372aa4 kern_wait6(cab32bc0,0,513,0,f3372bec,...) at kern_wait6+0x3ec/frame 0xf3372b00 kern_wait(cab32bc0,513,f3372bec,0,0,...) at kern_wait+0xd8/frame 0xf3372bd0 sys_wait4(cab32bc0,f3372cc8,f3372d08,1,1,...) at sys_wait4+0x41/frame 0xf3372c40 syscall(f3372d08) at syscall+0x2ed/frame 0xf3372cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3372cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810ee5f, esp = 0xbfbfdd58, ebp = 0xbfbfdd70 --- Tracing command inetd pid 1273 tid 100107 td 0xca96f000 sched_switch(ca96f000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3281918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf328194c sleepq_switch(ca96f000,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3281980 sleepq_catch_signals(f32819ec,c0a8dc29,cab4c320,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32819c8 sleepq_wait_sig(cab4c324,0,f3281a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32819ec _cv_wait_sig(cab4c324,cab4c310,c108b0dc,677,8,...) at _cv_wait_sig+0x200/frame 0xf3281a34 seltdwait(caa948c0,58,c7dd4e80,ca96f000,0,...) at seltdwait+0x8c/frame 0xf3281a58 kern_select(ca96f000,8,bfbfd008,0,0,...) at kern_select+0x85f/frame 0xf3281bf8 sys_select(ca96f000,f3281cc8,f3281d08,1,1,...) at sys_select+0x69/frame 0xf3281c40 syscall(f3281d08) at syscall+0x2ed/frame 0xf3281cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3281cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a2217, esp = 0xbfbfcf84, ebp = 0xbfbfde34 --- Tracing command watchdogd pid 1248 tid 100142 td 0xcae43000 sched_switch(cae43000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3360a80 mi_switch(104,0,c108835c,1f9,c13f9e00,...) at mi_switch+0x1c9/frame 0xf3360ab4 sleepq_switch(cae43000,0,c108835c,1ad,f3360b2c,...) at sleepq_switch+0x1b9/frame 0xf3360ae8 sleepq_catch_signals(ea61,c0ae2960,cae43000,2,2,...) at sleepq_catch_signals+0x3b1/frame 0xf3360b30 sleepq_timedwait_sig(c12320c0,6c,c1083f56,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3360b58 _sleep(c12320c0,0,16c,c1083f56,ea61,...) at _sleep+0x303/frame 0xf3360bb0 kern_nanosleep(bfbfdd08,f3360c18,f3360c20,caaba880,3c,...) at kern_nanosleep+0xd9/frame 0xf3360c00 sys_nanosleep(cae43000,f3360cc8,c7b1bc80,c7b1bccc,0,...) at sys_nanosleep+0x6b/frame 0xf3360c40 syscall(f3360d08) at syscall+0x2ed/frame 0xf3360cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3360cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281698af, esp = 0xbfbfdcfc, ebp = 0xbfbfdd40 --- Tracing command cron pid 1181 tid 100109 td 0xc98888d0 sched_switch(c98888d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3288a80 mi_switch(104,0,c108835c,1f9,c13f9d00,...) at mi_switch+0x1c9/frame 0xf3288ab4 sleepq_switch(c98888d0,0,c108835c,1ad,f3288b2c,...) at sleepq_switch+0x1b9/frame 0xf3288ae8 sleepq_catch_signals(10c7,c0ae2960,c98888d0,1,1,...) at sleepq_catch_signals+0x3b1/frame 0xf3288b30 sleepq_timedwait_sig(c12320c0,6c,c1083f56,100,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3288b58 _sleep(c12320c0,0,16c,c1083f56,10c7,...) at _sleep+0x303/frame 0xf3288bb0 kern_nanosleep(bfbfde28,f3288c18,f3288c20,f3288cc8,4,...) at kern_nanosleep+0xd9/frame 0xf3288c00 sys_nanosleep(c98888d0,f3288cc8,0,0,c98888d0,...) at sys_nanosleep+0x6b/frame 0xf3288c40 syscall(f3288d08) at syscall+0x2ed/frame 0xf3288cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3288cfc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x281788af, esp = 0xbfbfdcb4, ebp = 0xbfbfde44 --- Tracing command sendmail pid 1176 tid 100118 td 0xcab31000 sched_switch(cab31000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32b7ab4 mi_switch(104,0,c108835c,1f9,c108835c,...) at mi_switch+0x1c9/frame 0xf32b7ae8 sleepq_switch(cab31000,0,c108835c,1ad,f32b7b60,...) at sleepq_switch+0x1b9/frame 0xf32b7b1c sleepq_catch_signals(0,c108835c,166,c0,cab31000,...) at sleepq_catch_signals+0x3b1/frame 0xf32b7b64 sleepq_wait_sig(cab288c8,74,c0f00260,100,0,...) at sleepq_wait_sig+0x14/frame 0xf32b7b88 _sleep(cab288c8,cab288f8,174,c0f00260,0,...) at _sleep+0x32d/frame 0xf32b7be0 kern_sigsuspend(cab31000,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf32b7c10 sys_sigsuspend(cab31000,f32b7cc8,1,0,cab31000,...) at sys_sigsuspend+0x58/frame 0xf32b7c40 syscall(f32b7d08) at syscall+0x2ed/frame 0xf32b7cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32b7cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28352497, esp = 0xbfbfbf8c, ebp = 0xbfbfbfb8 --- Tracing command sendmail pid 1173 tid 100103 td 0xcab11bc0 sched_switch(cab11bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3274914 mi_switch(104,0,c108835c,1f9,c13f9d00,...) at mi_switch+0x1c9/frame 0xf3274948 sleepq_switch(cab11bc0,0,c108835c,1ad,cab4b790,...) at sleepq_switch+0x1b9/frame 0xf327497c sleepq_catch_signals(c11b5100,f32749ec,c0a8dc29,cab4b7a0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32749c4 sleepq_timedwait_sig(cab4b7a4,0,f3274a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32749ec _cv_timedwait_sig(cab4b7a4,cab4b790,1389,677,f3274ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3274a34 seltdwait(f3274ac0,f3274ac8,caa52d80,cab11bc0,f3274aa0,...) at seltdwait+0x7e/frame 0xf3274a58 kern_select(cab11bc0,5,bfbfb478,0,0,...) at kern_select+0x85f/frame 0xf3274bf8 sys_select(cab11bc0,f3274cc8,f3274d08,1,1,...) at sys_select+0x69/frame 0xf3274c40 syscall(f3274d08) at syscall+0x2ed/frame 0xf3274cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3274cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2840d217, esp = 0xbfbfb36c, ebp = 0xbfbfbf98 --- Tracing command sshd pid 1170 tid 100096 td 0xcaa84bc0 sched_switch(caa84bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3246918 mi_switch(104,0,c108835c,1f9,200046,...) at mi_switch+0x1c9/frame 0xf324694c sleepq_switch(caa84bc0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3246980 sleepq_catch_signals(f32469ec,c0a8dc29,cab4b720,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32469c8 sleepq_wait_sig(cab4b724,0,f3246a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32469ec _cv_wait_sig(cab4b724,cab4b710,c108b0dc,677,5,...) at _cv_wait_sig+0x200/frame 0xf3246a34 seltdwait(caabdd90,58,caa52a00,caa84bc0,c1092cf7,...) at seltdwait+0x8c/frame 0xf3246a58 kern_select(caa84bc0,5,28c0c140,0,0,...) at kern_select+0x85f/frame 0xf3246bf8 sys_select(caa84bc0,f3246cc8,f3246d08,1,1,...) at sys_select+0x69/frame 0xf3246c40 syscall(f3246d08) at syscall+0x2ed/frame 0xf3246cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3246cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28515217, esp = 0xbfbfd47c, ebp = 0xbfbfde44 --- Tracing command moused pid 1138 tid 100121 td 0xcab2c5e0 sched_switch(cab2c5e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32c5918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf32c594c sleepq_switch(cab2c5e0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf32c5980 sleepq_catch_signals(f32c59ec,c0a8dc29,ca95a7a0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32c59c8 sleepq_wait_sig(ca95a7a4,0,f32c5a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32c59ec _cv_wait_sig(ca95a7a4,ca95a790,c108b0dc,677,6,...) at _cv_wait_sig+0x200/frame 0xf32c5a34 seltdwait(caa93188,58,c7dd4e80,cab2c5e0,0,...) at seltdwait+0x8c/frame 0xf32c5a58 kern_select(cab2c5e0,400,bfbfdcb0,0,0,...) at kern_select+0x85f/frame 0xf32c5bf8 sys_select(cab2c5e0,f32c5cc8,f32c5d08,1,1,...) at sys_select+0x69/frame 0xf32c5c40 syscall(f32c5d08) at syscall+0x2ed/frame 0xf32c5cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32c5cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281b0217, esp = 0xbfbfd88c, ebp = 0xbfbfde24 --- Tracing command winbindd pid 1137 tid 100097 td 0xcaa848d0 sched_switch(caa848d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf324a984 mi_switch(104,0,c108835c,1f9,c13f9c00,...) at mi_switch+0x1c9/frame 0xf324a9b8 sleepq_switch(caa848d0,0,c108835c,1ad,ca95b950,...) at sleepq_switch+0x1b9/frame 0xf324a9ec sleepq_catch_signals(c11b5100,f324aa5c,c0a8dc29,ca95b960,0,...) at sleepq_catch_signals+0x3b1/frame 0xf324aa34 sleepq_timedwait_sig(ca95b964,0,f324aa90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf324aa5c _cv_timedwait_sig(ca95b964,ca95b950,5265c00,677,caa848d0,...) at _cv_timedwait_sig+0x20c/frame 0xf324aaa4 seltdwait(f324ab10,f324ab18,5ac,caa848d0,cb21ec80,...) at seltdwait+0x7e/frame 0xf324aac8 sys_poll(caa848d0,f324acc8,c10d70ff,d6,1,...) at sys_poll+0x3e5/frame 0xf324ac40 syscall(f324ad08) at syscall+0x2ed/frame 0xf324acfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf324acfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192bbaf, esp = 0xbfbfc47c, ebp = 0xbfbfc4b8 --- Tracing command smbd pid 1133 tid 100089 td 0xcab322f0 sched_switch(cab322f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3226984 mi_switch(104,0,c108835c,1f9,c13f9c00,...) at mi_switch+0x1c9/frame 0xf32269b8 sleepq_switch(cab322f0,0,c108835c,1ad,ca95a7d0,...) at sleepq_switch+0x1b9/frame 0xf32269ec sleepq_catch_signals(c11b5100,f3226a5c,c0a8dc29,ca95a7e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3226a34 sleepq_timedwait_sig(ca95a7e4,0,f3226a90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3226a5c _cv_timedwait_sig(ca95a7e4,ca95a7d0,5265c00,677,cab322f0,...) at _cv_timedwait_sig+0x20c/frame 0xf3226aa4 seltdwait(f3226b10,f3226b18,5ac,cab322f0,cb206658,...) at seltdwait+0x7e/frame 0xf3226ac8 sys_poll(cab322f0,f3226cc8,f3226d08,1,1,...) at sys_poll+0x3e5/frame 0xf3226c40 syscall(f3226d08) at syscall+0x2ed/frame 0xf3226cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3226cfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b54baf, esp = 0xbfbfd9ec, ebp = 0xbfbfda28 --- Tracing command winbindd pid 1120 tid 100110 td 0xc98885e0 sched_switch(c98885e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf328b984 mi_switch(104,0,c108835c,1f9,c13f9e00,...) at mi_switch+0x1c9/frame 0xf328b9b8 sleepq_switch(c98885e0,0,c108835c,1ad,ca95aa10,...) at sleepq_switch+0x1b9/frame 0xf328b9ec sleepq_catch_signals(c11b5100,f328ba5c,c0a8dc29,ca95aa20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf328ba34 sleepq_timedwait_sig(ca95aa24,0,f328ba90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf328ba5c _cv_timedwait_sig(ca95aa24,ca95aa10,493e1,677,c98885e0,...) at _cv_timedwait_sig+0x20c/frame 0xf328baa4 seltdwait(f328bb10,f328bb18,5ac,c98885e0,c137c104,...) at seltdwait+0x7e/frame 0xf328bac8 sys_poll(c98885e0,f328bcc8,f328bd08,1,1,...) at sys_poll+0x3e5/frame 0xf328bc40 syscall(f328bd08) at syscall+0x2ed/frame 0xf328bcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf328bcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2192bbaf, esp = 0xbfbfdbcc, ebp = 0xbfbfdc08 --- Tracing command smbd pid 1118 tid 100083 td 0xcab12bc0 sched_switch(cab12bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf320d984 mi_switch(104,0,c108835c,1f9,c13f9c00,...) at mi_switch+0x1c9/frame 0xf320d9b8 sleepq_switch(cab12bc0,0,c108835c,1ad,cab4bb10,...) at sleepq_switch+0x1b9/frame 0xf320d9ec sleepq_catch_signals(c11b5100,f320da5c,c0a8dc29,cab4bb20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf320da34 sleepq_timedwait_sig(cab4bb24,0,f320da90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf320da5c _cv_timedwait_sig(cab4bb24,cab4bb10,ea61,677,cab12bc0,...) at _cv_timedwait_sig+0x20c/frame 0xf320daa4 seltdwait(f320db10,f320db18,5ac,cab12bc0,0,...) at seltdwait+0x7e/frame 0xf320dac8 sys_poll(cab12bc0,f320dcc8,0,0,cab12bc0,...) at sys_poll+0x3e5/frame 0xf320dc40 syscall(f320dd08) at syscall+0x2ed/frame 0xf320dcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf320dcfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21b54baf, esp = 0xbfbfda9c, ebp = 0xbfbfdad8 --- Tracing command nmbd pid 1116 tid 100087 td 0xcaa855e0 sched_switch(caa855e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf321e984 mi_switch(104,0,c108835c,1f9,c13f9c00,...) at mi_switch+0x1c9/frame 0xf321e9b8 sleepq_switch(caa855e0,0,c108835c,1ad,ca95bdd0,...) at sleepq_switch+0x1b9/frame 0xf321e9ec sleepq_catch_signals(c11b5100,f321ea5c,c0a8dc29,ca95bde0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf321ea34 sleepq_timedwait_sig(ca95bde4,0,f321ea90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf321ea5c _cv_timedwait_sig(ca95bde4,ca95bdd0,2711,677,caa855e0,...) at _cv_timedwait_sig+0x20c/frame 0xf321eaa4 seltdwait(f321eb10,f321eb18,5ac,caa855e0,0,...) at seltdwait+0x7e/frame 0xf321eac8 sys_poll(caa855e0,f321ecc8,f321ed08,1,1,...) at sys_poll+0x3e5/frame 0xf321ec40 syscall(f321ed08) at syscall+0x2ed/frame 0xf321ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf321ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x21556baf, esp = 0xbfbfdb1c, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 1092 tid 100082 td 0xcab13000 sched_switch(cab13000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3209918 mi_switch(104,0,c108835c,1f9,200046,...) at mi_switch+0x1c9/frame 0xf320994c sleepq_switch(cab13000,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3209980 sleepq_catch_signals(f32099ec,c0a8dc29,caa17c60,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32099c8 sleepq_wait_sig(caa17c64,0,f3209a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32099ec _cv_wait_sig(caa17c64,caa17c50,c108b0dc,677,1c,...) at _cv_wait_sig+0x200/frame 0xf3209a34 seltdwait(caabd930,58,c7dd4e80,cab13000,0,...) at seltdwait+0x8c/frame 0xf3209a58 kern_select(cab13000,1c,bfbfdd48,0,0,...) at kern_select+0x85f/frame 0xf3209bf8 sys_select(cab13000,f3209cc8,0,0,cab13000,...) at sys_select+0x69/frame 0xf3209c40 syscall(f3209d08) at syscall+0x2ed/frame 0xf3209cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3209cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28389217, esp = 0xbfbfdd24, ebp = 0xbfbfdde4 --- Tracing command nfsd pid 1036 tid 100125 td 0xcae43bc0 sched_switch(cae43bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3314a90 mi_switch(104,0,c108835c,1f9,c13f9f00,...) at mi_switch+0x1c9/frame 0xf3314ac4 sleepq_switch(cae43bc0,0,c108835c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3314af8 sleepq_catch_signals(c11b5100,f3314b68,c0a8dc29,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3314b40 sleepq_timedwait_sig(caa80e10,0,f3314b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3314b68 _cv_timedwait_sig(caa80e10,c9777a80,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3314bb0 svc_run_internal(f3314cf4,c0a711af,c9777a80,f3314d08,c107c4a8,...) at svc_run_internal+0xa30/frame 0xf3314cc4 svc_thread_start(c9777a80,f3314d08,c107c4a8,3d7,0,...) at svc_thread_start+0xd/frame 0xf3314ccc fork_exit(c0c9a6d0,c9777a80,f3314d08) at fork_exit+0x7f/frame 0xf3314cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3314cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100124 td 0xcae45000 sched_switch(cae45000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3311a90 mi_switch(104,0,c108835c,1f9,c13f9e00,...) at mi_switch+0x1c9/frame 0xf3311ac4 sleepq_switch(cae45000,0,c108835c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3311af8 sleepq_catch_signals(c11b5100,f3311b68,c0a8dc29,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf3311b40 sleepq_timedwait_sig(c82086d0,0,f3311b9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3311b68 _cv_timedwait_sig(c82086d0,c9777a80,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf3311bb0 svc_run_internal(f3311cf4,c0a711af,c9777a80,f3311d08,c107c4a8,...) at svc_run_internal+0xa30/frame 0xf3311cc4 svc_thread_start(c9777a80,f3311d08,c107c4a8,3d7,0,...) at svc_thread_start+0xd/frame 0xf3311ccc fork_exit(c0c9a6d0,c9777a80,f3311d08) at fork_exit+0x7f/frame 0xf3311cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3311cf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100123 td 0xcae452f0 sched_switch(cae452f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf330ea90 mi_switch(104,0,c108835c,1f9,c13f9f00,...) at mi_switch+0x1c9/frame 0xf330eac4 sleepq_switch(cae452f0,0,c108835c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf330eaf8 sleepq_catch_signals(c11b5100,f330eb68,c0a8dc29,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf330eb40 sleepq_timedwait_sig(caa80c90,0,f330eb9c,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf330eb68 _cv_timedwait_sig(caa80c90,c9777a80,1388,3b1,0,...) at _cv_timedwait_sig+0x20c/frame 0xf330ebb0 svc_run_internal(f330ecf4,c0a711af,c9777a80,f330ed08,c107c4a8,...) at svc_run_internal+0xa30/frame 0xf330ecc4 svc_thread_start(c9777a80,f330ed08,c107c4a8,3d7,0,...) at svc_thread_start+0xd/frame 0xf330eccc fork_exit(c0c9a6d0,c9777a80,f330ed08) at fork_exit+0x7f/frame 0xf330ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xf330ecf4 --- trap 0, eip = 0xc, esp = 0x33, ebp = 0xbfbfd9ef --- Tracing command nfsd pid 1036 tid 100102 td 0xca96fbc0 sched_switch(ca96fbc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3271318 mi_switch(104,0,c108835c,1f9,c13f9f00,...) at mi_switch+0x1c9/frame 0xf327134c sleepq_switch(ca96fbc0,0,c108835c,1ad,c9777a80,...) at sleepq_switch+0x1b9/frame 0xf3271380 sleepq_catch_signals(c11b5100,f32713f0,c0a8dc29,c9777a90,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32713c8 sleepq_timedwait_sig(c8208810,0,f3271424,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32713f0 _cv_timedwait_sig(c8208810,c9777a80,1388,3b1,c7d8e340,...) at _cv_timedwait_sig+0x20c/frame 0xf3271438 svc_run_internal(c0c9a6d0,c9777a80,cadae2d0,f3271578,0,...) at svc_run_internal+0xa30/frame 0xf3271550 svc_run(c9777a80,0,c106e597,1b3,f32715d0,...) at svc_run+0xc6/frame 0xf3271588 nfsrvd_nfsd(ca96fbc0,f32716e0,c,0,f9,...) at nfsrvd_nfsd+0x1a2/frame 0xf32716c0 nfssvc_nfsd(ca96fbc0,f3271cc8,0,ca96fbc0,f3271cfc,...) at nfssvc_nfsd+0xf4/frame 0xf3271c28 sys_nfssvc(ca96fbc0,f3271cc8,f3271d08,1,1,...) at sys_nfssvc+0xbf/frame 0xf3271c40 syscall(f3271d08) at syscall+0x2ed/frame 0xf3271cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3271cfc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c2ac7, esp = 0xbfbfd89c, ebp = 0xbfbfdb10 --- Tracing command nfsd pid 1033 tid 100115 td 0xcab115e0 sched_switch(cab115e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf329f918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf329f94c sleepq_switch(cab115e0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf329f980 sleepq_catch_signals(f329f9ec,c0a8dc29,caa30ae0,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf329f9c8 sleepq_wait_sig(caa30ae4,0,f329fa20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf329f9ec _cv_wait_sig(caa30ae4,caa30ad0,c108b0dc,677,7,...) at _cv_wait_sig+0x200/frame 0xf329fa34 seltdwait(caabdb60,58,c7dd4e80,cab115e0,f329fa90,...) at seltdwait+0x8c/frame 0xf329fa58 kern_select(cab115e0,7,bfbfdcf8,0,0,...) at kern_select+0x85f/frame 0xf329fbf8 sys_select(cab115e0,f329fcc8,f329fd08,1,1,...) at sys_select+0x69/frame 0xf329fc40 syscall(f329fd08) at syscall+0x2ed/frame 0xf329fcfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf329fcfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817d217, esp = 0xbfbfdb14, ebp = 0xbfbfde34 --- Tracing command nfsuserd pid 1031 tid 100095 td 0xcaa85000 sched_switch(caa85000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3242914 mi_switch(104,0,c108835c,1f9,c13f9d00,...) at mi_switch+0x1c9/frame 0xf3242948 sleepq_switch(caa85000,0,c108835c,1ad,caa17510,...) at sleepq_switch+0x1b9/frame 0xf324297c sleepq_catch_signals(c11b5100,f32429ec,c0a8dc29,caa17520,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32429c4 sleepq_timedwait_sig(caa17524,0,f3242a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32429ec _cv_timedwait_sig(caa17524,caa17510,7531,677,f3242ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3242a34 seltdwait(f3242ac0,f3242ac8,c7dd4e80,caa85000,f3242b60,...) at seltdwait+0x7e/frame 0xf3242a58 kern_select(caa85000,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3242bf8 sys_select(caa85000,f3242cc8,c10d70ff,e9,1,...) at sys_select+0x69/frame 0xf3242c40 syscall(f3242d08) at syscall+0x2ed/frame 0xf3242cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3242cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1030 tid 100098 td 0xcaa845e0 sched_switch(caa845e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf324e914 mi_switch(104,0,c108835c,1f9,c13f9c00,...) at mi_switch+0x1c9/frame 0xf324e948 sleepq_switch(caa845e0,0,c108835c,1ad,cab4c1d0,...) at sleepq_switch+0x1b9/frame 0xf324e97c sleepq_catch_signals(c11b5100,f324e9ec,c0a8dc29,cab4c1e0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf324e9c4 sleepq_timedwait_sig(cab4c1e4,0,f324ea20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf324e9ec _cv_timedwait_sig(cab4c1e4,cab4c1d0,7531,677,f324eac0,...) at _cv_timedwait_sig+0x20c/frame 0xf324ea34 seltdwait(f324eac0,f324eac8,c7dd4e80,caa845e0,f324ea90,...) at seltdwait+0x7e/frame 0xf324ea58 kern_select(caa845e0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf324ebf8 sys_select(caa845e0,f324ecc8,0,0,caa845e0,...) at sys_select+0x69/frame 0xf324ec40 syscall(f324ed08) at syscall+0x2ed/frame 0xf324ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf324ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1029 tid 100084 td 0xcab128d0 sched_switch(cab128d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3212914 mi_switch(104,0,c108835c,1f9,c13f9d00,...) at mi_switch+0x1c9/frame 0xf3212948 sleepq_switch(cab128d0,0,c108835c,1ad,ca95ad50,...) at sleepq_switch+0x1b9/frame 0xf321297c sleepq_catch_signals(c11b5100,f32129ec,c0a8dc29,ca95ad60,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32129c4 sleepq_timedwait_sig(ca95ad64,0,f3212a20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf32129ec _cv_timedwait_sig(ca95ad64,ca95ad50,7531,677,f3212ac0,...) at _cv_timedwait_sig+0x20c/frame 0xf3212a34 seltdwait(f3212ac0,f3212ac8,c7dd4e80,cab128d0,f3212a90,...) at seltdwait+0x7e/frame 0xf3212a58 kern_select(cab128d0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf3212bf8 sys_select(cab128d0,f3212cc8,f3212d08,1,1,...) at sys_select+0x69/frame 0xf3212c40 syscall(f3212d08) at syscall+0x2ed/frame 0xf3212cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3212cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1028 tid 100106 td 0xca96f2f0 sched_switch(ca96f2f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf327e914 mi_switch(104,0,c108835c,1f9,c13f9d00,...) at mi_switch+0x1c9/frame 0xf327e948 sleepq_switch(ca96f2f0,0,c108835c,1ad,caa30b10,...) at sleepq_switch+0x1b9/frame 0xf327e97c sleepq_catch_signals(c11b5100,f327e9ec,c0a8dc29,caa30b20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf327e9c4 sleepq_timedwait_sig(caa30b24,0,f327ea20,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf327e9ec _cv_timedwait_sig(caa30b24,caa30b10,7531,677,f327eac0,...) at _cv_timedwait_sig+0x20c/frame 0xf327ea34 seltdwait(f327eac0,f327eac8,c7dd4e80,ca96f2f0,f327ea90,...) at seltdwait+0x7e/frame 0xf327ea58 kern_select(ca96f2f0,4,bfbfdc10,0,0,...) at kern_select+0x85f/frame 0xf327ebf8 sys_select(ca96f2f0,f327ecc8,f327ed08,1,1,...) at sys_select+0x69/frame 0xf327ec40 syscall(f327ed08) at syscall+0x2ed/frame 0xf327ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf327ecfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b217, esp = 0xbfbfdb64, ebp = 0xbfbfdca8 --- Tracing command nfsuserd pid 1027 tid 100093 td 0xcab12000 sched_switch(cab12000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3239ab4 mi_switch(104,0,c108835c,1f9,c108835c,...) at mi_switch+0x1c9/frame 0xf3239ae8 sleepq_switch(cab12000,0,c108835c,1ad,f3239b60,...) at sleepq_switch+0x1b9/frame 0xf3239b1c sleepq_catch_signals(0,c108835c,166,108,cab12000,...) at sleepq_catch_signals+0x3b1/frame 0xf3239b64 sleepq_wait_sig(cab08b98,74,c0f00260,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3239b88 _sleep(cab08b98,cab08bc8,174,c0f00260,0,...) at _sleep+0x32d/frame 0xf3239be0 kern_sigsuspend(cab12000,0,0,0,0,...) at kern_sigsuspend+0xdb/frame 0xf3239c10 sys_sigsuspend(cab12000,f3239cc8,f3239d08,1,1,...) at sys_sigsuspend+0x58/frame 0xf3239c40 syscall(f3239d08) at syscall+0x2ed/frame 0xf3239cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3239cfc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c0497, esp = 0xbfbfdcac, ebp = 0xbfbfde44 --- Tracing command mountd pid 1011 tid 100104 td 0xca96f8d0 sched_switch(ca96f8d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3277918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf327794c sleepq_switch(ca96f8d0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3277980 sleepq_catch_signals(f32779ec,c0a8dc29,caa17560,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32779c8 sleepq_wait_sig(caa17564,0,f3277a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32779ec _cv_wait_sig(caa17564,caa17550,c108b0dc,677,9,...) at _cv_wait_sig+0x200/frame 0xf3277a34 seltdwait(caa93a80,58,c7dd4e80,ca96f8d0,c1092cf7,...) at seltdwait+0x8c/frame 0xf3277a58 kern_select(ca96f8d0,9,bfbfdd50,0,0,...) at kern_select+0x85f/frame 0xf3277bf8 sys_select(ca96f8d0,f3277cc8,0,0,ca96f8d0,...) at sys_select+0x69/frame 0xf3277c40 syscall(f3277d08) at syscall+0x2ed/frame 0xf3277cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3277cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28193217, esp = 0xbfbfdd0c, ebp = 0xbfbfde34 --- Tracing command rpcbind pid 978 tid 100111 td 0xc98882f0 sched_switch(c98882f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf328e984 mi_switch(104,0,c108835c,1f9,c13f9f00,...) at mi_switch+0x1c9/frame 0xf328e9b8 sleepq_switch(c98882f0,0,c108835c,1ad,ca95ae10,...) at sleepq_switch+0x1b9/frame 0xf328e9ec sleepq_catch_signals(c11b5100,f328ea5c,c0a8dc29,ca95ae20,0,...) at sleepq_catch_signals+0x3b1/frame 0xf328ea34 sleepq_timedwait_sig(ca95ae24,0,f328ea90,101,0,...) at sleepq_timedwait_sig+0x14/frame 0xf328ea5c _cv_timedwait_sig(ca95ae24,ca95ae10,7531,677,c98882f0,...) at _cv_timedwait_sig+0x20c/frame 0xf328eaa4 seltdwait(f328eb10,f328eb18,5ac,c98882f0,a3a,...) at seltdwait+0x7e/frame 0xf328eac8 sys_poll(c98882f0,f328ecc8,f328ed08,1,1,...) at sys_poll+0x3e5/frame 0xf328ec40 syscall(f328ed08) at syscall+0x2ed/frame 0xf328ecfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf328ecfc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28132baf, esp = 0xbfbfbbfc, ebp = 0xbfbfddd8 --- Tracing command syslogd pid 963 tid 100116 td 0xcab315e0 sched_switch(cab315e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf32a3918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf32a394c sleepq_switch(cab315e0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf32a3980 sleepq_catch_signals(f32a39ec,c0a8dc29,ca95b120,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32a39c8 sleepq_wait_sig(ca95b124,0,f32a3a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32a39ec _cv_wait_sig(ca95b124,ca95b110,c108b0dc,677,9,...) at _cv_wait_sig+0x200/frame 0xf32a3a34 seltdwait(caad6118,58,c7dd4e80,cab315e0,0,...) at seltdwait+0x8c/frame 0xf32a3a58 kern_select(cab315e0,9,28849100,0,0,...) at kern_select+0x85f/frame 0xf32a3bf8 sys_select(cab315e0,f32a3cc8,0,0,cab315e0,...) at sys_select+0x69/frame 0xf32a3c40 syscall(f32a3d08) at syscall+0x2ed/frame 0xf32a3cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf32a3cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28192217, esp = 0xbfbfceac, ebp = 0xbfbfde34 --- Tracing command devd pid 840 tid 100100 td 0xcab318d0 sched_switch(cab318d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xf3266918 mi_switch(104,0,c108835c,1f9,46,...) at mi_switch+0x1c9/frame 0xf326694c sleepq_switch(cab318d0,0,c108835c,1ad,b1,...) at sleepq_switch+0x1b9/frame 0xf3266980 sleepq_catch_signals(f32669ec,c0a8dc29,cab4c420,0,0,...) at sleepq_catch_signals+0x3b1/frame 0xf32669c8 sleepq_wait_sig(cab4c424,0,f3266a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf32669ec _cv_wait_sig(cab4c424,cab4c410,c108b0dc,677,5,...) at _cv_wait_sig+0x200/frame 0xf3266a34 seltdwait(caabdab8,58,c7dd4e80,cab318d0,cadaacb8,...) at seltdwait+0x8c/frame 0xf3266a58 kern_select(cab318d0,5,bfbfd998,0,0,...) at kern_select+0x85f/frame 0xf3266bf8 sys_select(cab318d0,f3266cc8,c7b18c80,c7b18ccc,0,...) at sys_select+0x69/frame 0xf3266c40 syscall(f3266d08) at syscall+0x2ed/frame 0xf3266cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xf3266cfc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x808c2a3, esp = 0xbfbfd93c, ebp = 0xbfbfde54 --- Tracing command softdepflush pid 19 tid 100078 td 0xca9718d0 sched_switch(ca9718d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee1dbb8 mi_switch(104,0,c108835c,1f9,1,...) at mi_switch+0x1c9/frame 0xeee1dbec sleepq_switch(ca9718d0,0,c108835c,292,ca9718d0,...) at sleepq_switch+0x1b9/frame 0xeee1dc20 sleepq_timedwait(c13ac528,54,c10b9ea0,0,0,...) at sleepq_timedwait+0x48/frame 0xeee1dc44 _sleep(c13ac528,c13ac4b4,54,c10b9ea0,3e8,...) at _sleep+0x317/frame 0xeee1dc9c softdep_flush(0,eee1dd08,c107c4a8,3d7,0,...) at softdep_flush+0x23e/frame 0xeee1dccc fork_exit(c0cf2420,0,eee1dd08) at fork_exit+0x7f/frame 0xeee1dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee1dcf4 --- trap 0, eip = 0, esp = 0xeee1dd40, ebp = 0 --- Tracing command syncer pid 18 tid 100077 td 0xca971bc0 sched_switch(ca971bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee1a8a8 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xeee1a8dc sleepq_switch(ca971bc0,0,c108835c,26f,0,...) at sleepq_switch+0x1b9/frame 0xeee1a910 sleepq_wait(c7de121c,60,c10b7165,4,0,...) at sleepq_wait+0x48/frame 0xeee1a934 sleeplk(cc273394,c10b7165,60,33,0,...) at sleeplk+0x11e/frame 0xeee1a970 __lockmgr_args(c7de121c,80900,cc273394,0,0,...) at __lockmgr_args+0xa44/frame 0xeee1aa50 ffs_copyonwrite(cc2732d0,e1ea5480,ca971bc0,e1ea5480,4,...) at ffs_copyonwrite+0x1d1/frame 0xeee1aac0 ffs_geom_strategy(cc2733c8,e1ea5480,39f,f33,c10900ac,...) at ffs_geom_strategy+0xbf/frame 0xeee1aadc bufwrite(e1ea5480,0,c10ba229,817,4140) at bufwrite+0x161/frame 0xeee1ab0c ffs_bufwrite(e1ea5480,e6ecc000,1000,1000,0,...) at ffs_bufwrite+0x13b/frame 0xeee1ab30 ffs_sbupdate(caa68000,3,0,5ad,eee1abb8,...) at ffs_sbupdate+0x1e8/frame 0xeee1ab78 ffs_sync(cd8798c4,3,2,e6c,0,...) at ffs_sync+0x585/frame 0xeee1ac00 sync_fsync(eee1aca8,c10ddd78,c1092cf7,6f5,705,...) at sync_fsync+0x146/frame 0xeee1ac2c VOP_FSYNC_APV(c11bfb58,eee1aca8,c1092cf7,6f5,4e20,...) at VOP_FSYNC_APV+0x103/frame 0xeee1ac58 sched_sync(0,eee1ad08,c107c4a8,3d7,0,...) at sched_sync+0x35f/frame 0xeee1accc fork_exit(c0b46f70,0,eee1ad08) at fork_exit+0x7f/frame 0xeee1acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee1acf4 --- trap 0, eip = 0, esp = 0xeee1ad40, ebp = 0 --- Tracing command vnlru pid 17 tid 100076 td 0xc97578d0 sched_switch(c97578d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee17b8c mi_switch(104,0,c108835c,1f9,1,...) at mi_switch+0x1c9/frame 0xeee17bc0 sleepq_switch(c97578d0,0,c108835c,292,c97578d0,...) at sleepq_switch+0x1b9/frame 0xeee17bf4 sleepq_timedwait(ca96c5a0,60,c109406d,0,0,...) at sleepq_timedwait+0x48/frame 0xeee17c18 _sleep(ca96c5a0,c13a8308,260,c109406d,3e8,...) at _sleep+0x317/frame 0xeee17c70 vnlru_proc(0,eee17d08,c107c4a8,3d7,0,...) at vnlru_proc+0x95/frame 0xeee17ccc fork_exit(c0b47760,0,eee17d08) at fork_exit+0x7f/frame 0xeee17cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee17cf4 --- trap 0, eip = 0, esp = 0xeee17d40, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xc9757bc0 sched_switch(c9757bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee14bc8 mi_switch(104,0,c108835c,1f9,0,...) at mi_switch+0x1c9/frame 0xeee14bfc sleepq_switch(c9757bc0,0,c108835c,292,c9757bc0,...) at sleepq_switch+0x1b9/frame 0xeee14c30 sleepq_timedwait(c13a80e8,54,c1090c92,0,0,...) at sleepq_timedwait+0x48/frame 0xeee14c54 _sleep(c13a80e8,c13a80d0,54,c1090c92,3e8,...) at _sleep+0x317/frame 0xeee14cac buf_daemon(0,eee14d08,c107c4a8,3d7,0,...) at buf_daemon+0x8c/frame 0xeee14ccc fork_exit(c0b2ad20,0,eee14d08) at fork_exit+0x7f/frame 0xeee14cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee14cf4 --- trap 0, eip = 0, esp = 0xeee14d40, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xc9886000 sched_switch(c9886000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee11bc0 mi_switch(104,0,c108835c,1f9,3,...) at mi_switch+0x1c9/frame 0xeee11bf4 sleepq_switch(c9886000,0,c108835c,292,c9886000,...) at sleepq_switch+0x1b9/frame 0xeee11c28 sleepq_timedwait(c13acf4c,0,c10c0dd0,0,0,...) at sleepq_timedwait+0x48/frame 0xeee11c4c _sleep(c13acf4c,c1400900,0,c10c0dd0,493e0,...) at _sleep+0x317/frame 0xeee11ca4 vm_pagezero(0,eee11d08,c107c4a8,3d7,0,...) at vm_pagezero+0x89/frame 0xeee11ccc fork_exit(c0d38170,0,eee11d08) at fork_exit+0x7f/frame 0xeee11cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee11cf4 --- trap 0, eip = 0, esp = 0xeee11d40, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xc98862f0 sched_switch(c98862f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee0eb8c mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xeee0ebc0 sleepq_switch(c98862f0,0,c108835c,26f,c98862f0,...) at sleepq_switch+0x1b9/frame 0xeee0ebf4 sleepq_wait(c13acb18,74,c1090c92,0,0,...) at sleepq_wait+0x48/frame 0xeee0ec18 _sleep(c13acb18,c13acb00,74,c1090c92,0,...) at _sleep+0x34e/frame 0xeee0ec70 vm_daemon(0,eee0ed08,c107c4a8,3d7,0,...) at vm_daemon+0x8c/frame 0xeee0eccc fork_exit(c0d312c0,0,eee0ed08) at fork_exit+0x7f/frame 0xeee0ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee0ecf4 --- trap 0, eip = 0, esp = 0xeee0ed40, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xc98865e0 sched_switch(c98865e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeee0bb3c mi_switch(104,0,c108835c,1f9,2,...) at mi_switch+0x1c9/frame 0xeee0bb70 sleepq_switch(c98865e0,0,c108835c,292,c98865e0,...) at sleepq_switch+0x1b9/frame 0xeee0bba4 sleepq_timedwait(c1400984,54,c1090c92,0,0,...) at sleepq_timedwait+0x48/frame 0xeee0bbc8 _sleep(c1400984,c1400900,54,c1090c92,1388,...) at _sleep+0x317/frame 0xeee0bc20 vm_pageout(0,eee0bd08,c107c4a8,3d7,0,...) at vm_pageout+0x256/frame 0xeee0bccc fork_exit(c0d31b20,0,eee0bd08) at fork_exit+0x7f/frame 0xeee0bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeee0bcf4 --- trap 0, eip = 0, esp = 0xeee0bd40, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xc98868d0 sched_switch(c98868d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec88bc4 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xeec88bf8 sleepq_switch(c98868d0,0,c108835c,26f,c98868d0,...) at sleepq_switch+0x1b9/frame 0xeec88c2c sleepq_wait(c11f9a24,5c,c0ed38a0,0,0,...) at sleepq_wait+0x48/frame 0xeec88c50 _sleep(c11f9a24,c11f9a68,5c,c0ed38a0,0,...) at _sleep+0x34e/frame 0xeec88ca8 xpt_scanner_thread(0,eec88d08,c107c4a8,3d7,0,...) at xpt_scanner_thread+0xfc/frame 0xeec88ccc fork_exit(c04b2aa0,0,eec88d08) at fork_exit+0x7f/frame 0xeec88cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec88cf4 --- trap 0, eip = 0, esp = 0xeec88d40, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xc9886bc0 sched_switch(c9886bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec85bcc mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xeec85c00 sleepq_switch(c9886bc0,0,c108835c,26f,c9886bc0,...) at sleepq_switch+0x1b9/frame 0xeec85c34 sleepq_wait(c13fc67c,0,c10a7205,0,0,...) at sleepq_wait+0x48/frame 0xeec85c58 _sleep(c13fc67c,c13fc644,0,c10a7205,0,...) at _sleep+0x34e/frame 0xeec85cb0 sctp_iterator_thread(0,eec85d08,c107c4a8,3d7,0,...) at sctp_iterator_thread+0x5c/frame 0xeec85ccc fork_exit(c0be24f0,0,eec85d08) at fork_exit+0x7f/frame 0xeec85cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec85cf4 --- trap 0, eip = 0, esp = 0xeec85d40, ebp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xc9887bc0 sched_switch(c9887bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec75b50 mi_switch(104,0,c108835c,1f9,2,...) at mi_switch+0x1c9/frame 0xeec75b84 sleepq_switch(c9887bc0,0,c108835c,292,c9887bc0,...) at sleepq_switch+0x1b9/frame 0xeec75bb8 sleepq_timedwait(c96f083c,5c,c106ef8a,0,0,...) at sleepq_timedwait+0x48/frame 0xeec75bdc _sleep(c96f083c,c96f08f0,5c,c106ef8a,3e8,...) at _sleep+0x317/frame 0xeec75c34 fdc_thread(c96f0800,eec75d08,c107c4a8,3d7,0,...) at fdc_thread+0x74a/frame 0xeec75ccc fork_exit(c0e41d80,c96f0800,eec75d08) at fork_exit+0x7f/frame 0xeec75cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec75cf4 --- trap 0, eip = 0, esp = 0xeec75d40, ebp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xc97462f0 sched_switch(c97462f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec656b4 mi_switch(104,0,c108835c,1f9,c108835c,...) at mi_switch+0x1c9/frame 0xeec656e8 sleepq_switch(c97462f0,0,c108835c,1ad,eec65760,...) at sleepq_switch+0x1b9/frame 0xeec6571c sleepq_catch_signals(0,c108835c,166,780,c97462f0,...) at sleepq_catch_signals+0x3b1/frame 0xeec65764 sleepq_wait_sig(c9785000,6c,c106ef8a,100,0,...) at sleepq_wait_sig+0x14/frame 0xeec65788 _sleep(c9785000,c9789488,16c,c106ef8a,0,...) at _sleep+0x32d/frame 0xeec657e0 fw_bus_probe_thread(c9785000,eec65d08,c107c4a8,3d7,0,...) at fw_bus_probe_thread+0x88/frame 0xeec65ccc fork_exit(c0707050,c9785000,eec65d08) at fork_exit+0x7f/frame 0xeec65cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec65cf4 --- trap 0, eip = 0, esp = 0xeec65d40, ebp = 0 --- Tracing command usb pid 15 tid 100059 td 0xc9754000 sched_switch(c9754000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec44bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec44c08 sleepq_switch(c9754000,0,c108835c,26f,c9754000,...) at sleepq_switch+0x1b9/frame 0xeec44c3c sleepq_wait(c975dd34,0,eec44c90,1,0,...) at sleepq_wait+0x48/frame 0xeec44c60 _cv_wait(c975dd34,c975de4c,c106080b,73,c975dd3c,...) at _cv_wait+0x1f9/frame 0xeec44ca4 usb_process(c975dd2c,eec44d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec44ccc fork_exit(c09579e0,c975dd2c,eec44d08) at fork_exit+0x7f/frame 0xeec44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec44cf4 --- trap 0, eip = 0, esp = 0xeec44d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xc97542f0 sched_switch(c97542f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec41bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec41c08 sleepq_switch(c97542f0,0,c108835c,26f,c97542f0,...) at sleepq_switch+0x1b9/frame 0xeec41c3c sleepq_wait(c975dd04,0,eec41c90,1,0,...) at sleepq_wait+0x48/frame 0xeec41c60 _cv_wait(c975dd04,c975de4c,c106080b,73,c975dd0c,...) at _cv_wait+0x1f9/frame 0xeec41ca4 usb_process(c975dcfc,eec41d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec41ccc fork_exit(c09579e0,c975dcfc,eec41d08) at fork_exit+0x7f/frame 0xeec41cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec41cf4 --- trap 0, eip = 0, esp = 0xeec41d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xc97545e0 sched_switch(c97545e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec3ebd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec3ec08 sleepq_switch(c97545e0,0,c108835c,26f,c97545e0,...) at sleepq_switch+0x1b9/frame 0xeec3ec3c sleepq_wait(c975dcd4,0,eec3ec90,1,0,...) at sleepq_wait+0x48/frame 0xeec3ec60 _cv_wait(c975dcd4,c975de4c,c106080b,73,c975dcdc,...) at _cv_wait+0x1f9/frame 0xeec3eca4 usb_process(c975dccc,eec3ed08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec3eccc fork_exit(c09579e0,c975dccc,eec3ed08) at fork_exit+0x7f/frame 0xeec3ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec3ecf4 --- trap 0, eip = 0, esp = 0xeec3ed40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xc97548d0 sched_switch(c97548d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec3bbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec3bc08 sleepq_switch(c97548d0,0,c108835c,26f,c97548d0,...) at sleepq_switch+0x1b9/frame 0xeec3bc3c sleepq_wait(c975dca4,0,eec3bc90,1,0,...) at sleepq_wait+0x48/frame 0xeec3bc60 _cv_wait(c975dca4,c975de4c,c106080b,73,c975dcac,...) at _cv_wait+0x1f9/frame 0xeec3bca4 usb_process(c975dc9c,eec3bd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec3bccc fork_exit(c09579e0,c975dc9c,eec3bd08) at fork_exit+0x7f/frame 0xeec3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec3bcf4 --- trap 0, eip = 0, esp = 0xeec3bd40, ebp = 0 --- Tracing command usb pid 15 tid 100054 td 0xc9757000 sched_switch(c9757000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec32bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec32c08 sleepq_switch(c9757000,0,c108835c,26f,c9757000,...) at sleepq_switch+0x1b9/frame 0xeec32c3c sleepq_wait(c9750b5c,0,eec32c90,1,0,...) at sleepq_wait+0x48/frame 0xeec32c60 _cv_wait(c9750b5c,c9750c74,c106080b,73,c9750b64,...) at _cv_wait+0x1f9/frame 0xeec32ca4 usb_process(c9750b54,eec32d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec32ccc fork_exit(c09579e0,c9750b54,eec32d08) at fork_exit+0x7f/frame 0xeec32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec32cf4 --- trap 0, eip = 0, esp = 0xeec32d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xc97572f0 sched_switch(c97572f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec2fbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec2fc08 sleepq_switch(c97572f0,0,c108835c,26f,c97572f0,...) at sleepq_switch+0x1b9/frame 0xeec2fc3c sleepq_wait(c9750b2c,0,eec2fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec2fc60 _cv_wait(c9750b2c,c9750c74,c106080b,73,c9750b34,...) at _cv_wait+0x1f9/frame 0xeec2fca4 usb_process(c9750b24,eec2fd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec2fccc fork_exit(c09579e0,c9750b24,eec2fd08) at fork_exit+0x7f/frame 0xeec2fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec2fcf4 --- trap 0, eip = 0, esp = 0xeec2fd40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xc97575e0 sched_switch(c97575e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec2cbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec2cc08 sleepq_switch(c97575e0,0,c108835c,26f,c97575e0,...) at sleepq_switch+0x1b9/frame 0xeec2cc3c sleepq_wait(c9750afc,0,eec2cc90,1,0,...) at sleepq_wait+0x48/frame 0xeec2cc60 _cv_wait(c9750afc,c9750c74,c106080b,73,c9750b04,...) at _cv_wait+0x1f9/frame 0xeec2cca4 usb_process(c9750af4,eec2cd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec2cccc fork_exit(c09579e0,c9750af4,eec2cd08) at fork_exit+0x7f/frame 0xeec2ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec2ccf4 --- trap 0, eip = 0, esp = 0xeec2cd40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xc9742000 sched_switch(c9742000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec29bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec29c08 sleepq_switch(c9742000,0,c108835c,26f,c9742000,...) at sleepq_switch+0x1b9/frame 0xeec29c3c sleepq_wait(c9750acc,0,eec29c90,1,0,...) at sleepq_wait+0x48/frame 0xeec29c60 _cv_wait(c9750acc,c9750c74,c106080b,73,c9750ad4,...) at _cv_wait+0x1f9/frame 0xeec29ca4 usb_process(c9750ac4,eec29d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec29ccc fork_exit(c09579e0,c9750ac4,eec29d08) at fork_exit+0x7f/frame 0xeec29cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec29cf4 --- trap 0, eip = 0, esp = 0xeec29d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xc97422f0 sched_switch(c97422f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec25bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec25c08 sleepq_switch(c97422f0,0,c108835c,26f,c97422f0,...) at sleepq_switch+0x1b9/frame 0xeec25c3c sleepq_wait(c974cb5c,0,eec25c90,1,0,...) at sleepq_wait+0x48/frame 0xeec25c60 _cv_wait(c974cb5c,c974cc74,c106080b,73,c974cb64,...) at _cv_wait+0x1f9/frame 0xeec25ca4 usb_process(c974cb54,eec25d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec25ccc fork_exit(c09579e0,c974cb54,eec25d08) at fork_exit+0x7f/frame 0xeec25cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec25cf4 --- trap 0, eip = 0, esp = 0xeec25d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xc97425e0 sched_switch(c97425e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec22bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec22c08 sleepq_switch(c97425e0,0,c108835c,26f,c97425e0,...) at sleepq_switch+0x1b9/frame 0xeec22c3c sleepq_wait(c974cb2c,0,eec22c90,1,0,...) at sleepq_wait+0x48/frame 0xeec22c60 _cv_wait(c974cb2c,c974cc74,c106080b,73,c974cb34,...) at _cv_wait+0x1f9/frame 0xeec22ca4 usb_process(c974cb24,eec22d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec22ccc fork_exit(c09579e0,c974cb24,eec22d08) at fork_exit+0x7f/frame 0xeec22cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec22cf4 --- trap 0, eip = 0, esp = 0xeec22d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xc97428d0 sched_switch(c97428d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec1fbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec1fc08 sleepq_switch(c97428d0,0,c108835c,26f,c97428d0,...) at sleepq_switch+0x1b9/frame 0xeec1fc3c sleepq_wait(c974cafc,0,eec1fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec1fc60 _cv_wait(c974cafc,c974cc74,c106080b,73,c974cb04,...) at _cv_wait+0x1f9/frame 0xeec1fca4 usb_process(c974caf4,eec1fd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec1fccc fork_exit(c09579e0,c974caf4,eec1fd08) at fork_exit+0x7f/frame 0xeec1fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec1fcf4 --- trap 0, eip = 0, esp = 0xeec1fd40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xc9742bc0 sched_switch(c9742bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec1cbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec1cc08 sleepq_switch(c9742bc0,0,c108835c,26f,c9742bc0,...) at sleepq_switch+0x1b9/frame 0xeec1cc3c sleepq_wait(c974cacc,0,eec1cc90,1,0,...) at sleepq_wait+0x48/frame 0xeec1cc60 _cv_wait(c974cacc,c974cc74,c106080b,73,c974cad4,...) at _cv_wait+0x1f9/frame 0xeec1cca4 usb_process(c974cac4,eec1cd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec1cccc fork_exit(c09579e0,c974cac4,eec1cd08) at fork_exit+0x7f/frame 0xeec1ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec1ccf4 --- trap 0, eip = 0, esp = 0xeec1cd40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xc9743000 sched_switch(c9743000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec18bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec18c08 sleepq_switch(c9743000,0,c108835c,26f,c9743000,...) at sleepq_switch+0x1b9/frame 0xeec18c3c sleepq_wait(c9747b5c,0,eec18c90,1,0,...) at sleepq_wait+0x48/frame 0xeec18c60 _cv_wait(c9747b5c,c9747c74,c106080b,73,c9747b64,...) at _cv_wait+0x1f9/frame 0xeec18ca4 usb_process(c9747b54,eec18d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec18ccc fork_exit(c09579e0,c9747b54,eec18d08) at fork_exit+0x7f/frame 0xeec18cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec18cf4 --- trap 0, eip = 0, esp = 0xeec18d40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xc97432f0 sched_switch(c97432f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec15bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec15c08 sleepq_switch(c97432f0,0,c108835c,26f,c97432f0,...) at sleepq_switch+0x1b9/frame 0xeec15c3c sleepq_wait(c9747b2c,0,eec15c90,1,0,...) at sleepq_wait+0x48/frame 0xeec15c60 _cv_wait(c9747b2c,c9747c74,c106080b,73,c9747b34,...) at _cv_wait+0x1f9/frame 0xeec15ca4 usb_process(c9747b24,eec15d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec15ccc fork_exit(c09579e0,c9747b24,eec15d08) at fork_exit+0x7f/frame 0xeec15cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec15cf4 --- trap 0, eip = 0, esp = 0xeec15d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xc97435e0 sched_switch(c97435e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec12bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec12c08 sleepq_switch(c97435e0,0,c108835c,26f,c97435e0,...) at sleepq_switch+0x1b9/frame 0xeec12c3c sleepq_wait(c9747afc,0,eec12c90,1,0,...) at sleepq_wait+0x48/frame 0xeec12c60 _cv_wait(c9747afc,c9747c74,c106080b,73,c9747b04,...) at _cv_wait+0x1f9/frame 0xeec12ca4 usb_process(c9747af4,eec12d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec12ccc fork_exit(c09579e0,c9747af4,eec12d08) at fork_exit+0x7f/frame 0xeec12cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec12cf4 --- trap 0, eip = 0, esp = 0xeec12d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xc97438d0 sched_switch(c97438d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec0fbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec0fc08 sleepq_switch(c97438d0,0,c108835c,26f,c97438d0,...) at sleepq_switch+0x1b9/frame 0xeec0fc3c sleepq_wait(c9747acc,0,eec0fc90,1,0,...) at sleepq_wait+0x48/frame 0xeec0fc60 _cv_wait(c9747acc,c9747c74,c106080b,73,c9747ad4,...) at _cv_wait+0x1f9/frame 0xeec0fca4 usb_process(c9747ac4,eec0fd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec0fccc fork_exit(c09579e0,c9747ac4,eec0fd08) at fork_exit+0x7f/frame 0xeec0fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec0fcf4 --- trap 0, eip = 0, esp = 0xeec0fd40, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xc9746000 sched_switch(c9746000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec08bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec08c08 sleepq_switch(c9746000,0,c108835c,26f,c9746000,...) at sleepq_switch+0x1b9/frame 0xeec08c3c sleepq_wait(c973eb5c,0,eec08c90,1,0,...) at sleepq_wait+0x48/frame 0xeec08c60 _cv_wait(c973eb5c,c973ec74,c106080b,73,c973eb64,...) at _cv_wait+0x1f9/frame 0xeec08ca4 usb_process(c973eb54,eec08d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec08ccc fork_exit(c09579e0,c973eb54,eec08d08) at fork_exit+0x7f/frame 0xeec08cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec08cf4 --- trap 0, eip = 0, esp = 0xeec08d40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xc9719000 sched_switch(c9719000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec05bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec05c08 sleepq_switch(c9719000,0,c108835c,26f,c9719000,...) at sleepq_switch+0x1b9/frame 0xeec05c3c sleepq_wait(c973eb2c,0,eec05c90,1,0,...) at sleepq_wait+0x48/frame 0xeec05c60 _cv_wait(c973eb2c,c973ec74,c106080b,73,c973eb34,...) at _cv_wait+0x1f9/frame 0xeec05ca4 usb_process(c973eb24,eec05d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec05ccc fork_exit(c09579e0,c973eb24,eec05d08) at fork_exit+0x7f/frame 0xeec05cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec05cf4 --- trap 0, eip = 0, esp = 0xeec05d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xc97192f0 sched_switch(c97192f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec02bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeec02c08 sleepq_switch(c97192f0,0,c108835c,26f,c97192f0,...) at sleepq_switch+0x1b9/frame 0xeec02c3c sleepq_wait(c973eafc,0,eec02c90,1,0,...) at sleepq_wait+0x48/frame 0xeec02c60 _cv_wait(c973eafc,c973ec74,c106080b,73,c973eb04,...) at _cv_wait+0x1f9/frame 0xeec02ca4 usb_process(c973eaf4,eec02d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeec02ccc fork_exit(c09579e0,c973eaf4,eec02d08) at fork_exit+0x7f/frame 0xeec02cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec02cf4 --- trap 0, eip = 0, esp = 0xeec02d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xc97195e0 sched_switch(c97195e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeebffbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebffc08 sleepq_switch(c97195e0,0,c108835c,26f,c97195e0,...) at sleepq_switch+0x1b9/frame 0xeebffc3c sleepq_wait(c973eacc,0,eebffc90,1,0,...) at sleepq_wait+0x48/frame 0xeebffc60 _cv_wait(c973eacc,c973ec74,c106080b,73,c973ead4,...) at _cv_wait+0x1f9/frame 0xeebffca4 usb_process(c973eac4,eebffd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeebffccc fork_exit(c09579e0,c973eac4,eebffd08) at fork_exit+0x7f/frame 0xeebffcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebffcf4 --- trap 0, eip = 0, esp = 0xeebffd40, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xc9719bc0 sched_switch(c9719bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeebf8bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf8c08 sleepq_switch(c9719bc0,0,c108835c,26f,c9719bc0,...) at sleepq_switch+0x1b9/frame 0xeebf8c3c sleepq_wait(c9735b5c,0,eebf8c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf8c60 _cv_wait(c9735b5c,c9735c74,c106080b,73,c9735b64,...) at _cv_wait+0x1f9/frame 0xeebf8ca4 usb_process(c9735b54,eebf8d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeebf8ccc fork_exit(c09579e0,c9735b54,eebf8d08) at fork_exit+0x7f/frame 0xeebf8cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf8cf4 --- trap 0, eip = 0, esp = 0xeebf8d40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xc971b000 sched_switch(c971b000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeebf5bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf5c08 sleepq_switch(c971b000,0,c108835c,26f,c971b000,...) at sleepq_switch+0x1b9/frame 0xeebf5c3c sleepq_wait(c9735b2c,0,eebf5c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf5c60 _cv_wait(c9735b2c,c9735c74,c106080b,73,c9735b34,...) at _cv_wait+0x1f9/frame 0xeebf5ca4 usb_process(c9735b24,eebf5d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeebf5ccc fork_exit(c09579e0,c9735b24,eebf5d08) at fork_exit+0x7f/frame 0xeebf5cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf5cf4 --- trap 0, eip = 0, esp = 0xeebf5d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xc971b2f0 sched_switch(c971b2f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeebf2bd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebf2c08 sleepq_switch(c971b2f0,0,c108835c,26f,c971b2f0,...) at sleepq_switch+0x1b9/frame 0xeebf2c3c sleepq_wait(c9735afc,0,eebf2c90,1,0,...) at sleepq_wait+0x48/frame 0xeebf2c60 _cv_wait(c9735afc,c9735c74,c106080b,73,c9735b04,...) at _cv_wait+0x1f9/frame 0xeebf2ca4 usb_process(c9735af4,eebf2d08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeebf2ccc fork_exit(c09579e0,c9735af4,eebf2d08) at fork_exit+0x7f/frame 0xeebf2cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebf2cf4 --- trap 0, eip = 0, esp = 0xeebf2d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xc971b5e0 sched_switch(c971b5e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeebefbd4 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xeebefc08 sleepq_switch(c971b5e0,0,c108835c,26f,c971b5e0,...) at sleepq_switch+0x1b9/frame 0xeebefc3c sleepq_wait(c9735acc,0,eebefc90,1,0,...) at sleepq_wait+0x48/frame 0xeebefc60 _cv_wait(c9735acc,c9735c74,c106080b,73,c9735ad4,...) at _cv_wait+0x1f9/frame 0xeebefca4 usb_process(c9735ac4,eebefd08,c107c4a8,3d7,0,...) at usb_process+0xe6/frame 0xeebefccc fork_exit(c09579e0,c9735ac4,eebefd08) at fork_exit+0x7f/frame 0xeebefcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebefcf4 --- trap 0, eip = 0, esp = 0xeebefd40, ebp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xc81498d0 sched_switch(c81498d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b7264c mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b72680 sleepq_switch(c81498d0,0,c108835c,26f,c81498d0,...) at sleepq_switch+0x1b9/frame 0xc7b726b4 sleepq_wait(c8236000,5c,c0ede47f,0,0,...) at sleepq_wait+0x48/frame 0xc7b726d8 _sleep(c8236000,c8236000,5c,c0ede47f,0,...) at _sleep+0x34e/frame 0xc7b72730 ctl_work_thread(c8236000,c7b72d08,c107c4a8,3d7,0,...) at ctl_work_thread+0x110/frame 0xc7b72ccc fork_exit(c04d5780,c8236000,c7b72d08) at fork_exit+0x7f/frame 0xc7b72cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b72cf4 --- trap 0, eip = 0, esp = 0xc7b72d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc81485e0 sched_switch(c81485e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b51b90 mi_switch(104,0,c108835c,1f9,3,...) at mi_switch+0x1c9/frame 0xc7b51bc4 sleepq_switch(c81485e0,0,c108835c,292,c81485e0,...) at sleepq_switch+0x1b9/frame 0xc7b51bf8 sleepq_timedwait(c1230fe0,0,c106ef8a,2,0,...) at sleepq_timedwait+0x48/frame 0xc7b51c1c _sleep(c1230fe0,0,0,c106ef8a,64) at _sleep+0x317/frame 0xc7b51c74 pause(c106ef8a,64,c103c5ce,111,0,...) at pause+0x85/frame 0xc7b51c98 random_kthread(0,c7b51d08,c107c4a8,3d7,0,...) at random_kthread+0x30f/frame 0xc7b51ccc fork_exit(c0847da0,0,c7b51d08) at fork_exit+0x7f/frame 0xc7b51cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b51cf4 --- trap 0, eip = 0, esp = 0xc7b51d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8148bc0 sched_switch(c8148bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b4ab88 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b4abbc sleepq_switch(c8148bc0,0,c108835c,26f,c8148bc0,...) at sleepq_switch+0x1b9/frame 0xc7b4abf0 sleepq_wait(c13f8798,5c,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4ac14 _sleep(c13f8798,c122f330,25c,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b4ac6c g_io_schedule_down(c8148bc0,0,c1070a14,6c,c7b4acf4,...) at g_io_schedule_down+0x3c/frame 0xc7b4acb4 g_down_procbody(0,c7b4ad08,c107c4a8,3d7,0,...) at g_down_procbody+0x9d/frame 0xc7b4accc fork_exit(c0a03dd0,0,c7b4ad08) at fork_exit+0x7f/frame 0xc7b4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4acf4 --- trap 0, eip = 0, esp = 0xc7b4ad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8149000 sched_switch(c8149000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b47bac mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b47be0 sleepq_switch(c8149000,0,c108835c,26f,c8149000,...) at sleepq_switch+0x1b9/frame 0xc7b47c14 sleepq_wait(c13f8794,5c,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b47c38 _sleep(c13f8794,c122f350,25c,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b47c90 g_io_schedule_up(c8149000,0,c1070a14,5f,c7b47cf4,...) at g_io_schedule_up+0x8f/frame 0xc7b47cb4 g_up_procbody(0,c7b47d08,c107c4a8,3d7,0,...) at g_up_procbody+0x9d/frame 0xc7b47ccc fork_exit(c0a03d30,0,c7b47d08) at fork_exit+0x7f/frame 0xc7b47cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b47cf4 --- trap 0, eip = 0, esp = 0xc7b47d40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc7dfc2f0 sched_switch(c7dfc2f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b44bbc mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b44bf0 sleepq_switch(c7dfc2f0,0,c108835c,26f,c7dfc2f0,...) at sleepq_switch+0x1b9/frame 0xc7b44c24 sleepq_wait(c13f8790,5c,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b44c48 _sleep(c13f8790,c122f308,25c,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b44ca0 g_run_events(0,c7b44d08,c107c4a8,3d7,0,...) at g_run_events+0x4f3/frame 0xc7b44ccc fork_exit(c0a03c90,0,c7b44d08) at fork_exit+0x7f/frame 0xc7b44cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b44cf4 --- trap 0, eip = 0, esp = 0xc7b44d40, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xc98875e0 sched_switch(c98875e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec7bc64 mi_switch(109,0,c107c745,563,c98875e0,...) at mi_switch+0x1c9/frame 0xeec7bc98 ithread_loop(c7df5940,eec7bd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec7bccc fork_exit(c0a73f00,c7df5940,eec7bd08) at fork_exit+0x7f/frame 0xeec7bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec7bcf4 --- trap 0, eip = 0, esp = 0xeec7bd40, ebp = 0 --- Tracing command intr pid 12 tid 100066 td 0xc98878d0 sched_switch(c98878d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec78c64 mi_switch(109,0,c107c745,563,c98878d0,...) at mi_switch+0x1c9/frame 0xeec78c98 ithread_loop(c7df5990,eec78d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec78ccc fork_exit(c0a73f00,c7df5990,eec78d08) at fork_exit+0x7f/frame 0xeec78cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec78cf4 --- trap 0, eip = 0, esp = 0xeec78d40, ebp = 0 --- Tracing command intr pid 12 tid 100064 td 0xc9888000 sched_switch(c9888000,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec68c64 mi_switch(109,0,c107c745,563,c9888000,...) at mi_switch+0x1c9/frame 0xeec68c98 ithread_loop(c7df5a30,eec68d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec68ccc fork_exit(c0a73f00,c7df5a30,eec68d08) at fork_exit+0x7f/frame 0xeec68cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec68cf4 --- trap 0, eip = 0, esp = 0xeec68d40, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xc97468d0 sched_switch(c97468d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec5cc64 mi_switch(109,0,c107c745,563,c97468d0,...) at mi_switch+0x1c9/frame 0xeec5cc98 ithread_loop(c7df5960,eec5cd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec5cccc fork_exit(c0a73f00,c7df5960,eec5cd08) at fork_exit+0x7f/frame 0xeec5ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec5ccf4 --- trap 0, eip = 0, esp = 0xeec5cd40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc9746bc0 sched_switch(c9746bc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec4ac64 mi_switch(109,0,c107c745,563,c9746bc0,...) at mi_switch+0x1c9/frame 0xeec4ac98 ithread_loop(c7df5a40,eec4ad08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec4accc fork_exit(c0a73f00,c7df5a40,eec4ad08) at fork_exit+0x7f/frame 0xeec4acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec4acf4 --- trap 0, eip = 0, esp = 0xeec4ad40, ebp = 0 --- Tracing command intr pid 12 tid 100055 td 0xc9754bc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xc9743bc0 sched_switch(c9743bc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeec0cc64 mi_switch(109,0,c107c745,563,c9743bc0,...) at mi_switch+0x1c9/frame 0xeec0cc98 ithread_loop(c7df5970,eec0cd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeec0cccc fork_exit(c0a73f00,c7df5970,eec0cd08) at fork_exit+0x7f/frame 0xeec0ccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec0ccf4 --- trap 0, eip = 0, esp = 0xeec0cd40, ebp = 0 --- Tracing command intr pid 12 tid 100037 td 0xc97198d0 sched_switch(c97198d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeebfcc64 mi_switch(109,0,c107c745,563,c97198d0,...) at mi_switch+0x1c9/frame 0xeebfcc98 ithread_loop(c7df5920,eebfcd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeebfcccc fork_exit(c0a73f00,c7df5920,eebfcd08) at fork_exit+0x7f/frame 0xeebfccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebfccf4 --- trap 0, eip = 0, esp = 0xeebfcd40, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc971b8d0 sched_switch(c971b8d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeebecc64 mi_switch(109,0,c107c745,563,c971b8d0,...) at mi_switch+0x1c9/frame 0xeebecc98 ithread_loop(c7df5830,eebecd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeebecccc fork_exit(c0a73f00,c7df5830,eebecd08) at fork_exit+0x7f/frame 0xeebeccf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeebeccf4 --- trap 0, eip = 0, esp = 0xeebecd40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc971bbc0 sched_switch(c971bbc0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeea96c64 mi_switch(109,0,c107c745,563,c971bbc0,...) at mi_switch+0x1c9/frame 0xeea96c98 ithread_loop(c7df5ab0,eea96d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeea96ccc fork_exit(c0a73f00,c7df5ab0,eea96d08) at fork_exit+0x7f/frame 0xeea96cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea96cf4 --- trap 0, eip = 0, esp = 0xeea96d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc81492f0 sched_switch(c81492f0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xeea92c64 mi_switch(109,0,c107c745,563,c81492f0,...) at mi_switch+0x1c9/frame 0xeea92c98 ithread_loop(c7df6100,eea92d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xeea92ccc fork_exit(c0a73f00,c7df6100,eea92d08) at fork_exit+0x7f/frame 0xeea92cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeea92cf4 --- trap 0, eip = 0, esp = 0xeea92d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc81495e0 sched_switch(c81495e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7ba4c64 mi_switch(109,0,c107c745,563,c81495e0,...) at mi_switch+0x1c9/frame 0xc7ba4c98 ithread_loop(c7df5a50,c7ba4d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7ba4ccc fork_exit(c0a73f00,c7df5a50,c7ba4d08) at fork_exit+0x7f/frame 0xc7ba4cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7ba4cf4 --- trap 0, eip = 0, esp = 0xc7ba4d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xc8233000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100025 td 0xc82332f0 sched_switch(c82332f0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b69c64 mi_switch(109,0,c107c745,563,c82332f0,...) at mi_switch+0x1c9/frame 0xc7b69c98 ithread_loop(c7df5b20,c7b69d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b69ccc fork_exit(c0a73f00,c7df5b20,c7b69d08) at fork_exit+0x7f/frame 0xc7b69cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b69cf4 --- trap 0, eip = 0, esp = 0xc7b69d40, ebp = 0 --- Tracing command intr pid 12 tid 100023 td 0xc82338d0 sched_switch(c82338d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b63c64 mi_switch(109,0,c107c745,563,c82338d0,...) at mi_switch+0x1c9/frame 0xc7b63c98 ithread_loop(c7df5b30,c7b63d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b63ccc fork_exit(c0a73f00,c7df5b30,c7b63d08) at fork_exit+0x7f/frame 0xc7b63cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b63cf4 --- trap 0, eip = 0, esp = 0xc7b63d40, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc81482f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc7dfc5e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc7dfc8d0 sched_switch(c7dfc8d0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b3ec64 mi_switch(109,0,c107c745,563,c7dfc8d0,...) at mi_switch+0x1c9/frame 0xc7b3ec98 ithread_loop(c7df5b90,c7b3ed08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b3eccc fork_exit(c0a73f00,c7df5b90,c7b3ed08) at fork_exit+0x7f/frame 0xc7b3ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b3ecf4 --- trap 0, eip = 0, esp = 0xc7b3ed40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc7dfcbc0 sched_switch(c7dfcbc0,0,109,1b3,c107c745,...) at sched_switch+0x4ba/frame 0xc7b3bc64 mi_switch(109,0,c107c745,563,c7dfcbc0,...) at mi_switch+0x1c9/frame 0xc7b3bc98 ithread_loop(c7df5ba0,c7b3bd08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b3bccc fork_exit(c0a73f00,c7df5ba0,c7b3bd08) at fork_exit+0x7f/frame 0xc7b3bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b3bcf4 --- trap 0, eip = 0, esp = 0xc7b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc7e40000 sched_switch(c7e40000,0,109,1b3,c107c745,...) at sched_switch+0x4ba/frame 0xc7b38c64 mi_switch(109,0,c107c745,563,c7e40000,...) at mi_switch+0x1c9/frame 0xc7b38c98 ithread_loop(c7df5bb0,c7b38d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b38ccc fork_exit(c0a73f00,c7df5bb0,c7b38d08) at fork_exit+0x7f/frame 0xc7b38cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b38cf4 --- trap 0, eip = 0, esp = 0xc7b38d40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc7e402f0 sched_switch(c7e402f0,0,109,1b3,c107c745,...) at sched_switch+0x4ba/frame 0xc7b35c64 mi_switch(109,0,c107c745,563,c7e402f0,...) at mi_switch+0x1c9/frame 0xc7b35c98 ithread_loop(c7df5bc0,c7b35d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b35ccc fork_exit(c0a73f00,c7df5bc0,c7b35d08) at fork_exit+0x7f/frame 0xc7b35cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b35cf4 --- trap 0, eip = 0, esp = 0xc7b35d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc7e405e0 sched_switch(c7e405e0,0,109,1b3,0,...) at sched_switch+0x4ba/frame 0xc7b32c64 mi_switch(109,0,c107c745,563,c7e405e0,...) at mi_switch+0x1c9/frame 0xc7b32c98 ithread_loop(c7df5bd0,c7b32d08,c107c4a8,3d7,0,...) at ithread_loop+0x100/frame 0xc7b32ccc fork_exit(c0a73f00,c7df5bd0,c7b32d08) at fork_exit+0x7f/frame 0xc7b32cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b32cf4 --- trap 0, eip = 0, esp = 0xc7b32d40, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc7dfb000 cpustop_handler(3,13,c7b2eba8,c0ea4d9b,c7b2eaa8,...) at cpustop_handler+0x2f/frame 0xc7b2ea58 ipi_nmi_handler(c7b2eaa8,40a890,c7b2eb68,d03a0101,c7b2ead8,...) at ipi_nmi_handler+0x37/frame 0xc7b2ea68 trap(c7b2ebb4) at trap+0x3b/frame 0xc7b2eba8 calltrap() at calltrap+0x6/frame 0xc7b2eba8 --- trap 0x13, eip = 0xc0e8a902, esp = 0xc7b2ebf4, ebp = 0xc7b2ec34 --- acpi_cpu_c1(0,c7b2ec50,c0e94b4d,0,3,...) at acpi_cpu_c1+0x2/frame 0xc7b2ec34 cpu_idle_acpi(0,3,c7b2eccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2ec40 cpu_idle(0,2,c1084d9d,a46,c123f808,...) at cpu_idle+0x7d/frame 0xc7b2ec50 sched_idletd(0,c7b2ed08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2eccc fork_exit(c0ac8ae0,0,c7b2ed08) at fork_exit+0x7f/frame 0xc7b2ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2ecf4 --- trap 0, eip = 0, esp = 0xc7b2ed40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc7dfb2f0 kdb_break(c8171400,c7b2bb68,691f300,6fd,59a510bb,...) at kdb_break+0x4e/frame 0xc7b2bb0c uart_intr(c8171400,100,c124db30,0,0,...) at uart_intr+0x8e/frame 0xc7b2bb38 intr_event_handle(c7dc8a00,c7b2bbb4,0,c7b2bbb4,2,...) at intr_event_handle+0x7a/frame 0xc7b2bb64 intr_execute_handlers(c7e3d0d0,c7b2bbb4,2) at intr_execute_handlers+0x42/frame 0xc7b2bb84 lapic_handle_intr(30,c7b2bbb4) at lapic_handle_intr+0x6f/frame 0xc7b2bba4 Xapic_isr1() at Xapic_isr1+0x35/frame 0xc7b2bba4 --- interrupt, eip = 0xc0e8a902, esp = 0xc7b2bbf4, ebp = 0xc7b2bc34 --- acpi_cpu_c1(0,c7b2bc50,c0e94b4d,0,3,...) at acpi_cpu_c1+0x2/frame 0xc7b2bc34 cpu_idle_acpi(0,3,c7b2bccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b2bc40 cpu_idle(0,2,c1084d9d,a46,c123f108,...) at cpu_idle+0x7d/frame 0xc7b2bc50 sched_idletd(0,c7b2bd08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b2bccc fork_exit(c0ac8ae0,0,c7b2bd08) at fork_exit+0x7f/frame 0xc7b2bcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b2bcf4 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc7dfb5e0 cpustop_handler(1,13,c7b28ba8,c0ea4d9b,c7b28aa8,...) at cpustop_handler+0x2f/frame 0xc7b28a58 ipi_nmi_handler(c7b28aa8,40a6b2,c7b28b68,2cf40101,c7b28ad8,...) at ipi_nmi_handler+0x37/frame 0xc7b28a68 trap(c7b28bb4) at trap+0x3b/frame 0xc7b28ba8 calltrap() at calltrap+0x6/frame 0xc7b28ba8 --- trap 0x13, eip = 0xc0e8a902, esp = 0xc7b28bf4, ebp = 0xc7b28c34 --- acpi_cpu_c1(0,c7b28c50,c0e94b4d,0,5,...) at acpi_cpu_c1+0x2/frame 0xc7b28c34 cpu_idle_acpi(0,5,c7b28ccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b28c40 cpu_idle(0,2,c1084d9d,a46,c123ea08,...) at cpu_idle+0x7d/frame 0xc7b28c50 sched_idletd(0,c7b28d08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b28ccc fork_exit(c0ac8ae0,0,c7b28d08) at fork_exit+0x7f/frame 0xc7b28cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b28cf4 --- trap 0, eip = 0, esp = 0xc7b28d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc7dfb8d0 cpustop_handler(0,13,c7b25ba8,c0ea4d9b,c7b25aa8,...) at cpustop_handler+0x2f/frame 0xc7b25a58 ipi_nmi_handler(c7b25aa8,4076d5,c7b25b68,73810101,c7b25ad8,...) at ipi_nmi_handler+0x37/frame 0xc7b25a68 trap(c7b25bb4) at trap+0x3b/frame 0xc7b25ba8 calltrap() at calltrap+0x6/frame 0xc7b25ba8 --- trap 0x13, eip = 0xc0e8a902, esp = 0xc7b25bf4, ebp = 0xc7b25c34 --- acpi_cpu_c1(0,c7b25c50,c0e94b4d,0,3,...) at acpi_cpu_c1+0x2/frame 0xc7b25c34 cpu_idle_acpi(0,3,c7b25ccc,c0ac8cda,0,...) at cpu_idle_acpi+0x2f/frame 0xc7b25c40 cpu_idle(0,2,c1084d9d,409,c123e308,...) at cpu_idle+0x7d/frame 0xc7b25c50 sched_idletd(0,c7b25d08,c107c4a8,3d7,0,...) at sched_idletd+0x1fa/frame 0xc7b25ccc fork_exit(c0ac8ae0,0,c7b25d08) at fork_exit+0x7f/frame 0xc7b25cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b25cf4 --- trap 0, eip = 0, esp = 0xc7b25d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc7dfbbc0 sched_switch(c7dfbbc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b21978 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xc7b219ac sleepq_switch(c7dfbbc0,0,c108835c,1ad,c7b21a24,...) at sleepq_switch+0x1b9/frame 0xc7b219e0 sleepq_catch_signals(0,c108835c,166,288,c7dfbbc0,...) at sleepq_catch_signals+0x3b1/frame 0xc7b21a28 sleepq_wait_sig(c7df9b40,6c,c108b811,100,0,...) at sleepq_wait_sig+0x14/frame 0xc7b21a4c _sleep(c7df9b40,c7df9bc8,16c,c108b811,0,...) at _sleep+0x32d/frame 0xc7b21aa4 kern_wait6(c7dfbbc0,7,0,0,c7b21bec,...) at kern_wait6+0x3ec/frame 0xc7b21b00 kern_wait(c7dfbbc0,ffffffff,c7b21bec,0,0,...) at kern_wait+0xd8/frame 0xc7b21bd0 sys_wait4(c7dfbbc0,c7b21cc8,c7b21d08,1,1,...) at sys_wait4+0x41/frame 0xc7b21c40 syscall(c7b21d08) at syscall+0x2ed/frame 0xc7b21cfc Xint0x80_syscall() at Xint0x80_syscall+0x21/frame 0xc7b21cfc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x805dce7, esp = 0xbfbfd8f4, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc7dfc000 sched_switch(c7dfc000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b1eba8 mi_switch(104,0,c108835c,1f9,8,...) at mi_switch+0x1c9/frame 0xc7b1ebdc sleepq_switch(c7dfc000,0,c108835c,26f,c7dfc000,...) at sleepq_switch+0x1b9/frame 0xc7b1ec10 sleepq_wait(c13ff444,0,c7b1ec64,1,0,...) at sleepq_wait+0x48/frame 0xc7b1ec34 _cv_wait(c13ff444,c13ff3d0,c10b33c2,18d,0,...) at _cv_wait+0x1f9/frame 0xc7b1ec78 audit_worker(0,c7b1ed08,c107c4a8,3d7,0,...) at audit_worker+0x94/frame 0xc7b1eccc fork_exit(c0ca8390,0,c7b1ed08) at fork_exit+0x7f/frame 0xc7b1ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b1ecf4 --- trap 0, eip = 0, esp = 0xc7b1ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xc9887000 sched_switch(c9887000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec81b8c mi_switch(104,0,c108835c,1f9,0,...) at mi_switch+0x1c9/frame 0xeec81bc0 sleepq_switch(c9887000,0,c108835c,292,c9887000,...) at sleepq_switch+0x1b9/frame 0xeec81bf4 sleepq_timedwait(c1230fe0,0,c106ef8a,2,0,...) at sleepq_timedwait+0x48/frame 0xeec81c18 _sleep(c1230fe0,0,0,c106ef8a,bb8) at _sleep+0x317/frame 0xeec81c70 pause(c106ef8a,bb8,12b,129,c13f8814,...) at pause+0x85/frame 0xeec81c94 deadlkres(0,eec81d08,c107c4a8,3d7,0,...) at deadlkres+0x48/frame 0xeec81ccc fork_exit(c0a53460,0,eec81d08) at fork_exit+0x7f/frame 0xeec81cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec81cf4 --- trap 0, eip = 0, esp = 0xeec81d40, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xc98872f0 sched_switch(c98872f0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec7ebd8 mi_switch(104,0,c108835c,1f9,c124d504,...) at mi_switch+0x1c9/frame 0xeec7ec0c sleepq_switch(c98872f0,0,c108835c,26f,c9744140,...) at sleepq_switch+0x1b9/frame 0xeec7ec40 sleepq_wait(c9744140,0,c108356d,c106ef8a,0,...) at sleepq_wait+0x48/frame 0xeec7ec64 msleep_spin(c9744140,c9744158,c106ef8a,0,c98872f0,...) at msleep_spin+0x216/frame 0xeec7eca4 taskqueue_thread_loop(c13f4ec8,eec7ed08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xeec7eccc fork_exit(c0ae6ae0,c13f4ec8,eec7ed08) at fork_exit+0x7f/frame 0xeec7ecf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec7ecf4 --- trap 0, eip = 0, esp = 0xeec7ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xc97465e0 sched_switch(c97465e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xeec62bd8 mi_switch(104,0,c108835c,1f9,c124d594,...) at mi_switch+0x1c9/frame 0xeec62c0c sleepq_switch(c97465e0,0,c108835c,26f,c9744700,...) at sleepq_switch+0x1b9/frame 0xeec62c40 sleepq_wait(c9744700,0,c108356d,c106ef8a,0,...) at sleepq_wait+0x48/frame 0xeec62c64 msleep_spin(c9744700,c9744718,c106ef8a,0,c97465e0,...) at msleep_spin+0x216/frame 0xeec62ca4 taskqueue_thread_loop(c978949c,eec62d08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xeec62ccc fork_exit(c0ae6ae0,c978949c,eec62d08) at fork_exit+0x7f/frame 0xeec62cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xeec62cf4 --- trap 0, eip = 0, esp = 0xeec62d40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc8149bc0 sched_switch(c8149bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b6fbc0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b6fbf4 sleepq_switch(c8149bc0,0,c108835c,26f,c8149bc0,...) at sleepq_switch+0x1b9/frame 0xc7b6fc28 sleepq_wait(c7dc3a00,0,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b6fc4c _sleep(c7dc3a00,c7dc3a18,0,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b6fca4 taskqueue_thread_loop(c13fbe38,c7b6fd08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b6fccc fork_exit(c0ae6ae0,c13fbe38,c7b6fd08) at fork_exit+0x7f/frame 0xc7b6fcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b6fcf4 --- trap 0, eip = 0, esp = 0xc7b6fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc82335e0 sched_switch(c82335e0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b66bc0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b66bf4 sleepq_switch(c82335e0,0,c108835c,26f,c82335e0,...) at sleepq_switch+0x1b9/frame 0xc7b66c28 sleepq_wait(c7dc3ac0,0,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b66c4c _sleep(c7dc3ac0,c7dc3ad8,0,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b66ca4 taskqueue_thread_loop(c13ff480,c7b66d08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b66ccc fork_exit(c0ae6ae0,c13ff480,c7b66d08) at fork_exit+0x7f/frame 0xc7b66cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b66cf4 --- trap 0, eip = 0, esp = 0xc7b66d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8233bc0 sched_switch(c8233bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b60bd8 mi_switch(104,0,c108835c,1f9,c124d48c,...) at mi_switch+0x1c9/frame 0xc7b60c0c sleepq_switch(c8233bc0,0,c108835c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b60c40 sleepq_wait(c7dc3c40,0,c108356d,c106ef8a,0,...) at sleepq_wait+0x48/frame 0xc7b60c64 msleep_spin(c7dc3c40,c7dc3c58,c106ef8a,0,c8233bc0,...) at msleep_spin+0x216/frame 0xc7b60ca4 taskqueue_thread_loop(c13f5ae0,c7b60d08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b60ccc fork_exit(c0ae6ae0,c13f5ae0,c7b60d08) at fork_exit+0x7f/frame 0xc7b60cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b60cf4 --- trap 0, eip = 0, esp = 0xc7b60d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc7e408d0 sched_switch(c7e408d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b5dbd8 mi_switch(104,0,c108835c,1f9,c124d48c,...) at mi_switch+0x1c9/frame 0xc7b5dc0c sleepq_switch(c7e408d0,0,c108835c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b5dc40 sleepq_wait(c7dc3c40,0,c108356d,c106ef8a,0,...) at sleepq_wait+0x48/frame 0xc7b5dc64 msleep_spin(c7dc3c40,c7dc3c58,c106ef8a,0,c7e408d0,...) at msleep_spin+0x216/frame 0xc7b5dca4 taskqueue_thread_loop(c13f5ae0,c7b5dd08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b5dccc fork_exit(c0ae6ae0,c13f5ae0,c7b5dd08) at fork_exit+0x7f/frame 0xc7b5dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b5dcf4 --- trap 0, eip = 0, esp = 0xc7b5dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc7e40bc0 sched_switch(c7e40bc0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b5abd8 mi_switch(104,0,c108835c,1f9,c124d48c,...) at mi_switch+0x1c9/frame 0xc7b5ac0c sleepq_switch(c7e40bc0,0,c108835c,26f,c7dc3c40,...) at sleepq_switch+0x1b9/frame 0xc7b5ac40 sleepq_wait(c7dc3c40,0,c108356d,c106ef8a,0,...) at sleepq_wait+0x48/frame 0xc7b5ac64 msleep_spin(c7dc3c40,c7dc3c58,c106ef8a,0,c7e40bc0,...) at msleep_spin+0x216/frame 0xc7b5aca4 taskqueue_thread_loop(c13f5ae0,c7b5ad08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0x7c/frame 0xc7b5accc fork_exit(c0ae6ae0,c13f5ae0,c7b5ad08) at fork_exit+0x7f/frame 0xc7b5acf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b5acf4 --- trap 0, eip = 0, esp = 0xc7b5ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xc8148000 sched_switch(c8148000,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b57bc0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b57bf4 sleepq_switch(c8148000,0,c108835c,26f,c8148000,...) at sleepq_switch+0x1b9/frame 0xc7b57c28 sleepq_wait(c7dc3c80,0,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b57c4c _sleep(c7dc3c80,c7dc3c98,0,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b57ca4 taskqueue_thread_loop(c13f8f68,c7b57d08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b57ccc fork_exit(c0ae6ae0,c13f8f68,c7b57d08) at fork_exit+0x7f/frame 0xc7b57cf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b57cf4 --- trap 0, eip = 0, esp = 0xc7b57d40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc81488d0 sched_switch(c81488d0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc7b4dbc0 mi_switch(104,0,c108835c,1f9,166,...) at mi_switch+0x1c9/frame 0xc7b4dbf4 sleepq_switch(c81488d0,0,c108835c,26f,c81488d0,...) at sleepq_switch+0x1b9/frame 0xc7b4dc28 sleepq_wait(c7dc3e40,0,c106ef8a,0,0,...) at sleepq_wait+0x48/frame 0xc7b4dc4c _sleep(c7dc3e40,c7dc3e58,0,c106ef8a,0,...) at _sleep+0x34e/frame 0xc7b4dca4 taskqueue_thread_loop(c124c3c0,c7b4dd08,c107c4a8,3d7,0,...) at taskqueue_thread_loop+0xb9/frame 0xc7b4dccc fork_exit(c0ae6ae0,c124c3c0,c7b4dd08) at fork_exit+0x7f/frame 0xc7b4dcf4 fork_trampoline() at fork_trampoline+0x8/frame 0xc7b4dcf4 --- trap 0, eip = 0, esp = 0xc7b4dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc13f8af0 sched_switch(c13f8af0,0,104,1b3,c0a8f20e,...) at sched_switch+0x4ba/frame 0xc1820c20 mi_switch(104,0,c108835c,1f9,1,...) at mi_switch+0x1c9/frame 0xc1820c54 sleepq_switch(c13f8af0,0,c108835c,292,c13f8af0,...) at sleepq_switch+0x1b9/frame 0xc1820c88 sleepq_timedwait(c13f8814,54,c10b4585,0,0,...) at sleepq_timedwait+0x48/frame 0xc1820cac _sleep(c13f8814,0,54,c10b4585,2710,...) at _sleep+0x317/frame 0xc1820d04 scheduler(0,0,c10e489c,181e000,1825000,...) at scheduler+0x274/frame 0xc1820d38 mi_startup() at mi_startup+0xf7/frame 0xc1820d58 begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 374 MB: 359 343 327 311 295 279 263 247 231 215 199 183 167 151 135 119 103 87 71 55 39 23 7 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 Index: sys/sys/vnode.h =================================================================== --- sys/sys/vnode.h (revision 244771) +++ sys/sys/vnode.h (working copy) @@ -392,6 +392,8 @@ extern int vttoif_tab[]; #define V_NOWAIT 0x0002 /* vn_start_write: don't sleep for suspend */ #define V_XSLEEP 0x0004 /* vn_start_write: just return after sleep */ +#define VR_START_WRITE 0x0001 /* vfs_write_resume: start write atomically */ + #define VREF(vp) vref(vp) #ifdef DIAGNOSTIC @@ -701,6 +703,7 @@ int vn_io_fault_uiomove(char *data, int xfersize, int vfs_cache_lookup(struct vop_lookup_args *ap); void vfs_timestamp(struct timespec *); void vfs_write_resume(struct mount *mp); +void vfs_write_resume_flags(struct mount *mp, int flags); int vfs_write_suspend(struct mount *mp); int vop_stdbmap(struct vop_bmap_args *); int vop_stdfsync(struct vop_fsync_args *); Index: sys/ufs/ffs/ffs_snapshot.c =================================================================== --- sys/ufs/ffs/ffs_snapshot.c (revision 244771) +++ sys/ufs/ffs/ffs_snapshot.c (working copy) @@ -687,8 +687,7 @@ out1: /* * Resume operation on filesystem. */ - vfs_write_resume(vp->v_mount); - vn_start_write(NULL, &wrtmp, V_WAIT); + vfs_write_resume_flags(vp->v_mount, VR_START_WRITE); if (collectsnapstats && starttime.tv_sec > 0) { nanotime(&endtime); timespecsub(&endtime, &starttime); Index: sys/kern/vfs_vnops.c =================================================================== --- sys/kern/vfs_vnops.c (revision 244771) +++ sys/kern/vfs_vnops.c (working copy) @@ -1434,6 +1434,40 @@ vn_closefile(fp, td) * proceed. If a suspend request is in progress, we wait until the * suspension is over, and then proceed. */ +static int +vn_start_write_locked(struct mount *mp, int flags) +{ + int error; + + mtx_assert(MNT_MTX(mp), MA_OWNED); + error = 0; + + /* + * Check on status of suspension. + */ + if ((curthread->td_pflags & TDP_IGNSUSP) == 0 || + mp->mnt_susp_owner != curthread) { + while ((mp->mnt_kern_flag & MNTK_SUSPEND) != 0) { + if (flags & V_NOWAIT) { + error = EWOULDBLOCK; + goto unlock; + } + error = msleep(&mp->mnt_flag, MNT_MTX(mp), + (PUSER - 1) | (flags & PCATCH), "suspfs", 0); + if (error) + goto unlock; + } + } + if (flags & V_XSLEEP) + goto unlock; + mp->mnt_writeopcount++; +unlock: + if (error != 0 || (flags & V_XSLEEP) != 0) + MNT_REL(mp); + MNT_IUNLOCK(mp); + return (error); +} + int vn_start_write(vp, mpp, flags) struct vnode *vp; @@ -1470,30 +1504,7 @@ vn_start_write(vp, mpp, flags) if (vp == NULL) MNT_REF(mp); - /* - * Check on status of suspension. - */ - if ((curthread->td_pflags & TDP_IGNSUSP) == 0 || - mp->mnt_susp_owner != curthread) { - while ((mp->mnt_kern_flag & MNTK_SUSPEND) != 0) { - if (flags & V_NOWAIT) { - error = EWOULDBLOCK; - goto unlock; - } - error = msleep(&mp->mnt_flag, MNT_MTX(mp), - (PUSER - 1) | (flags & PCATCH), "suspfs", 0); - if (error) - goto unlock; - } - } - if (flags & V_XSLEEP) - goto unlock; - mp->mnt_writeopcount++; -unlock: - if (error != 0 || (flags & V_XSLEEP) != 0) - MNT_REL(mp); - MNT_IUNLOCK(mp); - return (error); + return (vn_start_write_locked(mp, flags)); } /* @@ -1639,8 +1650,7 @@ vfs_write_suspend(mp) * Request a filesystem to resume write operations. */ void -vfs_write_resume(mp) - struct mount *mp; +vfs_write_resume_flags(struct mount *mp, int flags) { MNT_ILOCK(mp); @@ -1652,12 +1662,27 @@ void wakeup(&mp->mnt_writeopcount); wakeup(&mp->mnt_flag); curthread->td_pflags &= ~TDP_IGNSUSP; + if ((flags & VR_START_WRITE) != 0) { + MNT_REF(mp); + mp->mnt_writeopcount++; + } MNT_IUNLOCK(mp); VFS_SUSP_CLEAN(mp); - } else + } else if ((flags & VR_START_WRITE) != 0) { + MNT_REF(mp); + vn_start_write_locked(mp, 0); + } else { MNT_IUNLOCK(mp); + } } +void +vfs_write_resume(struct mount *mp) +{ + + vfs_write_resume_flags(mp, 0); +} + /* * Implement kqueues for files by translating it to vnode operation. */