GENERIC HEAD from 2012-06-24 01:32:42 UTC, r237518, vmcore.404 KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #0 r237518: Sun Jun 24 08:12:56 CEST 2012 pho@x4.osted.lan:/var/tmp/vmcontention/sys/i386/compile/PHO_KTR i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) lock order reversal: 1st 0xc1320560 vm object (kernel object) @ vm/vm_fault.c:299 2nd 0xc1bb50e8 system map (system map) @ vm/vm_map.c:1457 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,34313a63,a3735,c0000a39,c1196d00,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3e4,c12ec598,5b1,c18207a8,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3e4,c1bb50e8,c1020072,c957f110,c10206e8,...) at _witness_debugger+0x25 witness_checkorder(c1bb50e8,9,c10206df,5b1,0,...) at witness_checkorder+0x86f _mtx_lock_flags(c1bb50e8,0,c10206df,5b1,c596e000,...) at _mtx_lock_flags+0xd9 _vm_map_lock(c1bb508c,c10206df,5b1,a,0,...) at _vm_map_lock+0x31 vm_map_find(c1bb508c,0,0,0,c182085c,...) at vm_map_find+0x31 kmem_alloc_nofault(c1bb508c,1000,c0fe26c7,eb,100,...) at kmem_alloc_nofault+0x67 vm_radix_node_zone_allocf(c1bb69a0,1000,c18208c3,101,c1bb69a0,...) at vm_radix_node_zone_allocf+0x58 keg_alloc_slab(c1bb7608,4,c101f6ac,86e,c1820910,...) at keg_alloc_slab+0xf9 keg_fetch_slab(101,11,c596ff44,c1820970,c0d0d08f,...) at keg_fetch_slab+0x17f zone_fetch_slab(c1bb69a0,c1bb7600,101,824,c1bb1ba0,...) at zone_fetch_slab+0x4c uma_zalloc_arg(c1bb69a0,0,101,0,5,...) at uma_zalloc_arg+0x59f vm_radix_insert(c1320590,234b0,0,c21fcb80,0,...) at vm_radix_insert+0x1e9 vm_page_insert(c21fcb80,c1320560,234b0,0,0,...) at vm_page_insert+0x1c5 vm_page_alloc(c1320560,234b0,0,800,c1820bcc,...) at vm_page_alloc+0x51c vm_fault_hold(c1bb5000,e339f000,0,1,0,...) at vm_fault_hold+0xdd1 vm_fault(c1bb5000,e339f000,0,1,c1bb3a20,...) at vm_fault+0x8b vm_fault_wire(c1bb5000,e3000000,e33c9000,0,0,...) at vm_fault_wire+0x3f vm_map_wire(c1bb5000,e3000000,e33c9000,0,e3000000,...) at vm_map_wire+0x2bc kmem_alloc(c1bb5000,3c9000,c9559770,0,0,...) at kmem_alloc+0x10d vm_ksubmap_init(c1331f4c,0,1,1000,0,...) at vm_ksubmap_init+0x64 cpu_startup(0,181ec00,181ec00,181e000,1825000,...) at cpu_startup+0x24f mi_startup() at mi_startup+0xac begin() at begin+0x2c avail memory = 3538608128 (3374 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 596011 free (1363 frags, 74331 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 115636 free (5412 frags, 13778 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 80761500 free (1492 frags, 10095001 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 1926676 free (211572 frags, 214388 blocks, 2.1% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 13534898 free (86914 frags, 1680998 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 lock order reversal: 1st 0xe3122e20 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xcc3fe200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,2e687361,38323a63,c1000a34,cbeed694,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3e4,c12eaca0,11c,f3ff6844,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3e4,cc3fe200,c101dfba,c9587ac8,c101dc4c,...) at _witness_debugger+0x25 witness_checkorder(cc3fe200,9,c101dc43,11c,0,...) at witness_checkorder+0x86f _sx_xlock(cc3fe200,0,c101dc43,11c,cc40be0c,...) at _sx_xlock+0x9a ufsdirhash_acquire(e3122dc0,cc40be0c,30,e3ca81e4,f3ff6914,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(cc40be0c,f3ff69c0,1e4,f3ff6900,f3ff6904,...) at ufsdirhash_add+0x13 ufs_direnter(cc1649d8,cc61d708,f3ff69c0,f3ff6b5c,e31232a0,...) at ufs_direnter+0x799 ufs_mkdir(f3ff6bec,c103ff67,c115d1a0,cc1649d8,f3ff6c00,...) at ufs_mkdir+0xa6f VOP_MKDIR_APV(c114ade0,f3ff6bec,f3ff6b5c,f3ff6b84,0,...) at VOP_MKDIR_APV+0x100 kern_mkdirat(cbeed5e0,ffffff9c,28803020,0,1c0,...) at kern_mkdirat+0x291 kern_mkdir(cbeed5e0,28803020,0,1c0,f3ff6cfc,...) at kern_mkdir+0x2e sys_mkdir(cbeed5e0,f3ff6ccc,c103885c,c0fed0ef,c1039e70,...) at sys_mkdir+0x29 syscall(f3ff6d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (136, FreeBSD ELF32, sys_mkdir), eip = 0x28169743, esp = 0xbfbfd8fc, ebp = 0xbfbfdda8 --- Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcc72d1c0 ufs (ufs) @ kern/vfs_lookup.c:542 2nd 0xe3128e00 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcc7435f8 ufs (ufs) @ kern/vfs_subr.c:2158 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,3a632e73,a303632,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3fd,c12ea8b8,86e,f3fe2328,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3fd,cc7435f8,c0fd4613,c9587a60,c0ff44da,...) at _witness_debugger+0x25 witness_checkorder(cc7435f8,9,c0ff44d1,86e,0,...) at witness_checkorder+0x86f __lockmgr_args(cc7435f8,80100,cc743664,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f3fe2430,c0adfd3c,c0ff188b,5e2,c111b508,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c114ade0,f3fe2430,cc172694,c115cf20,cc7435a0,...) at VOP_LOCK1_APV+0xf3 _vn_lock(cc7435a0,80100,c0ff44d1,86e,eb,...) at _vn_lock+0x78 vget(cc7435a0,80100,cc1725e0,50,0,...) at vget+0xbb vfs_hash_get(cc080b70,15ef55,80000,cc1725e0,f3fe257c,...) at vfs_hash_get+0xed ffs_vgetf(cc080b70,15ef55,80000,f3fe257c,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cc72d168,e3128da0,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cc72d168,1,0,cc172694,c12ea8a8,...) at ffs_syncvnode+0x24c ffs_truncate(cc72d168,200,0,880,cc0ad600,...) at ffs_truncate+0x8b5 ufs_direnter(cc72d168,cc7435a0,f3fe28f0,f3fe2b98,0,...) at ufs_direnter+0x980 ufs_makeinode(f3fe2b98,c114b3a0,f3fe2ae8,f3fe2a44,c0e38320,...) at ufs_makeinode+0x65d ufs_create(f3fe2ae8,c104012e,c115d1a0,cc72d168,f3fe2afc,...) at ufs_create+0x30 VOP_CREATE_APV(c114ade0,f3fe2ae8,f3fe2b98,f3fe2a80,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f3fe2b58,f3fe2c20,1b0,0,cc0ad600,...) at vn_open_cred+0x20a vn_open(f3fe2b58,f3fe2c20,1b0,cc0d8620,400,...) at vn_open+0x3b kern_openat(cc1725e0,ffffff9c,28c72f60,0,a03,...) at kern_openat+0x1ec kern_open(cc1725e0,28c72f60,0,a02,1b0,...) at kern_open+0x35 sys_open(cc1725e0,f3fe2ccc,c103885c,c0fed0ef,c1039e70,...) at sys_open+0x30 syscall(f3fe2d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x283dfed3, esp = 0xbfbfb52c, ebp = 0xbfbfb5b8 --- . Updating motd:. Starting ntpd. Starting default moused. Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xcc164e68 ufs (ufs) @ kern/vfs_mount.c:1254 2nd 0xcc156490 devfs (devfs) @ ufs/ffs/ffs_softdep.c:1834 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,38313a63,a3433,cc61d5f8,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3e4,c12ea430,72a,f407c988,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3e4,cc156490,c0fdf594,c95878c0,c101a0b5,...) at _witness_debugger+0x25 witness_checkorder(cc156490,9,c101a0ac,72a,cc1564fc,...) at witness_checkorder+0x86f __lockmgr_args(cc156490,80400,cc1564fc,0,0,...) at __lockmgr_args+0x8c5 vop_stdlock(f407ca8c,c131fde0,4,c0fe26c7,eb,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c110a8c0,f407ca8c,c131fde0,c115cf20,cc156438,...) at VOP_LOCK1_APV+0xf3 _vn_lock(cc156438,80400,c101a0ac,72a,0,...) at _vn_lock+0x78 softdep_flushworklist(cc40f2dc,f407cb44,cbeec000,612,cc164a9c,...) at softdep_flushworklist+0x47 ffs_sync(cc40f2dc,1,f407cb98,51f,c1bae7f0,...) at ffs_sync+0x3bf dounmount(cc40f2dc,8080000,cbeec000,4a1,f407cc1c,...) at dounmount+0x3f8 sys_unmount(cbeec000,f407cccc,c103885c,c0fed0b2,c1039e70,...) at sys_unmount+0x421 syscall(f407cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280c44bb, esp = 0xbfbfd67c, ebp = 0xbfbfd748 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes Jun 24 08:38:18 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79477 files, 37552481 used, 80761500 free (1492 frags, 10095001 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 79477 files, 37552481 used, 80761500 free (1492 frags, 10095001 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. lock order reversal: 1st 0xe310c080 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xcc09321c snaplk (snaplk) @ ufs/ffs/ffs_snapshot.c:2297 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,632e746f,3932323a,a37,cad2e300,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3e4,c12eacd8,8f9,f4073970,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3e4,cc09321c,c1019b74,c9588148,c1019afe,...) at _witness_debugger+0x25 witness_checkorder(cc09321c,9,c1019af5,8f9,0,...) at witness_checkorder+0x86f __lockmgr_args(cc09321c,80900,cc153ed4,0,0,...) at __lockmgr_args+0x8c5 ffs_copyonwrite(cc153e10,e310c020,e310c020,0,0,...) at ffs_copyonwrite+0x2c2 ffs_geom_strategy(cc153f08,e310c020,cc616658,e310c020,170f788,...) at ffs_geom_strategy+0xeb bufwrite(e310c020,0,c101cf90,811,0) at bufwrite+0x159 ffs_bufwrite(e310c020,cc61b500,100,4000,0,...) at ffs_bufwrite+0x290 ffs_update(cc619168,1,c101d711,151,0,...) at ffs_update+0x3a5 ffs_syncvnode(cc619168,1,0,c114ade0,cc619260,...) at ffs_syncvnode+0x591 ffs_fsync(f4073c20,c103f5e4,eb,0,df7,...) at ffs_fsync+0x2f VOP_FSYNC_APV(c114ade0,f4073c20,c0ff5ba7,dfc,0,...) at VOP_FSYNC_APV+0x100 sys_fsync(cbeec5e0,f4073ccc,c103885c,c0fee0ef,e,...) at sys_fsync+0x1df syscall(f4073d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (95, FreeBSD ELF32, sys_fsync), eip = 0x28190347, esp = 0xbfbfd2cc, ebp = 0xbfbfde18 --- Starting inetd. Sun Jun 24 08:41:41 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: lock order reversal: 1st 0xcc09321c snaplk (snaplk) @ ufs/ufs/ufs_vnops.c:968 2nd 0xcca51328 ufs (ufs) @ ufs/ffs/ffs_snapshot.c:1627 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,a373236,f4000a00,c0ab8855,c11aff00,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0acd5fb,c0fec3e4,c12eaf30,65b,f41ae6f8,...) at kdb_backtrace+0x2a _witness_debugger(c0fec3e4,cca51328,c0fd4613,c9587a60,c1019afe,...) at _witness_debugger+0x25 witness_checkorder(cca51328,9,c1019af5,65b,0,...) at witness_checkorder+0x86f __lockmgr_args(cca51328,80000,0,0,0,...) at __lockmgr_args+0x8c5 ffs_snapremove(cca512d0,c1019a33,0,462c1,ccb73bc0,...) at ffs_snapremove+0x11f ffs_truncate(cca512d0,0,0,c00,0,...) at ffs_truncate+0x647 ufs_inactive(f41aeab4,c103fafd,eb,c114ade0,f41aea88,...) at ufs_inactive+0x1f6 VOP_INACTIVE_APV(c114ade0,f41aeab4,c0ff44d1,9bf,f41aeae8,...) at VOP_INACTIVE_APV+0x100 vinactive(cca512d0,ccb73bc0,c0ff44d1,8bd,0,...) at vinactive+0x127 vputx(f41aec14,c0b3a093,cca512d0,ffffffdf,cca512d0,...) at vputx+0x370 vput(cca512d0,ffffffdf,cca512d0,f41aeb6c,1c378,...) at vput+0x10 kern_unlinkat(ccb73bc0,ffffff9c,bfbfdc52,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(ccb73bc0,bfbfdc52,0,f41aecfc,c0e0f9de,...) at kern_unlink+0x2f sys_unlink(ccb73bc0,f41aeccc,c103885c,c0fed103,c0abbf47,...) at sys_unlink+0x22 syscall(f41aed08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x28168b2f, esp = 0xbfbfd9cc, ebp = 0xbfbfda48 --- interrupt total irq1: atkbd0 2 irq4: uart0 545 irq6: fdc0 1 irq9: acpi0 1 irq14: ata0 42 irq16: hdac1 ohci0 74 irq17: ohci1 ohci3 3 irq18: ohci2 ohci4 3 irq20: fwohci0 1 irq22: ahci0 2137977 cpu0:timer 6134370 irq256: hdac0 5 irq257: re0 11259 cpu2:timer 5776326 cpu1:timer 5775835 cpu3:timer 5774317 Total 25610792 KDB: stack backtrace: db_trace_self_wrapper(c0fe8917,0,0,0,0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0fdc2ce,186ca28,0,186ca28,0,...) at kdb_backtrace+0x2a watchdog_fire(1,0,c0fdc19b,220,c95e72cc,...) at watchdog_fire+0xa9 hardclock_cnt(1,0,bd8aac,c105a6c0,3cd77f5d,...) at hardclock_cnt+0x2c1 handleevents(efbd8af8,8,c0fe5dd2,c12eb360,246,1,1777,3cd77f5d,443ab689,8276500) at handleevents+0x17d timercb(c13811a0,0,1,c1baf888,c1baf888,...) at timercb+0x292 lapic_handle_timer(efbd8b3c) at lapic_handle_timer+0x7f Xtimerint() at Xtimerint+0x20 --- interrupt, eip = 0xc0a7f22a, esp = 0xefbd8b7c, ebp = 0xefbd8ba0 --- _mtx_lock_flags(c1baf888,0,c101f6ac,2fd,0,...) at _mtx_lock_flags+0xea zone_drain_wait(efbd8bf0,c0d08605,c1baea80,0,c101f6ac,...) at zone_drain_wait+0x2f zone_drain(c1baea80,0,c101f6ac,639,0,...) at zone_drain+0x10 zone_foreach(c95a2d40,0,efbd8cc8,c0d26bec,c95a2d4c,...) at zone_foreach+0x45 uma_reclaim(c95a2d4c,0,c10225e7,2ee,1388,...) at uma_reclaim+0x16 vm_pageout(0,efbd8d08,c0fde6d0,3db,c95e72cc,...) at vm_pageout+0x80c fork_exit(c0d263e0,0,efbd8d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbd8d40, ebp = 0 --- KDB: enter: watchdog timeout [ thread pid 7 tid 100072 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho db:0:pho> bt Tracing pid 7 tid 100072 td 0xcae345e0 kdb_enter(c0e761e7,c0f68bbc,0,186ca28,0) at kdb_enter+0x3a watchdog_fire(1,0,c0fdc19b,220,c95e72cc,...) at watchdog_fire+0xbd hardclock_cnt(1,0,bd8aac,c105a6c0,3cd77f5d,...) at hardclock_cnt+0x2c1 handleevents(efbd8af8,8,c0fe5dd2,c12eb360,246,1,1777,3cd77f5d,443ab689,8276500) at handleevents+0x17d timercb(c13811a0,0,1,c1baf888,c1baf888,...) at timercb+0x292 lapic_handle_timer(efbd8b3c) at lapic_handle_timer+0x7f Xtimerint() at Xtimerint+0x20 --- interrupt, eip = 0xc0a7f22a, esp = 0xefbd8b7c, ebp = 0xefbd8ba0 --- _mtx_lock_flags(c1baf888,0,c101f6ac,2fd,0,...) at _mtx_lock_flags+0xea zone_drain_wait(efbd8bf0,c0d08605,c1baea80,0,c101f6ac,...) at zone_drain_wait+0x2f zone_drain(c1baea80,0,c101f6ac,639,0,...) at zone_drain+0x10 zone_foreach(c95a2d40,0,efbd8cc8,c0d26bec,c95a2d4c,...) at zone_foreach+0x45 uma_reclaim(c95a2d4c,0,c10225e7,2ee,1388,...) at uma_reclaim+0x16 vm_pageout(0,efbd8d08,c0fde6d0,3db,c95e72cc,...) at vm_pageout+0x80c fork_exit(c0d263e0,0,efbd8d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbd8d40, ebp = 0 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x6c1500 curthread = 0xc962f000: pid 12 "swi4: clock" curpcb = 0xc93fdd60 fpcurthread = none idlethread = 0xc95e88d0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x8276500 curthread = 0xcae345e0: pid 7 "pagedaemon" curpcb = 0xefbd8d60 fpcurthread = none idlethread = 0xc95e85e0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x8279500 curthread = 0xcc107bc0: pid 4461 "dd" curpcb = 0xf40fcd60 fpcurthread = none idlethread = 0xc95e82f0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: exclusive spin mutex sleepq chain (sleepq chain) r = 0 (0xc11bcc3c) locked @ kern/subr_sleepqueue.c:242 cpuid = 3 dynamic pcpu = 0x827c500 curthread = 0xcbeec5e0: pid 961 "syslogd" curpcb = 0xf4073d60 fpcurthread = none idlethread = 0xc95e8000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: exclusive spin mutex smp rendezvous (smp rendezvous) r = 0 (0xc11bd634) locked @ i386/i386/mp_machdep.c:1227 db:0:allpcpu> show alllocks Process 4510 (cron) thread 0xccf9d2f0 (100231) exclusive sleep mutex vm object (standard object) r = 0 (0xcf4ba6f0) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xccfd8b28) locked @ vm/vm_map.c:3726 Process 4509 (sh) thread 0xcd8b02f0 (100243) exclusive sleep mutex vm object (standard object) r = 0 (0xccd51d4c) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xcc127870) locked @ vm/vm_map.c:3726 Process 4508 (sh) thread 0xccfa02f0 (100212) exclusive sleep mutex vm object (standard object) r = 0 (0xcd279128) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xc95ebcf8) locked @ vm/vm_map.c:3726 Process 4461 (dd) thread 0xcc107bc0 (100134) exclusive sleep mutex vm object (standard object) r = 0 (0xcd279cb8) locked @ vm/vm_page.c:2339 exclusive lockmgr bufwait (bufwait) r = 0 (0xe3158680) locked @ kern/vfs_bio.c:1905 exclusive lockmgr bufwait (bufwait) r = 0 (0xe33158e0) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcc619a30) locked @ kern/vfs_vnops.c:727 Process 1231 (sshd) thread 0xcbeed000 (100111) exclusive sx so_snd_sx (so_snd_sx) r = 0 (0xcc4662c0) locked @ kern/uipc_sockbuf.c:148 Process 1159 (cron) thread 0xcc45b8d0 (100121) exclusive sleep mutex vm object (standard object) r = 0 (0xccd9b6f0) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xcc127788) locked @ vm/vm_map.c:3726 Process 1151 (sendmail) thread 0xcbeed5e0 (100091) exclusive sleep mutex vm object (standard object) r = 0 (0xcc7dfcb8) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xc95ebde0) locked @ vm/vm_map.c:3726 Process 1148 (sshd) thread 0xcae378d0 (100118) exclusive sleep mutex vm object (standard object) r = 0 (0xcc51b940) locked @ vm/vm_fault.c:299 shared sx user map (user map) r = 0 (0xcc550130) locked @ vm/vm_map.c:3726 Process 1091 (ntpd) thread 0xcc0b85e0 (100098) exclusive lockmgr bufwait (bufwait) r = 0 (0xe3239920) locked @ kern/vfs_bio.c:1905 exclusive lockmgr ufs (ufs) r = 0 (0xccc12328) locked @ kern/vfs_vnops.c:727 Process 961 (syslogd) thread 0xcbeec5e0 (100114) exclusive lockmgr bufwait (bufwait) r = 0 (0xe320a3e0) locked @ kern/vfs_bio.c:1905 exclusive lockmgr snaplk (snaplk) r = 0 (0xcc09321c) locked @ ufs/ffs/ffs_snapshot.c:2297 exclusive lockmgr ufs (ufs) r = 0 (0xcc6191c0) locked @ kern/vfs_syscalls.c:3575 Process 19 (softdepflush) thread 0xcbeed8d0 (100078) exclusive sleep mutex page lock (page lock) r = 0 (0xc1321180) locked @ vm/vm_page.c:1322 exclusive sleep mutex vm object (standard object) r = 0 (0xcc15440c) locked @ vm/vm_page.c:2339 exclusive lockmgr bufwait (bufwait) r = 0 (0xe316d200) locked @ kern/vfs_bio.c:1905 exclusive lockmgr bufwait (bufwait) r = 0 (0xe32f4da0) locked @ kern/vfs_bio.c:1905 Process 7 (pagedaemon) thread 0xcae345e0 (100072) exclusive sleep mutex UMA lock (UMA lock) r = 0 (0xc13201cc) locked @ vm/uma_core.c:1593 Process 12 (intr) thread 0xc962f000 (100009) exclusive sleep mutex Giant (Giant) r = 0 (0xc119fc10) locked @ kern/kern_mutex.c:154 db:0:alllocks> show lockedvnods Locked vnodes 0xcc619168: tag ufs, type VREG usecount 2, writecount 1, refcount 4 mountedhere 0 flags (VI(0x200)) v_object 0xcc4356f0 ref 0 pages 3 lock type ufs: EXCL by thread 0xcbeec5e0 (pid 961, syslogd, tid 100114) with shared waiters pending #0 0xc0a769ad at __lockmgr_args+0xd6d #1 0xc0cef6e1 at ffs_lock+0xa1 #2 0xc0e36ee3 at VOP_LOCK1_APV+0xf3 #3 0xc0b43a78 at _vn_lock+0x78 #4 0xc0b40cb6 at sys_fsync+0x116 #5 0xc0e0f9de at syscall+0x2fe #6 0xc0df9731 at Xint0x80_syscall+0x21 ino 6052878, on dev ada0s1e 0xccc0d168: tag ufs, type VREG usecount 1, writecount 0, refcount 51 mountedhere 0 flags (VV_SYSTEM|VI(0x200)) v_object 0xccb489d4 ref 0 pages 2012 lock type snaplk: EXCL by thread 0xcbeec5e0 (pid 961, syslogd, tid 100114) #0 0xc0a769ad at __lockmgr_args+0xd6d #1 0xc0ccbf42 at ffs_copyonwrite+0x2c2 #2 0xc0ce900b at ffs_geom_strategy+0xeb #3 0xc0cfdda3 at ufs_strategy+0xd3 #4 0xc0e36bb9 at VOP_STRATEGY_APV+0x119 #5 0xc0b147b1 at bufstrategy+0x61 #6 0xc0b18249 at bufwrite+0x159 #7 0xc0b185b8 at vfs_bio_awrite+0x328 #8 0xc0cefb45 at ffs_syncvnode+0x3a5 #9 0xc0cefd9f at ffs_fsync+0x2f #10 0xc0e33620 at VOP_FSYNC_APV+0x100 #11 0xc0b40d7f at sys_fsync+0x1df #12 0xc0e0f9de at syscall+0x2fe #13 0xc0df9731 at Xint0x80_syscall+0x21 ino 7, on dev ada0s1e 0xcc6199d8: tag ufs, type VREG usecount 1, writecount 1, refcount 7078 mountedhere 0 flags (VI(0x200)) v_object 0xcd279cb8 ref 0 pages 492392 lock type ufs: EXCL by thread 0xcc107bc0 (pid 4461, dd, tid 100134) #0 0xc0a769ad at __lockmgr_args+0xd6d #1 0xc0cef6e1 at ffs_lock+0xa1 #2 0xc0e36ee3 at VOP_LOCK1_APV+0xf3 #3 0xc0b43a78 at _vn_lock+0x78 #4 0xc0b457e4 at vn_write+0x184 #5 0xc0b426df at vn_io_fault+0x31f #6 0xc0ae1fa5 at dofilewrite+0x95 #7 0xc0ae2618 at kern_writev+0x68 #8 0xc0ae272f at sys_write+0x4f #9 0xc0e0f9de at syscall+0x2fe #10 0xc0df9731 at Xint0x80_syscall+0x21 ino 6194265, on dev ada0s1e 0xccc122d0: tag ufs, type VREG usecount 1, writecount 1, refcount 2 mountedhere 0 flags (VI(0x200)) v_object 0xcd25665c ref 0 pages 0 lock type ufs: EXCL by thread 0xcc0b85e0 (pid 1091, ntpd, tid 100098) #0 0xc0a769ad at __lockmgr_args+0xd6d #1 0xc0cef6e1 at ffs_lock+0xa1 #2 0xc0e36ee3 at VOP_LOCK1_APV+0xf3 #3 0xc0b43a78 at _vn_lock+0x78 #4 0xc0b457e4 at vn_write+0x184 #5 0xc0b426df at vn_io_fault+0x31f #6 0xc0ae1fa5 at dofilewrite+0x95 #7 0xc0ae2618 at kern_writev+0x68 #8 0xc0ae272f at sys_write+0x4f #9 0xc0e0f9de at syscall+0x2fe #10 0xc0df9731 at Xint0x80_syscall+0x21 ino 1742893, on dev ada0s1e db:0:lockedvnods> show mount 0xcc07fb70 /dev/ad4s1a on / (ufs) 0xcc080000 devfs on /dev (devfs) 0xcc40f5b8 /dev/ad4s1f on /home (ufs) 0xcc40f000 /dev/ad4s1d on /usr (ufs) 0xcc080b70 /dev/ad4s1e on /var (ufs) 0xcc080894 procfs on /proc (procfs) 0xccb7e000 /dev/label/tmp on /tmp (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 4513 1148 1148 0 RL sshd 4512 1154 1154 25 RL sendmail 4511 1151 1151 0 RL sendmail 4510 1159 1159 0 LL *page loc 0xccf9e700 cron 4509 1234 1232 1001 RL sh 4508 1753 1753 0 LL *page loc 0xccf9e700 sh 4462 1807 1807 0 S+ piperd 0xcd7bac80 egrep 4461 1807 1807 0 R+ CPU 2 dd 1807 1208 1807 0 S+ wait 0xccb52000 sh 1806 1 1806 0 Ss+ ttyin 0xc9704670 getty 1805 1 1805 0 Ss+ ttyin 0xc9704870 getty 1804 1 1804 0 Ss+ ttyin 0xc9704a70 getty 1803 1 1803 0 Ss+ ttyin 0xc9704c70 getty 1802 1 1802 0 Ss+ ttyin 0xc9704e70 getty 1801 1 1801 0 Ss+ ttyin 0xcae3f070 getty 1800 1 1800 0 Ss+ ttyin 0xcae3f270 getty 1799 1 1799 0 Ss+ ttyin 0xcae3f470 getty 1798 1 1798 0 Ss+ ttyin 0xc9703670 getty 1778 1 1778 0 Ss select 0xcc195aa4 inetd 1753 1 1753 0 Ss wait 0xcc9b1598 watchdogd 1235 1232 1232 1001 S piperd 0xccacb4b0 awk 1234 1232 1232 1001 RL sh 1233 1231 1233 1001 Ss+ ttyout 0xcc069878 top 1232 1230 1232 1001 Ss wait 0xcca312cc sh 1231 1223 1223 1001 R sshd 1230 1224 1224 1001 S select 0xcbf1d724 sshd 1229 1228 1229 1001 Ds ufs 0xcc6191c0 tail 1228 1222 1222 1001 S select 0xcbf1d764 sshd 1224 1148 1224 0 Ss select 0xcbf1dca4 sshd 1223 1148 1223 0 Ss select 0xcbf1d9e4 sshd 1222 1148 1222 0 Ss select 0xcbf1d924 sshd 1208 1205 1208 0 S+ wait 0xcc438864 bash 1205 1204 1205 0 S+ pause 0xcca318bc csh 1204 1199 1204 1001 S+ wait 0xcc4382cc su 1199 1198 1199 1001 Ss+ wait 0xcca34000 bash 1198 1196 1196 1001 S select 0xcbf50ca4 sshd 1196 1148 1196 0 Ss select 0xcca413e4 sshd 1159 1 1159 0 RLs cron 1154 1 1154 25 RLs sendmail 1151 1 1151 0 RLs sendmail 1148 1 1148 0 LLs *page loc 0xccf9e700 sshd 1116 1 1116 0 Ss select 0xcbf50224 moused 1091 1 1091 0 Rs ntpd 1033 1031 1031 0 S (threaded) nfsd 100125 S rpcsvc 0xcbebdbd0 nfsd: service 100124 S rpcsvc 0xcbebdc10 nfsd: service 100123 S rpcsvc 0xcbebdb90 nfsd: service 100106 S rpcsvc 0xcbf4bd50 nfsd: master 1031 1 1031 0 Ss select 0xcbed6124 nfsd 1029 1025 1025 0 S select 0xcbf1e024 nfsuserd 1028 1025 1025 0 S select 0xcbed6164 nfsuserd 1027 1025 1025 0 S select 0xcbf1e064 nfsuserd 1026 1025 1025 0 S select 0xcbed61a4 nfsuserd 1025 1 1025 0 Ss pause 0xcbeea8bc nfsuserd 1009 1 1009 0 Ss select 0xcbed61e4 mountd 976 1 976 0 Ss select 0xcc1958e4 rpcbind 961 1 961 0 Rs CPU 3 syslogd 838 1 838 0 Ss select 0xcc195a64 devd 19 0 0 0 RL [softdepflush] 18 0 0 0 DL syncer 0xc1318114 [syncer] 17 0 0 0 DL vlruwt 0xcbee9598 [vnlru] 16 0 0 0 DL psleep 0xc1317da8 [bufdaemon] 9 0 0 0 DL pgzero 0xc1321de8 [pagezero] 8 0 0 0 DL psleep 0xc1321948 [vmdaemon] 7 0 0 0 RL CPU 1 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc1164854 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc131b638 [sctp_iterator] 4 0 0 0 DL - 0xcac9723c [fdc0] 3 0 0 0 SL - 0xcad32000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xcacfdd34 [usbus5] 100058 D - 0xcacfdd04 [usbus5] 100057 D - 0xcacfdcd4 [usbus5] 100056 D - 0xcacfdca4 [usbus5] 100054 D - 0xcacf1b5c [usbus4] 100053 D - 0xcacf1b2c [usbus4] 100052 D - 0xcacf1afc [usbus4] 100051 D - 0xcacf1acc [usbus4] 100050 D - 0xcacebb5c [usbus3] 100049 D - 0xcacebb2c [usbus3] 100048 D - 0xcacebafc [usbus3] 100047 D - 0xcacebacc [usbus3] 100046 D - 0xcace7b5c [usbus2] 100045 D - 0xcace7b2c [usbus2] 100044 D - 0xcace7afc [usbus2] 100043 D - 0xcace7acc [usbus2] 100041 D - 0xcacdeb5c [usbus1] 100040 D - 0xcacdeb2c [usbus1] 100039 D - 0xcacdeafc [usbus1] 100038 D - 0xcacdeacc [usbus1] 100036 D - 0xcacd7b5c [usbus0] 100035 D - 0xcacd7b2c [usbus0] 100034 D - 0xcacd7afc [usbus0] 100033 D - 0xcacd7acc [usbus0] 2 0 0 0 DL ctl_work 0xc97da000 [ctl_thrd] 14 0 0 0 DL - 0xc11a0d04 [yarrow] 13 0 0 0 DL (threaded) [geom] 100015 D - 0xc119dda8 [g_down] 100014 D - 0xc119dda4 [g_up] 100013 D - 0xc119dd9c [g_event] 12 0 0 0 RL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100025 I [swi5: +] 100023 I [swi2: cambio] 100019 I [swi6: task queue] 100018 I [swi6: Giant taskq] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 Run CPU 0 [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xc95e6b30 [init] 10 0 0 0 DL audit_wo 0xc131f560 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xc11a0d04 [deadlkres] 100068 D - 0xcad2e000 [mca taskq] 100062 D - 0xcad2ee40 [fw0_taskq] 100027 D - 0xc9718300 [thread taskq] 100026 D - 0xc9718340 [ffs_trim taskq] 100024 D - 0xc97183c0 [kqueue taskq] 100022 D - 0xc9718540 [acpi_task_2] 100021 D - 0xc9718540 [acpi_task_1] 100020 D - 0xc9718540 [acpi_task_0] 100016 D - 0xc95b40c0 [firmware taskq] 100000 D sched 0xc119df60 [swapper] db:0:ps> allt Tracing command sshd pid 4513 tid 100149 td 0xcca558d0 sched_switch(cca558d0,0,104,1b3,f4129904,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,cc103a80,...) at mi_switch+0x243 sleepq_switch(cca558d0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13204dc,78,c1021e2d,0,0,...) at sleepq_wait+0x6b _sleep(c13204dc,c1320780,278,c1021e2d,0,...) at _sleep+0x39c vm_waitpfault(ccd9bde0,1d,0,0,f4129b44,...) at vm_waitpfault+0x75 vm_fault_hold(c95eb740,bfbfc000,2,0,0,...) at vm_fault_hold+0x61e vm_fault(c95eb740,bfbfc000,2,0,bfbfcf1c,...) at vm_fault+0x8b trap_pfault(c0e0eeef,0,cca558d0,cc9b1b30,cc9b1b30,...) at trap_pfault+0x1b9 trap(f4129d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8054974, esp = 0xbfbfcf20, ebp = 0xbfbfde28 --- Tracing command sendmail pid 4512 tid 100237 td 0xcd8b15e0 sched_switch(cd8b15e0,0,602,1ae,0,...) at sched_switch+0x453 mi_switch(602,0,c0fe4e9f,cd,cd8b15e0,...) at mi_switch+0x243 critical_exit(c13811a0,0,0,cd8b15e0,c1320780,...) at critical_exit+0xb8 lapic_handle_timer(f42958cc) at lapic_handle_timer+0x95 Xtimerint() at Xtimerint+0x20 --- interrupt, eip = 0xc0e0222b, esp = 0xf429590c, ebp = 0xf4295910 --- spinlock_exit(c11aeb80,4,c0fe26c7,119,cd8b15e0,c1320780) at spinlock_exit+0x2b _mtx_unlock_spin_flags(c11aeb80,0,c0fea300,270) at _mtx_unlock_spin_flags+0x132 sleepq_wait(c13204dc,78,c1021e2d,0,0,...) at sleepq_wait+0x8d _sleep(c13204dc,c1320780,278,c1021e2d,0,...) at _sleep+0x39c vm_waitpfault(ccb46d4c,28,0,0,f4295b44,...) at vm_waitpfault+0x75 vm_fault_hold(ccb55000,811c000,2,0,0,...) at vm_fault_hold+0x61e vm_fault(ccb55000,811c000,2,0,811c810,...) at vm_fault+0x8b trap_pfault(c0e0eeef,0,cd8b15e0,cd1ad598,cd1ad598,...) at trap_pfault+0x1b9 trap(f4295d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x80a21ac, esp = 0xbfbfbf50, ebp = 0xbfbfbfb8 --- Tracing command sendmail pid 4511 tid 100079 td 0xcc0b9bc0 sched_switch(cc0b9bc0,0,104,1b3,f3fc6904,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,cc103a80,...) at mi_switch+0x243 sleepq_switch(cc0b9bc0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13204dc,78,c1021e2d,0,0,...) at sleepq_wait+0x6b _sleep(c13204dc,c1320780,278,c1021e2d,0,...) at _sleep+0x39c vm_waitpfault(ccac7818,28,0,0,f3fc6b44,...) at vm_waitpfault+0x75 vm_fault_hold(c95ea488,811c000,2,0,0,...) at vm_fault_hold+0x61e vm_fault(c95ea488,811c000,2,0,811c810,...) at vm_fault+0x8b trap_pfault(c11af8b0,cc0b85e0,c0fe68ec,1f4,cc0b2b30,...) at trap_pfault+0x1b9 trap(f3fc6d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x80a21ac, esp = 0xbfbfb400, ebp = 0xbfbfb468 --- Tracing command cron pid 4510 tid 100231 td 0xccf9d2f0 sched_switch(ccf9d2f0,0,103,1ae,c11af200,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1321180,...) at mi_switch+0x243 turnstile_wait(ccf9e700,cbeed8d0,0,1c5,0,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1321180,ccf9d2f0,0,c1021b67,52a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1321180,0,c1021b67,52a,0,...) at _mtx_lock_flags+0x10f vm_page_alloc(cf4ba6f0,1e,0,0,f4283b44,...) at vm_page_alloc+0x565 vm_fault_hold(ccfd8ae0,bfbfd000,2,0,0,...) at vm_fault_hold+0x60a vm_fault(ccfd8ae0,bfbfd000,2,0,bfbfdc50,...) at vm_fault+0x8b trap_pfault(c0e0eeef,0,ccf9d2f0,cd1ae864,cd1ae864,...) at trap_pfault+0x1b9 trap(f4283d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x804c147, esp = 0xbfbfdc50, ebp = 0xbfbfdc88 --- Tracing command sh pid 4509 tid 100243 td 0xcd8b02f0 sched_switch(cd8b02f0,0,103,1ae,c11aeb80,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1bb7608,...) at mi_switch+0x243 turnstile_wait(cc104680,cca558d0,0,1c5,c0a7ea2a,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1bb7608,cd8b02f0,0,c101f6ac,966,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1bb7608,0,c101f6ac,966,c0a9b653,...) at _mtx_lock_flags+0x10f uma_zalloc_arg(c1bb69a0,0,101,c102333e,0,...) at uma_zalloc_arg+0x4bf vm_radix_insert(ccd51d7c,1e,0,c38f8bc0,c1320780,...) at vm_radix_insert+0x8f vm_page_insert(c38f8bc0,ccd51d4c,1e,0,0,...) at vm_page_insert+0x1c5 vm_page_alloc(ccd51d4c,1e,0,0,f42a7b44,...) at vm_page_alloc+0x51c vm_fault_hold(cc127828,bfbfd000,2,0,0,...) at vm_fault_hold+0x60a vm_fault(cc127828,bfbfd000,2,0,bfbfda78,...) at vm_fault+0x8b trap_pfault(c0e0eeef,0,cd8b02f0,cd1ac2cc,cd1ac2cc,...) at trap_pfault+0x1b9 trap(f42a7d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8054c2f, esp = 0xbfbfda60, ebp = 0xbfbfda88 --- Tracing command sh pid 4508 tid 100212 td 0xccfa02f0 sched_switch(ccfa02f0,0,103,1ae,c11af200,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1321180,...) at mi_switch+0x243 turnstile_wait(ccf9e700,cbeed8d0,0,1c5,3,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1321180,ccfa02f0,0,c1021b67,52a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1321180,0,c1021b67,52a,0,...) at _mtx_lock_flags+0x10f vm_page_alloc(cd279128,340,0,40,f4246b44,...) at vm_page_alloc+0x565 vm_fault_hold(c95ebcb0,28551000,1,0,0,...) at vm_fault_hold+0x60a vm_fault(c95ebcb0,28551000,1,0,28551000,...) at vm_fault+0x8b trap_pfault(c119fc10,0,c10387b2,304,ccf3f000,...) at trap_pfault+0x1b9 trap(f4246d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x28168ae3, esp = 0xbfbfd760, ebp = 0xbfbfd7b8 --- Tracing command egrep pid 4462 tid 100224 td 0xccb5c000 sched_switch(ccb5c000,0,104,1b3,f426aa84,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb5c000,0,c0fea300,1ac,5c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cd7bac80,5c,c0fecc87,100,0,...) at sleepq_wait_sig+0x17 _sleep(cd7bac80,cd7badf8,15c,c0fecc87,0,...) at _sleep+0x385 pipe_read(cc0d8cb0,f426ac1c,c95c6200,0,ccb5c000,...) at pipe_read+0x427 dofileread(f426ac1c,ffffffff,ffffffff,0,f426abf8,...) at dofileread+0x9e kern_readv(ccb5c000,0,f426ac1c,f426ac3c,1,...) at kern_readv+0x68 sys_read(ccb5c000,f426accc,c103885c,c0fed17a,cacc5bc0,...) at sys_read+0x4f syscall(f426ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281c04d3, esp = 0xbfbfd84c, ebp = 0xbfbfd8d8 --- Tracing command dd pid 4461 tid 100134 td 0xcc107bc0 cpustop_handler(2,f40fc5a4,c0e0ff23,c0fec7de,f40fc528,...) at cpustop_handler+0x26 ipi_nmi_handler(c0fec7de,f40fc528,c0adfd3c,2,cca34598,...) at ipi_nmi_handler+0x35 trap(f40fc5b0) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0ad3745, esp = 0xf40fc5f0, ebp = 0xf40fc608 --- sleepq_lookup(c1321910,cd279cb8,f40fc630,c0ad40d9,c11bcc3c,...) at sleepq_lookup+0x75 sleepq_broadcast(c1321910,0,0,0,c38f8d00,...) at sleepq_broadcast+0x58 wakeup(c1321910,f40fc684,c0d242d8,c1321480,0,...) at wakeup+0x37 pagedaemon_wakeup(c1321480,0,c1021b67,52e,20,...) at pagedaemon_wakeup+0x36 vm_page_alloc(cd279cb8,78270,0,40222,40222,...) at vm_page_alloc+0x5b8 vm_page_grab(cd279cb8,78270,0,412a2,c12e9b70,...) at vm_page_grab+0x152 allocbuf(e3158620,4000,c0ff188b,b04,ffffffe0,...) at allocbuf+0x672 getblk(cc6199d8,1e09c,0,4000,0,...) at getblk+0x613 ffs_balloc_ufs2(cc6199d8,78270000,0,4000,c95c6200,...) at ffs_balloc_ufs2+0x1e6c ffs_write(f40fca8c,c1040063,cc6199d8,cc6199d8,f40fca34,...) at ffs_write+0x2bd VOP_WRITE_APV(c114ade0,f40fca8c,cc6199d8,2d7,cc619a9c,...) at VOP_WRITE_APV+0x174 vn_write(ccb74a10,f40fcc1c,c95c6200,1,cc107bc0,...) at vn_write+0x202 vn_io_fault(ccb74a10,f40fcc1c,c95c6200,0,cc107bc0,...) at vn_io_fault+0x31f dofilewrite(f40fcc1c,ffffffff,ffffffff,0,f40fcbf8,...) at dofilewrite+0x95 kern_writev(cc107bc0,4,f40fcc1c,f40fcc3c,1,...) at kern_writev+0x68 sys_write(cc107bc0,f40fcccc,c103885c,c0e4218b,c0abbf47,...) at sys_write+0x4f syscall(f40fcd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2817d4b3, esp = 0xbfbfd9ec, ebp = 0xbfbfda18 --- Tracing command sh pid 1807 tid 100162 td 0xcca53000 sched_switch(cca53000,0,104,1b3,f4150aac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca53000,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ccb52000,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(ccb52000,ccb52088,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cca53000,ffffffff,f4150c38,2,0,...) at kern_wait+0x597 sys_wait4(cca53000,f4150ccc,c103885c,c0fed217,c0abbf47,...) at sys_wait4+0x3b syscall(f4150d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28156d8b, esp = 0xbfbfd7bc, ebp = 0xbfbfd7d8 --- Tracing command getty pid 1806 tid 100161 td 0xcca532f0 sched_switch(cca532f0,0,104,1b3,f414d9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca532f0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,cca532f0,cca532f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9704670,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9704670,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9704600,c9704670,f414dc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9704600,f414dc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabe500,f414dc1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc137230,f414dc1c,c95c6e80,0,cca532f0,...) at devfs_read_f+0x7e dofileread(f414dc1c,ffffffff,ffffffff,0,f414dbf8,...) at dofileread+0x9e kern_readv(cca532f0,0,f414dc1c,f414dc3c,1,...) at kern_readv+0x68 sys_read(cca532f0,f414dccc,c103885c,c0e46f0a,c0abbf47,...) at sys_read+0x4f syscall(f414dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1805 tid 100148 td 0xcca55bc0 sched_switch(cca55bc0,0,104,1b3,f41269fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca55bc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,cca55bc0,cca55bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9704870,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9704870,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9704800,c9704870,f4126c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9704800,f4126c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabe600,f4126c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc137690,f4126c1c,c95c6e80,0,cca55bc0,...) at devfs_read_f+0x7e dofileread(f4126c1c,ffffffff,ffffffff,0,f4126bf8,...) at dofileread+0x9e kern_readv(cca55bc0,0,f4126c1c,f4126c3c,1,...) at kern_readv+0x68 sys_read(cca55bc0,f4126ccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f4126d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1804 tid 100186 td 0xccb738d0 sched_switch(ccb738d0,0,104,1b3,f41b19fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb738d0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,ccb738d0,ccb738d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9704a70,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9704a70,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9704a00,c9704a70,f41b1c1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9704a00,f41b1c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabe700,f41b1c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ccaad5b0,f41b1c1c,c95c6e80,0,ccb738d0,...) at devfs_read_f+0x7e dofileread(f41b1c1c,ffffffff,ffffffff,0,f41b1bf8,...) at dofileread+0x9e kern_readv(ccb738d0,0,f41b1c1c,f41b1c3c,1,...) at kern_readv+0x68 sys_read(ccb738d0,f41b1ccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f41b1d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1803 tid 100189 td 0xccb73000 sched_switch(ccb73000,0,104,1b3,f41ba9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb73000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,ccb73000,ccb73000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9704c70,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9704c70,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9704c00,c9704c70,f41bac1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9704c00,f41bac1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabe800,f41bac1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc0d9038,f41bac1c,c95c6e80,0,ccb73000,...) at devfs_read_f+0x7e dofileread(f41bac1c,ffffffff,ffffffff,0,f41babf8,...) at dofileread+0x9e kern_readv(ccb73000,0,f41bac1c,f41bac3c,1,...) at kern_readv+0x68 sys_read(ccb73000,f41baccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f41bad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1802 tid 100084 td 0xcc0b95e0 sched_switch(cc0b95e0,0,104,1b3,f3fda9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc0b95e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,cc0b95e0,cc0b95e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9704e70,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9704e70,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9704e00,c9704e70,f3fdac1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9704e00,f3fdac1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabe900,f3fdac1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc0d99d8,f3fdac1c,c95c6e80,0,cc0b95e0,...) at devfs_read_f+0x7e dofileread(f3fdac1c,ffffffff,ffffffff,0,f3fdabf8,...) at dofileread+0x9e kern_readv(cc0b95e0,0,f3fdac1c,f3fdac3c,1,...) at kern_readv+0x68 sys_read(cc0b95e0,f3fdaccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f3fdad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1801 tid 100187 td 0xccb735e0 sched_switch(ccb735e0,0,104,1b3,f41b49fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb735e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,ccb735e0,ccb735e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cae3f070,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cae3f070,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(cae3f000,cae3f070,f41b4c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cae3f000,f41b4c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabea00,f41b4c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc121000,f41b4c1c,c95c6e80,0,ccb735e0,...) at devfs_read_f+0x7e dofileread(f41b4c1c,ffffffff,ffffffff,0,f41b4bf8,...) at dofileread+0x9e kern_readv(ccb735e0,0,f41b4c1c,f41b4c3c,1,...) at kern_readv+0x68 sys_read(ccb735e0,f41b4ccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f41b4d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1800 tid 100160 td 0xcca535e0 sched_switch(cca535e0,0,104,1b3,f414a9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca535e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,cca535e0,cca535e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cae3f270,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cae3f270,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(cae3f200,cae3f270,f414ac1c,1,0,...) at tty_wait+0x71 ttydisc_read(cae3f200,f414ac1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabeb00,f414ac1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ccb741f8,f414ac1c,c95c6e80,0,cca535e0,...) at devfs_read_f+0x7e dofileread(f414ac1c,ffffffff,ffffffff,0,f414abf8,...) at dofileread+0x9e kern_readv(cca535e0,0,f414ac1c,f414ac3c,1,...) at kern_readv+0x68 sys_read(cca535e0,f414accc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f414ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1799 tid 100174 td 0xccb67000 sched_switch(ccb67000,0,104,1b3,f418d9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb67000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,ccb67000,ccb67000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cae3f470,0,c0fef0c7,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cae3f470,c119fc10,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(cae3f400,cae3f470,f418dc1c,1,0,...) at tty_wait+0x71 ttydisc_read(cae3f400,f418dc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(caabec00,f418dc1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc167af0,f418dc1c,c95c6e80,0,ccb67000,...) at devfs_read_f+0x7e dofileread(f418dc1c,ffffffff,ffffffff,0,f418dbf8,...) at dofileread+0x9e kern_readv(ccb67000,0,f418dc1c,f418dc3c,1,...) at kern_readv+0x68 sys_read(ccb67000,f418dccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f418dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command getty pid 1798 tid 100190 td 0xccb72bc0 sched_switch(ccb72bc0,0,104,1b3,f41bd9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb72bc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,c9703604,0,c0fe26c7,ccb72bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c9703670,0,f41bdac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(c9703670,c9703604,c0feea98,538,0,...) at _cv_wait_sig+0x260 tty_wait(c9703600,c9703670,f41bdc1c,1,0,...) at tty_wait+0x71 ttydisc_read(c9703600,f41bdc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(c9628b00,f41bdc1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(cc0d9188,f41bdc1c,c95c6e80,0,ccb72bc0,...) at devfs_read_f+0x7e dofileread(f41bdc1c,ffffffff,ffffffff,0,f41bdbf8,...) at dofileread+0x9e kern_readv(ccb72bc0,0,f41bdc1c,f41bdc3c,1,...) at kern_readv+0x68 sys_read(ccb72bc0,f41bdccc,c103885c,c0e46f0a,c1039e70,...) at sys_read+0x4f syscall(f41bdd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2818f4d3, esp = 0xbfbfddac, ebp = 0xbfbfdde8 --- Tracing command inetd pid 1778 tid 100188 td 0xccb732f0 sched_switch(ccb732f0,0,104,1b3,f41b7964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(ccb732f0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cc195a90,0,c0fe26c7,ccb732f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc195aa4,0,f41b7a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc195aa4,cc195a90,c0feca58,6ae,ccaee070,...) at _cv_wait_sig+0x260 seltdwait(ccaee070,58,c95c6e80,ccb732f0,202,...) at seltdwait+0xa2 kern_select(ccb732f0,8,bfbfcfd0,0,0,0,20,ccb6c598,4) at kern_select+0x655 sys_select(ccb732f0,f41b7ccc,c103885c,c0fed284,c1039e70,...) at sys_select+0x66 syscall(f41b7d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a2453, esp = 0xbfbfcf8c, ebp = 0xbfbfde18 --- Tracing command watchdogd pid 1753 tid 100151 td 0xcca552f0 sched_switch(cca552f0,0,104,1b3,f412faac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca552f0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc9b1598,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc9b1598,cc9b1620,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cca552f0,119c,f412fc38,0,0,...) at kern_wait+0x597 sys_wait4(cca552f0,f412fccc,c103885c,c0fde75c,c0abbf47,...) at sys_wait4+0x3b syscall(f412fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28109d8b, esp = 0xbfbfdc6c, ebp = 0xbfbfdd18 --- Tracing command awk pid 1235 tid 100140 td 0xcc1072f0 sched_switch(cc1072f0,0,104,1b3,f410ea84,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1072f0,0,c0fea300,1ac,5c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(ccacb4b0,5c,c0fecc87,100,0,...) at sleepq_wait_sig+0x17 _sleep(ccacb4b0,ccacb628,15c,c0fecc87,0,...) at _sleep+0x385 pipe_read(cc0d84d0,f410ec1c,cc0adb00,0,cc1072f0,...) at pipe_read+0x427 dofileread(f410ec1c,ffffffff,ffffffff,0,f410ebf8,...) at dofileread+0x9e kern_readv(cc1072f0,0,f410ec1c,f410ec3c,1,...) at kern_readv+0x68 sys_read(cc1072f0,f410eccc,c103885c,c0e4218b,c1039e70,...) at sys_read+0x4f syscall(f410ed08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b34d3, esp = 0xbfbfd96c, ebp = 0xbfbfd988 --- Tracing command sh pid 1234 tid 100146 td 0xcca562f0 sched_switch(cca562f0,0,104,1b3,f4120904,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,cc0b66c0,...) at mi_switch+0x243 sleepq_switch(cca562f0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13204dc,78,c1021e2d,0,0,...) at sleepq_wait+0x6b _sleep(c13204dc,c1320780,278,c1021e2d,0,...) at _sleep+0x39c vm_waitpfault(ccd511bc,1e,0,0,f4120b44,...) at vm_waitpfault+0x75 vm_fault_hold(cc54fae0,bfbfd000,2,0,0,...) at vm_fault_hold+0x61e vm_fault(cc54fae0,bfbfd000,2,0,bfbfda78,...) at vm_fault+0x8b trap_pfault(cca31598,f4120c44,c0ad7788,cca562f0,cca31598,...) at trap_pfault+0x1b9 trap(f4120d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8054c2f, esp = 0xbfbfda60, ebp = 0xbfbfda88 --- Tracing command top pid 1233 tid 100116 td 0xcbeec000 sched_switch(cbeec000,0,104,1b3,f407c914,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cbeec000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cc069804,0,c0fe26c7,cbeec000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc069878,0,f407c9e0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc069878,cc069804,c0feea98,538,d,...) at _cv_wait_sig+0x260 tty_wait(cc069800,cc069878,c0feeb9a,65,0,...) at tty_wait+0x71 ttydisc_write(cc069800,f407cc1c,0,a1,1b1,...) at ttydisc_write+0x2f0 ttydev_write(cbfab900,f407cc1c,0,0,0,...) at ttydev_write+0xfa devfs_write_f(cc0d99a0,f407cc1c,cc0ada00,0,cbeec000,...) at devfs_write_f+0xa9 dofilewrite(f407cc1c,ffffffff,ffffffff,0,f407cbf8,...) at dofilewrite+0x95 kern_writev(cbeec000,1,f407cc1c,f407cc3c,1,...) at kern_writev+0x68 sys_write(cbeec000,f407cccc,c103885c,c0fed68e,c0fe68ec,...) at sys_write+0x4f syscall(f407cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x281ea4b3, esp = 0xbfbfdadc, ebp = 0xbfbfdaf8 --- Tracing command sh pid 1232 tid 100147 td 0xcca56000 sched_switch(cca56000,0,104,1b3,f4123aac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca56000,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cca312cc,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(cca312cc,cca31354,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cca56000,ffffffff,f4123c38,2,0,...) at kern_wait+0x597 sys_wait4(cca56000,f4123ccc,c103885c,c0fed217,c1039e70,...) at sys_wait4+0x3b syscall(f4123d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28156d8b, esp = 0xbfbfdb4c, ebp = 0xbfbfdb68 --- Tracing command sshd pid 1231 tid 100111 td 0xcbeed000 sched_switch(cbeed000,0,103,1ae,c11aeb80,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1320780,...) at mi_switch+0x243 turnstile_wait(cacf8080,cbeed8d0,0,1c5,c111b508,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1320780,cbeed000,0,c1021b67,68a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1320780,0,c1021b67,68a,174,...) at _mtx_lock_flags+0x10f vm_wait(c1bb5118,c102040b,174,172,cd65f000,...) at vm_wait+0x2a kmem_back(c1bb5118,cd65f000,1000,102,2,...) at kmem_back+0x1e5 kmem_malloc(c1bb5118,1000,102,f406a978,c0d0b279,...) at kmem_malloc+0x2a0 page_alloc(c1baab60,1000,f406a96b,102,c1baab60,...) at page_alloc+0x27 keg_alloc_slab(c1ba4488,4,c101f6ac,86e,c0a7f2a6,...) at keg_alloc_slab+0xf9 keg_fetch_slab(2,0,c1baabc8,f406aa18,c0d0d08f,...) at keg_fetch_slab+0x17f zone_fetch_slab(c1baab60,0,2,824,c0fe26c7,...) at zone_fetch_slab+0x4c uma_zalloc_arg(c1baab60,cc9b8700,2,47,0,...) at uma_zalloc_arg+0x59f mb_zinit_pack(cc9b8700,100,2,996,617,...) at mb_zinit_pack+0x23 uma_zalloc_arg(c1baac40,f406aab4,2,ee0001,0,...) at uma_zalloc_arg+0x661 m_getm2(0,150,2,1,0,...) at m_getm2+0x128 m_uiotombuf(f406ac1c,2,8218,0,0,...) at m_uiotombuf+0x77 sosend_generic(cc4661a0,0,f406ac1c,0,0,...) at sosend_generic+0x432 sosend(cc4661a0,0,f406ac1c,0,0,...) at sosend+0x3f soo_write(cc0d8c08,f406ac1c,cc0ade00,0,cbeed000,...) at soo_write+0x63 dofilewrite(f406ac1c,ffffffff,ffffffff,0,f406abf8,...) at dofilewrite+0x95 kern_writev(cbeed000,3,f406ac1c,f406ac3c,1,...) at kern_writev+0x68 sys_write(cbeed000,f406accc,c103885c,c0fed137,c0fe68ec,...) at sys_write+0x4f syscall(f406ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x284ed4b3, esp = 0xbfbfcdec, ebp = 0xbfbfce18 --- Tracing command sshd pid 1230 tid 100133 td 0xcc16e000 sched_switch(cc16e000,0,104,1b3,f40f9964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc16e000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf1d710,0,c0fe26c7,cc16e000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf1d724,0,f40f9a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf1d724,cbf1d710,c0feca58,6ae,cc167268,...) at _cv_wait_sig+0x260 seltdwait(cc167268,58,c95c7c80,cc16e000,cc16e0b4,...) at seltdwait+0xa2 kern_select(cc16e000,c,28c0c170,28c0c1b0,0,0,20,cca34864,0) at kern_select+0x655 sys_select(cc16e000,f40f9ccc,c103885c,c0fed385,c1039e70,...) at sys_select+0x66 syscall(f40f9d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284ed453, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command tail pid 1229 tid 100152 td 0xcca55000 sched_switch(cca55000,0,104,1b3,f41328e4,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,cc103c00,...) at mi_switch+0x243 sleepq_switch(cca55000,0,c0fea300,26e,60,...) at sleepq_switch+0x1a7 sleepq_wait(cc6191c0,60,c0fd4613,4,1,...) at sleepq_wait+0x6b __lockmgr_args(cc6191c0,200400,cc61922c,0,0,...) at __lockmgr_args+0x593 ffs_lock(f4132a38,c0ad3c68,cc0f1b98,246,f4132a2c,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c114ade0,f4132a38,c111b508,c115cf20,cc619168,...) at VOP_LOCK1_APV+0xf3 _vn_lock(cc619168,200400,c0ff5e04,26a,f4132aa0,...) at _vn_lock+0x78 vn_read(cc121540,f4132c1c,cc0ad180,1,cca55000,...) at vn_read+0xd7 vn_io_fault(cc121540,f4132c1c,cc0ad180,0,cca55000,...) at vn_io_fault+0x31f dofileread(f4132c1c,ffffffff,ffffffff,0,f4132bf8,...) at dofileread+0x9e kern_readv(cca55000,3,f4132c1c,f4132c3c,1,...) at kern_readv+0x68 sys_read(cca55000,f4132ccc,c103885c,c0e4218b,c0fe68ec,...) at sys_read+0x4f syscall(f4132d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2817c4d3, esp = 0xbfbfda9c, ebp = 0xbfbfdab8 --- Tracing command sshd pid 1228 tid 100087 td 0xcc1722f0 sched_switch(cc1722f0,0,104,1b3,f3fe6964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1722f0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf1d750,0,c0fe26c7,cc1722f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf1d764,0,f3fe6a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf1d764,cbf1d750,c0feca58,6ae,cc167578,...) at _cv_wait_sig+0x260 seltdwait(cc167578,58,c95c6880,cc1722f0,cc1723a4,...) at seltdwait+0xa2 kern_select(cc1722f0,c,28c0c170,28c0c1b0,0,0,20,cc16cb30,0) at kern_select+0x655 sys_select(cc1722f0,f3fe6ccc,c103885c,c0fed385,c1039e70,...) at sys_select+0x66 syscall(f3fe6d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284ed453, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sshd pid 1224 tid 100128 td 0xcc45abc0 sched_switch(cc45abc0,0,104,1b3,f40ea9c8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc45abc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf1dc90,0,c0fe26c7,cc45abc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf1dca4,0,f40eaa94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf1dca4,cbf1dc90,c0feca58,6ae,f40eab1c,...) at _cv_wait_sig+0x260 seltdwait(cc45c42c,c0feca58,5ab,cc45abc0,0,...) at seltdwait+0xa2 sys_poll(cc45abc0,f40eaccc,c103885c,c0e4218b,c0abbf47,...) at sys_poll+0x321 syscall(f40ead08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284849ab, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command sshd pid 1223 tid 100103 td 0xcc1715e0 sched_switch(cc1715e0,0,104,1b3,f40279c8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1715e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf1d9d0,0,c0fe26c7,cc1715e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf1d9e4,0,f4027a94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf1d9e4,cbf1d9d0,c0feca58,6ae,f4027b1c,...) at _cv_wait_sig+0x260 seltdwait(cc53d02c,c0feca58,5ab,cc1715e0,0,...) at seltdwait+0xa2 sys_poll(cc1715e0,f4027ccc,c103885c,c0e4218b,c0abbf47,...) at sys_poll+0x321 syscall(f4027d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284849ab, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command sshd pid 1222 tid 100101 td 0xcc0b82f0 sched_switch(cc0b82f0,0,104,1b3,f401f9c8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc0b82f0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf1d910,0,c0fe26c7,cc0b82f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf1d924,0,f401fa94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf1d924,cbf1d910,c0feca58,6ae,f401fb1c,...) at _cv_wait_sig+0x260 seltdwait(cc45dc2c,c0feca58,5ab,cc0b82f0,0,...) at seltdwait+0xa2 sys_poll(cc0b82f0,f401fccc,c103885c,c0e4218b,c0abbf47,...) at sys_poll+0x321 syscall(f401fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284849ab, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command bash pid 1208 tid 100145 td 0xcc172bc0 sched_switch(cc172bc0,0,104,1b3,f411daac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc172bc0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc438864,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc438864,cc4388ec,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cc172bc0,ffffffff,f411dc38,6,0,...) at kern_wait+0x597 sys_wait4(cc172bc0,f411dccc,c103885c,c0fed137,c0abbf47,...) at sys_wait4+0x3b syscall(f411dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b3d8b, esp = 0xbfbfd7ac, ebp = 0xbfbfd7c8 --- Tracing command csh pid 1205 tid 100142 td 0xcca565e0 sched_switch(cca565e0,0,104,1b3,f4114af8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cca565e0,0,c0fea300,1ac,74,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cca318bc,74,c0e6994e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cca318bc,cca318ec,174,c0e6994e,0,...) at _sleep+0x385 kern_sigsuspend(cca565e0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cca565e0,f4114ccc,c103885c,c0fed137,c1039e70,...) at sys_sigsuspend+0x4d syscall(f4114d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2817637b, esp = 0xbfbfd09c, ebp = 0xbfbfd108 --- Tracing command su pid 1204 tid 100112 td 0xcbeecbc0 sched_switch(cbeecbc0,0,104,1b3,f406daac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cbeecbc0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc4382cc,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc4382cc,cc438354,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cbeecbc0,4b5,f406dc38,2,0,...) at kern_wait+0x597 sys_wait4(cbeecbc0,f406dccc,c103885c,c0feda4e,c1039e70,...) at sys_wait4+0x3b syscall(f406dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28110d8b, esp = 0xbfbfd5ec, ebp = 0xbfbfd608 --- Tracing command bash pid 1199 tid 100138 td 0xcc1075e0 sched_switch(cc1075e0,0,104,1b3,f4108aac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1075e0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cca34000,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(cca34000,cca34088,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(cc1075e0,ffffffff,f4108c38,6,0,...) at kern_wait+0x597 sys_wait4(cc1075e0,f4108ccc,c103885c,c0fed137,c1039e70,...) at sys_wait4+0x3b syscall(f4108d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282b3d8b, esp = 0xbfbfd9bc, ebp = 0xbfbfd9d8 --- Tracing command sshd pid 1198 tid 100127 td 0xcc45b000 sched_switch(cc45b000,0,104,1b3,f40e7964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc45b000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf50c90,0,c0fe26c7,cc45b000,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf50ca4,0,f40e7a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf50ca4,cbf50c90,c0feca58,6ae,cc137310,...) at _cv_wait_sig+0x260 seltdwait(cc137310,58,cc081880,cc45b000,cc45b0b4,...) at seltdwait+0xa2 kern_select(cc45b000,c,28c0c170,28c0c1b0,0,0,20,cc9b0b30,0) at kern_select+0x655 sys_select(cc45b000,f40e7ccc,c103885c,c0fed385,c1039e70,...) at sys_select+0x66 syscall(f40e7d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284ed453, esp = 0xbfbfce5c, ebp = 0xbfbfcea8 --- Tracing command sshd pid 1196 tid 100108 td 0xcc16e5e0 sched_switch(cc16e5e0,0,104,1b3,f40409c8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc16e5e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cca413d0,0,c0fe26c7,cc16e5e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cca413e4,0,f4040a94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cca413e4,cca413d0,c0feca58,6ae,f4040b1c,...) at _cv_wait_sig+0x260 seltdwait(cc52732c,c0feca58,5ab,cc16e5e0,8,...) at seltdwait+0xa2 sys_poll(cc16e5e0,f4040ccc,c103885c,c0fcea51,c1039e70,...) at sys_poll+0x321 syscall(f4040d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284849ab, esp = 0xbfbfcebc, ebp = 0xbfbfcef8 --- Tracing command cron pid 1159 tid 100121 td 0xcc45b8d0 sched_switch(cc45b8d0,0,103,1ae,c11aff00,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1321180,...) at mi_switch+0x243 turnstile_wait(cacc4480,cbeed8d0,0,1c5,0,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1321180,cc45b8d0,0,c1021b67,52a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1321180,0,c1021b67,52a,0,...) at _mtx_lock_flags+0x10f vm_page_alloc(ccd9b6f0,1e,0,0,f408eb44,...) at vm_page_alloc+0x565 vm_fault_hold(cc127740,bfbfd000,2,0,0,...) at vm_fault_hold+0x60a vm_fault(cc127740,bfbfd000,2,0,bfbfdc90,...) at vm_fault+0x8b trap_pfault(0,f408ec50,c0ab93cc,c11aff30,cc16d598,...) at trap_pfault+0x1b9 trap(f408ed08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x804c26c, esp = 0xbfbfdc90, ebp = 0xbfbfdca8 --- Tracing command sendmail pid 1154 tid 100083 td 0xcc0b98d0 sched_switch(cc0b98d0,0,104,1b3,f3fd6904,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c3440,...) at mi_switch+0x243 sleepq_switch(cc0b98d0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13204dc,78,c1021e2d,0,0,...) at sleepq_wait+0x6b _sleep(c13204dc,c1320780,278,c1021e2d,0,...) at _sleep+0x39c vm_waitpfault(d04a2c24,1c,0,0,f3fd6b44,...) at vm_waitpfault+0x75 vm_fault_hold(c95ea740,bfbfb000,2,0,0,...) at vm_fault_hold+0x61e vm_fault(c95ea740,bfbfb000,2,0,bfbfbf50,...) at vm_fault+0x8b trap_pfault(0,f3fd6c50,c0ab93cc,c11af8b0,cc0b2864,...) at trap_pfault+0x1b9 trap(f3fd6d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x80a2461, esp = 0xbfbfbf50, ebp = 0xbfbfbfb8 --- Tracing command sendmail pid 1151 tid 100091 td 0xcbeed5e0 sched_switch(cbeed5e0,0,103,1ae,c11af200,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1320780,...) at mi_switch+0x243 turnstile_wait(cc170900,cc0b85e0,0,1c5,0,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1320780,cbeed5e0,0,c1021b67,4a5,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1320780,0,c1021b67,4a5,1c,...) at _mtx_lock_flags+0x10f vm_page_alloc(cc7dfcb8,1c,0,0,f3ff6b44,...) at vm_page_alloc+0x99 vm_fault_hold(c95ebd98,bfbfb000,2,0,0,...) at vm_fault_hold+0x60a vm_fault(c95ebd98,bfbfb000,2,0,bfbfb400,...) at vm_fault+0x8b trap_pfault(cac28b30,f3ff6c44,c0ad7788,cbeed5e0,cac28b30,...) at trap_pfault+0x1b9 trap(f3ff6d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x80a2461, esp = 0xbfbfb400, ebp = 0xbfbfb468 --- Tracing command sshd pid 1148 tid 100118 td 0xcae378d0 sched_switch(cae378d0,0,103,1ae,c11af200,...) at sched_switch+0x453 mi_switch(103,0,c0feacf0,2e7,c1321180,...) at mi_switch+0x243 turnstile_wait(ccf9e700,cbeed8d0,0,1c5,0,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c1321180,cae378d0,0,c1021b67,52a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c1321180,0,c1021b67,52a,0,...) at _mtx_lock_flags+0x10f vm_page_alloc(cc51b940,1d,0,0,f4083b44,...) at vm_page_alloc+0x565 vm_fault_hold(cc5500e8,bfbfc000,2,0,0,...) at vm_fault_hold+0x60a vm_fault(cc5500e8,bfbfc000,2,0,bfbfcf20,...) at vm_fault+0x8b trap_pfault(0,f4083c50,c0ab93cc,c11aebb0,cc437000,...) at trap_pfault+0x1b9 trap(f4083d08) at trap+0x3a3 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0x8054678, esp = 0xbfbfcf20, ebp = 0xbfbfde28 --- Tracing command moused pid 1116 tid 100081 td 0xcc106bc0 sched_switch(cc106bc0,0,104,1b3,f3fce964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc106bc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbf50210,0,c0fe26c7,cc106bc0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbf50224,0,f3fcea30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbf50224,cbf50210,c0feca58,6ae,cc0d8348,...) at _cv_wait_sig+0x260 seltdwait(cc0d8348,58,c95c6e80,cc106bc0,f6,...) at seltdwait+0xa2 kern_select(cc106bc0,400,bfbfda34,0,0,0,20,cc101864,1) at kern_select+0x655 sys_select(cc106bc0,f3fceccc,c103885c,c0e46f0a,c0abbf47,...) at sys_select+0x66 syscall(f3fced08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281af453, esp = 0xbfbfd9cc, ebp = 0xbfbfdb58 --- Tracing command ntpd pid 1091 tid 100098 td 0xcc0b85e0 sched_switch(cc0b85e0,0,104,1b3,f40135c0,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,cc0b6180,...) at mi_switch+0x243 sleepq_switch(cc0b85e0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c13204dc,54,c1021e3b,0,0,...) at sleepq_wait+0x6b _sleep(c13204dc,c1320780,254,c1021e3b,0,...) at _sleep+0x39c vm_wait(cd25665c,0,c1021b67,921,10222,...) at vm_wait+0xbe vm_page_grab(cd25665c,0,0,112a2,c12ea818,...) at vm_page_grab+0x180 allocbuf(e32398c0,800,c0ff188b,b04,fffffffc,...) at allocbuf+0x672 getblk(ccc122d0,0,0,800,0,...) at getblk+0x613 ffs_balloc_ufs2(ccc122d0,0,0,8,c95c6e80,...) at ffs_balloc_ufs2+0x1231 ffs_write(f4013a8c,c1040063,ccc122d0,ccc122d0,f4013a34,...) at ffs_write+0x2bd VOP_WRITE_APV(c114ade0,f4013a8c,ccc122d0,2d7,ccc12394,...) at VOP_WRITE_APV+0x174 vn_write(cf4b9620,f4013c1c,c95c6e80,1,cc0b85e0,...) at vn_write+0x202 vn_io_fault(cf4b9620,f4013c1c,c95c6e80,0,cc0b85e0,...) at vn_io_fault+0x31f dofilewrite(f4013c1c,ffffffff,ffffffff,0,f4013bf8,...) at dofilewrite+0x95 kern_writev(cc0b85e0,4,f4013c1c,f4013c3c,1,...) at kern_writev+0x68 sys_write(cc0b85e0,f4013ccc,c103885c,c0fed17a,e,...) at sys_write+0x4f syscall(f4013d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x283654b3, esp = 0xbfbfdacc, ebp = 0xbfbfdae8 --- Tracing command nfsd pid 1033 tid 100125 td 0xcc1028d0 sched_switch(cc1028d0,0,104,1b3,f40e1b28,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc1028d0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f40e1bbc,c0a7eafa,cae19100,0,cc1028d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbebdbd0,0,f40e1bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbebdbd0,cae19100,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f40e1cf4,c0a61258,cae19100,f40e1d08,c0fde6d0,...) at svc_run_internal+0x356 svc_thread_start(cae19100,f40e1d08,c0fde6d0,3db,cc16a598,...) at svc_thread_start+0x10 fork_exit(c0c91a70,cae19100,f40e1d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1033 tid 100124 td 0xcc102bc0 sched_switch(cc102bc0,0,104,1b3,f40deb28,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc102bc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f40debbc,c0a7eafa,cae19100,0,cc102bc0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbebdc10,0,f40debf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbebdc10,cae19100,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f40decf4,c0a61258,cae19100,f40ded08,c0fde6d0,...) at svc_run_internal+0x356 svc_thread_start(cae19100,f40ded08,c0fde6d0,3db,cc16a598,...) at svc_thread_start+0x10 fork_exit(c0c91a70,cae19100,f40ded08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1033 tid 100123 td 0xcc105000 sched_switch(cc105000,0,104,1b3,f40dbb28,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc105000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f40dbbbc,c0a7eafa,cae19100,0,cc105000,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbebdb90,0,f40dbbf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbebdb90,cae19100,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f40dbcf4,c0a61258,cae19100,f40dbd08,c0fde6d0,...) at svc_run_internal+0x356 svc_thread_start(cae19100,f40dbd08,c0fde6d0,3db,cc16a598,...) at svc_thread_start+0x10 fork_exit(c0c91a70,cae19100,f40dbd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1033 tid 100106 td 0xcc16ebc0 sched_switch(cc16ebc0,0,104,1b3,f40333d8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc16ebc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f403346c,c0a7eafa,cae19100,0,cc16ebc0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbf4bd50,0,f40334a8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbf4bd50,cae19100,1388,3b1,3,...) at _cv_timedwait_sig+0x270 svc_run_internal(cc16ed68,14,c1014cfa,c0fcff5b,f40337e8,...) at svc_run_internal+0x356 svc_run(cae19100,0,c0fcff36,19f,c0e307e7,...) at svc_run+0x7b nfsrvd_nfsd(cc16ebc0,f40337e8,c,c1039e70,104,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cc16ebc0,f4033ccc,0,cc16ebc0,f4033cfc,...) at nfssvc_nfsd+0x177 sys_nfssvc(cc16ebc0,f4033ccc,c103885c,c0fed614,c1039e70,...) at sys_nfssvc+0xeb syscall(f4033d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280c4fbb, esp = 0xbfbfd85c, ebp = 0xbfbfdac8 --- Tracing command nfsd pid 1031 tid 100119 td 0xcae375e0 sched_switch(cae375e0,0,104,1b3,f4088964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cae375e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbed6110,0,c0fe26c7,cae375e0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbed6124,0,f4088a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbed6124,cbed6110,c0feca58,6ae,cc1671f8,...) at _cv_wait_sig+0x260 seltdwait(cc1671f8,58,c95c6e80,cae375e0,0,...) at seltdwait+0xa2 kern_select(cae375e0,7,bfbfdce4,0,0,0,20,cc16db30,1) at kern_select+0x655 sys_select(cae375e0,f4088ccc,c103885c,c0fed614,c1039e70,...) at sys_select+0x66 syscall(f4088d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817c453, esp = 0xbfbfdacc, ebp = 0xbfbfde18 --- Tracing command nfsuserd pid 1029 tid 100097 td 0xcc106000 sched_switch(cc106000,0,104,1b3,f400f960,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc106000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f400f9f4,c0a7eafa,cbf1e010,0,cc106000,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbf1e024,0,f400fa30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbf1e024,cbf1e010,7531,6ae,cc0d9620,...) at _cv_timedwait_sig+0x270 seltdwait(f400fbe8,f400fbf0,c95c6e80,cc106000,ccfa02f0,...) at seltdwait+0x8a kern_select(cc106000,4,bfbfdbf4,0,0,f400fc34,20,1e,0) at kern_select+0x655 sys_select(cc106000,f400fccc,c103885c,c0fed36e,c11aff00,...) at sys_select+0x66 syscall(f400fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b453, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1028 tid 100109 td 0xcc1055e0 sched_switch(cc1055e0,0,104,1b3,f4048960,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc1055e0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f40489f4,c0a7eafa,cbed6150,0,cc1055e0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbed6164,0,f4048a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbed6164,cbed6150,7531,6ae,cc0d9620,...) at _cv_timedwait_sig+0x270 seltdwait(f4048be8,f4048bf0,c95c6e80,cc1055e0,cca558d0,...) at seltdwait+0x8a kern_select(cc1055e0,4,bfbfdbf4,0,0,f4048c34,20,1e,0) at kern_select+0x655 sys_select(cc1055e0,f4048ccc,c103885c,c0fed36e,c0fe68ec,...) at sys_select+0x66 syscall(f4048d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b453, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1027 tid 100099 td 0xcc105bc0 sched_switch(cc105bc0,0,104,1b3,f4017960,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc105bc0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f40179f4,c0a7eafa,cbf1e050,0,cc105bc0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbf1e064,0,f4017a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbf1e064,cbf1e050,7531,6ae,cc0d9620,...) at _cv_timedwait_sig+0x270 seltdwait(f4017be8,f4017bf0,c95c6e80,cc105bc0,ccfa02f0,...) at seltdwait+0x8a kern_select(cc105bc0,4,bfbfdbf4,0,0,f4017c34,20,1e,0) at kern_select+0x655 sys_select(cc105bc0,f4017ccc,c103885c,c0fed36e,c0fe68ec,...) at sys_select+0x66 syscall(f4017d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b453, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1026 tid 100100 td 0xcc1058d0 sched_switch(cc1058d0,0,104,1b3,f401b960,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc1058d0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f401b9f4,c0a7eafa,cbed6190,0,cc1058d0,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cbed61a4,0,f401ba30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cbed61a4,cbed6190,7531,6ae,cc0d9620,...) at _cv_timedwait_sig+0x270 seltdwait(f401bbe8,f401bbf0,c95c6e80,cc1058d0,cc45b8d0,...) at seltdwait+0x8a kern_select(cc1058d0,4,bfbfdbf4,0,0,f401bc34,20,1e,0) at kern_select+0x655 sys_select(cc1058d0,f401bccc,c103885c,c0fed36e,c0fe68ec,...) at sys_select+0x66 syscall(f401bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2817b453, esp = 0xbfbfdb4c, ebp = 0xbfbfdc88 --- Tracing command nfsuserd pid 1025 tid 100096 td 0xcc0b88d0 sched_switch(cc0b88d0,0,104,1b3,f400aaf8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc0b88d0,0,c0fea300,1ac,74,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbeea8bc,74,c0e6994e,100,0,...) at sleepq_wait_sig+0x17 _sleep(cbeea8bc,cbeea8ec,174,c0e6994e,0,...) at _sleep+0x385 kern_sigsuspend(cc0b88d0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cc0b88d0,f400accc,c103885c,c0fed614,c0abbf47,...) at sys_sigsuspend+0x4d syscall(f400ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280c337b, esp = 0xbfbfdc8c, ebp = 0xbfbfde28 --- Tracing command mountd pid 1009 tid 100094 td 0xcc1062f0 sched_switch(cc1062f0,0,104,1b3,f4002964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1062f0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cbed61d0,0,c0fe26c7,cc1062f0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cbed61e4,0,f4002a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cbed61e4,cbed61d0,c0feca58,6ae,cc0d8498,...) at _cv_wait_sig+0x260 seltdwait(cc0d8498,58,c95c6e80,cc1062f0,cc07fb70,...) at seltdwait+0xa2 kern_select(cc1062f0,9,bfbfdd34,0,0,0,20,cc101000,bfbfdd34) at kern_select+0x655 sys_select(cc1062f0,f4002ccc,c103885c,c0fcdcb7,c1039e70,...) at sys_select+0x66 syscall(f4002d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28193453, esp = 0xbfbfdccc, ebp = 0xbfbfde18 --- Tracing command rpcbind pid 976 tid 100089 td 0xcc172000 sched_switch(cc172000,0,104,1b3,f3fee9c4,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc172000,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f3feea58,c0a7eafa,cc1958d0,0,cc172000,...) at sleepq_catch_signals+0xfc sleepq_timedwait_sig(cc1958e4,0,f3feea94,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cc1958e4,cc1958d0,7531,6ae,f3feeb4c,...) at _cv_timedwait_sig+0x270 seltdwait(f3feec1c,f3feec24,5ab,cc172000,c12ec530,...) at seltdwait+0x8a sys_poll(cc172000,f3feeccc,c103885c,c0fed36e,c0fe68ec,...) at sys_poll+0x321 syscall(f3feed08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x281329ab, esp = 0xbfbfbbdc, ebp = 0xbfbfdda8 --- Tracing command syslogd pid 961 tid 100114 td 0xcbeec5e0 cpustop_handler(3,f407362c,c0e0ff23,c12eb2f8,0,...) at cpustop_handler+0x26 ipi_nmi_handler(c12eb2f8,0,c957fc70,f407356c,cc437b30,...) at ipi_nmi_handler+0x35 trap(f4073638) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0e03e87, esp = 0xf4073678, ebp = 0xf4073698 --- smp_tlb_shootdown(f40736c4,c0e0683c,e6040000,e6044000,c9585f28,...) at smp_tlb_shootdown+0x97 smp_invlpg_range(e6040000,e6044000,c9585f28,cbeec694,e6044000,...) at smp_invlpg_range+0x1c pmap_invalidate_range(c1340b20,e6040000,e6044000) at pmap_invalidate_range+0x6c pmap_qremove(e6040000,4,cc619ad0,4,e320a380,...) at pmap_qremove+0x54 vfs_vmio_release(c1317df4,0,c0ff188b,792,0,...) at vfs_vmio_release+0x25 getnewbuf(4000,4000,0,ad5,c111b508,...) at getnewbuf+0x334 getblk(ccc0d168,ffd1dff4,ffffffff,4000,0,...) at getblk+0x4b5 breadn_flags(ccc0d168,ffd1dff4,ffffffff,4000,0,...) at breadn_flags+0x43 ffs_balloc_ufs2(ccc0d168,882c0000,b,4000,c95c7000,...) at ffs_balloc_ufs2+0x1775 ffs_copyonwrite(cc153e10,e32c4ca0,0,e32c4ca0,cc619168,...) at ffs_copyonwrite+0x3f8 ffs_geom_strategy(cc153f08,e32c4ca0,c12eacc8,c111b508,cc619168,...) at ffs_geom_strategy+0xeb ufs_strategy(f4073ab0,c103fe2b,c0df9731,e32c4d00,cbeec5e0,...) at ufs_strategy+0xd3 VOP_STRATEGY_APV(c114ade0,f4073ab0,c0ff188b,c115d100,cc619168,...) at VOP_STRATEGY_APV+0x119 bufstrategy(cc619260,e32c4ca0,3a0,2800,0,...) at bufstrategy+0x61 bufwrite(e32c4ca0,0,c0ff188b,6d6,0,...) at bufwrite+0x159 vfs_bio_awrite(e32c4ca0,0,c101d711,106,0,...) at vfs_bio_awrite+0x328 ffs_syncvnode(cc619168,1,0,c114ade0,cc619260,...) at ffs_syncvnode+0x3a5 ffs_fsync(f4073c20,c103f5e4,eb,0,df7,...) at ffs_fsync+0x2f VOP_FSYNC_APV(c114ade0,f4073c20,c0ff5ba7,dfc,0,...) at VOP_FSYNC_APV+0x100 sys_fsync(cbeec5e0,f4073ccc,c103885c,c0fee0ef,e,...) at sys_fsync+0x1df syscall(f4073d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (95, FreeBSD ELF32, sys_fsync), eip = 0x28190347, esp = 0xbfbfd2cc, ebp = 0xbfbfde18 --- Tracing command devd pid 838 tid 100102 td 0xcc1718d0 sched_switch(cc1718d0,0,104,1b3,f4023964,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cc1718d0,0,c0fea300,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7eafa,cc195a50,0,c0fe26c7,cc1718d0,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cc195a64,0,f4023a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc195a64,cc195a50,c0feca58,6ae,cc0d92d8,...) at _cv_wait_sig+0x260 seltdwait(cc0d92d8,58,c95c6e80,cc1718d0,c12ead78,...) at seltdwait+0xa2 kern_select(cc1718d0,5,bfbfd990,0,0,0,20,cc16c2cc,34) at kern_select+0x655 sys_select(cc1718d0,f4023ccc,c103885c,c0e4218b,c1039e70,...) at sys_select+0x66 syscall(f4023d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80893bb, esp = 0xbfbfd95c, ebp = 0xbfbfde38 --- Tracing command softdepflush pid 19 tid 100078 td 0xcbeed8d0 sched_switch(cbeed8d0,0,602,1ae,0,...) at sched_switch+0x453 mi_switch(602,0,c0fe4e9f,cd,cbeed8d0,...) at mi_switch+0x243 critical_exit(c11bd9ec,efbea864,c0a7e662,c11bd9ec,4,...) at critical_exit+0xb8 spinlock_exit(c11bd9ec,4,c0fe26c7,119,3b0,c0ad9bea) at spinlock_exit+0x10 _mtx_unlock_spin_flags(c11bd9ec,0,c0feacf0,267,efbea89c,...) at _mtx_unlock_spin_flags+0x132 turnstile_chain_unlock(c1320780,0,c111b508,c1320780,c1320780,...) at turnstile_chain_unlock+0x39 _mtx_unlock_sleep(c1320780,0,c1021b67,796,0,...) at _mtx_unlock_sleep+0xaf _mtx_unlock_flags(c1320780,0,c1021b67,796,c3e90880,...) at _mtx_unlock_flags+0x157 vm_page_free_toq(c3e90880,efbea918,c0d242a3,c3e90880,0,...) at vm_page_free_toq+0x26c vm_page_free(c3e90880,0,c1021b67,52a,20,...) at vm_page_free+0x15 vm_page_alloc(cc15440c,3beb1c,0,40222,40222,...) at vm_page_alloc+0x583 vm_page_grab(cc15440c,3beb1c,0,412a2,c12eb108,...) at vm_page_grab+0x152 allocbuf(e316d1a0,4000,c0ff188b,b04,efbea9dc,...) at allocbuf+0x672 getblk(cc153e10,1df58e0,0,4000,0,...) at getblk+0x613 breadn_flags(cc153e10,1df58e0,0,4000,0,...) at breadn_flags+0x43 indir_trunc(fffe8ff4,ffffffff,c101a0ac,1e29,0,...) at indir_trunc+0x114 indir_trunc(fffff7f3,ffffffff,c101a0ac,1ceb,c12eb0e8,...) at indir_trunc+0x4ba handle_workitem_freeblocks(0,efbeac50,2,6ba,efbeac54,...) at handle_workitem_freeblocks+0x24f process_worklist_item(c131fde0,0,c101a0ac,5e9,cc094e00,...) at process_worklist_item+0x2c2 softdep_process_worklist(cc080b70,0,c101a0ac,562,3e8,...) at softdep_process_worklist+0x84 softdep_flush(0,efbead08,c0fde6d0,3db,cbee9000,...) at softdep_flush+0x2a0 fork_exit(c0ce4b60,0,efbead08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbead40, ebp = 0 --- Tracing command syncer pid 18 tid 100077 td 0xcbeedbc0 sched_switch(cbeedbc0,0,104,1b3,efbe7bcc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fe26c7,...) at mi_switch+0x243 sleepq_switch(cbeedbc0,0,c0fea300,291,cbeedbc0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1318114,0,efbe7c58,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1318114,c1318100,3e8,782,4e20,...) at _cv_timedwait+0x270 sched_sync(0,efbe7d08,c0fde6d0,3db,cbee92cc,...) at sched_sync+0x595 fork_exit(c0b36300,0,efbe7d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbe7d40, ebp = 0 --- Tracing command vnlru pid 17 tid 100076 td 0xcacf78d0 sched_switch(cacf78d0,0,104,1b3,efbe4bc4,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,352,...) at mi_switch+0x243 sleepq_switch(cacf78d0,0,c0fea300,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(cbee9598,60,c0ff54f5,0,0,...) at sleepq_timedwait+0x6b _sleep(cbee9598,c13180d4,260,c0ff54f5,3e8,...) at _sleep+0x36a vnlru_proc(0,efbe4d08,c0fde6d0,3db,cbee9598,...) at vnlru_proc+0xe7 fork_exit(c0b36fe0,0,efbe4d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbe4d40, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xcacf7bc0 sched_switch(cacf7bc0,0,104,1b3,efbe1bfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,352,...) at mi_switch+0x243 sleepq_switch(cacf7bc0,0,c0fea300,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1317da8,54,c0ff2255,0,0,...) at sleepq_timedwait+0x6b _sleep(c1317da8,c1317db0,54,c0ff2255,3e8,...) at _sleep+0x36a buf_daemon(0,efbe1d08,c0fde6d0,3db,cbee9864,...) at buf_daemon+0x175 fork_exit(c0b18f20,0,efbe1d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbe1d40, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xcae34000 sched_switch(cae34000,0,104,1b3,efbdec00,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,352,...) at mi_switch+0x243 sleepq_switch(cae34000,0,c0fea300,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1321de8,0,c10238fc,0,0,...) at sleepq_timedwait+0x6b _sleep(c1321de8,c1320780,0,c10238fc,493e0,...) at _sleep+0x36a vm_pagezero(0,efbded08,c0fde6d0,3db,cbee9b30,...) at vm_pagezero+0xdc fork_exit(c0d2cea0,0,efbded08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbded40, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xcae342f0 sched_switch(cae342f0,0,104,1b3,efbdbbc4,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c3d80,...) at mi_switch+0x243 sleepq_switch(cae342f0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1321948,74,c0ff2255,0,0,...) at sleepq_wait+0x6b _sleep(c1321948,c132194c,74,c0ff2255,0,...) at _sleep+0x39c vm_daemon(0,efbdbd08,c0fde6d0,3db,cbeea000,...) at vm_daemon+0x59 fork_exit(c0d25360,0,efbdbd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbdbd40, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xcae345e0 kdb_enter(c0e761e7,c0f68bbc,0,186ca28,0) at kdb_enter+0x3a watchdog_fire(1,0,c0fdc19b,220,c95e72cc,...) at watchdog_fire+0xbd hardclock_cnt(1,0,bd8aac,c105a6c0,3cd77f5d,...) at hardclock_cnt+0x2c1 handleevents(efbd8af8,8,c0fe5dd2,c12eb360,246,1,1777,3cd77f5d,443ab689,8276500) at handleevents+0x17d timercb(c13811a0,0,1,c1baf888,c1baf888,...) at timercb+0x292 lapic_handle_timer(efbd8b3c) at lapic_handle_timer+0x7f Xtimerint() at Xtimerint+0x20 --- interrupt, eip = 0xc0a7f22a, esp = 0xefbd8b7c, ebp = 0xefbd8ba0 --- _mtx_lock_flags(c1baf888,0,c101f6ac,2fd,0,...) at _mtx_lock_flags+0xea zone_drain_wait(efbd8bf0,c0d08605,c1baea80,0,c101f6ac,...) at zone_drain_wait+0x2f zone_drain(c1baea80,0,c101f6ac,639,0,...) at zone_drain+0x10 zone_foreach(c95a2d40,0,efbd8cc8,c0d26bec,c95a2d4c,...) at zone_foreach+0x45 uma_reclaim(c95a2d4c,0,c10225e7,2ee,1388,...) at uma_reclaim+0x16 vm_pageout(0,efbd8d08,c0fde6d0,3db,c95e72cc,...) at vm_pageout+0x80c fork_exit(c0d263e0,0,efbd8d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefbd8d40, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xcae348d0 sched_switch(cae348d0,0,104,1b3,efa55bfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c3d00,...) at mi_switch+0x243 sleepq_switch(cae348d0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1164854,5c,c0e3c2e8,0,0,...) at sleepq_wait+0x6b _sleep(c1164854,c1164898,5c,c0e3c2e8,0,...) at _sleep+0x39c xpt_scanner_thread(0,efa55d08,c0fde6d0,3db,c95e7598,...) at xpt_scanner_thread+0x47 fork_exit(c04a8330,0,efa55d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa55d40, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xcae34bc0 sched_switch(cae34bc0,0,104,1b3,efa52c04,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c3cc0,...) at mi_switch+0x243 sleepq_switch(cae34bc0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c131b638,0,c1009a87,0,0,...) at sleepq_wait+0x6b _sleep(c131b638,c131b600,0,c1009a87,0,...) at _sleep+0x39c sctp_iterator_thread(0,efa52d08,c0fde6d0,3db,c95e7864,...) at sctp_iterator_thread+0x5c fork_exit(c0bd27e0,0,efa52d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa52d40, ebp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xcae35bc0 sched_switch(cae35bc0,0,104,1b3,efa42b4c,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,348,...) at mi_switch+0x243 sleepq_switch(cae35bc0,0,c0fea300,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(cac9723c,5c,c0fd09d2,0,0,...) at sleepq_timedwait+0x6b _sleep(cac9723c,cac972f0,5c,c0fd09d2,3e8,...) at _sleep+0x36a fdc_thread(cac97200,efa42d08,c0fde6d0,3db,c95e7b30,...) at fdc_thread+0x27d fork_exit(c0db1150,cac97200,efa42d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa42d40, ebp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xcace62f0 sched_switch(cace62f0,0,104,1b3,efa326f0,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(cace62f0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(cad32000,6c,c0fd09d2,100,0,...) at sleepq_wait_sig+0x17 _sleep(cad32000,cad36488,16c,c0fd09d2,0,...) at _sleep+0x385 fw_bus_probe_thread(cad32000,efa32d08,c0fde6d0,3db,cac28000,...) at fw_bus_probe_thread+0xa08 fork_exit(c070a980,cad32000,efa32d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa32d40, ebp = 0 --- Tracing command usb pid 15 tid 100059 td 0xcacf5000 sched_switch(cacf5000,0,104,1b3,efa1bc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf5000,0,c0fea300,26e,cacf5000,...) at sleepq_switch+0x1a7 sleepq_wait(cacfdd34,0,efa1bc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacfdd34,cacfde4c,c0fc2051,74,cacfdd3c,...) at _cv_wait+0x260 usb_process(cacfdd2c,efa1bd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacfdd2c,efa1bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa1bd40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xcacf52f0 sched_switch(cacf52f0,0,104,1b3,efa18c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf52f0,0,c0fea300,26e,cacf52f0,...) at sleepq_switch+0x1a7 sleepq_wait(cacfdd04,0,efa18c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacfdd04,cacfde4c,c0fc2051,74,cacfdd0c,...) at _cv_wait+0x260 usb_process(cacfdcfc,efa18d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacfdcfc,efa18d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa18d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xcacf55e0 sched_switch(cacf55e0,0,104,1b3,efa15c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf55e0,0,c0fea300,26e,cacf55e0,...) at sleepq_switch+0x1a7 sleepq_wait(cacfdcd4,0,efa15c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacfdcd4,cacfde4c,c0fc2051,74,cacfdcdc,...) at _cv_wait+0x260 usb_process(cacfdccc,efa15d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacfdccc,efa15d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa15d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xcacf58d0 sched_switch(cacf58d0,0,104,1b3,efa12c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf58d0,0,c0fea300,26e,cacf58d0,...) at sleepq_switch+0x1a7 sleepq_wait(cacfdca4,0,efa12c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacfdca4,cacfde4c,c0fc2051,74,cacfdcac,...) at _cv_wait+0x260 usb_process(cacfdc9c,efa12d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacfdc9c,efa12d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa12d40, ebp = 0 --- Tracing command usb pid 15 tid 100054 td 0xcacf7000 sched_switch(cacf7000,0,104,1b3,efa09c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf7000,0,c0fea300,26e,cacf7000,...) at sleepq_switch+0x1a7 sleepq_wait(cacf1b5c,0,efa09c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacf1b5c,cacf1c74,c0fc2051,74,cacf1b64,...) at _cv_wait+0x260 usb_process(cacf1b54,efa09d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacf1b54,efa09d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa09d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xcacf72f0 sched_switch(cacf72f0,0,104,1b3,efa06c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf72f0,0,c0fea300,26e,cacf72f0,...) at sleepq_switch+0x1a7 sleepq_wait(cacf1b2c,0,efa06c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacf1b2c,cacf1c74,c0fc2051,74,cacf1b34,...) at _cv_wait+0x260 usb_process(cacf1b24,efa06d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacf1b24,efa06d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa06d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xcacf75e0 sched_switch(cacf75e0,0,104,1b3,efa03c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacf75e0,0,c0fea300,26e,cacf75e0,...) at sleepq_switch+0x1a7 sleepq_wait(cacf1afc,0,efa03c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacf1afc,cacf1c74,c0fc2051,74,cacf1b04,...) at _cv_wait+0x260 usb_process(cacf1af4,efa03d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacf1af4,efa03d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa03d40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xcace3000 sched_switch(cace3000,0,104,1b3,efa00c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace3000,0,c0fea300,26e,cace3000,...) at sleepq_switch+0x1a7 sleepq_wait(cacf1acc,0,efa00c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacf1acc,cacf1c74,c0fc2051,74,cacf1ad4,...) at _cv_wait+0x260 usb_process(cacf1ac4,efa00d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacf1ac4,efa00d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa00d40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xcace32f0 sched_switch(cace32f0,0,104,1b3,ef9fcc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace32f0,0,c0fea300,26e,cace32f0,...) at sleepq_switch+0x1a7 sleepq_wait(cacebb5c,0,ef9fcc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacebb5c,cacebc74,c0fc2051,74,cacebb64,...) at _cv_wait+0x260 usb_process(cacebb54,ef9fcd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacebb54,ef9fcd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9fcd40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xcace35e0 sched_switch(cace35e0,0,104,1b3,ef9f9c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace35e0,0,c0fea300,26e,cace35e0,...) at sleepq_switch+0x1a7 sleepq_wait(cacebb2c,0,ef9f9c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacebb2c,cacebc74,c0fc2051,74,cacebb34,...) at _cv_wait+0x260 usb_process(cacebb24,ef9f9d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacebb24,ef9f9d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9f9d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xcace38d0 sched_switch(cace38d0,0,104,1b3,ef9f6c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace38d0,0,c0fea300,26e,cace38d0,...) at sleepq_switch+0x1a7 sleepq_wait(cacebafc,0,ef9f6c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacebafc,cacebc74,c0fc2051,74,cacebb04,...) at _cv_wait+0x260 usb_process(cacebaf4,ef9f6d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacebaf4,ef9f6d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9f6d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xcace3bc0 sched_switch(cace3bc0,0,104,1b3,ef9f3c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace3bc0,0,c0fea300,26e,cace3bc0,...) at sleepq_switch+0x1a7 sleepq_wait(cacebacc,0,ef9f3c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacebacc,cacebc74,c0fc2051,74,cacebad4,...) at _cv_wait+0x260 usb_process(cacebac4,ef9f3d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacebac4,ef9f3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9f3d40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xcace5000 sched_switch(cace5000,0,104,1b3,ef9efc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace5000,0,c0fea300,26e,cace5000,...) at sleepq_switch+0x1a7 sleepq_wait(cace7b5c,0,ef9efc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cace7b5c,cace7c74,c0fc2051,74,cace7b64,...) at _cv_wait+0x260 usb_process(cace7b54,ef9efd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cace7b54,ef9efd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9efd40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xcace52f0 sched_switch(cace52f0,0,104,1b3,ef9ecc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace52f0,0,c0fea300,26e,cace52f0,...) at sleepq_switch+0x1a7 sleepq_wait(cace7b2c,0,ef9ecc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cace7b2c,cace7c74,c0fc2051,74,cace7b34,...) at _cv_wait+0x260 usb_process(cace7b24,ef9ecd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cace7b24,ef9ecd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9ecd40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xcace55e0 sched_switch(cace55e0,0,104,1b3,ef9e9c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace55e0,0,c0fea300,26e,cace55e0,...) at sleepq_switch+0x1a7 sleepq_wait(cace7afc,0,ef9e9c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cace7afc,cace7c74,c0fc2051,74,cace7b04,...) at _cv_wait+0x260 usb_process(cace7af4,ef9e9d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cace7af4,ef9e9d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9e9d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xcace58d0 sched_switch(cace58d0,0,104,1b3,ef9e6c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace58d0,0,c0fea300,26e,cace58d0,...) at sleepq_switch+0x1a7 sleepq_wait(cace7acc,0,ef9e6c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cace7acc,cace7c74,c0fc2051,74,cace7ad4,...) at _cv_wait+0x260 usb_process(cace7ac4,ef9e6d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cace7ac4,ef9e6d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9e6d40, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xcace6000 sched_switch(cace6000,0,104,1b3,ef9dfc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cace6000,0,c0fea300,26e,cace6000,...) at sleepq_switch+0x1a7 sleepq_wait(cacdeb5c,0,ef9dfc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacdeb5c,cacdec74,c0fc2051,74,cacdeb64,...) at _cv_wait+0x260 usb_process(cacdeb54,ef9dfd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacdeb54,ef9dfd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9dfd40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xcacc3000 sched_switch(cacc3000,0,104,1b3,ef9dcc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc3000,0,c0fea300,26e,cacc3000,...) at sleepq_switch+0x1a7 sleepq_wait(cacdeb2c,0,ef9dcc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacdeb2c,cacdec74,c0fc2051,74,cacdeb34,...) at _cv_wait+0x260 usb_process(cacdeb24,ef9dcd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacdeb24,ef9dcd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9dcd40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xcacc32f0 sched_switch(cacc32f0,0,104,1b3,ef9d9c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc32f0,0,c0fea300,26e,cacc32f0,...) at sleepq_switch+0x1a7 sleepq_wait(cacdeafc,0,ef9d9c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacdeafc,cacdec74,c0fc2051,74,cacdeb04,...) at _cv_wait+0x260 usb_process(cacdeaf4,ef9d9d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacdeaf4,ef9d9d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9d9d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xcacc35e0 sched_switch(cacc35e0,0,104,1b3,ef9d6c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc35e0,0,c0fea300,26e,cacc35e0,...) at sleepq_switch+0x1a7 sleepq_wait(cacdeacc,0,ef9d6c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacdeacc,cacdec74,c0fc2051,74,cacdead4,...) at _cv_wait+0x260 usb_process(cacdeac4,ef9d6d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacdeac4,ef9d6d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9d6d40, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xcacc3bc0 sched_switch(cacc3bc0,0,104,1b3,ef9cfc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc3bc0,0,c0fea300,26e,cacc3bc0,...) at sleepq_switch+0x1a7 sleepq_wait(cacd7b5c,0,ef9cfc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacd7b5c,cacd7c74,c0fc2051,74,cacd7b64,...) at _cv_wait+0x260 usb_process(cacd7b54,ef9cfd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacd7b54,ef9cfd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9cfd40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xcacc5000 sched_switch(cacc5000,0,104,1b3,ef9ccc08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc5000,0,c0fea300,26e,cacc5000,...) at sleepq_switch+0x1a7 sleepq_wait(cacd7b2c,0,ef9ccc8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacd7b2c,cacd7c74,c0fc2051,74,cacd7b34,...) at _cv_wait+0x260 usb_process(cacd7b24,ef9ccd08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacd7b24,ef9ccd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9ccd40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xcacc52f0 sched_switch(cacc52f0,0,104,1b3,ef9c9c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc52f0,0,c0fea300,26e,cacc52f0,...) at sleepq_switch+0x1a7 sleepq_wait(cacd7afc,0,ef9c9c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacd7afc,cacd7c74,c0fc2051,74,cacd7b04,...) at _cv_wait+0x260 usb_process(cacd7af4,ef9c9d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacd7af4,ef9c9d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9c9d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xcacc55e0 sched_switch(cacc55e0,0,104,1b3,ef9c6c08,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cacc55e0,0,c0fea300,26e,cacc55e0,...) at sleepq_switch+0x1a7 sleepq_wait(cacd7acc,0,ef9c6c8c,1,0,...) at sleepq_wait+0x6b _cv_wait(cacd7acc,cacd7c74,c0fc2051,74,cacd7ad4,...) at _cv_wait+0x260 usb_process(cacd7ac4,ef9c6d08,c0fde6d0,3db,cac282cc,...) at usb_process+0x1a3 fork_exit(c0939af0,cacd7ac4,ef9c6d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9c6d40, ebp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xc96f88d0 sched_switch(c96f88d0,0,104,1b3,ef733654,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c28c0,...) at mi_switch+0x243 sleepq_switch(c96f88d0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c97da000,5c,c0e473a8,0,0,...) at sleepq_wait+0x6b _sleep(c97da000,c97da000,5c,c0e473a8,0,...) at _sleep+0x39c ctl_work_thread(c97da000,ef733d08,c0fde6d0,3db,cac28598,...) at ctl_work_thread+0x22f6 fork_exit(c04d5910,c97da000,ef733d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef733d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xc96f75e0 sched_switch(c96f75e0,0,104,1b3,e33e0bd0,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,348,...) at mi_switch+0x243 sleepq_switch(c96f75e0,0,c0fea300,291,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c11a0d04,0,c0fd09d2,2,0,...) at sleepq_timedwait+0x6b _sleep(c11a0d04,0,0,c0fd09d2,64) at _sleep+0x36a pause(c0fd09d2,64,c0f9e0b0,111,0,...) at pause+0xa0 random_kthread(0,e33e0d08,c0fde6d0,3db,c95e6000,...) at random_kthread+0x1ef fork_exit(c0837310,0,e33e0d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33e0d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc96f7bc0 sched_switch(c96f7bc0,0,104,1b3,e33dabb4,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c29c0,...) at mi_switch+0x243 sleepq_switch(c96f7bc0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c119dda8,5c,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c119dda8,c119dd08,25c,c0fd09d2,0,...) at _sleep+0x39c g_io_schedule_down(c96f7bc0,0,c0fd2521,6c,e33dacf4,...) at g_io_schedule_down+0x5b g_down_procbody(0,e33dad08,c0fde6d0,3db,c95e62cc,...) at g_down_procbody+0x9d fork_exit(c09f1050,0,e33dad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33dad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc96f8000 sched_switch(c96f8000,0,104,1b3,e33d7bdc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c2980,...) at mi_switch+0x243 sleepq_switch(c96f8000,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c119dda4,5c,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c119dda4,c119dd28,25c,c0fd09d2,0,...) at _sleep+0x39c g_io_schedule_up(c96f8000,0,c0fd2521,5f,e33d7cf4,...) at g_io_schedule_up+0x134 g_up_procbody(0,e33d7d08,c0fde6d0,3db,c95e62cc,...) at g_up_procbody+0x9d fork_exit(c09f10f0,0,e33d7d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33d7d40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc95e92f0 sched_switch(c95e92f0,0,104,1b3,e33d4bd8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c2d00,...) at mi_switch+0x243 sleepq_switch(c95e92f0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c119dd9c,5c,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c119dd9c,c119dccc,25c,c0fd09d2,0,...) at _sleep+0x39c g_run_events(c11aeb80,0,c0fd2521,79,e33d4cf4,...) at g_run_events+0x54b g_event_procbody(0,e33d4d08,c0fde6d0,3db,c95e62cc,...) at g_event_procbody+0x90 fork_exit(c09f1190,0,e33d4d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33d4d40, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xcae355e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xcae358d0 sched_switch(cae358d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cae358d0,...) at mi_switch+0x243 ithread_loop(c962e340,efa45d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e340,efa45d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa45d40, ebp = 0 --- Tracing command intr pid 12 tid 100064 td 0xcae37000 sched_switch(cae37000,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cae37000,...) at mi_switch+0x243 ithread_loop(c962e2d0,efa35d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e2d0,efa35d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa35d40, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xcace68d0 sched_switch(cace68d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cace68d0,...) at mi_switch+0x243 ithread_loop(c962e660,efa29d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e660,efa29d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa29d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xcace6bc0 sched_switch(cace6bc0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cace6bc0,...) at mi_switch+0x243 ithread_loop(c962e370,efa21d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e370,efa21d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa21d40, ebp = 0 --- Tracing command intr pid 12 tid 100055 td 0xcacf5bc0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xcace5bc0 sched_switch(cace5bc0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cace5bc0,...) at mi_switch+0x243 ithread_loop(c962e510,ef9e3d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e510,ef9e3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9e3d40, ebp = 0 --- Tracing command intr pid 12 tid 100037 td 0xcacc38d0 sched_switch(cacc38d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cacc38d0,...) at mi_switch+0x243 ithread_loop(c962e560,ef9d3d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e560,ef9d3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9d3d40, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xcacc58d0 sched_switch(cacc58d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cacc58d0,...) at mi_switch+0x243 ithread_loop(c962e5a0,ef9c3d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e5a0,ef9c3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef9c3d40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xcacc5bc0 sched_switch(cacc5bc0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,cacc5bc0,...) at mi_switch+0x243 ithread_loop(c962e690,ef86dd08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e690,ef86dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef86dd40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc96f82f0 sched_switch(c96f82f0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c96f82f0,...) at mi_switch+0x243 ithread_loop(c962e310,ef869d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e310,ef869d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef869d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc96f85e0 sched_switch(c96f85e0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c96f85e0,...) at mi_switch+0x243 ithread_loop(c962e350,ef763d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e350,ef763d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xef763d40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xc97d72f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100023 td 0xc97d78d0 sched_switch(c97d78d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c97d78d0,...) at mi_switch+0x243 ithread_loop(c962e770,e33f2d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e770,e33f2d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33f2d40, ebp = 0 --- Tracing command intr pid 12 tid 100019 td 0xc96f7000 sched_switch(c96f7000,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c96f7000,...) at mi_switch+0x243 ithread_loop(c962e780,e33e6d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e780,e33e6d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33e6d40, ebp = 0 --- Tracing command intr pid 12 tid 100018 td 0xc96f72f0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc95e95e0 sched_switch(c95e95e0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c95e95e0,...) at mi_switch+0x243 ithread_loop(c962e7a0,e33d1d08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e7a0,e33d1d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33d1d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xc95e98d0 sched_switch(c95e98d0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c95e98d0,...) at mi_switch+0x243 ithread_loop(c962e7b0,e33ced08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e7b0,e33ced08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33ced40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc95e9bc0 sched_switch(c95e9bc0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c95e9bc0,...) at mi_switch+0x243 ithread_loop(c962e7c0,e33cbd08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e7c0,e33cbd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33cbd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc962f000 cpustop_handler(0,c93fdb3c,c0e0ff23,6c1500,c962f000,...) at cpustop_handler+0x26 ipi_nmi_handler(6c1500,c962f000,c1825cb4,c1825c80,c95e6598,...) at ipi_nmi_handler+0x35 trap(c93fdb48) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc054b82d, esp = 0xc93fdb88, ebp = 0xc93fdb98 --- acpi_timer_get_timecount_safe(c105a6c0,1,c93fdbd0,c08d8264,c08d8000,...) at acpi_timer_get_timecount_safe+0x1d binuptime(c93fdc4c,1,c0fe5dd2,1e7,c11af880,...) at binuptime+0x3d softclock(c11a1f40,c11aeb80,4,c0fe26c7,c9630138,...) at softclock+0x30b intr_event_execute_handlers(c95e6598,c9630100,c0fde9f3,561,c962f000,...) at intr_event_execute_handlers+0x125 ithread_loop(c962e7d0,c93fdd08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0xa9 fork_exit(c0a64d70,c962e7d0,c93fdd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93fdd40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xc962f2f0 sched_switch(c962f2f0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fde9f3,557,c962f2f0,...) at mi_switch+0x243 ithread_loop(c962e7e0,c93fad08,c0fde6d0,3db,c95e6598,...) at ithread_loop+0x1fb fork_exit(c0a64d70,c962e7e0,c93fad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93fad40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc962f5e0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xc95e8000 sched_switch(c95e8000,0,108,1ae,c0a7e662,...) at sched_switch+0x453 mi_switch(108,0,c0fe68ec,3e3,c95e8000,...) at mi_switch+0x243 sched_idletd(0,c93f3d08,c0fde6d0,3db,c95e6864,...) at sched_idletd+0x17c fork_exit(c0aba2c0,0,c93f3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93f3d40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc95e82f0 sched_switch(c95e82f0,0,108,1ae,c0a7e662,...) at sched_switch+0x453 mi_switch(108,0,c0fe68ec,3e3,c95e82f0,...) at mi_switch+0x243 sched_idletd(0,c93f0d08,c0fde6d0,3db,c95e6864,...) at sched_idletd+0x17c fork_exit(c0aba2c0,0,c93f0d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93f0d40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc95e85e0 sched_switch(c95e85e0,0,108,1ae,c0a7e662,...) at sched_switch+0x453 mi_switch(108,0,c0fe68ec,3e3,c95e85e0,...) at mi_switch+0x243 sched_idletd(0,c93edd08,c0fde6d0,3db,c95e6864,...) at sched_idletd+0x17c fork_exit(c0aba2c0,0,c93edd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93edd40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xc95e88d0 sched_switch(c95e88d0,0,108,1ae,c0a7e662,...) at sched_switch+0x453 mi_switch(108,0,c0fe68ec,3e3,c95e88d0,...) at mi_switch+0x243 sched_idletd(0,c93ead08,c0fde6d0,3db,c95e6864,...) at sched_idletd+0x17c fork_exit(c0aba2c0,0,c93ead08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93ead40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc95e8bc0 sched_switch(c95e8bc0,0,104,1b3,c93e6aac,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0a7fbea,...) at mi_switch+0x243 sleepq_switch(c95e8bc0,0,c0fea300,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fea300,165,0,100,100,...) at sleepq_catch_signals+0xfc sleepq_wait_sig(c95e6b30,6c,c0fed238,100,0,...) at sleepq_wait_sig+0x17 _sleep(c95e6b30,c95e6bb8,16c,c0fed238,0,...) at _sleep+0x385 kern_wait(c95e8bc0,ffffffff,c93e6c38,0,0,...) at kern_wait+0x597 sys_wait4(c95e8bc0,c93e6ccc,c103885c,c0fed086,c1039e70,...) at sys_wait4+0x3b syscall(c93e6d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x80606bf, esp = 0xbfbfd8ec, ebp = 0xbfbfd908 --- Tracing command audit pid 10 tid 100001 td 0xc95e9000 sched_switch(c95e9000,0,104,1b3,c93e3be8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,eb,...) at mi_switch+0x243 sleepq_switch(c95e9000,0,c0fea300,26e,c95e9000,...) at sleepq_switch+0x1a7 sleepq_wait(c131f560,0,c93e3c6c,1,0,...) at sleepq_wait+0x6b _cv_wait(c131f560,c131f544,c1016777,194,c93e3ca4,...) at _cv_wait+0x260 audit_worker(0,c93e3d08,c0fde6d0,3db,c95e7000,...) at audit_worker+0x84 fork_exit(c0ca1dc0,0,c93e3d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc93e3d40, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xcae35000 sched_switch(cae35000,0,104,1b3,efa4ebc8,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,352,...) at mi_switch+0x243 sleepq_switch(cae35000,0,c0fea300,291,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c11a0d04,0,c0fd09d2,2,0,...) at sleepq_timedwait+0x6b _sleep(c11a0d04,0,0,c0fd09d2,bb8) at _sleep+0x36a pause(c0fd09d2,bb8,12b,129,c119dfe8,...) at pause+0xa0 deadlkres(0,efa4ed08,c0fde6d0,3db,c119df60,...) at deadlkres+0x324 fork_exit(c0a43e10,0,efa4ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa4ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xcae352f0 sched_switch(cae352f0,0,104,1b3,efa4bc18,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fea300,...) at mi_switch+0x243 sleepq_switch(cae352f0,0,c0fea300,26e,cae352f0,...) at sleepq_switch+0x1a7 sleepq_wait(cad2e000,0,c0fe53c1,c0fd09d2,0,...) at sleepq_wait+0x6b msleep_spin(cad2e000,cad2e018,c0fd09d2,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1381260,efa4bd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0x8f fork_exit(c0ad75b0,c1381260,efa4bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa4bd40, ebp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xcace65e0 sched_switch(cace65e0,0,104,1b3,efa2fc18,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fea300,...) at mi_switch+0x243 sleepq_switch(cace65e0,0,c0fea300,26e,cace65e0,...) at sleepq_switch+0x1a7 sleepq_wait(cad2ee40,0,c0fe53c1,c0fd09d2,0,...) at sleepq_wait+0x6b msleep_spin(cad2ee40,cad2ee58,c0fd09d2,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(cad3649c,efa2fd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0x8f fork_exit(c0ad75b0,cad3649c,efa2fd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xefa2fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xc96f8bc0 sched_switch(c96f8bc0,0,104,1b3,e33febfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c2880,...) at mi_switch+0x243 sleepq_switch(c96f8bc0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c9718300,0,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c9718300,c9718318,0,c0fd09d2,0,...) at _sleep+0x39c taskqueue_thread_loop(c11bd90c,e33fed08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ad75b0,c11bd90c,e33fed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33fed40, ebp = 0 --- Tracing command kernel pid 0 tid 100026 td 0xc97d7000 sched_switch(c97d7000,0,104,1b3,e33fbbfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c2840,...) at mi_switch+0x243 sleepq_switch(c97d7000,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c9718340,0,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c9718340,c9718358,0,c0fd09d2,0,...) at _sleep+0x39c taskqueue_thread_loop(c131fb44,e33fbd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ad75b0,c131fb44,e33fbd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33fbd40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xc97d75e0 sched_switch(c97d75e0,0,104,1b3,e33f5bfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c27c0,...) at mi_switch+0x243 sleepq_switch(c97d75e0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c97183c0,0,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c97183c0,c97183d8,0,c0fd09d2,0,...) at _sleep+0x39c taskqueue_thread_loop(c119e8f8,e33f5d08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ad75b0,c119e8f8,e33f5d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33f5d40, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc97d7bc0 sched_switch(c97d7bc0,0,104,1b3,e33efc18,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fea300,...) at mi_switch+0x243 sleepq_switch(c97d7bc0,0,c0fea300,26e,c97d7bc0,...) at sleepq_switch+0x1a7 sleepq_wait(c9718540,0,c0fe53c1,c0fd09d2,0,...) at sleepq_wait+0x6b msleep_spin(c9718540,c9718558,c0fd09d2,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1167a98,e33efd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0x8f fork_exit(c0ad75b0,c1167a98,e33efd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33efd40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc962f8d0 sched_switch(c962f8d0,0,104,1b3,e33ecc18,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fea300,...) at mi_switch+0x243 sleepq_switch(c962f8d0,0,c0fea300,26e,c962f8d0,...) at sleepq_switch+0x1a7 sleepq_wait(c9718540,0,c0fe53c1,c0fd09d2,0,...) at sleepq_wait+0x6b msleep_spin(c9718540,c9718558,c0fd09d2,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1167a98,e33ecd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0x8f fork_exit(c0ad75b0,c1167a98,e33ecd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33ecd40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc962fbc0 sched_switch(c962fbc0,0,104,1b3,e33e9c18,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c0fea300,...) at mi_switch+0x243 sleepq_switch(c962fbc0,0,c0fea300,26e,c962fbc0,...) at sleepq_switch+0x1a7 sleepq_wait(c9718540,0,c0fe53c1,c0fd09d2,0,...) at sleepq_wait+0x6b msleep_spin(c9718540,c9718558,c0fd09d2,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1167a98,e33e9d08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0x8f fork_exit(c0ad75b0,c1167a98,e33e9d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33e9d40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xc96f78d0 sched_switch(c96f78d0,0,104,1b3,e33ddbfc,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,c95c2a00,...) at mi_switch+0x243 sleepq_switch(c96f78d0,0,c0fea300,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c95b40c0,0,c0fd09d2,0,0,...) at sleepq_wait+0x6b _sleep(c95b40c0,c95b40d8,0,c0fd09d2,0,...) at _sleep+0x39c taskqueue_thread_loop(c11bc300,e33ddd08,c0fde6d0,3db,c119df60,...) at taskqueue_thread_loop+0xb5 fork_exit(c0ad75b0,c11bc300,e33ddd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xe33ddd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc119e230 sched_switch(c119e230,0,104,1b3,c1820c5c,...) at sched_switch+0x453 mi_switch(104,0,c0fea300,1f8,352,...) at mi_switch+0x243 sleepq_switch(c119e230,0,c0fea300,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c119df60,54,c1017158,0,0,...) at sleepq_timedwait+0x6b _sleep(c119df60,0,54,c1017158,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x243 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 311 MB: 296 280 264 248 232 216 200 184 168 152 136 120 104 88 72 56 40 24 8 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 $ svn diff -x -p /var/tmp/vmcontention/sys -- Test scenario: $ ./altbufferflushes.sh vfs.dirtybufthresh: 1643 -> 10 08:42:14 Create big.1 08:43:40 Create big.2 08:44:34 Create big.3 08:46:35 Create big.4 vfs.altbufferflushes changed from 0 to 16455. 08:47:27 Create big.1 08:48:33 Create big.2 08:49:34 Create big.3 08:51:41 Create big.4 vfs.altbufferflushes changed from 16455 to 31616. 08:52:41 Create big.1 08:53:53 Create big.2 08:54:58 Create big.3 08:57:05 Create big.4 vfs.altbufferflushes changed from 31616 to 47493. 08:57:55 Create big.1 08:58:55 Create big.2 08:59:55 Create big.3 09:01:33 Create big.4 vfs.altbufferflushes changed from 47493 to 55017. 09:02:32 Create big.1 09:03:47 Create big.2 09:05:02 Create big.3 09:06:58 Create big.4 vfs.altbufferflushes changed from 55017 to 69734. 09:08:00 Create big.1 09:09:13 Create big.2 load: 6.79 cmd: dd 4461 [running] 1098.60r 0.00u 417.37s 39% 8960k load: 13.06 cmd: dd 4461 [runnable] 2651.20r 0.00u 809.33s 19% 8960k load: 11.81 cmd: dd 4461 [*vm page queue free mutex] 3548.29r 0.00u 980.09s 19% 8960k