GENERIC HEAD from Sat May 26 23:40:04 CEST 2012, r235885M, vmcore.375 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb 524288K of memory above 4GB ignored Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-CURRENT #15 r235885M: Sat May 26 23:40:04 CEST 2012 pho@x4.osted.lan:/usr/src/sys/i386/compile/MEMGUARD i386 WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. MEMGUARD DEBUGGING ALLOCATOR INITIALIZED: MEMGUARD map base: 0xc7c00000 MEMGUARD map limit: 0xca534000 MEMGUARD map size: 42192 KBytes CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x100f23 Family = 10 Model = 2 Stepping = 3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 3531436032 (3367 MB) : Trying to mount root from ufs:/dev/ad4s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. Entropy harvesting: interrupts ethernet point_to_point kickstart. Starting file system checks: /dev/ad4s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1a: clean, 614627 free (1307 frags, 76665 blocks, 0.1% fragmentation) /dev/ad4s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1f: clean, 123023 free (5295 frags, 14716 blocks, 0.5% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 80774908 free (2564 frags, 10096543 blocks, 0.0% fragmentation) /dev/ad4s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1d: clean, 2461906 free (205066 frags, 282105 blocks, 2.0% fragmentation) /dev/ad4s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ad4s1e: clean, 10046756 free (77732 frags, 1246128 blocks, 0.3% fragmentation) Mounting local file systems:. Setting hostname: x4.osted.lan. re0: link state changed to DOWN re0: link state changed to UP Starting Network: lo0 re0 fwe0 fwip0. lo0: flags=8049 metric 0 mtu 16384 options=3 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0xa inet 127.0.0.1 netmask 0xff000000 nd6 options=21 re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=29 media: Ethernet autoselect (100baseTX ) status: active fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 Starting devd. Starting Network: fwe0. fwe0: flags=8802 metric 0 mtu 1500 options=8 ether 02:dc:10:62:ad:eb nd6 options=29 ch 1 dma -1 Starting Network: fwip0. fwip0: flags=8802 metric 0 mtu 1500 lladdr 0.dc.10.0.1.62.ad.eb.a.2.ff.fe.0.0.0.0 nd6 options=29 add net default: gateway 192.168.1.1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/kde4/lib /usr/local/lib/compat /usr/local/lib/gcc46 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/qt4 /usr/local/lib/virtualbox a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Creating and/or trimming log files. Starting syslogd. No core dumps found. Additional ABI support: linux. Starting rpcbind. NFS access cache time=60 rpc.umntall: 127.0.0.1: MOUNTPROG: RPC: Program not registered Clearing /tmp (X related). Starting mountd. Starting nfsuserd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xcebd25c8 ufs (ufs) @ kern/vfs_lookup.c:542 2nd 0xe1928920 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:260 3rd 0xcebd1b38 ufs (ufs) @ kern/vfs_subr.c:2159 KDB: stack backtrace: db_trace_self_wrapper(c0fd8717,3a632e73,a303632,ffffff00,c119ecc0,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0ac35cb,c0fdc1fd,c12dabb0,86f,f2717324,...) at kdb_backtrace+0x2a _witness_debugger(c0fdc1fd,cebd1b38,c0fc4644,ca6bc540,c0fe425a,...) at _witness_debugger+0x25 witness_checkorder(cebd1b38,9,c0fe4251,86f,0,...) at witness_checkorder+0x86f __lockmgr_args(cebd1b38,80100,cebd1ba4,0,0,...) at __lockmgr_args+0x8c5 ffs_lock(f271742c,c0ad5cac,c0fe168b,5e2,c110b328,...) at ffs_lock+0xa1 VOP_LOCK1_APV(c113ab00,f271742c,ce555670,c114d0c0,cebd1ae0,...) at VOP_LOCK1_APV+0xf3 _vn_lock(cebd1ae0,80100,c0fe4251,86f,eb,...) at _vn_lock+0x78 vget(cebd1ae0,80100,ce5555c0,50,0,...) at vget+0xbb vfs_hash_get(ce486000,15ef55,80000,ce5555c0,f2717578,...) at vfs_hash_get+0xed ffs_vgetf(ce486000,15ef55,80000,f2717578,1,...) at ffs_vgetf+0x49 softdep_sync_buf(cebd2570,e19288c0,1,106,0,...) at softdep_sync_buf+0xac9 ffs_syncvnode(cebd2570,1,0,ce555670,c12daba0,...) at ffs_syncvnode+0x24c ffs_truncate(cebd2570,200,0,880,ce5b8880,...) at ffs_truncate+0x862 ufs_direnter(cebd2570,cebd1ae0,f27178e4,f2717b98,0,...) at ufs_direnter+0x93a ufs_makeinode(f2717b98,c113b040,f2717adc,f2717a38,c0e2a810,...) at ufs_makeinode+0x61c ufs_create(f2717adc,c102fdae,c114d340,cebd2570,f2717af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2717adc,f2717b98,f2717a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2717b58,f2717c20,1b0,0,ce5b8880,...) at vn_open_cred+0x205 vn_open(f2717b58,f2717c20,1b0,ce5b2ce8,4fc1c07f,...) at vn_open+0x3b kern_openat(ce5555c0,ffffff9c,28c72f60,0,a03,...) at kern_openat+0x1ec kern_open(ce5555c0,28c72f60,0,a02,1b0,...) at kern_open+0x35 sys_open(ce5555c0,f2717ccc,c10285fc,c0fdceef,c1029bb0,...) at sys_open+0x30 syscall(f2717d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x283d28d3, esp = 0xbfbfc4ec, ebp = 0xbfbfc578 --- . Updating motd:. Starting ntpd. Starting default moused. Expensive timeout(9) function: 0xc08cec80(0xc1331980) 0.013183519 s Configuring syscons: keymap blanktime. Starting sshd. Starting cron. Local package initialization: backuplock order reversal: 1st 0xce5e4c94 ufs (ufs) @ kern/vfs_mount.c:1254 2nd 0xce60d9dc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1834 KDB: stack backtrace: db_trace_self_wrapper(c0fd8717,38313a63,a3433,ceba29dc,8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0ac35cb,c0fdc1e4,c12da780,72a,f2704988,...) at kdb_backtrace+0x2a _witness_debugger(c0fdc1e4,ce60d9dc,c0fcf574,ca6bc408,c1009c75,...) at _witness_debugger+0x25 witness_checkorder(ce60d9dc,9,c1009c6c,72a,ce60da48,...) at witness_checkorder+0x86f __lockmgr_args(ce60d9dc,80400,ce60da48,0,0,...) at __lockmgr_args+0x8c5 vop_stdlock(f2704a8c,c130ffbc,4,c0fd2687,eb,...) at vop_stdlock+0x65 VOP_LOCK1_APV(c10fa6e0,f2704a8c,c130ffbc,c114d0c0,ce60d984,...) at VOP_LOCK1_APV+0xf3 _vn_lock(ce60d984,80400,c1009c6c,72a,0,...) at _vn_lock+0x78 softdep_flushworklist(ce4865b8,f2704b44,ce58f000,612,ce5d8220,...) at softdep_flushworklist+0x47 ffs_sync(ce4865b8,1,f2704b98,51f,c1bafe10,...) at ffs_sync+0x3b7 dounmount(ce4865b8,8080000,ce58f000,4a1,f2704c1c,...) at dounmount+0x3f8 sys_unmount(ce58f000,f2704ccc,c10285fc,c0fdceb2,c1029bb0,...) at sys_unmount+0x421 syscall(f2704d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (22, FreeBSD ELF32, sys_unmount), eip = 0x280beebb, esp = 0xbfbfe63c, ebp = 0xbfbfe708 --- ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes lock order reversal: 1st 0xe1939a20 bufwait (bufwait) @ kern/vfs_bio.c:2652 2nd 0xce99ea00 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:284 KDB: stack backtrace: db_trace_self_wrapper(c0fd8717,2e687361,38323a63,c1000a34,ce555670,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0ac35cb,c0fdc1e4,c12dab68,11c,f27177b0,...) at kdb_backtrace+0x2a _witness_debugger(c0fdc1e4,ce99ea00,c100db42,ca6bc5a8,c100d7d4,...) at _witness_debugger+0x25 witness_checkorder(ce99ea00,9,c100d7cb,11c,0,...) at witness_checkorder+0x86f _sx_xlock(ce99ea00,0,c100d7cb,11c,cee456cc,...) at _sx_xlock+0x9a ufsdirhash_acquire(e19399c0,cee456cc,f27178e4,e282a378,f2717880,...) at ufsdirhash_acquire+0x48 ufsdirhash_add(cee456cc,f27178e4,2378,f271786c,f2717870,...) at ufsdirhash_add+0x13 ufs_direnter(cee2f000,cebd1ae0,f27178e4,f2717b98,0,...) at ufs_direnter+0x749 ufs_makeinode(f2717b98,c113b040,f2717adc,f2717a38,c0e2a810,...) at ufs_makeinode+0x61c ufs_create(f2717adc,c102fdae,c114d340,cee2f000,f2717af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2717adc,f2717b98,f2717a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2717b58,f2717c20,180,0,ce548080,...) at vn_open_cred+0x205 vn_open(f2717b58,f2717c20,180,ce562310,0,...) at vn_open+0x3b kern_openat(ce5555c0,ffffff9c,bfbfe7ab,0,a02,...) at kern_openat+0x1ec kern_open(ce5555c0,bfbfe7ab,0,a01,180,...) at kern_open+0x35 sys_open(ce5555c0,f2717ccc,c10285fc,c0fdceef,c1029bb0,...) at sys_open+0x30 syscall(f2717d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x2829f8d3, esp = 0xbfbfe37c, ebp = 0xbfbfec18 --- May 27 07:52:51 x4 su: pho to root on /dev/pts/0 ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 5923 files, 37539073 used, 80774908 free (2564 frags, 10096543 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 5923 files, 37539073 used, 80774908 free (2564 frags, 10096543 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp watchdogd. Starting inetd. Sun May 27 07:55:25 CEST 2012 FreeBSD/i386 (x4.osted.lan) (console) login: 20120527 07:55:30 all: memguard.sh May 27 07:55:41 x4 kernel: pid 1585 (creat), uid 1004 inumber 1933 on /mnt: out of inodes May 27 07:55:42 x4 kernel: pid 1578 (creat), uid 1004 inumber 1925 on /mnt: out of inodes May 27 07:55:48 x4 kernel: pid 1591 (mkdir), uid 1004 inumber 2416 on /mnt: out of inodes May 27 07:55:50 x4 kernel: pid 1554 (rw), uid 1004 inumber 2409 on /mnt: filesystem full May 27 07:55:50 x4 kernel: pid 1561 (rw), uid 1004 inumber 1416 on /mnt: filesystem full May 27 07:55:51 x4 kernel: pid 1553 (rw), uid 1004 inumber 642 on /mnt: filesystem full May 27 07:56:00 x4 kernel: pid 1568 (creat), uid 1004 inumber 1300 on /mnt: out of inodes May 27 07:56:08 x4 kernel: pid 1575 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:56:17 x4 kernel: pid 1582 (creat), uid 1004 inumber 653 on /mnt: out of inodes May 27 07:56:29 x4 kernel: pid 1584 (creat), uid 1004 inumber 652 on /mnt: out of inodes May 27 07:56:34 x4 kernel: pid 1582 (creat), uid 1004 inumber 653 on /mnt: out of inodes May 27 07:56:37 x4 kernel: pid 1583 (creat), uid 1004 inumber 1927 on /mnt: out of inodes May 27 07:56:40 x4 kernel: pid 1588 (mkdir), uid 1004 inumber 505 on /mnt: out of inodes May 27 07:56:43 x4 kernel: pid 1586 (creat), uid 1004 inumber 1929 on /mnt: out of inodes May 27 07:56:49 x4 kernel: pid 1576 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:56:52 x4 kernel: pid 1575 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:56:54 x4 kernel: pid 1580 (creat), uid 1004 inumber 651 on /mnt: out of inodes May 27 07:56:58 x4 kernel: pid 1580 (creat), uid 1004 inumber 651 on /mnt: out of inodes May 27 07:57:04 x4 kernel: pid 1599 (mkdir), uid 1004 inumber 540 on /mnt: out of inodes May 27 07:57:06 x4 kernel: pid 1572 (creat), uid 1004 inumber 1932 on /mnt: out of inodes May 27 07:57:18 x4 kernel: pid 1568 (creat), uid 1004 inumber 1300 on /mnt: out of inodes May 27 07:57:23 x4 kernel: pid 1582 (creat), uid 1004 inumber 653 on /mnt: out of inodes May 27 07:57:25 x4 kernel: pid 1573 (creat), uid 1004 inumber 1296 on /mnt: out of inodes May 27 07:57:29 x4 kernel: pid 1572 (creat), uid 1004 inumber 1932 on /mnt: out of inodes May 27 07:57:55 x4 kernel: pid 2681 (rw), uid 1004 inumber 1927 on /mnt: filesystem full May 27 07:58:04 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:05 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:06 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:08 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:58:09 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:10 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:11 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:12 x4 kernel: pid 2676 (creat), uid 1004 inumber 645 on /mnt: out of inodes May 27 07:58:13 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:15 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:16 x4 kernel: pid 2674 (creat), uid 1004 inumber 1922 on /mnt: out of inodes May 27 07:58:17 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:58:18 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:58:19 x4 kernel: pid 2673 (creat), uid 1004 inumber 643 on /mnt: out of inodes May 27 07:58:20 x4 kernel: pid 2687 (creat), uid 1004 inumber 7 on /mnt: out of inodes May 27 07:58:21 x4 kernel: pid 2673 (creat), uid 1004 inumber 643 on /mnt: out of inodes May 27 07:58:23 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:58:24 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:25 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:26 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:58:27 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:58:28 x4 kernel: pid 2673 (creat), uid 1004 inumber 643 on /mnt: out of inodes May 27 07:58:29 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:58:30 x4 kernel: pid 2673 (creat), uid 1004 inumber 643 on /mnt: out of inodes May 27 07:58:31 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:32 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:34 x4 kernel: pid 2685 (creat), uid 1004 inumber 4 on /mnt: out of inodes May 27 07:58:35 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:36 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:38 x4 kernel: pid 2687 (creat), uid 1004 inumber 7 on /mnt: out of inodes May 27 07:58:39 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:58:40 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:41 x4 kernel: pid 2676 (creat), uid 1004 inumber 645 on /mnt: out of inodes May 27 07:58:42 x4 kernel: pid 2685 (creat), uid 1004 inumber 4 on /mnt: out of inodes May 27 07:58:43 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:58:45 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:58:47 x4 last message repeated 2 times May 27 07:58:48 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:58:49 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:58:51 x4 kernel: pid 2687 (creat), uid 1004 inumber 7 on /mnt: out of inodes May 27 07:58:52 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:58:53 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:58:54 x4 kernel: pid 2687 (creat), uid 1004 inumber 7 on /mnt: out of inodes May 27 07:58:55 x4 kernel: pid 2676 (creat), uid 1004 inumber 645 on /mnt: out of inodes May 27 07:58:56 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:58:58 x4 kernel: pid 2677 (creat), uid 1004 inumber 646 on /mnt: out of inodes May 27 07:58:59 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:59:00 x4 kernel: pid 2683 (creat), uid 1004 inumber 1928 on /mnt: out of inodes May 27 07:59:01 x4 kernel: pid 2678 (creat), uid 1004 inumber 1923 on /mnt: out of inodes May 27 07:59:02 x4 kernel: pid 2674 (creat), uid 1004 inumber 1922 on /mnt: out of inodes May 27 07:59:03 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:59:04 x4 kernel: pid 2685 (creat), uid 1004 inumber 4 on /mnt: out of inodes May 27 07:59:06 x4 kernel: pid 2677 (creat), uid 1004 inumber 646 on /mnt: out of inodes May 27 07:59:07 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:59:08 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:59:09 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes May 27 07:59:10 x4 kernel: pid 2676 (creat), uid 1004 inumber 645 on /mnt: out of inodes May 27 07:59:11 x4 kernel: pid 2673 (creat), uid 1004 inumber 643 on /mnt: out of inodes May 27 07:59:12 x4 kernel: pid 2686 (creat), uid 1004 inumber 1926 on /mnt: out of inodes May 27 07:59:13 x4 kernel: pid 2679 (creat), uid 1004 inumber 1920 on /mnt: out of inodes May 27 07:59:14 x4 kernel: pid 2674 (creat), uid 1004 inumber 1922 on /mnt: out of inodes May 27 07:59:15 x4 kernel: pid 2675 (creat), uid 1004 inumber 5 on /mnt: out of inodes May 27 07:59:16 x4 kernel: pid 2688 (creat), uid 1004 inumber 1924 on /mnt: out of inodes Kernel page fault with the following non-sleepable locks held: exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc130ffbc) locked @ ufs/ffs/ffs_softdep.c:4870 KDB: stack backtrace: db_trace_self_wrapper(c0fd8717,1,75ab3,ce8bc8a0,602,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0ac35b0,2,ffffffff,c12d9914,f2827594,...) at kdb_backtrace+0x2a _witness_debugger(c0fdbb10,f28275a8,4,1,0,...) at _witness_debugger+0x25 witness_warn(5,0,c1028540,f28275b4,c9f03f7c,...) at witness_warn+0x1fe trap_pfault(95b,0,d3a74246,4af,cee4b598,...) at trap_pfault+0x78 trap(f28276dc) at trap+0x5f1 calltrap() at calltrap+0x6 --- trap 0xc, eip = 0xc0cceb8d, esp = 0xf282771c, ebp = 0xf2827740 --- softdep_setup_inomapdep(e1969da0,cf1df074,62,81b0,0,...) at softdep_setup_inomapdep+0xed ffs_nodealloccg(cf1df074,0,4,0,81b0,...) at ffs_nodealloccg+0x5ab ffs_hashalloc(4,0,81b0,0,c0cb1d70,...) at ffs_hashalloc+0x85 ffs_valloc(cf52f828,81b0,cee5c880,f28278e0,cf52f828,...) at ffs_valloc+0x4d3 ufs_makeinode(f2827b98,c113b040,f2827adc,f2827a38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f2827adc,c102fdae,c114d340,cf52f828,f2827af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2827adc,f2827b98,f2827a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2827b58,f2827c20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f2827b58,f2827c20,1b0,ce5a2b98,c1ba9010,...) at vn_open+0x3b kern_openat(ce8bc8a0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce8bc8a0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce8bc8a0,f2827ccc,c10285fc,c0fbea91,c0ab1f37,...) at sys_open+0x30 syscall(f2827d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Fatal trap 12: page fault while in kernel mode cpuid = 1; apic id = 01 fault virtual address = 0xc9f03f7c fault code = supervisor read, page not present instruction pointer = 0x20:0xc0cceb8d stack pointer = 0x28:0xf282771c frame pointer = 0x28:0xf2827740 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 2685 (creat) [ thread pid 2685 tid 100129 ] Stopped at softdep_setup_inomapdep+0xed: movl 0xc(%edx),%eax db> run pho db:0:pho> bt Tracing pid 2685 tid 100129 td 0xce8bc8a0 softdep_setup_inomapdep(e1969da0,cf1df074,62,81b0,0,...) at softdep_setup_inomapdep+0xed ffs_nodealloccg(cf1df074,0,4,0,81b0,...) at ffs_nodealloccg+0x5ab ffs_hashalloc(4,0,81b0,0,c0cb1d70,...) at ffs_hashalloc+0x85 ffs_valloc(cf52f828,81b0,cee5c880,f28278e0,cf52f828,...) at ffs_valloc+0x4d3 ufs_makeinode(f2827b98,c113b040,f2827adc,f2827a38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f2827adc,c102fdae,c114d340,cf52f828,f2827af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2827adc,f2827b98,f2827a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2827b58,f2827c20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f2827b58,f2827c20,1b0,ce5a2b98,c1ba9010,...) at vn_open+0x3b kern_openat(ce8bc8a0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce8bc8a0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce8bc8a0,f2827ccc,c10285fc,c0fbea91,c0ab1f37,...) at sys_open+0x30 syscall(f2827d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- db:0:bt> show allpcpu Current CPU: 1 cpuid = 0 dynamic pcpu = 0x6d1380 curthread = 0xce5f98a0: pid 2683 "creat" curpcb = 0xf275ad60 fpcurthread = none idlethread = 0xca74e8a0: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x69c1380 curthread = 0xce8bc8a0: pid 2685 "creat" curpcb = 0xf2827d60 fpcurthread = none idlethread = 0xca74e5c0: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x69c4380 curthread = 0xce8bab80: pid 2678 "creat" curpcb = 0xf2833d60 fpcurthread = none idlethread = 0xca74e2e0: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x69c7380 curthread = 0xceec0b80: pid 2673 "creat" curpcb = 0xf2884d60 fpcurthread = none idlethread = 0xca74e000: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db:0:allpcpu> show alllocks Process 2687 (creat) thread 0xceeab000 (100153) exclusive lockmgr ufs (ufs) r = 0 (0xcf5c9df0) locked @ kern/vfs_lookup.c:542 Process 2686 (creat) thread 0xce58db80 (100117) exclusive lockmgr ufs (ufs) r = 0 (0xcf562c94) locked @ ufs/ffs/ffs_vfsops.c:1690 exclusive lockmgr ufs (ufs) r = 0 (0xcf4a546c) locked @ kern/vfs_lookup.c:542 Process 2685 (creat) thread 0xce8bc8a0 (100129) exclusive sleep mutex Softdep Lock (Softdep Lock) r = 0 (0xc130ffbc) locked @ ufs/ffs/ffs_softdep.c:4870 exclusive lockmgr bufwait (bufwait) r = 0 (0xe1969e00) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcf52f880) locked @ kern/vfs_lookup.c:542 Process 2683 (creat) thread 0xce5f98a0 (100097) exclusive lockmgr bufwait (bufwait) r = 0 (0xe197ad60) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcf500880) locked @ kern/vfs_subr.c:2159 exclusive lockmgr ufs (ufs) r = 0 (0xcf393b38) locked @ kern/vfs_lookup.c:542 Process 2679 (creat) thread 0xce554000 (100195) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19777c0) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 1 (0xcf279c94) locked @ kern/vfs_subr.c:2159 exclusive lockmgr ufs (ufs) r = 0 (0xcf143724) locked @ kern/vfs_lookup.c:542 Process 2678 (creat) thread 0xce8bab80 (100133) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1965820) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcf392880) locked @ ufs/ffs/ffs_vfsops.c:1690 exclusive lockmgr ufs (ufs) r = 0 (0xcf50c46c) locked @ kern/vfs_lookup.c:542 Process 2677 (creat) thread 0xce5515c0 (100200) exclusive lockmgr ufs (ufs) r = 0 (0xcf18ec94) locked @ kern/vfs_subr.c:2159 Process 2676 (creat) thread 0xce5518a0 (100199) exclusive lockmgr ufs (ufs) r = 0 (0xcf357310) locked @ kern/vfs_lookup.c:542 Process 2674 (creat) thread 0xcc67b8a0 (100113) exclusive lockmgr ufs (ufs) r = 0 (0xcefbb880) locked @ kern/vfs_lookup.c:542 Process 2673 (creat) thread 0xceec0b80 (100160) exclusive lockmgr bufwait (bufwait) r = 0 (0xe195bf60) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcf561724) locked @ kern/vfs_subr.c:2159 Process 19 (softdepflush) thread 0xce2028a0 (100078) exclusive lockmgr bufwait (bufwait) r = 0 (0xe1954da0) locked @ kern/vfs_bio.c:2652 exclusive lockmgr ufs (ufs) r = 0 (0xcf4fcb38) locked @ ufs/ffs/ffs_vfsops.c:1690 Process 16 (bufdaemon) thread 0xcc309b80 (100075) exclusive lockmgr bufwait (bufwait) r = 0 (0xe19574a0) locked @ kern/vfs_bio.c:2319 exclusive sleep mutex buf queue lock (buf queue lock) r = 0 (0xc1307f34) locked @ kern/vfs_bio.c:2389 db:0:alllocks> show lockedvnods Locked vnodes 0xcf3572b8: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcf2d9000 ref 0 pages 0 lock type ufs: EXCL by thread 0xce5518a0 (pid 2676, creat, tid 100199) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 645, on dev md5a 0xcf1436cc: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcf468128 ref 0 pages 0 lock type ufs: EXCL by thread 0xce554000 (pid 2679, creat, tid 100195) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b2fc31 at kern_unlinkat+0xa1 #7 0xc0b2feaf at kern_unlink+0x2f #8 0xc0b2fee2 at sys_unlink+0x22 #9 0xc0e025fe at syscall+0x2fe #10 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1920, on dev md5a 0xcefbb828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcf2e5de0 ref 0 pages 0 lock type ufs: EXCL by thread 0xcc67b8a0 (pid 2674, creat, tid 100113) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1922, on dev md5a 0xcf50c414: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcefcfde0 ref 0 pages 0 lock type ufs: EXCL by thread 0xce8bab80 (pid 2678, creat, tid 100133) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1923, on dev md5a 0xcf52f828: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xce891784 ref 0 pages 0 lock type ufs: EXCL by thread 0xce8bc8a0 (pid 2685, creat, tid 100129) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 4, on dev md5a 0xcf5c9d98: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcf4f2940 ref 0 pages 0 lock type ufs: EXCL by thread 0xceeab000 (pid 2687, creat, tid 100153) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 7, on dev md5a 0xcf4a5414: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcf125afc ref 0 pages 0 lock type ufs: EXCL by thread 0xce58db80 (pid 2686, creat, tid 100117) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b38760 at vn_open_cred+0x90 #7 0xc0b38ceb at vn_open+0x3b #8 0xc0b34f3c at kern_openat+0x1ec #9 0xc0b353e5 at kern_open+0x35 #10 0xc0b35420 at sys_open+0x30 #11 0xc0e025fe at syscall+0x2fe #12 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1926, on dev md5a 0xcf393ae0: tag ufs, type VDIR usecount 2, writecount 0, refcount 3 mountedhere 0 flags (VI(0x200)) v_object 0xcefc5534 ref 0 pages 0 lock type ufs: EXCL by thread 0xce5f98a0 (pid 2683, creat, tid 100097) #0 0xc0a6cea2 at __lockmgr_args+0x662 #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b1b2a6 at lookup+0x106 #5 0xc0b1c8ef at namei+0x6ff #6 0xc0b2fc31 at kern_unlinkat+0xa1 #7 0xc0b2feaf at kern_unlink+0x2f #8 0xc0b2fee2 at sys_unlink+0x22 #9 0xc0e025fe at syscall+0x2fe #10 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1928, on dev md5a 0xcf5616cc: tag ufs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VV_NOSYNC|VI_DOINGINACT|VI(0x200)) v_object 0xcf1352e4 ref 0 pages 0 lock type ufs: EXCL by thread 0xceec0b80 (pid 2673, creat, tid 100160) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b2bdab at vget+0xbb #5 0xc0b1a42d at vfs_hash_get+0xed #6 0xc0cddc69 at ffs_vgetf+0x49 #7 0xc0cde21e at ffs_vget+0x2e #8 0xc0ceb05f at ufs_lookup_ino+0x7ff #9 0xc0ceb40a at ufs_lookup+0x2a #10 0xc0e26b60 at VOP_CACHEDLOOKUP_APV+0x100 #11 0xc0b138c6 at vfs_cache_lookup+0xe6 #12 0xc0e2aa18 at VOP_LOOKUP_APV+0x108 #13 0xc0b1b88b at lookup+0x6eb #14 0xc0b1c8ef at namei+0x6ff #15 0xc0b2fc31 at kern_unlinkat+0xa1 #16 0xc0b2feaf at kern_unlink+0x2f #17 0xc0b2fee2 at sys_unlink+0x22 ino 1292, on dev md5a 0xcf279c3c: tag ufs, type VREG usecount 2, writecount 0, refcount 2 mountedhere 0 flags (VI(0x200)) v_object 0xcf59a250 ref 0 pages 0 lock type ufs: EXCL by thread 0xce554000 (pid 2679, creat, tid 100195) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b2bdab at vget+0xbb #5 0xc0b1a42d at vfs_hash_get+0xed #6 0xc0cddc69 at ffs_vgetf+0x49 #7 0xc0cde21e at ffs_vget+0x2e #8 0xc0ceb05f at ufs_lookup_ino+0x7ff #9 0xc0ceb40a at ufs_lookup+0x2a #10 0xc0e26b60 at VOP_CACHEDLOOKUP_APV+0x100 #11 0xc0b138c6 at vfs_cache_lookup+0xe6 #12 0xc0e2aa18 at VOP_LOOKUP_APV+0x108 #13 0xc0b1b88b at lookup+0x6eb #14 0xc0b1c8ef at namei+0x6ff #15 0xc0b2fc31 at kern_unlinkat+0xa1 #16 0xc0b2feaf at kern_unlink+0x2f #17 0xc0b2fee2 at sys_unlink+0x22 ino 2038, on dev md5a 0xcf18ec3c: tag ufs, type VREG usecount 0, writecount 0, refcount 1 mountedhere 0 flags (VV_NOSYNC|VI_DOINGINACT|VI(0x200)) v_object 0xcf656000 ref 0 pages 0 lock type ufs: EXCL by thread 0xce5515c0 (pid 2677, creat, tid 100200) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b2bdab at vget+0xbb #5 0xc0b1a42d at vfs_hash_get+0xed #6 0xc0cddc69 at ffs_vgetf+0x49 #7 0xc0cde21e at ffs_vget+0x2e #8 0xc0ceb05f at ufs_lookup_ino+0x7ff #9 0xc0ceb40a at ufs_lookup+0x2a #10 0xc0e26b60 at VOP_CACHEDLOOKUP_APV+0x100 #11 0xc0b138c6 at vfs_cache_lookup+0xe6 #12 0xc0e2aa18 at VOP_LOOKUP_APV+0x108 #13 0xc0b1b88b at lookup+0x6eb #14 0xc0b1c8ef at namei+0x6ff #15 0xc0b2fc31 at kern_unlinkat+0xa1 #16 0xc0b2feaf at kern_unlink+0x2f #17 0xc0b2fee2 at sys_unlink+0x22 ino 1337, on dev md5a 0xcf500828: tag ufs, type VREG usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI(0x200)) v_object 0xcf07b9d4 ref 0 pages 0 lock type ufs: EXCL by thread 0xce5f98a0 (pid 2683, creat, tid 100097) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0ce4961 at ffs_lock+0xa1 #2 0xc0e293d3 at VOP_LOCK1_APV+0xf3 #3 0xc0b39218 at _vn_lock+0x78 #4 0xc0b2bdab at vget+0xbb #5 0xc0b1a42d at vfs_hash_get+0xed #6 0xc0cddc69 at ffs_vgetf+0x49 #7 0xc0cde21e at ffs_vget+0x2e #8 0xc0ceb05f at ufs_lookup_ino+0x7ff #9 0xc0ceb40a at ufs_lookup+0x2a #10 0xc0e26b60 at VOP_CACHEDLOOKUP_APV+0x100 #11 0xc0b138c6 at vfs_cache_lookup+0xe6 #12 0xc0e2aa18 at VOP_LOOKUP_APV+0x108 #13 0xc0b1b88b at lookup+0x6eb #14 0xc0b1c8ef at namei+0x6ff #15 0xc0b2fc31 at kern_unlinkat+0xa1 #16 0xc0b2feaf at kern_unlink+0x2f #17 0xc0b2fee2 at sys_unlink+0x22 ino 2039, on dev md5a 0xcf562c3c: tag ufs, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI(0x200)) lock type ufs: EXCL by thread 0xce58db80 (pid 2686, creat, tid 100117) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0cddda9 at ffs_vgetf+0x189 #2 0xc0cde21e at ffs_vget+0x2e #3 0xc0cb1a60 at ffs_valloc+0x500 #4 0xc0cf1fa3 at ufs_makeinode+0xc3 #5 0xc0cf2830 at ufs_create+0x30 #6 0xc0e2a810 at VOP_CREATE_APV+0x100 #7 0xc0b388d5 at vn_open_cred+0x205 #8 0xc0b38ceb at vn_open+0x3b #9 0xc0b34f3c at kern_openat+0x1ec #10 0xc0b353e5 at kern_open+0x35 #11 0xc0b35420 at sys_open+0x30 #12 0xc0e025fe at syscall+0x2fe #13 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 1956, on dev md5a 0xcf392828: tag ufs, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI(0x200)) lock type ufs: EXCL by thread 0xce8bab80 (pid 2678, creat, tid 100133) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0cddda9 at ffs_vgetf+0x189 #2 0xc0cde21e at ffs_vget+0x2e #3 0xc0cb1a60 at ffs_valloc+0x500 #4 0xc0cf1fa3 at ufs_makeinode+0xc3 #5 0xc0cf2830 at ufs_create+0x30 #6 0xc0e2a810 at VOP_CREATE_APV+0x100 #7 0xc0b388d5 at vn_open_cred+0x205 #8 0xc0b38ceb at vn_open+0x3b #9 0xc0b34f3c at kern_openat+0x1ec #10 0xc0b353e5 at kern_open+0x35 #11 0xc0b35420 at sys_open+0x30 #12 0xc0e025fe at syscall+0x2fe #13 0xc0dec7d1 at Xint0x80_syscall+0x21 ino 2023, on dev md5a 0xcf4fcae0: tag ufs, type VNON usecount 1, writecount 0, refcount 1 mountedhere 0 flags (VI(0x200)) lock type ufs: EXCL by thread 0xce2028a0 (pid 19, softdepflush, tid 100078) #0 0xc0a6d5ad at __lockmgr_args+0xd6d #1 0xc0cddda9 at ffs_vgetf+0x189 #2 0xc0ccc766 at clear_inodedeps+0x1a6 #3 0xc0cd9bcc at softdep_process_worklist+0x9c #4 0xc0cda170 at softdep_flush+0x2a0 #5 0xc0a57e08 at fork_exit+0xb8 #6 0xc0dec7e4 at fork_trampoline+0x8 ino 98, on dev md5a db:0:lockedvnods> show mount 0xce486b70 /dev/ad4s1a on / (ufs) 0xce487000 devfs on /dev (devfs) 0xce486894 /dev/ad4s1f on /home (ufs) 0xce4862dc /dev/ad4s1d on /usr (ufs) 0xce486000 /dev/ad4s1e on /var (ufs) 0xce8af5b8 procfs on /proc (procfs) 0xce8af2dc /dev/label/tmp on /tmp (ufs) 0xcefe9000 /dev/md5a on /mnt (ufs) More info: show mount db:0:mount> ps pid ppid pgrp uid state wmesg wchan cmd 2688 2672 1540 1004 R+ creat 2687 2672 1540 1004 D+ getblk 0xe1969e00 creat 2686 2672 1540 1004 R+ creat 2685 2672 1540 1004 R+ CPU 1 creat 2683 2672 1540 1004 R+ CPU 0 creat 2679 2672 1540 1004 R+ creat 2678 2672 1540 1004 R+ CPU 2 creat 2677 2672 1540 1004 R+ creat 2676 2672 1540 1004 D+ getblk 0xe1969e00 creat 2675 2672 1540 1004 R+ creat 2674 2672 1540 1004 D+ softupda 0xc130ffd4 creat 2673 2672 1540 1004 R+ CPU 3 creat 2672 2670 1540 1004 S+ wait 0xce1f7598 creat 2671 1547 1540 1004 S+ nanslp 0xc1192064 mkdir 2670 1547 1540 1004 S+ nanslp 0xc1192064 creat 2669 1547 1540 1004 S+ nanslp 0xc1192064 rw 1547 1546 1540 1004 S+ wait 0xceea92cc run 1546 1545 1540 1004 S+ wait 0xcee4a000 run 1545 1540 1540 1004 S+ nanslp 0xc1192064 run 1540 1539 1540 1004 S+ wait 0xceeb6864 sh 1539 1513 1216 0 S+ wait 0xce585b30 su 1528 0 0 0 DL mdwait 0xce512800 [md5] 1513 1216 1216 0 S+ wait 0xceeb62cc sh 1409 1 1409 0 Ss+ ttyin 0xcc69d270 getty 1408 1 1408 0 Ss+ ttyin 0xcc69da70 getty 1407 1 1407 0 Ss+ ttyin 0xcc69e270 getty 1406 1 1406 0 Ss+ ttyin 0xcc69ea70 getty 1405 1 1405 0 Ss+ ttyin 0xcc12ca70 getty 1404 1 1404 0 Ss+ ttyin 0xcc12c270 getty 1403 1 1403 0 Ss+ ttyin 0xca87a270 getty 1402 1 1402 0 Ss+ ttyin 0xcc12d270 getty 1401 1 1401 0 Ss+ ttyin 0xca87ba70 getty 1384 1 1384 0 Ss select 0xcee753a4 inetd 1359 1 1359 0 Ss nanslp 0xc1192064 watchdogd 1216 1212 1216 0 S+ wait 0xcee4b000 sh 1212 1209 1212 0 S+ wait 0xcee4b2cc bash 1209 1208 1209 0 S+ pause 0xce54e324 csh 1208 1201 1208 1001 S+ wait 0xce624b30 su 1201 1200 1201 1001 Ss+ wait 0xcee4a2cc bash 1200 1198 1198 1001 S select 0xcee757a4 sshd 1198 1150 1198 0 Ss select 0xcee75ea4 sshd 1161 1 1161 0 Ss nanslp 0xc1192064 cron 1156 1 1156 25 Ss pause 0xce6105f0 sendmail 1153 1 1153 0 Ss select 0xcea938a4 sendmail 1150 1 1150 0 Ss select 0xce25c5a4 sshd 1118 1 1118 0 Ss select 0xcea935a4 moused 1093 1 1093 0 Ss select 0xce25a5a4 ntpd 1037 1033 1033 0 S (threaded) nfsd 100125 S rpcsvc 0xce381a90 nfsd: service 100124 S rpcsvc 0xce1c8190 nfsd: service 100123 S rpcsvc 0xce1c7490 nfsd: service 100114 S rpcsvc 0xce383190 nfsd: master 1033 1 1033 0 Ss select 0xce1df4a4 nfsd 1031 1027 1027 0 S select 0xce34a4a4 nfsuserd 1030 1027 1027 0 S select 0xcea932a4 nfsuserd 1029 1027 1027 0 S select 0xce34a2a4 nfsuserd 1028 1027 1027 0 S select 0xcea934a4 nfsuserd 1027 1 1027 0 Ss pause 0xce610324 nfsuserd 1011 1 1011 0 Ss select 0xce349da4 mountd 977 1 977 0 Ss select 0xcea946a4 rpcbind 962 1 962 0 Ss select 0xce25d8a4 syslogd 839 1 839 0 Ss select 0xce3494a4 devd 19 0 0 0 DL biowr 0xe1954d40 [softdepflush] 18 0 0 0 DL syncer 0xc1308254 [syncer] 17 0 0 0 DL vlruwt 0xce1f5598 [vnlru] 16 0 0 0 LL *Softdep 0xcf018300 [bufdaemon] 9 0 0 0 DL pgzero 0xc1311fdc [pagezero] 8 0 0 0 DL psleep 0xc1311b48 [vmdaemon] 7 0 0 0 DL psleep 0xc1311b10 [pagedaemon] 6 0 0 0 DL ccb_scan 0xc11549d4 [xpt_thrd] 5 0 0 0 DL waiting_ 0xc130b778 [sctp_iterator] 4 0 0 0 DL - 0xcc3ab23c [fdc0] 3 0 0 0 SL - 0xcc3b0000 [fw0_probe] 15 0 0 0 DL (threaded) [usb] 100059 D - 0xcc310d34 [usbus5] 100058 D - 0xcc310d04 [usbus5] 100057 D - 0xcc310cd4 [usbus5] 100056 D - 0xcc310ca4 [usbus5] 100054 D - 0xcc2ffb5c [usbus4] 100053 D - 0xcc2ffb2c [usbus4] 100052 D - 0xcc2ffafc [usbus4] 100051 D - 0xcc2ffacc [usbus4] 100050 D - 0xcc2eab5c [usbus3] 100049 D - 0xcc2eab2c [usbus3] 100048 D - 0xcc2eaafc [usbus3] 100047 D - 0xcc2eaacc [usbus3] 100046 D - 0xcc2dcb5c [usbus2] 100045 D - 0xcc2dcb2c [usbus2] 100044 D - 0xcc2dcafc [usbus2] 100043 D - 0xcc2dcacc [usbus2] 100041 D - 0xcc2bab5c [usbus1] 100040 D - 0xcc2bab2c [usbus1] 100039 D - 0xcc2baafc [usbus1] 100038 D - 0xcc2baacc [usbus1] 100036 D - 0xcc2adb5c [usbus0] 100035 D - 0xcc2adb2c [usbus0] 100034 D - 0xcc2adafc [usbus0] 100033 D - 0xcc2adacc [usbus0] 2 0 0 0 DL ctl_work 0xcaa64000 [ctl_thrd] 14 0 0 0 DL - 0xc1190e64 [yarrow] 13 0 0 0 RL (threaded) [geom] 100015 RunQ [g_down] 100014 L *Softdep 0xcf018300 [g_up] 100013 D - 0xc118df1c [g_event] 12 0 0 0 LL (threaded) [intr] 100067 I [irq12: psm0] 100066 I [irq1: atkbd0] 100064 I [swi0: uart] 100061 I [irq20: fwohci0] 100060 I [irq14: ata0] 100055 I [irq19: ehci0] 100042 I [irq18: ohci2 ohci4] 100037 I [irq17: ohci1 ohci3] 100032 I [irq16: hdac1 ohci0] 100031 I [irq22: ahci0] 100030 I [irq257: re0] 100029 I [irq256: hdac0] 100026 I [swi6: task queue] 100025 I [swi6: Giant taskq] 100022 I [swi5: +] 100018 I [swi2: cambio] 100012 I [swi4: clock] 100011 I [swi4: clock] 100010 I [swi4: clock] 100009 L *Softdep 0xcf018300 [swi4: clock] 100008 I [swi1: netisr 0] 100007 I [swi3: vm] 11 0 0 0 RL (threaded) [idle] 100006 CanRun [idle: cpu3] 100005 CanRun [idle: cpu2] 100004 CanRun [idle: cpu1] 100003 CanRun [idle: cpu0] 1 0 1 0 SLs wait 0xca74bb30 [init] 10 0 0 0 DL audit_wo 0xc130f6a0 [audit] 0 0 0 0 DLs (threaded) [kernel] 100069 D - 0xc1190e64 [deadlkres] 100068 D - 0xcc63c780 [mca taskq] 100062 D - 0xcc2cb180 [fw0_taskq] 100027 D - 0xcaa5f880 [kqueue taskq] 100024 D - 0xcaa5fc80 [thread taskq] 100023 D - 0xcaa5fe80 [ffs_trim taskq] 100021 D - 0xca8c8880 [acpi_task_2] 100020 D - 0xca8c8880 [acpi_task_1] 100019 D - 0xca8c8880 [acpi_task_0] 100016 D - 0xca870580 [firmware taskq] 100000 D sched 0xc118e0e0 [swapper] 2680 2669 1540 1004 Z+ rw 2684 2671 1540 1004 Z+ mkdir db:0:ps> allt Tracing command creat pid 2688 tid 100127 td 0xce8bd000 sched_switch(ce8bd000,0,207,1ae,b3,...) at sched_switch+0x453 mi_switch(207,0,c0fdaa9e,e0,28,...) at mi_switch+0x243 ast(f2821d08) at ast+0x2e8 doreti_ast() at doreti_ast+0x17 Tracing command creat pid 2687 tid 100153 td 0xceeab000 sched_switch(ceeab000,0,104,1b3,f286f5dc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ce5520c0,...) at mi_switch+0x243 sleepq_switch(ceeab000,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(e1969e00,60,c0fcc1f4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1969e00,81900,cefba7c4,c0fcc1f4,60,...) at __lockmgr_args+0xc86 getblk(cefba6cc,100,0,1000,0,...) at getblk+0x167 breadn_flags(cefba6cc,100,0,1000,0,...) at breadn_flags+0x43 ffs_nodealloccg(cefaad24,0,7,0,81b0,...) at ffs_nodealloccg+0x133 ffs_hashalloc(7,0,81b0,0,c0cb1d70,...) at ffs_hashalloc+0x85 ffs_valloc(cf5c9d98,81b0,cee5c880,f286f8e0,cf5c9d98,...) at ffs_valloc+0x4d3 ufs_makeinode(f286fb98,c113b040,f286fadc,f286fa38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f286fadc,c102fdae,c114d340,cf5c9d98,f286faf4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f286fadc,f286fb98,f286fa74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f286fb58,f286fc20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f286fb58,f286fc20,1b0,ceebe818,c1ba9010,...) at vn_open+0x3b kern_openat(ceeab000,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ceeab000,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ceeab000,f286fccc,c10285fc,c0fbea91,c1029bb0,...) at sys_open+0x30 syscall(f286fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2686 tid 100117 td 0xce58db80 sched_switch(ce58db80,0,104,1b3,f27ad610,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71b500,...) at mi_switch+0x243 sleepq_switch(ce58db80,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(e1965820,60,c0fcc1f4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1965820,81900,cefba7c4,c0fcc1f4,60,...) at __lockmgr_args+0xc86 getblk(cefba6cc,7940,0,8000,0,...) at getblk+0x167 breadn_flags(cefba6cc,7940,0,8000,0,...) at breadn_flags+0x43 ffs_vgetf(cefe9000,7a4,80000,f27ad8e0,0,...) at ffs_vgetf+0x3a4 ffs_vget(cefe9000,7a4,80000,f27ad8e0,c0cb1d70,...) at ffs_vget+0x2e ffs_valloc(cf4a5414,81b0,cee5c880,f27ad8e0,cf4a5414,...) at ffs_valloc+0x500 ufs_makeinode(f27adb98,c113b040,f27adadc,f27ada38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f27adadc,c102fdae,c114d340,cf4a5414,f27adaf4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f27adadc,f27adb98,f27ada74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f27adb58,f27adc20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f27adb58,f27adc20,1b0,ceebe850,c1ba9010,...) at vn_open+0x3b kern_openat(ce58db80,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce58db80,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce58db80,f27adccc,c10285fc,c0fbea91,c1029bb0,...) at sys_open+0x30 syscall(f27add08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2685 tid 100129 td 0xce8bc8a0 softdep_setup_inomapdep(e1969da0,cf1df074,62,81b0,0,...) at softdep_setup_inomapdep+0xed ffs_nodealloccg(cf1df074,0,4,0,81b0,...) at ffs_nodealloccg+0x5ab ffs_hashalloc(4,0,81b0,0,c0cb1d70,...) at ffs_hashalloc+0x85 ffs_valloc(cf52f828,81b0,cee5c880,f28278e0,cf52f828,...) at ffs_valloc+0x4d3 ufs_makeinode(f2827b98,c113b040,f2827adc,f2827a38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f2827adc,c102fdae,c114d340,cf52f828,f2827af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2827adc,f2827b98,f2827a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2827b58,f2827c20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f2827b58,f2827c20,1b0,ce5a2b98,c1ba9010,...) at vn_open+0x3b kern_openat(ce8bc8a0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce8bc8a0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce8bc8a0,f2827ccc,c10285fc,c0fbea91,c0ab1f37,...) at sys_open+0x30 syscall(f2827d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2683 tid 100097 td 0xce5f98a0 cpustop_handler(0,f275a988,c0e02af3,c1825c80,f275a8d8,...) at cpustop_handler+0x26 ipi_nmi_handler(c1825c80,f275a8d8,c0a752b3,c1825c80,ce5f32cc,...) at ipi_nmi_handler+0x35 trap(f275a994) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a75bce, esp = 0xf275a9d4, ebp = 0xf275aa28 --- _mtx_lock_sleep(c130ffbc,ce5f98a0,0,c1009c6c,30d7,...) at _mtx_lock_sleep+0x1fe _mtx_lock_flags(c130ffbc,0,c1009c6c,30d7,200000,...) at _mtx_lock_flags+0x10f softdep_slowdown(cf393ae0,cf34de0c,ceeca9f8,0,f275aa98,...) at softdep_slowdown+0x30 ufs_dirremove(cf393ae0,ceeca9f8,500800c,0,cf393ae0,...) at ufs_dirremove+0x1f7 ufs_remove(f275abf4,c102fca1,c114d340,cf393ae0,0,...) at ufs_remove+0x6e VOP_REMOVE_APV(c113ab00,f275abf4,cf500828,f275ab6c,eb,...) at VOP_REMOVE_APV+0x126 kern_unlinkat(ce5f98a0,ffffff9c,bfbfe728,0,0,...) at kern_unlinkat+0x258 kern_unlink(ce5f98a0,bfbfe728,0,f275acfc,c0e025fe,...) at kern_unlink+0x2f sys_unlink(ce5f98a0,f275accc,c10285fc,c1007286,c0fd672c,...) at sys_unlink+0x22 syscall(f275ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817652f, esp = 0xbfbfe6fc, ebp = 0xbfbfe7b8 --- Tracing command creat pid 2679 tid 100195 td 0xce554000 sched_switch(ce554000,0,104,1b3,f2900838,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71b500,...) at mi_switch+0x243 sleepq_switch(ce554000,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(e1965820,60,c0fcc1f4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1965820,81900,cefba7c4,c0fcc1f4,60,...) at __lockmgr_args+0xc86 getblk(cefba6cc,7940,0,8000,0,...) at getblk+0x167 breadn_flags(cefba6cc,7940,0,8000,0,...) at breadn_flags+0x43 ffs_update(cf279c3c,0,c1009c6c,2464,1,...) at ffs_update+0x1c2 handle_workitem_remove(c130ffbc,0,c1009c6c,2129,c92d5f70,...) at handle_workitem_remove+0x478 softdep_setup_remove(e1977760,cf53432c,cf57532c,0,f2900a98,...) at softdep_setup_remove+0x1bb ufs_dirremove(cf1436cc,cf57532c,500800c,0,cf1436cc,...) at ufs_dirremove+0x1ec ufs_remove(f2900bf4,c102fca1,c114d340,cf1436cc,0,...) at ufs_remove+0x6e VOP_REMOVE_APV(c113ab00,f2900bf4,cf279c3c,f2900b6c,eb,...) at VOP_REMOVE_APV+0x126 kern_unlinkat(ce554000,ffffff9c,bfbfe728,0,0,...) at kern_unlinkat+0x258 kern_unlink(ce554000,bfbfe728,0,f2900cfc,c0e025fe,...) at kern_unlink+0x2f sys_unlink(ce554000,f2900ccc,c10285fc,c1007286,c0fd672c,...) at sys_unlink+0x22 syscall(f2900d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817652f, esp = 0xbfbfe6fc, ebp = 0xbfbfe7b8 --- Tracing command creat pid 2678 tid 100133 td 0xce8bab80 cpustop_handler(2,f2833684,c0e02af3,c7b18c80,f28335d4,...) at cpustop_handler+0x26 ipi_nmi_handler(c7b18c80,f28335d4,c0a752b3,c7b18c80,cee4a864,...) at ipi_nmi_handler+0x35 trap(f2833690) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a75bb2, esp = 0xf28336d0, ebp = 0xf2833724 --- _mtx_lock_sleep(c130ffbc,ce8bab80,0,c1009c6c,2cf1,...) at _mtx_lock_sleep+0x1e2 _mtx_lock_flags(c130ffbc,0,c1009c6c,2cf1,0,...) at _mtx_lock_flags+0x10f softdep_load_inodeblock(cf643414,cf643414,cefed000,7e7,0,...) at softdep_load_inodeblock+0x36 ffs_vgetf(cefe9000,7e7,80000,f28338e0,0,...) at ffs_vgetf+0x464 ffs_vget(cefe9000,7e7,80000,f28338e0,c0cb1d70,...) at ffs_vget+0x2e ffs_valloc(cf50c414,81b0,cee5c880,f28338e0,cf50c414,...) at ffs_valloc+0x500 ufs_makeinode(f2833b98,c113b040,f2833adc,f2833a38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f2833adc,c102fdae,c114d340,cf50c414,f2833af4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f2833adc,f2833b98,f2833a74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f2833b58,f2833c20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f2833b58,f2833c20,1b0,cefc0d90,c1ba9010,...) at vn_open+0x3b kern_openat(ce8bab80,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce8bab80,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce8bab80,f2833ccc,c10285fc,c0fbea91,c0fd672c,...) at sys_open+0x30 syscall(f2833d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2677 tid 100200 td 0xce5515c0 sched_switch(ce5515c0,0,103,1ae,c11a0040,...) at sched_switch+0x453 mi_switch(103,0,c0fdaaf0,2e7,cefba7c4,...) at mi_switch+0x243 turnstile_wait(ce58c680,ce8bd000,0,1c5,c12d9b20,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(cefba7c4,ce5515c0,0,c0fe168b,a4e,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(cefba7c4,0,c0fe168b,a4e,f291197c,...) at _mtx_lock_flags+0x10f getblk(cefba6cc,5140,0,8000,0,...) at getblk+0xe3 breadn_flags(cefba6cc,5140,0,8000,0,...) at breadn_flags+0x43 ffs_update(cf18ec3c,0,81b0,f2911ab4,f2911a6c,...) at ffs_update+0x1c2 ufs_inactive(f2911ab4,c102f77d,eb,c113ab00,f2911a88,...) at ufs_inactive+0x32a VOP_INACTIVE_APV(c113ab00,f2911ab4,c0fe4251,9bf,f2911ae8,...) at VOP_INACTIVE_APV+0x100 vinactive(cf18ec3c,ce5515c0,c0fe4251,8be,0,...) at vinactive+0x127 vputx(f2911c14,c0b2fe33,cf18ec3c,ffffffdf,cf18ec3c,...) at vputx+0x370 vput(cf18ec3c,ffffffdf,cf18ec3c,f2911b6c,c119ecf0,...) at vput+0x10 kern_unlinkat(ce5515c0,ffffff9c,bfbfe728,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(ce5515c0,bfbfe728,0,f2911cfc,c0e025fe,...) at kern_unlink+0x2f sys_unlink(ce5515c0,f2911ccc,c10285fc,c1007286,c0ab1f37,...) at sys_unlink+0x22 syscall(f2911d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817652f, esp = 0xbfbfe6fc, ebp = 0xbfbfe7b8 --- Tracing command creat pid 2676 tid 100199 td 0xce5518a0 sched_switch(ce5518a0,0,104,1b3,f290d5dc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ce5520c0,...) at mi_switch+0x243 sleepq_switch(ce5518a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(e1969e00,60,c0fcc1f4,4,0,...) at sleepq_wait+0x63 __lockmgr_args(e1969e00,81900,cefba7c4,c0fcc1f4,60,...) at __lockmgr_args+0xc86 getblk(cefba6cc,100,0,1000,0,...) at getblk+0x167 breadn_flags(cefba6cc,100,0,1000,0,...) at breadn_flags+0x43 ffs_nodealloccg(cf528cb0,0,0,0,81b0,...) at ffs_nodealloccg+0x133 ffs_hashalloc(285,0,81b0,0,c0cb1d70,...) at ffs_hashalloc+0xdc ffs_valloc(cf3572b8,81b0,cee5c880,f290d8e0,cf3572b8,...) at ffs_valloc+0x4d3 ufs_makeinode(f290db98,c113b040,f290dadc,f290da38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f290dadc,c102fdae,c114d340,cf3572b8,f290daf4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f290dadc,f290db98,f290da74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f290db58,f290dc20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f290db58,f290dc20,1b0,cee522a0,c1ba9010,...) at vn_open+0x3b kern_openat(ce5518a0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(ce5518a0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(ce5518a0,f290dccc,c10285fc,c0fbea91,c0ab1f37,...) at sys_open+0x30 syscall(f290dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2675 tid 100161 td 0xceec08a0 sched_switch(ceec08a0,0,207,1ae,b3,...) at sched_switch+0x453 mi_switch(207,0,c0fdaa9e,e0,ceec08a0,...) at mi_switch+0x243 ast(f2887d08) at ast+0x2e8 doreti_ast() at doreti_ast+0x17 Tracing command creat pid 2674 tid 100113 td 0xcc67b8a0 sched_switch(cc67b8a0,0,104,1b3,f279c6c8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71b680,...) at mi_switch+0x243 sleepq_switch(cc67b8a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c130ffd4,74,c100a386,0,0,...) at sleepq_wait+0x63 _sleep(c130ffd4,c130ffbc,74,c100a386,0,...) at _sleep+0x39c request_cleanup(c130ffbc,0,c1009c6c,3129,0,...) at request_cleanup+0x19c softdep_request_cleanup(cefed000,cefbb828,cee5c880,2,c0cb1d70,...) at softdep_request_cleanup+0x117 ffs_valloc(cefbb828,81b0,cee5c880,f279c8e0,cefbb828,...) at ffs_valloc+0x767 ufs_makeinode(f279cb98,c113b040,f279cadc,f279ca38,c0e2a810,...) at ufs_makeinode+0xc3 ufs_create(f279cadc,c102fdae,c114d340,cefbb828,f279caf4,...) at ufs_create+0x30 VOP_CREATE_APV(c113ab00,f279cadc,f279cb98,f279ca74,0,...) at VOP_CREATE_APV+0x100 vn_open_cred(f279cb58,f279cc20,1b0,0,cee5c880,...) at vn_open_cred+0x205 vn_open(f279cb58,f279cc20,1b0,cf014a48,c1ba9010,...) at vn_open+0x3b kern_openat(cc67b8a0,ffffff9c,bfbfe728,0,602,...) at kern_openat+0x1ec kern_open(cc67b8a0,bfbfe728,0,601,1b0,...) at kern_open+0x35 sys_open(cc67b8a0,f279cccc,c10285fc,c0fbea91,c0ab1f37,...) at sys_open+0x30 syscall(f279cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (5, FreeBSD ELF32, sys_open), eip = 0x281808d3, esp = 0xbfbfe6dc, ebp = 0xbfbfe6f8 --- Tracing command creat pid 2673 tid 100160 td 0xceec0b80 cpustop_handler(3,f28848d0,c0e02af3,c7b1bc80,f2884820,...) at cpustop_handler+0x26 ipi_nmi_handler(c7b1bc80,f2884820,c0a752b3,c7b1bc80,ceeb7598,...) at ipi_nmi_handler+0x35 trap(f28848dc) at trap+0x33 calltrap() at calltrap+0x6 --- trap 0x13, eip = 0xc0a75bb6, esp = 0xf288491c, ebp = 0xf2884970 --- _mtx_lock_sleep(c130ffbc,ceec0b80,0,c1009c6c,2d27,...) at _mtx_lock_sleep+0x1e6 _mtx_lock_flags(c130ffbc,0,c1009c6c,2d27,cefe9000,...) at _mtx_lock_flags+0x10f softdep_update_inodeblock(cef113a0,e195bf00,0,8000,0,...) at softdep_update_inodeblock+0xed ffs_update(cf5616cc,0,81b0,f2884ab4,f2884a6c,...) at ffs_update+0x2aa ufs_inactive(f2884ab4,c102f77d,eb,c113ab00,f2884a88,...) at ufs_inactive+0x32a VOP_INACTIVE_APV(c113ab00,f2884ab4,c0fe4251,9bf,f2884ae8,...) at VOP_INACTIVE_APV+0x100 vinactive(cf5616cc,ceec0b80,c0fe4251,8be,0,...) at vinactive+0x127 vputx(f2884c14,c0b2fe33,cf5616cc,ffffffdf,cf5616cc,...) at vputx+0x370 vput(cf5616cc,ffffffdf,cf5616cc,f2884b6c,c0fd672c,...) at vput+0x10 kern_unlinkat(ceec0b80,ffffff9c,bfbfe728,0,0,...) at kern_unlinkat+0x2a3 kern_unlink(ceec0b80,bfbfe728,0,f2884cfc,c0e025fe,...) at kern_unlink+0x2f sys_unlink(ceec0b80,f2884ccc,c11a0040,f2884c98,c0ab1f37,...) at sys_unlink+0x22 syscall(f2884d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (10, FreeBSD ELF32, sys_unlink), eip = 0x2817652f, esp = 0xbfbfe6fc, ebp = 0xbfbfe7b8 --- Tracing command creat pid 2672 tid 100094 td 0xce5545c0 sched_switch(ce5545c0,0,104,1b3,f2743aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5545c0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce1f7598,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce1f7598,ce1f7620,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce5545c0,a71,f2743c38,0,0,...) at kern_wait+0x597 sys_wait4(ce5545c0,f2743ccc,c10285fc,c0fce73c,c0ab1f37,...) at sys_wait4+0x3b syscall(f2743d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e978b, esp = 0xbfbfe79c, ebp = 0xbfbfe7b8 --- Tracing command mkdir pid 2671 tid 100189 td 0xcf0a8000 sched_switch(cf0a8000,0,104,1b3,f28edae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f28edb08,...) at mi_switch+0x243 sleepq_switch(cf0a8000,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(3e9,c0ac9e30,cf0a8000,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,3e9,...) at _sleep+0x34f kern_nanosleep(cf0a8000,f28edc28,f28edc30,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cf0a8000,f28edccc,c10285fc,c0fdd48e,c1029bb0,...) at sys_nanosleep+0x6f syscall(f28edd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28167483, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command creat pid 2670 tid 100190 td 0xcf09fb80 sched_switch(cf09fb80,0,104,1b3,f28f0ae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f28f0b08,...) at mi_switch+0x243 sleepq_switch(cf09fb80,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(3e9,c0ac9e30,cf09fb80,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,3e9,...) at _sleep+0x34f kern_nanosleep(cf09fb80,f28f0c28,f28f0c30,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cf09fb80,f28f0ccc,c10285fc,c0fdd48e,c1029bb0,...) at sys_nanosleep+0x6f syscall(f28f0d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28167483, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command rw pid 2669 tid 100204 td 0xcf09e5c0 sched_switch(cf09e5c0,0,104,1b3,f291dae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f291db08,...) at mi_switch+0x243 sleepq_switch(cf09e5c0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(3e9,c0ac9e30,cf09e5c0,2,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,3e9,...) at _sleep+0x34f kern_nanosleep(cf09e5c0,f291dc28,f291dc30,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(cf09e5c0,f291dccc,c10285fc,c0fdd48e,c0ab1f37,...) at sys_nanosleep+0x6f syscall(f291dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28167483, esp = 0xbfbfe78c, ebp = 0xbfbfe7b8 --- Tracing command run pid 1547 tid 100147 td 0xceeac000 sched_switch(ceeac000,0,104,1b3,f285daac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceeac000,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ceea92cc,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ceea92cc,ceea9354,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ceeac000,a6d,f285dc38,0,0,...) at kern_wait+0x597 sys_wait4(ceeac000,f285dccc,c10285fc,c0fce73c,c1029bb0,...) at sys_wait4+0x3b syscall(f285dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e878b, esp = 0xbfbfe22c, ebp = 0xbfbfe248 --- Tracing command run pid 1546 tid 100136 td 0xce8ba2e0 sched_switch(ce8ba2e0,0,104,1b3,f283caac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8ba2e0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee4a000,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(cee4a000,cee4a088,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce8ba2e0,60b,f283cc38,0,0,...) at kern_wait+0x597 sys_wait4(ce8ba2e0,f283cccc,c0a8f428,f283cc98,c0ab1f37,...) at sys_wait4+0x3b syscall(f283cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x280e878b, esp = 0xbfbfe74c, ebp = 0xbfbfe768 --- Tracing command run pid 1545 tid 100096 td 0xce5f9b80 sched_switch(ce5f9b80,0,104,1b3,f2756ae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f2756b08,...) at mi_switch+0x243 sleepq_switch(ce5f9b80,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(3e9,c0ac9e30,ce5f9b80,3,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,3e9,...) at _sleep+0x34f kern_nanosleep(ce5f9b80,f2756c28,f2756c30,1,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ce5f9b80,f2756ccc,c10285fc,c0fdd48e,c1029bb0,...) at sys_nanosleep+0x6f syscall(f2756d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28166483, esp = 0xbfbfe73c, ebp = 0xbfbfe768 --- Tracing command sh pid 1540 tid 100164 td 0xceec0000 sched_switch(ceec0000,0,104,1b3,f2890aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceec0000,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ceeb6864,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ceeb6864,ceeb68ec,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ceec0000,ffffffff,f2890c38,2,0,...) at kern_wait+0x597 sys_wait4(ceec0000,f2890ccc,c10285fc,c0fdd017,c1029bb0,...) at sys_wait4+0x3b syscall(f2890d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815078b, esp = 0xbfbfe59c, ebp = 0xbfbfe5b8 --- Tracing command su pid 1539 tid 100116 td 0xce58e000 sched_switch(ce58e000,0,104,1b3,f27a9aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce58e000,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce585b30,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce585b30,ce585bb8,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce58e000,604,f27a9c38,2,0,...) at kern_wait+0x597 sys_wait4(ce58e000,f27a9ccc,c0a8f428,f27a9c98,c0ab1f37,...) at sys_wait4+0x3b syscall(f27a9d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810b78b, esp = 0xbfbfe2ec, ebp = 0xbfbfe308 --- Tracing command md5 pid 1528 tid 100167 td 0xceebf5c0 sched_switch(ceebf5c0,0,104,1b3,f2899bf0,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ce552b80,...) at mi_switch+0x243 sleepq_switch(ceebf5c0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(ce512800,5c,c0f740e2,0,0,...) at sleepq_wait+0x63 _sleep(ce512800,ce512820,25c,c0f740e2,0,...) at _sleep+0x39c md_kthread(ce512800,f2899d08,c0fce6b0,3d8,ceeb6000,...) at md_kthread+0x11a fork_exit(c07842a0,ce512800,f2899d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xf2899d40, ebp = 0 --- Tracing command sh pid 1513 tid 100166 td 0xceebf8a0 sched_switch(ceebf8a0,0,104,1b3,f2896aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceebf8a0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ceeb62cc,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ceeb62cc,ceeb6354,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ceebf8a0,ffffffff,f2896c38,2,0,...) at kern_wait+0x597 sys_wait4(ceebf8a0,f2896ccc,c10285fc,c0fdd017,c1029bb0,...) at sys_wait4+0x3b syscall(f2896d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815078b, esp = 0xbfbfe7dc, ebp = 0xbfbfe7f8 --- Tracing command getty pid 1409 tid 100140 td 0xce5f5000 sched_switch(ce5f5000,0,104,1b3,f28489fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5f5000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce5f5000,ce5f5000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc69d270,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc69d270,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc69d200,cc69d270,f2848c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc69d200,f2848c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc177900,f2848c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ceebe310,f2848c1c,ca71ee80,0,ce5f5000,...) at devfs_read_f+0x7e dofileread(f2848c1c,ffffffff,ffffffff,0,f2848bf8,...) at dofileread+0x9e kern_readv(ce5f5000,0,f2848c1c,f2848c3c,1,...) at kern_readv+0x68 sys_read(ce5f5000,f2848ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f2848d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1408 tid 100079 td 0xce555b80 sched_switch(ce555b80,0,104,1b3,f27009fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce555b80,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce555b80,ce555b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc69da70,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc69da70,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc69da00,cc69da70,f2700c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc69da00,f2700c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc177b00,f2700c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce5c1bd0,f2700c1c,ca71ee80,0,ce555b80,...) at devfs_read_f+0x7e dofileread(f2700c1c,ffffffff,ffffffff,0,f2700bf8,...) at dofileread+0x9e kern_readv(ce555b80,0,f2700c1c,f2700c3c,1,...) at kern_readv+0x68 sys_read(ce555b80,f2700ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f2700d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1407 tid 100146 td 0xceeac2e0 sched_switch(ceeac2e0,0,104,1b3,f285a9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceeac2e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ceeac2e0,ceeac2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc69e270,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc69e270,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc69e200,cc69e270,f285ac1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc69e200,f285ac1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc177d00,f285ac1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce5a2850,f285ac1c,ca71ee80,0,ceeac2e0,...) at devfs_read_f+0x7e dofileread(f285ac1c,ffffffff,ffffffff,0,f285abf8,...) at dofileread+0x9e kern_readv(ceeac2e0,0,f285ac1c,f285ac3c,1,...) at kern_readv+0x68 sys_read(ceeac2e0,f285accc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f285ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1406 tid 100121 td 0xce8bd8a0 sched_switch(ce8bd8a0,0,104,1b3,f27c69fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8bd8a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce8bd8a0,ce8bd8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc69ea70,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc69ea70,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc69ea00,cc69ea70,f27c6c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc69ea00,f27c6c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc177f00,f27c6c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce5b2ce8,f27c6c1c,ca71ee80,0,ce8bd8a0,...) at devfs_read_f+0x7e dofileread(f27c6c1c,ffffffff,ffffffff,0,f27c6bf8,...) at dofileread+0x9e kern_readv(ce8bd8a0,0,f27c6c1c,f27c6c3c,1,...) at kern_readv+0x68 sys_read(ce8bd8a0,f27c6ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f27c6d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1405 tid 100109 td 0xce2012e0 sched_switch(ce2012e0,0,104,1b3,f278d9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce2012e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce2012e0,ce2012e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc12ca70,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc12ca70,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc12ca00,cc12ca70,f278dc1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc12ca00,f278dc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc67c100,f278dc1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce561850,f278dc1c,ca71ee80,0,ce2012e0,...) at devfs_read_f+0x7e dofileread(f278dc1c,ffffffff,ffffffff,0,f278dbf8,...) at dofileread+0x9e kern_readv(ce2012e0,0,f278dc1c,f278dc3c,1,...) at kern_readv+0x68 sys_read(ce2012e0,f278dccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f278dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1404 tid 100138 td 0xce5fab80 sched_switch(ce5fab80,0,104,1b3,f28429fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5fab80,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce5fab80,ce5fab80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc12c270,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc12c270,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc12c200,cc12c270,f2842c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc12c200,f2842c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc67c300,f2842c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce5b2bd0,f2842c1c,ca71ee80,0,ce5fab80,...) at devfs_read_f+0x7e dofileread(f2842c1c,ffffffff,ffffffff,0,f2842bf8,...) at dofileread+0x9e kern_readv(ce5fab80,0,f2842c1c,f2842c3c,1,...) at kern_readv+0x68 sys_read(ce5fab80,f2842ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f2842d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1403 tid 100157 td 0xceec15c0 sched_switch(ceec15c0,0,104,1b3,f287b9fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceec15c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ceec15c0,ceec15c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca87a270,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca87a270,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(ca87a200,ca87a270,f287bc1c,1,0,...) at tty_wait+0x71 ttydisc_read(ca87a200,f287bc1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc67c500,f287bc1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce562348,f287bc1c,ca71ee80,0,ceec15c0,...) at devfs_read_f+0x7e dofileread(f287bc1c,ffffffff,ffffffff,0,f287bbf8,...) at dofileread+0x9e kern_readv(ceec15c0,0,f287bc1c,f287bc3c,1,...) at kern_readv+0x68 sys_read(ceec15c0,f287bccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f287bd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1402 tid 100090 td 0xce554b80 sched_switch(ce554b80,0,104,1b3,f27309fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce554b80,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,ce554b80,ce554b80,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc12d270,0,c0fdeec0,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cc12d270,c118fd90,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(cc12d200,cc12d270,f2730c1c,1,0,...) at tty_wait+0x71 ttydisc_read(cc12d200,f2730c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(cc67c700,f2730c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ce5611f8,f2730c1c,ca71ee80,0,ce554b80,...) at devfs_read_f+0x7e dofileread(f2730c1c,ffffffff,ffffffff,0,f2730bf8,...) at dofileread+0x9e kern_readv(ce554b80,0,f2730c1c,f2730c3c,1,...) at kern_readv+0x68 sys_read(ce554b80,f2730ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f2730d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command getty pid 1401 tid 100132 td 0xce8bc000 sched_switch(ce8bc000,0,104,1b3,f28309fc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8bc000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ca87ba04,0,c0fd2687,ce8bc000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca87ba70,0,f2830ac8,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ca87ba70,ca87ba04,c0fde898,527,0,...) at _cv_wait_sig+0x260 tty_wait(ca87ba00,ca87ba70,f2830c1c,1,0,...) at tty_wait+0x71 ttydisc_read(ca87ba00,f2830c1c,0,a1,0,...) at ttydisc_read+0x22c ttydev_read(ca869d00,f2830c1c,0,0,1,...) at ttydev_read+0xaa devfs_read_f(ceebe1f8,f2830c1c,ca71ee80,0,ce8bc000,...) at devfs_read_f+0x7e dofileread(f2830c1c,ffffffff,ffffffff,0,f2830bf8,...) at dofileread+0x9e kern_readv(ce8bc000,0,f2830c1c,f2830c3c,1,...) at kern_readv+0x68 sys_read(ce8bc000,f2830ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_read+0x4f syscall(f2830d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28189ed3, esp = 0xbfbfed6c, ebp = 0xbfbfeda8 --- Tracing command inetd pid 1384 tid 100145 td 0xceeac5c0 sched_switch(ceeac5c0,0,104,1b3,f2857964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ceeac5c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,cee75390,0,c0fd2687,ceeac5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee753a4,0,f2857a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cee753a4,cee75390,c0fdc858,6ae,ce5c1690,...) at _cv_wait_sig+0x260 seltdwait(ce5c1690,58,ca71ee80,ceeac5c0,202,...) at seltdwait+0xa2 kern_select(ceeac5c0,8,bfbfdf90,0,0,0,20,ceea9864,4) at kern_select+0x655 sys_select(ceeac5c0,f2857ccc,c10285fc,c0fdd084,c0ab1f37,...) at sys_select+0x66 syscall(f2857d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2819be53, esp = 0xbfbfdf4c, ebp = 0xbfbfedd8 --- Tracing command watchdogd pid 1359 tid 100128 td 0xce8bcb80 sched_switch(ce8bcb80,0,104,1b3,f2824ae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f2824b08,...) at mi_switch+0x243 sleepq_switch(ce8bcb80,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(ea61,c0ac9e30,ce8bcb80,1,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,ea61,...) at _sleep+0x34f kern_nanosleep(ce8bcb80,f2824c28,f2824c30,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ce8bcb80,f2824ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_nanosleep+0x6f syscall(f2824d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28181483, esp = 0xbfbfecac, ebp = 0xbfbfecd8 --- Tracing command sh pid 1216 tid 100131 td 0xce8bc2e0 sched_switch(ce8bc2e0,0,104,1b3,f282daac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8bc2e0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee4b000,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(cee4b000,cee4b088,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce8bc2e0,ffffffff,f282dc38,2,0,...) at kern_wait+0x597 sys_wait4(ce8bc2e0,f282dccc,c10285fc,c0fdd017,c0ab1f37,...) at sys_wait4+0x3b syscall(f282dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2815078b, esp = 0xbfbfe6fc, ebp = 0xbfbfe718 --- Tracing command bash pid 1212 tid 100130 td 0xce8bc5c0 sched_switch(ce8bc5c0,0,104,1b3,f282aaac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8bc5c0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee4b2cc,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(cee4b2cc,cee4b354,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce8bc5c0,ffffffff,f282ac38,6,0,...) at kern_wait+0x597 sys_wait4(ce8bc5c0,f282accc,c10285fc,c0fdcf37,c1029bb0,...) at sys_wait4+0x3b syscall(f282ad08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282ad78b, esp = 0xbfbfe76c, ebp = 0xbfbfe788 --- Tracing command csh pid 1209 tid 100085 td 0xce5552e0 sched_switch(ce5552e0,0,104,1b3,f271caf8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5552e0,0,c0fda100,1ac,74,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce54e324,74,c0e5ad2e,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce54e324,ce54e354,174,c0e5ad2e,0,...) at _sleep+0x385 kern_sigsuspend(ce5552e0,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ce5552e0,f271cccc,c10285fc,c0fdcf37,c1029bb0,...) at sys_sigsuspend+0x4d syscall(f271cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2816fd7b, esp = 0xbfbfe05c, ebp = 0xbfbfe0c8 --- Tracing command su pid 1208 tid 100137 td 0xce8ba000 sched_switch(ce8ba000,0,104,1b3,f283faac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8ba000,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce624b30,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce624b30,ce624bb8,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce8ba000,4b9,f283fc38,2,0,...) at kern_wait+0x597 sys_wait4(ce8ba000,f283fccc,c10285fc,c0fdd84e,c1029bb0,...) at sys_wait4+0x3b syscall(f283fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x2810b78b, esp = 0xbfbfe5ac, ebp = 0xbfbfe5c8 --- Tracing command bash pid 1201 tid 100135 td 0xce8ba5c0 sched_switch(ce8ba5c0,0,104,1b3,f2839aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce8ba5c0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee4a2cc,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(cee4a2cc,cee4a354,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ce8ba5c0,ffffffff,f2839c38,6,0,...) at kern_wait+0x597 sys_wait4(ce8ba5c0,f2839ccc,c10285fc,c0fdcf37,c0ab1f37,...) at sys_wait4+0x3b syscall(f2839d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x282ad78b, esp = 0xbfbfe97c, ebp = 0xbfbfe998 --- Tracing command sshd pid 1200 tid 100098 td 0xce202000 sched_switch(ce202000,0,104,1b3,f275f964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce202000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,cee75790,0,c0fd2687,ce202000,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee757a4,0,f275fa30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cee757a4,cee75790,c0fdc858,6ae,ce5c11c0,...) at _cv_wait_sig+0x260 seltdwait(ce5c11c0,58,cee71880,ce202000,ce2020b0,...) at seltdwait+0xa2 kern_select(ce202000,c,28c0c170,28c0c1b0,0,0,20,ce624598,0) at kern_select+0x655 sys_select(ce202000,f275fccc,c10285fc,c0fdd185,c0ab1f37,...) at sys_select+0x66 syscall(f275fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284dae53, esp = 0xbfbfde1c, ebp = 0xbfbfde68 --- Tracing command sshd pid 1198 tid 100093 td 0xce5548a0 sched_switch(ce5548a0,0,104,1b3,f273f9c8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5548a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,cee75e90,0,c0fd2687,ce5548a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cee75ea4,0,f273fa94,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cee75ea4,cee75e90,c0fdc858,6ae,f273fb1c,...) at _cv_wait_sig+0x260 seltdwait(ce60652c,c0fdc858,5ab,ce5548a0,696,...) at seltdwait+0xa2 sys_poll(ce5548a0,f273fccc,c10285fc,c0fbea91,c1029bb0,...) at sys_poll+0x321 syscall(f273fd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284723ab, esp = 0xbfbfde7c, ebp = 0xbfbfdeb8 --- Tracing command cron pid 1161 tid 100105 td 0xce5f55c0 sched_switch(ce5f55c0,0,104,1b3,f277dae4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,f277db08,...) at mi_switch+0x243 sleepq_switch(ce5f55c0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(ea61,c0ac9e30,ce5f55c0,0,100,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(c1192064,6c,c0fd5a64,100,0,...) at sleepq_timedwait_sig+0x1a _sleep(c1192064,0,16c,c0fd5a64,ea61,...) at _sleep+0x34f kern_nanosleep(ce5f55c0,f277dc28,f277dc30,3c,0,...) at kern_nanosleep+0xc1 sys_nanosleep(ce5f55c0,f277dccc,c10285fc,c0fdd48e,14,...) at sys_nanosleep+0x6f syscall(f277dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28174483, esp = 0xbfbfec3c, ebp = 0xbfbfec68 --- Tracing command sendmail pid 1156 tid 100110 td 0xce201000 sched_switch(ce201000,0,104,1b3,f2791af8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce201000,0,c0fda100,1ac,74,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce6105f0,74,c0e5ad2e,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce6105f0,ce610620,174,c0e5ad2e,0,...) at _sleep+0x385 kern_sigsuspend(ce201000,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(ce201000,f2791ccc,c10285fc,c0fdcf37,c1029bb0,...) at sys_sigsuspend+0x4d syscall(f2791d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x28322d7b, esp = 0xbfbfcf8c, ebp = 0xbfbfcfb8 --- Tracing command sendmail pid 1153 tid 100091 td 0xce5fa2e0 sched_switch(ce5fa2e0,0,104,1b3,f2736960,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce5fa2e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f27369f4,c0a7574a,cea93890,0,ce5fa2e0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cea938a4,0,f2736a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cea938a4,cea93890,1389,6ae,ce5a2c40,...) at _cv_timedwait_sig+0x270 seltdwait(f2736be8,f2736bf0,ce5b8880,ce5fa2e0,100,...) at seltdwait+0x8a kern_select(ce5fa2e0,5,bfbfc500,0,0,f2736c34,20,5,0) at kern_select+0x655 sys_select(ce5fa2e0,f2736ccc,c10285fc,c0fdd414,c1029bb0,...) at sys_select+0x66 syscall(f2736d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x283dae53, esp = 0xbfbfc46c, ebp = 0xbfbfcf98 --- Tracing command sshd pid 1150 tid 100104 td 0xce58e5c0 sched_switch(ce58e5c0,0,104,1b3,f2779964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce58e5c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce25c590,0,c0fd2687,ce58e5c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce25c5a4,0,f2779a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce25c5a4,ce25c590,c0fdc858,6ae,ce561a48,...) at _cv_wait_sig+0x260 seltdwait(ce561a48,58,ca71fe80,ce58e5c0,f2779af4,...) at seltdwait+0xa2 kern_select(ce58e5c0,7,28c0c140,0,0,0,20,ce5882cc,a) at kern_select+0x655 sys_select(ce58e5c0,f2779ccc,c10285fc,c0fbea91,c1029bb0,...) at sys_select+0x66 syscall(f2779d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x284dae53, esp = 0xbfbfdedc, ebp = 0xbfbfede8 --- Tracing command moused pid 1118 tid 100118 td 0xce58d8a0 sched_switch(ce58d8a0,0,104,1b3,f27b1964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce58d8a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,cea93590,0,c0fd2687,ce58d8a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cea935a4,0,f27b1a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(cea935a4,cea93590,c0fdc858,6ae,ce561ab8,...) at _cv_wait_sig+0x260 seltdwait(ce561ab8,58,ca71ee80,ce58d8a0,f6,...) at seltdwait+0xa2 kern_select(ce58d8a0,400,bfbfe9f4,0,0,0,20,ce585598,1) at kern_select+0x655 sys_select(ce58d8a0,f27b1ccc,c10285fc,c0e38ef2,c1029bb0,...) at sys_select+0x66 syscall(f27b1d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281a8e53, esp = 0xbfbfe98c, ebp = 0xbfbfeb18 --- Tracing command ntpd pid 1093 tid 100103 td 0xce5f58a0 sched_switch(ce5f58a0,0,104,1b3,f2775964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5f58a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce25a590,0,c0fd2687,ce5f58a0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce25a5a4,0,f2775a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce25a5a4,ce25a590,c0fdc858,6ae,ce562b98,...) at _cv_wait_sig+0x260 seltdwait(ce562b98,58,ca71ee80,ce5f58a0,0,...) at seltdwait+0xa2 kern_select(ce5f58a0,1c,bfbfecd8,0,0,0,20,ce5f02cc,0) at kern_select+0x655 sys_select(ce5f58a0,f2775ccc,c10285fc,c0fdd860,e,...) at sys_select+0x66 syscall(f2775d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28358e53, esp = 0xbfbfecac, ebp = 0xbfbfed78 --- Tracing command nfsd pid 1037 tid 100125 td 0xce5898a0 sched_switch(ce5898a0,0,104,1b3,f281bb28,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce5898a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f281bbbc,c0a7574a,cc37e080,0,ce5898a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce381a90,0,f281bbf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce381a90,cc37e080,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f281bcf4,c0a57e08,cc37e080,f281bd08,c0fce6b0,...) at svc_run_internal+0x356 svc_thread_start(cc37e080,f281bd08,c0fce6b0,3d8,ce5f4b30,...) at svc_thread_start+0x10 fork_exit(c0c871c0,cc37e080,f281bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1037 tid 100124 td 0xce589b80 sched_switch(ce589b80,0,104,1b3,f2818b28,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce589b80,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2818bbc,c0a7574a,cc37e080,0,ce589b80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce1c8190,0,f2818bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce1c8190,cc37e080,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2818cf4,c0a57e08,cc37e080,f2818d08,c0fce6b0,...) at svc_run_internal+0x356 svc_thread_start(cc37e080,f2818d08,c0fce6b0,3d8,ce5f4b30,...) at svc_thread_start+0x10 fork_exit(c0c871c0,cc37e080,f2818d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1037 tid 100123 td 0xce58d000 sched_switch(ce58d000,0,104,1b3,f2815b28,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce58d000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2815bbc,c0a7574a,cc37e080,0,ce58d000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce1c7490,0,f2815bf8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce1c7490,cc37e080,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(f2815cf4,c0a57e08,cc37e080,f2815d08,c0fce6b0,...) at svc_run_internal+0x356 svc_thread_start(cc37e080,f2815d08,c0fce6b0,3d8,ce5f4b30,...) at svc_thread_start+0x10 fork_exit(c0c871c0,cc37e080,f2815d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0x2e, eip = 0xc, esp = 0x33, ebp = 0x1 --- Tracing command nfsd pid 1037 tid 100114 td 0xcc67b5c0 sched_switch(cc67b5c0,0,104,1b3,f27a03d8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(cc67b5c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f27a046c,c0a7574a,cc37e080,0,cc67b5c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce383190,0,f27a04a8,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce383190,cc37e080,1388,3b1,0,...) at _cv_timedwait_sig+0x270 svc_run_internal(cc67b774,14,c10048ba,c0fbff9b,f27a07e8,...) at svc_run_internal+0x356 svc_run(cc37e080,0,c0fbff76,19f,c0a7567a,...) at svc_run+0x7b nfsrvd_nfsd(cc67b5c0,f27a07e8,c,c12db248,cc67b670,...) at nfsrvd_nfsd+0x1c3 nfssvc_nfsd(cc67b5c0,f27a0ccc,0,cc67b5c0,f27a0cfc,...) at nfssvc_nfsd+0x177 sys_nfssvc(cc67b5c0,f27a0ccc,c10285fc,c0fdd414,c1029bb0,...) at sys_nfssvc+0xeb syscall(f27a0d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280bf9bb, esp = 0xbfbfe81c, ebp = 0xbfbfea88 --- Tracing command nfsd pid 1033 tid 100115 td 0xcc67b2e0 sched_switch(cc67b2e0,0,104,1b3,f27a4964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(cc67b2e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce1df490,0,c0fd2687,cc67b2e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce1df4a4,0,f27a4a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce1df4a4,ce1df490,c0fdc858,6ae,ce5b2150,...) at _cv_wait_sig+0x260 seltdwait(ce5b2150,58,ca71ee80,cc67b2e0,0,...) at seltdwait+0xa2 kern_select(cc67b2e0,7,bfbfeca4,0,0,0,20,ce5f4864,1) at kern_select+0x655 sys_select(cc67b2e0,f27a4ccc,c10285fc,c0fdd414,c0fd672c,...) at sys_select+0x66 syscall(f27a4d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28176e53, esp = 0xbfbfea8c, ebp = 0xbfbfedd8 --- Tracing command nfsuserd pid 1031 tid 100089 td 0xce555000 sched_switch(ce555000,0,104,1b3,f272c960,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce555000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f272c9f4,c0a7574a,ce34a490,0,ce555000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce34a4a4,0,f272ca30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce34a4a4,ce34a490,7531,6ae,ce5617e0,...) at _cv_timedwait_sig+0x270 seltdwait(f272cbe8,f272cbf0,ca71ee80,ce555000,0,...) at seltdwait+0x8a kern_select(ce555000,4,bfbfebb4,0,0,f272cc34,20,1e,0) at kern_select+0x655 sys_select(ce555000,f272cccc,c10285fc,c0fdd16e,c1029bb0,...) at sys_select+0x66 syscall(f272cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28175e53, esp = 0xbfbfeb0c, ebp = 0xbfbfec48 --- Tracing command nfsuserd pid 1030 tid 100101 td 0xce5f9000 sched_switch(ce5f9000,0,104,1b3,f276d960,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce5f9000,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f276d9f4,c0a7574a,cea93290,0,ce5f9000,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cea932a4,0,f276da30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cea932a4,cea93290,7531,6ae,ce5617e0,...) at _cv_timedwait_sig+0x270 seltdwait(f276dbe8,f276dbf0,ca71ee80,ce5f9000,0,...) at seltdwait+0x8a kern_select(ce5f9000,4,bfbfebb4,0,0,f276dc34,20,1e,0) at kern_select+0x655 sys_select(ce5f9000,f276dccc,c10285fc,c0fdd16e,c1029bb0,...) at sys_select+0x66 syscall(f276dd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28175e53, esp = 0xbfbfeb0c, ebp = 0xbfbfec48 --- Tracing command nfsuserd pid 1029 tid 100087 td 0xce58eb80 sched_switch(ce58eb80,0,104,1b3,f2724960,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce58eb80,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f27249f4,c0a7574a,ce34a290,0,ce58eb80,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(ce34a2a4,0,f2724a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(ce34a2a4,ce34a290,7531,6ae,ce5617e0,...) at _cv_timedwait_sig+0x270 seltdwait(f2724be8,f2724bf0,ca71ee80,ce58eb80,0,...) at seltdwait+0x8a kern_select(ce58eb80,4,bfbfebb4,0,0,f2724c34,20,1e,0) at kern_select+0x655 sys_select(ce58eb80,f2724ccc,c10285fc,c0fdd16e,c1029bb0,...) at sys_select+0x66 syscall(f2724d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28175e53, esp = 0xbfbfeb0c, ebp = 0xbfbfec48 --- Tracing command nfsuserd pid 1028 tid 100099 td 0xce5f95c0 sched_switch(ce5f95c0,0,104,1b3,f2763960,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce5f95c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f27639f4,c0a7574a,cea93490,0,ce5f95c0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cea934a4,0,f2763a30,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cea934a4,cea93490,7531,6ae,ce5617e0,...) at _cv_timedwait_sig+0x270 seltdwait(f2763be8,f2763bf0,ca71ee80,ce5f95c0,0,...) at seltdwait+0x8a kern_select(ce5f95c0,4,bfbfebb4,0,0,f2763c34,20,1e,0) at kern_select+0x655 sys_select(ce5f95c0,f2763ccc,c10285fc,c0fdd16e,c1029bb0,...) at sys_select+0x66 syscall(f2763d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28175e53, esp = 0xbfbfeb0c, ebp = 0xbfbfec48 --- Tracing command nfsuserd pid 1027 tid 100111 td 0xcc67bb80 sched_switch(cc67bb80,0,104,1b3,f2794af8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(cc67bb80,0,c0fda100,1ac,74,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce610324,74,c0e5ad2e,100,0,...) at sleepq_wait_sig+0x17 _sleep(ce610324,ce610354,174,c0e5ad2e,0,...) at _sleep+0x385 kern_sigsuspend(cc67bb80,0,0,0,0,...) at kern_sigsuspend+0xba sys_sigsuspend(cc67bb80,f2794ccc,c10285fc,c0fdd414,c0ab1f37,...) at sys_sigsuspend+0x4d syscall(f2794d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x280bdd7b, esp = 0xbfbfec4c, ebp = 0xbfbfede8 --- Tracing command mountd pid 1011 tid 100082 td 0xce2022e0 sched_switch(ce2022e0,0,104,1b3,f270c964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce2022e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce349d90,0,c0fd2687,ce2022e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce349da4,0,f270ca30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce349da4,ce349d90,c0fdc858,6ae,ce562ce8,...) at _cv_wait_sig+0x260 seltdwait(ce562ce8,58,ca71ee80,ce2022e0,f270caa0,...) at seltdwait+0xa2 kern_select(ce2022e0,9,bfbfecf4,0,0,0,20,cc036864,bfbfecf4) at kern_select+0x655 sys_select(ce2022e0,f270cccc,c10285fc,c0fbdcf7,c1029bb0,...) at sys_select+0x66 syscall(f270cd08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2818de53, esp = 0xbfbfec8c, ebp = 0xbfbfedd8 --- Tracing command rpcbind pid 977 tid 100107 td 0xce2018a0 sched_switch(ce2018a0,0,104,1b3,f27859c4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,46,...) at mi_switch+0x243 sleepq_switch(ce2018a0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(f2785a58,c0a7574a,cea94690,0,ce2018a0,...) at sleepq_catch_signals+0xf9 sleepq_timedwait_sig(cea946a4,0,f2785a94,101,0,...) at sleepq_timedwait_sig+0x1a _cv_timedwait_sig(cea946a4,cea94690,7531,6ae,f2785b4c,...) at _cv_timedwait_sig+0x270 seltdwait(f2785c1c,f2785c24,5ab,ce2018a0,ce8c9bec,...) at seltdwait+0x8a sys_poll(ce2018a0,f2785ccc,c10285fc,c0fdd16e,c1029bb0,...) at sys_poll+0x321 syscall(f2785d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2812c3ab, esp = 0xbfbfcb9c, ebp = 0xbfbfed68 --- Tracing command syslogd pid 962 tid 100081 td 0xce2025c0 sched_switch(ce2025c0,0,104,1b3,f2708964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce2025c0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce25d890,0,c0fd2687,ce2025c0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce25d8a4,0,f2708a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce25d8a4,ce25d890,c0fdc858,6ae,ce562d58,...) at _cv_wait_sig+0x260 seltdwait(ce562d58,58,ca71ee80,ce2025c0,58,...) at seltdwait+0xa2 kern_select(ce2025c0,9,28849100,0,0,0,20,cc036b30,0) at kern_select+0x655 sys_select(ce2025c0,f2708ccc,c10285fc,c100a95c,c1029bb0,...) at sys_select+0x66 syscall(f2708d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2818de53, esp = 0xbfbfe28c, ebp = 0xbfbfedd8 --- Tracing command devd pid 839 tid 100100 td 0xce5f92e0 sched_switch(ce5f92e0,0,104,1b3,f2768964,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ce5f92e0,0,c0fda100,1ac,0,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0a7574a,ce349490,0,c0fd2687,ce5f92e0,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ce3494a4,0,f2768a30,101,0,...) at sleepq_wait_sig+0x17 _cv_wait_sig(ce3494a4,ce349490,c0fdc858,6ae,ce562658,...) at _cv_wait_sig+0x260 seltdwait(ce562658,58,ca71ee80,ce5f92e0,c12db178,...) at seltdwait+0xa2 kern_select(ce5f92e0,5,bfbfe950,0,0,0,20,ce5f0b30,46) at kern_select+0x655 sys_select(ce5f92e0,f2768ccc,c10285fc,c0e3412f,c1029bb0,...) at sys_select+0x66 syscall(f2768d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80893bb, esp = 0xbfbfe91c, ebp = 0xbfbfedf8 --- Tracing command softdepflush pid 19 tid 100078 td 0xce2028a0 sched_switch(ce2028a0,0,104,1b3,ee324a40,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ce58a1c0,...) at mi_switch+0x243 sleepq_switch(ce2028a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(e1954d40,5c,c0fe1a3b,0,0,...) at sleepq_wait+0x63 _sleep(e1954d40,ca6d06dc,5c,c0fe1a3b,0,...) at _sleep+0x39c bwait(e1954d40,5c,c0fe1a3b,e1954d40,ee324b48,...) at bwait+0x6f bufwait(e1954d40,e1954d40,cf263910,e1954d40,0,...) at bufwait+0x48 bufwrite(e1954d40,0,c100cb50,811,0) at bufwrite+0x165 ffs_bufwrite(e1954d40,cf295d00,100,8000,0,...) at ffs_bufwrite+0x290 ffs_update(cf4fcae0,1,c100d299,151,cefe9000,...) at ffs_update+0x3a5 ffs_syncvnode(cf4fcae0,1,0,ee324c58,1,...) at ffs_syncvnode+0x591 clear_inodedeps(c130ffd4,0,c1009c6c,5e9,cefeb300,...) at clear_inodedeps+0x21f softdep_process_worklist(cefe9000,0,c1009c6c,562,3e8,...) at softdep_process_worklist+0x9c softdep_flush(0,ee324d08,c0fce6b0,3d8,ce1f5000,...) at softdep_flush+0x2a0 fork_exit(c0cd9ed0,0,ee324d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee324d40, ebp = 0 --- Tracing command syncer pid 18 tid 100077 td 0xce202b80 sched_switch(ce202b80,0,104,1b3,ee321bcc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fd2687,...) at mi_switch+0x243 sleepq_switch(ce202b80,0,c0fda100,291,ce202b80,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1308254,0,ee321c58,1,0,...) at sleepq_timedwait+0x6b _cv_timedwait(c1308254,c1308240,3e8,783,4e20,...) at _cv_timedwait+0x270 sched_sync(0,ee321d08,c0fce6b0,3d8,ce1f52cc,...) at sched_sync+0x595 fork_exit(c0b2c0f0,0,ee321d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee321d40, ebp = 0 --- Tracing command vnlru pid 17 tid 100076 td 0xcc3098a0 sched_switch(cc3098a0,0,104,1b3,ee31ebc4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,348,...) at mi_switch+0x243 sleepq_switch(cc3098a0,0,c0fda100,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(ce1f5598,60,c0fe5275,0,0,...) at sleepq_timedwait+0x6b _sleep(ce1f5598,c1308214,260,c0fe5275,3e8,...) at _sleep+0x36a vnlru_proc(0,ee31ed08,c0fce6b0,3d8,ce1f5598,...) at vnlru_proc+0xe7 fork_exit(c0b2cdc0,0,ee31ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31ed40, ebp = 0 --- Tracing command bufdaemon pid 16 tid 100075 td 0xcc309b80 sched_switch(cc309b80,0,103,1ae,c119f340,...) at sched_switch+0x453 mi_switch(103,0,c0fdaaf0,2e7,c130ffbc,...) at mi_switch+0x243 turnstile_wait(cf018300,ce8bc8a0,0,1c5,ca6baba8,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c130ffbc,cc309b80,0,c1009c6c,32ca,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c130ffbc,0,c1009c6c,32ca,e1957440,...) at _mtx_lock_flags+0x10f softdep_count_dependencies(e1957440,0,c0fe168b,91c,0,...) at softdep_count_dependencies+0x30 flushbufqueues(d7,8c5,ce1f58ec,391,391,...) at flushbufqueues+0x450 buf_do_flush(ce1f5864,0,c0fe168b,8a6,3e8,...) at buf_do_flush+0x19 buf_daemon(0,ee31bd08,c0fce6b0,3d8,ce1f5864,...) at buf_daemon+0xea fork_exit(c0b0ede0,0,ee31bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee31bd40, ebp = 0 --- Tracing command pagezero pid 9 tid 100074 td 0xcc679000 sched_switch(cc679000,0,104,1b3,ee318c00,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,352,...) at mi_switch+0x243 sleepq_switch(cc679000,0,c0fda100,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1311fdc,0,c1013581,0,0,...) at sleepq_timedwait+0x6b _sleep(c1311fdc,c1310980,0,c1013581,493e0,...) at _sleep+0x36a vm_pagezero(0,ee318d08,c0fce6b0,3d8,ce1f5b30,...) at vm_pagezero+0xdc fork_exit(c0d1fa00,0,ee318d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee318d40, ebp = 0 --- Tracing command vmdaemon pid 8 tid 100073 td 0xcc6792e0 sched_switch(cc6792e0,0,104,1b3,ee315bc4,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71bd80,...) at mi_switch+0x243 sleepq_switch(cc6792e0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c1311b48,74,c0fe1fd2,0,0,...) at sleepq_wait+0x63 _sleep(c1311b48,c1311b4c,74,c0fe1fd2,0,...) at _sleep+0x39c vm_daemon(0,ee315d08,c0fce6b0,3d8,ce1f7000,...) at vm_daemon+0x59 fork_exit(c0d18fc0,0,ee315d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee315d40, ebp = 0 --- Tracing command pagedaemon pid 7 tid 100072 td 0xcc6795c0 sched_switch(cc6795c0,0,104,1b3,ee312b4c,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,352,...) at mi_switch+0x243 sleepq_switch(cc6795c0,0,c0fda100,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1311b10,54,c0fe1fd2,0,0,...) at sleepq_timedwait+0x6b _sleep(c1311b10,c1310980,54,c0fe1fd2,1388,...) at _sleep+0x36a vm_pageout(0,ee312d08,c0fce6b0,3d8,ca74c2cc,...) at vm_pageout+0x2c7 fork_exit(c0d1a040,0,ee312d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee312d40, ebp = 0 --- Tracing command xpt_thrd pid 6 tid 100071 td 0xcc6798a0 sched_switch(cc6798a0,0,104,1b3,ee18fbfc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71bd00,...) at mi_switch+0x243 sleepq_switch(cc6798a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c11549d4,5c,c0e2e91e,0,0,...) at sleepq_wait+0x63 _sleep(c11549d4,c1154a18,5c,c0e2e91e,0,...) at _sleep+0x39c xpt_scanner_thread(0,ee18fd08,c0fce6b0,3d8,ca74c598,...) at xpt_scanner_thread+0x47 fork_exit(c04a7df0,0,ee18fd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18fd40, ebp = 0 --- Tracing command sctp_iterator pid 5 tid 100070 td 0xcc679b80 sched_switch(cc679b80,0,104,1b3,ee18cc04,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71bcc0,...) at mi_switch+0x243 sleepq_switch(cc679b80,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c130b778,0,c0ff96bf,0,0,...) at sleepq_wait+0x63 _sleep(c130b778,c130b740,0,c0ff96bf,0,...) at _sleep+0x39c sctp_iterator_thread(0,ee18cd08,c0fce6b0,3d8,ca74c864,...) at sctp_iterator_thread+0x5c fork_exit(c0bc79a0,0,ee18cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee18cd40, ebp = 0 --- Tracing command fdc0 pid 4 tid 100065 td 0xcc67ab80 sched_switch(cc67ab80,0,104,1b3,ee17db4c,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,348,...) at mi_switch+0x243 sleepq_switch(cc67ab80,0,c0fda100,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(cc3ab23c,5c,c0fc0a12,0,0,...) at sleepq_timedwait+0x6b _sleep(cc3ab23c,cc3ab2f0,5c,c0fc0a12,3e8,...) at _sleep+0x36a fdc_thread(cc3ab200,ee17dd08,c0fce6b0,3d8,ca74cb30,...) at fdc_thread+0x27d fork_exit(c0da3c00,cc3ab200,ee17dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee17dd40, ebp = 0 --- Tracing command fw0_probe pid 3 tid 100063 td 0xcc2ca2e0 sched_switch(cc2ca2e0,0,104,1b3,ee16d6f0,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(cc2ca2e0,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(cc3b0000,6c,c0fc0a12,100,0,...) at sleepq_wait_sig+0x17 _sleep(cc3b0000,cc3b4488,16c,c0fc0a12,0,...) at _sleep+0x385 fw_bus_probe_thread(cc3b0000,ee16dd08,c0fce6b0,3d8,cc036000,...) at fw_bus_probe_thread+0xa08 fork_exit(c0702700,cc3b0000,ee16dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16dd40, ebp = 0 --- Tracing command usb pid 15 tid 100059 td 0xcc307000 sched_switch(cc307000,0,104,1b3,ee156c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc307000,0,c0fda100,26e,cc307000,...) at sleepq_switch+0x1a7 sleepq_wait(cc310d34,0,ee156c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc310d34,cc310e4c,c0fb2091,74,cc310d3c,...) at _cv_wait+0x260 usb_process(cc310d2c,ee156d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc310d2c,ee156d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee156d40, ebp = 0 --- Tracing command usb pid 15 tid 100058 td 0xcc3072e0 sched_switch(cc3072e0,0,104,1b3,ee153c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc3072e0,0,c0fda100,26e,cc3072e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc310d04,0,ee153c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc310d04,cc310e4c,c0fb2091,74,cc310d0c,...) at _cv_wait+0x260 usb_process(cc310cfc,ee153d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc310cfc,ee153d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee153d40, ebp = 0 --- Tracing command usb pid 15 tid 100057 td 0xcc3075c0 sched_switch(cc3075c0,0,104,1b3,ee150c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc3075c0,0,c0fda100,26e,cc3075c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc310cd4,0,ee150c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc310cd4,cc310e4c,c0fb2091,74,cc310cdc,...) at _cv_wait+0x260 usb_process(cc310ccc,ee150d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc310ccc,ee150d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee150d40, ebp = 0 --- Tracing command usb pid 15 tid 100056 td 0xcc3078a0 sched_switch(cc3078a0,0,104,1b3,ee14dc08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc3078a0,0,c0fda100,26e,cc3078a0,...) at sleepq_switch+0x1a7 sleepq_wait(cc310ca4,0,ee14dc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc310ca4,cc310e4c,c0fb2091,74,cc310cac,...) at _cv_wait+0x260 usb_process(cc310c9c,ee14dd08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc310c9c,ee14dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee14dd40, ebp = 0 --- Tracing command usb pid 15 tid 100054 td 0xcc309000 sched_switch(cc309000,0,104,1b3,ee144c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc309000,0,c0fda100,26e,cc309000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2ffb5c,0,ee144c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2ffb5c,cc2ffc74,c0fb2091,74,cc2ffb64,...) at _cv_wait+0x260 usb_process(cc2ffb54,ee144d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2ffb54,ee144d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee144d40, ebp = 0 --- Tracing command usb pid 15 tid 100053 td 0xcc3092e0 sched_switch(cc3092e0,0,104,1b3,ee141c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc3092e0,0,c0fda100,26e,cc3092e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2ffb2c,0,ee141c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2ffb2c,cc2ffc74,c0fb2091,74,cc2ffb34,...) at _cv_wait+0x260 usb_process(cc2ffb24,ee141d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2ffb24,ee141d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee141d40, ebp = 0 --- Tracing command usb pid 15 tid 100052 td 0xcc3095c0 sched_switch(cc3095c0,0,104,1b3,ee13ec08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc3095c0,0,c0fda100,26e,cc3095c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2ffafc,0,ee13ec8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2ffafc,cc2ffc74,c0fb2091,74,cc2ffb04,...) at _cv_wait+0x260 usb_process(cc2ffaf4,ee13ed08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2ffaf4,ee13ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13ed40, ebp = 0 --- Tracing command usb pid 15 tid 100051 td 0xcc2c8000 sched_switch(cc2c8000,0,104,1b3,ee13bc08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c8000,0,c0fda100,26e,cc2c8000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2ffacc,0,ee13bc8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2ffacc,cc2ffc74,c0fb2091,74,cc2ffad4,...) at _cv_wait+0x260 usb_process(cc2ffac4,ee13bd08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2ffac4,ee13bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee13bd40, ebp = 0 --- Tracing command usb pid 15 tid 100050 td 0xcc2c82e0 sched_switch(cc2c82e0,0,104,1b3,ee137c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c82e0,0,c0fda100,26e,cc2c82e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2eab5c,0,ee137c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2eab5c,cc2eac74,c0fb2091,74,cc2eab64,...) at _cv_wait+0x260 usb_process(cc2eab54,ee137d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2eab54,ee137d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee137d40, ebp = 0 --- Tracing command usb pid 15 tid 100049 td 0xcc2c85c0 sched_switch(cc2c85c0,0,104,1b3,ee134c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c85c0,0,c0fda100,26e,cc2c85c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2eab2c,0,ee134c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2eab2c,cc2eac74,c0fb2091,74,cc2eab34,...) at _cv_wait+0x260 usb_process(cc2eab24,ee134d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2eab24,ee134d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee134d40, ebp = 0 --- Tracing command usb pid 15 tid 100048 td 0xcc2c88a0 sched_switch(cc2c88a0,0,104,1b3,ee131c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c88a0,0,c0fda100,26e,cc2c88a0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2eaafc,0,ee131c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2eaafc,cc2eac74,c0fb2091,74,cc2eab04,...) at _cv_wait+0x260 usb_process(cc2eaaf4,ee131d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2eaaf4,ee131d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee131d40, ebp = 0 --- Tracing command usb pid 15 tid 100047 td 0xcc2c8b80 sched_switch(cc2c8b80,0,104,1b3,ee12ec08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c8b80,0,c0fda100,26e,cc2c8b80,...) at sleepq_switch+0x1a7 sleepq_wait(cc2eaacc,0,ee12ec8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2eaacc,cc2eac74,c0fb2091,74,cc2eaad4,...) at _cv_wait+0x260 usb_process(cc2eaac4,ee12ed08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2eaac4,ee12ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ed40, ebp = 0 --- Tracing command usb pid 15 tid 100046 td 0xcc2c9000 sched_switch(cc2c9000,0,104,1b3,ee12ac08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c9000,0,c0fda100,26e,cc2c9000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2dcb5c,0,ee12ac8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2dcb5c,cc2dcc74,c0fb2091,74,cc2dcb64,...) at _cv_wait+0x260 usb_process(cc2dcb54,ee12ad08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2dcb54,ee12ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee12ad40, ebp = 0 --- Tracing command usb pid 15 tid 100045 td 0xcc2c92e0 sched_switch(cc2c92e0,0,104,1b3,ee127c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c92e0,0,c0fda100,26e,cc2c92e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2dcb2c,0,ee127c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2dcb2c,cc2dcc74,c0fb2091,74,cc2dcb34,...) at _cv_wait+0x260 usb_process(cc2dcb24,ee127d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2dcb24,ee127d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee127d40, ebp = 0 --- Tracing command usb pid 15 tid 100044 td 0xcc2c95c0 sched_switch(cc2c95c0,0,104,1b3,ee124c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c95c0,0,c0fda100,26e,cc2c95c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2dcafc,0,ee124c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2dcafc,cc2dcc74,c0fb2091,74,cc2dcb04,...) at _cv_wait+0x260 usb_process(cc2dcaf4,ee124d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2dcaf4,ee124d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee124d40, ebp = 0 --- Tracing command usb pid 15 tid 100043 td 0xcc2c98a0 sched_switch(cc2c98a0,0,104,1b3,ee121c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2c98a0,0,c0fda100,26e,cc2c98a0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2dcacc,0,ee121c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2dcacc,cc2dcc74,c0fb2091,74,cc2dcad4,...) at _cv_wait+0x260 usb_process(cc2dcac4,ee121d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2dcac4,ee121d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee121d40, ebp = 0 --- Tracing command usb pid 15 tid 100041 td 0xcc2ca000 sched_switch(cc2ca000,0,104,1b3,ee11ac08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2ca000,0,c0fda100,26e,cc2ca000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2bab5c,0,ee11ac8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2bab5c,cc2bac74,c0fb2091,74,cc2bab64,...) at _cv_wait+0x260 usb_process(cc2bab54,ee11ad08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2bab54,ee11ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ad40, ebp = 0 --- Tracing command usb pid 15 tid 100040 td 0xcc266000 sched_switch(cc266000,0,104,1b3,ee117c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc266000,0,c0fda100,26e,cc266000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2bab2c,0,ee117c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2bab2c,cc2bac74,c0fb2091,74,cc2bab34,...) at _cv_wait+0x260 usb_process(cc2bab24,ee117d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2bab24,ee117d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee117d40, ebp = 0 --- Tracing command usb pid 15 tid 100039 td 0xcc2662e0 sched_switch(cc2662e0,0,104,1b3,ee114c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2662e0,0,c0fda100,26e,cc2662e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2baafc,0,ee114c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2baafc,cc2bac74,c0fb2091,74,cc2bab04,...) at _cv_wait+0x260 usb_process(cc2baaf4,ee114d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2baaf4,ee114d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee114d40, ebp = 0 --- Tracing command usb pid 15 tid 100038 td 0xcc2665c0 sched_switch(cc2665c0,0,104,1b3,ee111c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc2665c0,0,c0fda100,26e,cc2665c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2baacc,0,ee111c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2baacc,cc2bac74,c0fb2091,74,cc2baad4,...) at _cv_wait+0x260 usb_process(cc2baac4,ee111d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2baac4,ee111d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee111d40, ebp = 0 --- Tracing command usb pid 15 tid 100036 td 0xcc266b80 sched_switch(cc266b80,0,104,1b3,ee10ac08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc266b80,0,c0fda100,26e,cc266b80,...) at sleepq_switch+0x1a7 sleepq_wait(cc2adb5c,0,ee10ac8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2adb5c,cc2adc74,c0fb2091,74,cc2adb64,...) at _cv_wait+0x260 usb_process(cc2adb54,ee10ad08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2adb54,ee10ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ad40, ebp = 0 --- Tracing command usb pid 15 tid 100035 td 0xcc26c000 sched_switch(cc26c000,0,104,1b3,ee107c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc26c000,0,c0fda100,26e,cc26c000,...) at sleepq_switch+0x1a7 sleepq_wait(cc2adb2c,0,ee107c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2adb2c,cc2adc74,c0fb2091,74,cc2adb34,...) at _cv_wait+0x260 usb_process(cc2adb24,ee107d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2adb24,ee107d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee107d40, ebp = 0 --- Tracing command usb pid 15 tid 100034 td 0xcc26c2e0 sched_switch(cc26c2e0,0,104,1b3,ee104c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc26c2e0,0,c0fda100,26e,cc26c2e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2adafc,0,ee104c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2adafc,cc2adc74,c0fb2091,74,cc2adb04,...) at _cv_wait+0x260 usb_process(cc2adaf4,ee104d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2adaf4,ee104d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee104d40, ebp = 0 --- Tracing command usb pid 15 tid 100033 td 0xcc26c5c0 sched_switch(cc26c5c0,0,104,1b3,ee101c08,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(cc26c5c0,0,c0fda100,26e,cc26c5c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2adacc,0,ee101c8c,1,0,...) at sleepq_wait+0x63 _cv_wait(cc2adacc,cc2adc74,c0fb2091,74,cc2adad4,...) at _cv_wait+0x260 usb_process(cc2adac4,ee101d08,c0fce6b0,3d8,cc0362cc,...) at usb_process+0x1a3 fork_exit(c0930730,cc2adac4,ee101d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee101d40, ebp = 0 --- Tracing command ctl_thrd pid 2 tid 100028 td 0xca86f8a0 sched_switch(ca86f8a0,0,104,1b3,c7b72654,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71a8c0,...) at mi_switch+0x243 sleepq_switch(ca86f8a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(caa64000,5c,c0e39390,0,0,...) at sleepq_wait+0x63 _sleep(caa64000,caa64000,5c,c0e39390,0,...) at _sleep+0x39c ctl_work_thread(caa64000,c7b72d08,c0fce6b0,3d8,cc036598,...) at ctl_work_thread+0x22f6 fork_exit(c04d13d0,caa64000,c7b72d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b72d40, ebp = 0 --- Tracing command yarrow pid 14 tid 100017 td 0xca86d5c0 sched_switch(ca86d5c0,0,104,1b3,c7b50bd0,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,348,...) at mi_switch+0x243 sleepq_switch(ca86d5c0,0,c0fda100,291,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1190e64,0,c0fc0a12,2,0,...) at sleepq_timedwait+0x6b _sleep(c1190e64,0,0,c0fc0a12,64) at _sleep+0x36a pause(c0fc0a12,64,c0f8e0f0,111,0,...) at pause+0xa0 random_kthread(0,c7b50d08,c0fce6b0,3d8,ca74b000,...) at random_kthread+0x1ef fork_exit(c082dfa0,0,c7b50d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b50d40, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xca86db80 sched_switch(ca86db80,0,602,1ae,0,...) at sched_switch+0x453 mi_switch(602,0,c0fd4cff,cd,4,...) at mi_switch+0x243 critical_exit(ca86db80,0,1,7bd172b2,7bd172ad,...) at critical_exit+0xb5 ipi_bitmap_handler(8,28,28,0,7bd172ad,...) at ipi_bitmap_handler+0x82 Xipi_intr_bitmap_handler() at Xipi_intr_bitmap_handler+0x2f --- interrupt, eip = 0xc05439ba, esp = 0xc7b4ab38, ebp = 0xc7b4ab48 --- acpi_timer_get_timecount_safe(c104a920,0,200,0,c7b4ab6c,...) at acpi_timer_get_timecount_safe+0x2a binuptime(cebacb18,c0fc2269,cebacab0,ce38c880,ce205580,...) at binuptime+0x3d g_io_request(cebacab0,ce38c880,c0fc4903,2,ce47d5d8,...) at g_io_request+0x24a g_part_start(ce1e6ab0,0,200,0,0,...) at g_part_start+0x130 g_io_schedule_down(ca86db80,0,c0fc2561,6c,c7b4acf4,...) at g_io_schedule_down+0x281 g_down_procbody(0,c7b4ad08,c0fce6b0,3d8,ca74b2cc,...) at g_down_procbody+0x9d fork_exit(c09e7a50,0,c7b4ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4ad40, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xca86f000 sched_switch(ca86f000,0,103,1ae,c119f340,...) at sched_switch+0x453 mi_switch(103,0,c0fdaaf0,2e7,c130ffbc,...) at mi_switch+0x243 turnstile_wait(cf018300,ce8bc8a0,0,1c5,f,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c130ffbc,ca86f000,0,c1009c6c,28e3,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c130ffbc,0,c1009c6c,28e3,fffffff0,...) at _mtx_lock_flags+0x10f softdep_disk_write_complete(e196c640,ca86f0b0,c12dc408,c110b328,c1307f08,...) at softdep_disk_write_complete+0x4a bufdone_finish(e196c640,ce387e80,ce387e80,e196c640,c7b47c60,...) at bufdone_finish+0x26 bufdone(e196c640,0,c0fc34d7,9d,cefba790,cee9bc80) at bufdone+0x6a g_vfs_done(ce4424c0,0,c0fe168b,c56,ca86f000,...) at g_vfs_done+0x1d0 biodone(ce4424c0,c118dea8,25c,c0fc0a12,0,...) at biodone+0xa5 g_io_schedule_up(ca86f000,0,c0fc2561,5f,c7b47cf4,...) at g_io_schedule_up+0xde g_up_procbody(0,c7b47d08,c0fce6b0,3d8,ca74b2cc,...) at g_up_procbody+0x9d fork_exit(c09e7af0,0,c7b47d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b47d40, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xca7502e0 sched_switch(ca7502e0,0,104,1b3,c7b44bd8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71ad00,...) at mi_switch+0x243 sleepq_switch(ca7502e0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(c118df1c,5c,c0fc0a12,0,0,...) at sleepq_wait+0x63 _sleep(c118df1c,c118de4c,25c,c0fc0a12,0,...) at _sleep+0x39c g_run_events(c119ecc0,0,c0fc2561,79,c7b44cf4,...) at g_run_events+0x54b g_event_procbody(0,c7b44d08,c0fce6b0,3d8,ca74b2cc,...) at g_event_procbody+0x90 fork_exit(c09e7b90,0,c7b44d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b44d40, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xcc67a5c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xcc67a8a0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100064 td 0xcc67b000 sched_switch(cc67b000,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc67b000,...) at mi_switch+0x243 ithread_loop(cc65c480,ee170d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc65c480,ee170d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee170d40, ebp = 0 --- Tracing command intr pid 12 tid 100061 td 0xcc2ca8a0 sched_switch(cc2ca8a0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc2ca8a0,...) at mi_switch+0x243 ithread_loop(cc0d9680,ee164d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc0d9680,ee164d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee164d40, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xcc2cab80 sched_switch(cc2cab80,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc2cab80,...) at mi_switch+0x243 ithread_loop(cc0e0d80,ee15cd08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc0e0d80,ee15cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee15cd40, ebp = 0 --- Tracing command intr pid 12 tid 100055 td 0xcc307b80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100042 td 0xcc2c9b80 sched_switch(cc2c9b80,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc2c9b80,...) at mi_switch+0x243 ithread_loop(cc140980,ee11ed08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc140980,ee11ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee11ed40, ebp = 0 --- Tracing command intr pid 12 tid 100037 td 0xcc2668a0 sched_switch(cc2668a0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc2668a0,...) at mi_switch+0x243 ithread_loop(cc178780,ee10ed08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc178780,ee10ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee10ed40, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xcc26c8a0 sched_switch(cc26c8a0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc26c8a0,...) at mi_switch+0x243 ithread_loop(cc13f880,ee0fed08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc13f880,ee0fed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee0fed40, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xcc26cb80 sched_switch(cc26cb80,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,cc26cb80,...) at mi_switch+0x243 ithread_loop(cc178380,edfa8d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc178380,edfa8d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa8d40, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xca86f2e0 sched_switch(ca86f2e0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca86f2e0,...) at mi_switch+0x243 ithread_loop(cc140080,edfa4d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc140080,edfa4d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xedfa4d40, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xca86f5c0 sched_switch(ca86f5c0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca86f5c0,...) at mi_switch+0x243 ithread_loop(cc140c80,c7ba4d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,cc140c80,c7ba4d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7ba4d40, ebp = 0 --- Tracing command intr pid 12 tid 100026 td 0xcaa5c000 sched_switch(caa5c000,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,caa5c000,...) at mi_switch+0x243 ithread_loop(ca70c580,c7b6cd08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca70c580,c7b6cd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6cd40, ebp = 0 --- Tracing command intr pid 12 tid 100025 td 0xcaa5c2e0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100022 td 0xcaa5cb80 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100018 td 0xca86d2e0 sched_switch(ca86d2e0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca86d2e0,...) at mi_switch+0x243 ithread_loop(ca70cb80,c7b54d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca70cb80,c7b54d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b54d40, ebp = 0 --- Tracing command intr pid 12 tid 100012 td 0xca7505c0 sched_switch(ca7505c0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca7505c0,...) at mi_switch+0x243 ithread_loop(ca70ce80,c7b41d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca70ce80,c7b41d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b41d40, ebp = 0 --- Tracing command intr pid 12 tid 100011 td 0xca7508a0 sched_switch(ca7508a0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca7508a0,...) at mi_switch+0x243 ithread_loop(ca7e2180,c7b3ed08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca7e2180,c7b3ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3ed40, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xca750b80 sched_switch(ca750b80,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca750b80,...) at mi_switch+0x243 ithread_loop(ca70b180,c7b3bd08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca70b180,c7b3bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b3bd40, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xca798000 sched_switch(ca798000,0,103,1ae,c119f340,...) at sched_switch+0x453 mi_switch(103,0,c0fdaaf0,2e7,c130ffbc,...) at mi_switch+0x243 turnstile_wait(cf018300,ce8bc8a0,0,1c5,8,...) at turnstile_wait+0x4f4 _mtx_lock_sleep(c130ffbc,ca798000,0,c0fd2687,9a,...) at _mtx_lock_sleep+0x2b7 _mtx_lock_flags(c130ffbc,0,c0fd2687,9a,c7b38c70,...) at _mtx_lock_flags+0x10f lock_mtx(c130ffbc,1,c0fd5c0a,1e7,ca86f000,...) at lock_mtx+0x29 softclock(c11920a0,c119f9c0,4,c0fd2687,ca79ccb8,...) at softclock+0x1df intr_event_execute_handlers(ca74b598,ca79cc80,c0fce9d3,561,ca798000,...) at intr_event_execute_handlers+0x125 ithread_loop(ca70b380,c7b38d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0xa9 fork_exit(c0a5b950,ca70b380,c7b38d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b38d40, ebp = 0 --- Tracing command intr pid 12 tid 100008 td 0xca7982e0 sched_switch(ca7982e0,0,109,1b3,0,...) at sched_switch+0x453 mi_switch(109,0,c0fce9d3,557,ca7982e0,...) at mi_switch+0x243 ithread_loop(ca70b580,c7b35d08,c0fce6b0,3d8,ca74b598,...) at ithread_loop+0x1fb fork_exit(c0a5b950,ca70b580,c7b35d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b35d40, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xca7985c0 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100006 td 0xca74e000 sched_switch(ca74e000,0,108,1ae,c0a752b3,...) at sched_switch+0x453 mi_switch(108,0,c0fd672c,3e3,ca74e000,...) at mi_switch+0x243 sched_idletd(0,c7b2ed08,c0fce6b0,3d8,ca74b864,...) at sched_idletd+0x17c fork_exit(c0ab02c0,0,c7b2ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2ed40, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xca74e2e0 sched_switch(ca74e2e0,0,108,1ae,c0a752b3,...) at sched_switch+0x453 mi_switch(108,0,c0fd672c,3e3,ca74e2e0,...) at mi_switch+0x243 sched_idletd(0,c7b2bd08,c0fce6b0,3d8,ca74b864,...) at sched_idletd+0x17c fork_exit(c0ab02c0,0,c7b2bd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b2bd40, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xca74e5c0 sched_switch(ca74e5c0,0,108,1ae,c0a752b3,...) at sched_switch+0x453 mi_switch(108,0,c0fd672c,3e3,ca74e5c0,...) at mi_switch+0x243 sched_idletd(0,c7b28d08,c0fce6b0,3d8,ca74b864,...) at sched_idletd+0x17c fork_exit(c0ab02c0,0,c7b28d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b28d40, ebp = 0 --- Tracing command idle pid 11 tid 100003 td 0xca74e8a0 sched_switch(ca74e8a0,0,108,1ae,c0a752b3,...) at sched_switch+0x453 mi_switch(108,0,c0fd672c,3e3,ca74e8a0,...) at mi_switch+0x243 sched_idletd(0,c7b25d08,c0fce6b0,3d8,ca74b864,...) at sched_idletd+0x17c fork_exit(c0ab02c0,0,c7b25d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b25d40, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xca74eb80 sched_switch(ca74eb80,0,104,1b3,c7b21aac,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0a7683b,...) at mi_switch+0x243 sleepq_switch(ca74eb80,0,c0fda100,1ac,6c,...) at sleepq_switch+0x1a7 sleepq_catch_signals(c0fda100,165,0,100,100,...) at sleepq_catch_signals+0xf9 sleepq_wait_sig(ca74bb30,6c,c0fdd038,100,0,...) at sleepq_wait_sig+0x17 _sleep(ca74bb30,ca74bbb8,16c,c0fdd038,0,...) at _sleep+0x385 kern_wait(ca74eb80,ffffffff,c7b21c38,0,0,...) at kern_wait+0x597 sys_wait4(ca74eb80,c7b21ccc,c10285fc,c0fdce86,c1029bb0,...) at sys_wait4+0x3b syscall(c7b21d08) at syscall+0x2fe Xint0x80_syscall() at Xint0x80_syscall+0x21 --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x806070f, esp = 0xbfbfe8ac, ebp = 0xbfbfe8c8 --- Tracing command audit pid 10 tid 100001 td 0xca750000 sched_switch(ca750000,0,104,1b3,c7b1ebe8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,eb,...) at mi_switch+0x243 sleepq_switch(ca750000,0,c0fda100,26e,ca750000,...) at sleepq_switch+0x1a7 sleepq_wait(c130f6a0,0,c7b1ec6c,1,0,...) at sleepq_wait+0x63 _cv_wait(c130f6a0,c130f684,c1006337,194,c7b1eca4,...) at _cv_wait+0x260 audit_worker(0,c7b1ed08,c0fce6b0,3d8,ca74c000,...) at audit_worker+0x84 fork_exit(c0c97510,0,c7b1ed08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b1ed40, ebp = 0 --- Tracing command kernel pid 0 tid 100069 td 0xcc67a000 sched_switch(cc67a000,0,104,1b3,ee189bc8,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,352,...) at mi_switch+0x243 sleepq_switch(cc67a000,0,c0fda100,291,2,...) at sleepq_switch+0x1a7 sleepq_timedwait(c1190e64,0,c0fc0a12,2,0,...) at sleepq_timedwait+0x6b _sleep(c1190e64,0,0,c0fc0a12,bb8) at _sleep+0x36a pause(c0fc0a12,bb8,12b,129,c118e168,...) at pause+0xa0 deadlkres(0,ee189d08,c0fce6b0,3d8,c118e0e0,...) at deadlkres+0x324 fork_exit(c0a3a800,0,ee189d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee189d40, ebp = 0 --- Tracing command kernel pid 0 tid 100068 td 0xcc67a2e0 sched_switch(cc67a2e0,0,104,1b3,ee186c18,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fda100,...) at mi_switch+0x243 sleepq_switch(cc67a2e0,0,c0fda100,26e,cc67a2e0,...) at sleepq_switch+0x1a7 sleepq_wait(cc63c780,0,c0fd5221,c0fc0a12,0,...) at sleepq_wait+0x63 msleep_spin(cc63c780,cc63c798,c0fc0a12,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1371360,ee186d08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0acd520,c1371360,ee186d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee186d40, ebp = 0 --- Tracing command kernel pid 0 tid 100062 td 0xcc2ca5c0 sched_switch(cc2ca5c0,0,104,1b3,ee16ac18,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fda100,...) at mi_switch+0x243 sleepq_switch(cc2ca5c0,0,c0fda100,26e,cc2ca5c0,...) at sleepq_switch+0x1a7 sleepq_wait(cc2cb180,0,c0fd5221,c0fc0a12,0,...) at sleepq_wait+0x63 msleep_spin(cc2cb180,cc2cb198,c0fc0a12,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(cc3b449c,ee16ad08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0acd520,cc3b449c,ee16ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xee16ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100027 td 0xca86fb80 sched_switch(ca86fb80,0,104,1b3,c7b6fbfc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71a880,...) at mi_switch+0x243 sleepq_switch(ca86fb80,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(caa5f880,0,c0fc0a12,0,0,...) at sleepq_wait+0x63 _sleep(caa5f880,caa5f898,0,c0fc0a12,0,...) at _sleep+0x39c taskqueue_thread_loop(c118ea78,c7b6fd08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0acd520,c118ea78,c7b6fd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b6fd40, ebp = 0 --- Tracing command kernel pid 0 tid 100024 td 0xcaa5c5c0 sched_switch(caa5c5c0,0,104,1b3,c7b66bfc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71a7c0,...) at mi_switch+0x243 sleepq_switch(caa5c5c0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(caa5fc80,0,c0fc0a12,0,0,...) at sleepq_wait+0x63 _sleep(caa5fc80,caa5fc98,0,c0fc0a12,0,...) at _sleep+0x39c taskqueue_thread_loop(c11ada4c,c7b66d08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0acd520,c11ada4c,c7b66d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b66d40, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xcaa5c8a0 sched_switch(caa5c8a0,0,104,1b3,c7b63bfc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71a780,...) at mi_switch+0x243 sleepq_switch(caa5c8a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(caa5fe80,0,c0fc0a12,0,0,...) at sleepq_wait+0x63 _sleep(caa5fe80,caa5fe98,0,c0fc0a12,0,...) at _sleep+0x39c taskqueue_thread_loop(c130fc84,c7b63d08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0acd520,c130fc84,c7b63d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b63d40, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xca7988a0 sched_switch(ca7988a0,0,104,1b3,c7b5dc18,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fda100,...) at mi_switch+0x243 sleepq_switch(ca7988a0,0,c0fda100,26e,ca7988a0,...) at sleepq_switch+0x1a7 sleepq_wait(ca8c8880,0,c0fd5221,c0fc0a12,0,...) at sleepq_wait+0x63 msleep_spin(ca8c8880,ca8c8898,c0fc0a12,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1157c18,c7b5dd08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0acd520,c1157c18,c7b5dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xca798b80 sched_switch(ca798b80,0,104,1b3,c7b5ac18,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fda100,...) at mi_switch+0x243 sleepq_switch(ca798b80,0,c0fda100,26e,ca798b80,...) at sleepq_switch+0x1a7 sleepq_wait(ca8c8880,0,c0fd5221,c0fc0a12,0,...) at sleepq_wait+0x63 msleep_spin(ca8c8880,ca8c8898,c0fc0a12,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1157c18,c7b5ad08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0acd520,c1157c18,c7b5ad08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b5ad40, ebp = 0 --- Tracing command kernel pid 0 tid 100019 td 0xca86d000 sched_switch(ca86d000,0,104,1b3,c7b57c18,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,c0fda100,...) at mi_switch+0x243 sleepq_switch(ca86d000,0,c0fda100,26e,ca86d000,...) at sleepq_switch+0x1a7 sleepq_wait(ca8c8880,0,c0fd5221,c0fc0a12,0,...) at sleepq_wait+0x63 msleep_spin(ca8c8880,ca8c8898,c0fc0a12,0,a77,...) at msleep_spin+0x25f taskqueue_thread_loop(c1157c18,c7b57d08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0x8f fork_exit(c0acd520,c1157c18,c7b57d08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b57d40, ebp = 0 --- Tracing command kernel pid 0 tid 100016 td 0xca86d8a0 sched_switch(ca86d8a0,0,104,1b3,c7b4dbfc,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,ca71aa00,...) at mi_switch+0x243 sleepq_switch(ca86d8a0,0,c0fda100,26e,0,...) at sleepq_switch+0x1a7 sleepq_wait(ca870580,0,c0fc0a12,0,0,...) at sleepq_wait+0x63 _sleep(ca870580,ca870598,0,c0fc0a12,0,...) at _sleep+0x39c taskqueue_thread_loop(c11ac440,c7b4dd08,c0fce6b0,3d8,c118e0e0,...) at taskqueue_thread_loop+0xb5 fork_exit(c0acd520,c11ac440,c7b4dd08) at fork_exit+0xb8 fork_trampoline() at fork_trampoline+0x8 --- trap 0, eip = 0, esp = 0xc7b4dd40, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc118e3b0 sched_switch(c118e3b0,0,104,1b3,c1820c5c,...) at sched_switch+0x453 mi_switch(104,0,c0fda100,1f8,352,...) at mi_switch+0x243 sleepq_switch(c118e3b0,0,c0fda100,291,0,...) at sleepq_switch+0x1a7 sleepq_timedwait(c118e0e0,54,c1006d18,0,0,...) at sleepq_timedwait+0x6b _sleep(c118e0e0,0,54,c1006d18,2710,...) at _sleep+0x36a scheduler(0,181ec00,181ec00,181e000,1825000,...) at scheduler+0x240 mi_startup() at mi_startup+0xac begin() at begin+0x2c db:0:allt> call doadump Physical memory: 3435 MB Dumping 220 MB: 205 189 173 157 141 125 109 93 77 61 45 29 13 Dump complete = 0 db:0:doadump> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 1 (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:244 #1 0xc051bea9 in db_fncall (dummy1=0xc0cceb8d, dummy2=0x0, dummy3=0xffffffff, dummy4=0xf2827308 "\034s\202ò") at ../../../ddb/db_command.c:573 #2 0xc051c2df in db_command (last_cmdp=0xc1155ddc, cmd_table=0x0, dopager=0x0) at ../../../ddb/db_command.c:449 #3 0xc051c394 in db_command_script (command=0xc1156ce8 "call doadump") at ../../../ddb/db_command.c:520 #4 0xc05207d0 in db_script_exec (scriptname=0xc1156640 "doadump", warnifnotfound=Variable "warnifnotfound" is not available. ) at ../../../ddb/db_script.c:302 #5 0xc0520861 in db_run_cmd (addr=0x1, have_addr=0x0, count=0xc1331980, modif=0xf2827440 "") at ../../../ddb/db_script.c:375 #6 0xc051c2a1 in db_command (last_cmdp=0xc1155ddc, cmd_table=0x0, dopager=0x1) at ../../../ddb/db_command.c:449 #7 0xc051c3fa in db_command_loop () at ../../../ddb/db_command.c:502 #8 0xc051e3ed in db_trap (type=0xc, code=0x0) at ../../../ddb/db_main.c:231 #9 0xc0abf136 in kdb_trap (type=0xc, code=0x0, tf=0xf28276dc) at ../../../kern/subr_kdb.c:654 #10 0xc0e01edf in trap_fatal (frame=0xf28276dc, eva=0xc9f03f7c) at ../../../i386/i386/trap.c:1013 #11 0xc0e01fb7 in trap_pfault (frame=0xf28276dc, usermode=0x0, eva=0xc9f03f7c) at ../../../i386/i386/trap.c:834 #12 0xc0e030b1 in trap (frame=0xf28276dc) at ../../../i386/i386/trap.c:546 #13 0xc0dec73c in calltrap () at ../../../i386/i386/exception.s:169 #14 0xc0cceb8d in softdep_setup_inomapdep (bp=0xe1969da0, ip=0xcf1df074, newinum=0x62, mode=0x81b0) at ../../../ufs/ffs/ffs_softdep.c:4720 #15 0xc0cb231b in ffs_nodealloccg (ip=0xcf1df074, cg=0x0, ipref=0x62, mode=0x81b0, unused=0x0) at ../../../ufs/ffs/ffs_alloc.c:1827 #16 0xc0cb0fd5 in ffs_hashalloc (ip=0xcf1df074, cg=0x0, pref=0x4, size=0x81b0, rsize=0x0, allocator=0xc0cb1d70 ) at ../../../ufs/ffs/ffs_alloc.c:1308 #17 0xc0cb1a33 in ffs_valloc (pvp=0xcf52f828, mode=0x81b0, cred=0xcee5c880, vpp=0xf28278e0) at ../../../ufs/ffs/ffs_alloc.c:972 #18 0xc0cf1fa3 in ufs_makeinode (mode=0x81b0, dvp=0xcf52f828, vpp=0xf2827b84, cnp=0xf2827b98) at ../../../ufs/ufs/ufs_vnops.c:2600 #19 0xc0cf2830 in ufs_create (ap=0xf2827adc) at ../../../ufs/ufs/ufs_vnops.c:203 #20 0xc0e2a810 in VOP_CREATE_APV (vop=0xc113b040, a=0xf2827adc) at vnode_if.c:250 #21 0xc0b388d5 in vn_open_cred (ndp=0xf2827b58, flagp=0xf2827c20, cmode=Variable "cmode" is not available. ) at vnode_if.h:109 #22 0xc0b38ceb in vn_open (ndp=0xf2827b58, flagp=0xf2827c20, cmode=0x1b0, fp=0xce5a2b98) at ../../../kern/vfs_vnops.c:101 #23 0xc0b34f3c in kern_openat (td=0xce8bc8a0, fd=0xffffff9c, path=0xbfbfe728
, pathseg=UIO_USERSPACE, flags=0x602, mode=0x1b0) at ../../../kern/vfs_syscalls.c:1133 #24 0xc0b353e5 in kern_open (td=0xce8bc8a0, path=0xbfbfe728
, pathseg=UIO_USERSPACE, flags=0x601, mode=0x1b0) at ../../../kern/vfs_syscalls.c:1084 #25 0xc0b35420 in sys_open (td=0xce8bc8a0, uap=0xf2827ccc) at ../../../kern/vfs_syscalls.c:1060 #26 0xc0e025fe in syscall (frame=0xf2827d08) at subr_syscall.c:135 #27 0xc0dec7d1 in Xint0x80_syscall () at ../../../i386/i386/exception.s:267 #28 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) f 14 #14 0xc0cceb8d in softdep_setup_inomapdep (bp=0xe1969da0, ip=0xcf1df074, newinum=0x62, mode=0x81b0) at ../../../ufs/ffs/ffs_softdep.c:4720 4720 pho = inodedep->id_state; /* Catch page fault here */ (kgdb) l 4715 if ((inodedep_lookup(mp, newinum, DEPALLOC | NODELAY, &inodedep))) 4716 panic("softdep_setup_inomapdep: dependency %p for new" 4717 "inode already exists", inodedep); 4718 bcopy(inodedep, &inodedep_backup, sizeof(inodedep_backup)); 4719 bmsafemap = bmsafemap_lookup(mp, bp, ino_to_cg(fs, newinum)); 4720 pho = inodedep->id_state; /* Catch page fault here */ 4721 if (jaddref) { 4722 LIST_INSERT_HEAD(&bmsafemap->sm_jaddrefhd, jaddref, ja_bmdeps); 4723 TAILQ_INSERT_TAIL(&inodedep->id_inoreflst, &jaddref->ja_ref, 4724 if_deps); (kgdb) info loc inodedep = (struct inodedep *) 0xc9f03f70 bmsafemap = (struct bmsafemap *) 0xcf477680 jaddref = (struct jaddref *) 0x0 mp = (struct mount *) 0xcefe9000 fs = (struct fs *) 0xcefed000 (kgdb) p *inodedep Cannot access memory at address 0xc9f03f70 (kgdb) p *bmsafemap $1 = {sm_list = {wk_list = {le_next = 0x0, le_prev = 0xe1969f2c}, wk_mp = 0xcefe9000, wk_type = 0x2, wk_state = 0x8000}, sm_hash = {le_next = 0x0, le_prev = 0xcdfe6fd8}, sm_next = {le_next = 0xcf09b480, le_prev = 0xcefeb380}, sm_cg = 0x0, sm_buf = 0xe1969da0, sm_allocdirecthd = {lh_first = 0xdeadc0de}, sm_allocdirectwr = {lh_first = 0xdeadc0de}, sm_allocindirhd = {lh_first = 0xdeadc0de}, sm_allocindirwr = { lh_first = 0xdeadc0de}, sm_inodedephd = {lh_first = 0x0}, sm_inodedepwr = {lh_first = 0x0}, sm_newblkhd = {lh_first = 0x0}, sm_newblkwr = {lh_first = 0x0}, sm_jaddrefhd = {lh_first = 0x0}, sm_jnewblkhd = { lh_first = 0x0}, sm_freehd = {lh_first = 0x0}, sm_freewr = {lh_first = 0x0}} (kgdb) p *mp $2 = {mnt_mtx = {lock_object = {lo_name = 0xc0fc01d1 "struct mount mtx", lo_flags = 0x1030000, lo_data = 0x0, lo_witness = 0xca6b5450}, mtx_lock = 0x4}, mnt_gen = 0x1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xce8af2f4}, mnt_op = 0xc113a860, mnt_vfc = 0xc113a6c0, mnt_vnodecovered = 0xcea9d828, mnt_syncer = 0xcef56570, mnt_ref = 0x8f9, mnt_nvnodelist = {tqh_first = 0xcef566cc, tqh_last = 0xcf4fcaf4}, mnt_nvnodelistsize = 0x8ed, mnt_activevnodelist = {tqh_first = 0xcf4fcae0, tqh_last = 0xcef56660}, mnt_activevnodelistsize = 0x427, mnt_writeopcount = 0x9, mnt_kern_flag = 0x60800044, mnt_flag = 0x201300, mnt_opt = 0xce33d180, mnt_optnew = 0x0, mnt_maxsymlinklen = 0x78, mnt_stat = {f_version = 0x20030518, f_type = 0x35, f_flags = 0x201300, f_bsize = 0x1000, f_iosize = 0x8000, f_blocks = 0x1305, f_bfree = 0xee1, f_bavail = 0xd5c, f_files = 0x9fe, f_ffree = 0x21f, f_syncwrites = 0x441bb, f_asyncwrites = 0x72f70, f_syncreads = 0x219, f_asyncreads = 0x0, f_spare = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}, f_namemax = 0xff, f_owner = 0x0, f_fsid = {val = {0x4fc1c1d3, 0x81aedc98}}, f_charspare = '\0' , f_fstypename = "ufs", '\0' , f_mntfromname = "/dev/md5a", '\0' , f_mntonname = "/mnt", '\0' }, mnt_cred = 0xcee72680, mnt_data = 0xcefeb300, mnt_time = 0x0, mnt_iosize_max = 0x20000, mnt_export = 0xce0c0d00, mnt_label = 0x0, mnt_hashseed = 0xea4582e1, mnt_lockref = 0x1, mnt_secondary_writes = 0x2, mnt_secondary_accwrites = 0x6b38fd, mnt_susp_owner = 0x0, mnt_gjprovider = 0x0, mnt_explock = {lock_object = { lo_name = 0xc0fc01e2 "explock", lo_flags = 0x5730000, lo_data = 0x0, lo_witness = 0xca6bae80}, lk_lock = 0x1, lk_exslpfail = 0x0, lk_timo = 0x0, lk_pri = 0x60, lk_stack = {depth = 0x6, pcs = {0xc0a6d5ad, 0xc0b17807, 0xc0b20393, 0xc0b20aaf, 0xc0e025fe, 0xc0dec7d1, 0x0 }}}} (kgdb) p *fs $3 = {fs_firstfield = 0x0, fs_unused_1 = 0x0, fs_sblkno = 0x18, fs_cblkno = 0x20, fs_iblkno = 0x28, fs_dblkno = 0x50, fs_old_cgoffset = 0x0, fs_old_cgmask = 0x0, fs_old_time = 0x0, fs_old_size = 0x0, fs_old_dsize = 0x0, fs_ncg = 0x4, fs_bsize = 0x8000, fs_fsize = 0x1000, fs_frag = 0x8, fs_minfree = 0x8, fs_old_rotdelay = 0x0, fs_old_rps = 0x0, fs_bmask = 0xffff8000, fs_fmask = 0xfffff000, fs_bshift = 0xf, fs_fshift = 0xc, fs_maxcontig = 0x4, fs_maxbpg = 0x1000, fs_fragshift = 0x3, fs_fsbtodb = 0x3, fs_sbsize = 0x1000, fs_spare1 = {0x0, 0x0}, fs_nindir = 0x1000, fs_inopb = 0x80, fs_old_nspf = 0x0, fs_optim = 0x1, fs_old_npsect = 0x0, fs_old_interleave = 0x0, fs_old_trackskew = 0x0, fs_id = {0x4fc1c1d3, 0x81aedc98}, fs_old_csaddr = 0x0, fs_cssize = 0x1000, fs_cgsize = 0x1000, fs_spare2 = 0x0, fs_old_nsect = 0x0, fs_old_spc = 0x0, fs_old_ncyl = 0x0, fs_old_cpg = 0x0, fs_ipg = 0x280, fs_fpg = 0x500, fs_old_cstotal = {cs_ndir = 0x0, cs_nbfree = 0x0, cs_nifree = 0x0, cs_nffree = 0x0}, fs_fmod = 0x1, fs_clean = 0x0, fs_ronly = 0x0, fs_old_flags = 0x80, fs_fsmnt = "/mnt", '\0' , fs_volname = '\0' , fs_swuid = 0x0, fs_pad = 0x0, fs_cgrotor = 0x0, fs_ocsp = {0x0 }, fs_contigdirs = 0xceff1010 "", fs_csp = 0xceff0000, fs_maxcluster = 0xceff1000, fs_active = 0x0, fs_old_cpc = 0x0, fs_maxbsize = 0x8000, fs_unrefs = 0x0, fs_sparecon64 = {0x0 }, fs_sblockloc = 0x10000, fs_cstotal = {cs_ndir = 0x41f, cs_nbfree = 0x1b5, cs_nifree = 0x18, cs_nffree = 0x139, cs_numclusters = 0x0, cs_spare = {0x0, 0x0, 0x0}}, fs_time = 0x4fc1c2b5, fs_size = 0x13fe, fs_dsize = 0x1305, fs_csaddr = 0x50, fs_pendingblocks = 0x0, fs_pendinginodes = 0xfc, fs_snapinum = {0x0 }, fs_avgfilesize = 0x4000, fs_avgfpdir = 0x40, fs_save_cgsize = 0x0, fs_mtime = 0x4fc1c1d3, fs_sujfree = 0x0, fs_sparecon32 = {0x0 }, fs_flags = 0x2, fs_contigsumsize = 0x4, fs_maxsymlinklen = 0x78, fs_old_inodefmt = 0x0, fs_maxfilesize = 0x800800805ffff, fs_qbmask = 0x7fff, fs_qfmask = 0xfff, fs_state = 0x0, fs_old_postblformat = 0x0, fs_old_nrpos = 0x0, fs_spare5 = {0x0, 0x0}, fs_magic = 0x19540119} (kgdb) p inodedep_backup $4 = {id_list = {wk_list = {le_next = 0xc9711f4d, le_prev = 0xc9715f70}, wk_mp = 0xcefe9000, wk_type = 0x1, wk_state = 0xd}, id_hash = {le_next = 0x0, le_prev = 0xcdfb1f74}, id_unlinked = {tqe_next = 0x0, tqe_prev = 0x0}, id_fs = 0xcefed000, id_ino = 0x7e7, id_nlinkdelta = 0x0, id_savednlink = 0xffff, id_deps = {le_next = 0xc9711f70, le_prev = 0xc9715f9c}, id_bmsafemap = 0x0, id_mkdiradd = 0x0, id_inoreflst = { tqh_first = 0x0, tqh_last = 0xc9f13fac}, id_savedextsize = 0xffffffff, id_savedsize = 0xffffffffffffffff, id_dirremhd = {lh_first = 0x0}, id_pendinghd = {lh_first = 0x0}, id_bufwait = {lh_first = 0x0}, id_inowait = {lh_first = 0x0}, id_inoupdt = {tqh_first = 0x0, tqh_last = 0xc9f13fd0}, id_newinoupdt = {tqh_first = 0x0, tqh_last = 0xc9f13fd8}, id_extupdt = {tqh_first = 0x0, tqh_last = 0xc9f13fe0}, id_newextupdt = { tqh_first = 0x0, tqh_last = 0xc9f13fe8}, id_freeblklst = {tqh_first = 0x0, tqh_last = 0xc9f13ff0}, id_un = {idu_savedino1 = 0x0, idu_savedino2 = 0x0}} (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/ufs/ffs/ffs_softdep.c =================================================================== --- /usr/src/sys/ufs/ffs/ffs_softdep.c (revision 235885) +++ /usr/src/sys/ufs/ffs/ffs_softdep.c (working copy) @@ -4641,6 +4641,9 @@ softdep_revert_rmdir(dp, ip) FREE_LOCK(&lk); } +int pho; +struct inodedep inodedep_backup; + /* * Protecting the freemaps (or bitmaps). * @@ -4712,7 +4715,9 @@ softdep_setup_inomapdep(bp, ip, newinum, mode) if ((inodedep_lookup(mp, newinum, DEPALLOC | NODELAY, &inodedep))) panic("softdep_setup_inomapdep: dependency %p for new" "inode already exists", inodedep); + bcopy(inodedep, &inodedep_backup, sizeof(inodedep_backup)); bmsafemap = bmsafemap_lookup(mp, bp, ino_to_cg(fs, newinum)); + pho = inodedep->id_state; /* Catch page fault here */ if (jaddref) { LIST_INSERT_HEAD(&bmsafemap->sm_jaddrefhd, jaddref, ja_bmdeps); TAILQ_INSERT_TAIL(&inodedep->id_inoreflst, &jaddref->ja_ref, @@ -4865,6 +4870,7 @@ bmsafemap_lookup(mp, bp, cg) ACQUIRE_LOCK(&lk); if (bmsafemap_find(bmsafemaphd, mp, cg, &collision) == 1) { WORKITEM_FREE(bmsafemap, D_BMSAFEMAP); + printf("collision = %p\n", collision); return (collision); } bmsafemap->sm_cg = cg; -- Test scenario: memguard.sh