GENERIC HEAD from 2016-04-23 09:15:58 UTC, r298511M, vmcore.920 GDB: no debug ports present KDB: debugger backends: ddb KDB: current backend: ddb Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #2 r298511M: Sun Apr 24 10:59:01 CEST 2016 pho@x4.osted.lan:/usr/src/sys/i386/compile/PHO i386 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. WARNING: DIAGNOSTIC option enabled, expect reduced performance. VT(vga): resolution 640x480 CPU: AMD Phenom(tm) 9150e Quad-Core Processor (1800.02-MHz 686-class CPU) Origin="AuthenticAMD" Id=0x100f23 Family=0x10 Model=0x2 Stepping=3 Features=0x178bfbff Features2=0x802009 AMD Features=0xee500800 AMD Features2=0x7ff SVM: NP,NAsids=64 TSC: P-state invariant real memory = 8589934592 (8192 MB) avail memory = 3524517888 (3361 MB) : Trying to mount root from ufs:/dev/ada0s1a [rw]... Setting hostuuid: 00000000-0000-0000-0000-00218515337d. Setting hostid: 0x6b64ac17. Starting ddb. eval: limits: not found /etc/rc: WARNING: failed to start ddb warning: total configured swap (4194304 pages) exceeds maximum recommended amount (2097312 pages). warning: increase kern.maxswzone or reduce amount of swap. Starting file system checks: /dev/ada0s1a: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1a: clean, 650707 free (2075 frags, 81079 blocks, 0.2% fragmentation) /dev/ada0s1f: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1f: clean, 746419 free (15771 frags, 91331 blocks, 1.6% fragmentation) /dev/label/tmp: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/label/tmp: clean, 66486355 free (26851 frags, 8307438 blocks, 0.0% fragmentation) /dev/ada0s1d: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1d: clean, 1020798 free (191478 frags, 103665 blocks, 1.9% fragmentation) /dev/ada0s1e: FILE SYSTEM CLEAN; SKIPPING CHECKS /dev/ada0s1e: clean, 6015779 free (185315 frags, 728808 blocks, 0.7% fragmentation) Mounting local file systems:. ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/arduino/lib /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/gcc48 /usr/local/lib/mysql /usr/local/lib/nss /usr/local/lib/pth /usr/local/lib/qt4 /usr/local/lib/virtualbox /usr/local/llvm35/lib /usr/local/llvm36/lib a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout Setting hostname: x4.osted.lan. Setting up harvesting:[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED Feeding entropy:. uhub5: 10 ports with 10 removable, self powered re0: link state changed to DOWN Starting Network: lo0 re0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 groups: lo re0: flags=8843 metric 0 mtu 1500 options=8209b ether 00:21:85:15:33:7d inet 192.168.1.101 netmask 0xffffff00 broadcast 192.168.1.255 inet6 fe80::221:85ff:fe15:337d%re0 prefixlen 64 scopeid 0x1 nd6 options=23 media: Ethernet autoselect (none) status: no carrier Starting devd. re0: link state changed to UP add net default: gateway 192.168.1.1 add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Starting rtsold. Creating and/or trimming log files. Starting syslogd. Starting rpcbind. NFS access cache time=60 Starting watchdogd. No core dumps found. Additional ABI support: linux. Starting casperd. lock order reversal: 1st 0xe48f460c bufwait (bufwait) @ kern/vfs_bio.c:3513 2nd 0xc96f7200 dirhash (dirhash) @ ufs/ufs/ufs_dirhash.c:281 stack backtrace: #0 0xc0c9b6e1 at witness_debugger+0x81 #1 0xc0c9b606 at witness_checkorder+0xd46 #2 0xc0c45011 at _sx_xlock+0x71 #3 0xc0f17623 at ufsdirhash_add+0x53 #4 0xc0f1c0ea at ufs_direnter+0x45a #5 0xc0f24fc4 at ufs_mkdir+0x7e4 #6 0xc11f900f at VOP_MKDIR_APV+0x12f #7 0xc0d0ad3c at kern_mkdirat+0x22c #8 0xc0d0ab01 at sys_mkdir+0x31 #9 0xc11c6d28 at syscall+0x388 #10 0xc11b1acf at Xint0x80_syscall+0x2f Clearing /tmp (X related). Starting nfsuserd. Starting mountd. Starting nfsd. Recovering vi editor sessions:lock order reversal: 1st 0xca149a0c ufs (ufs) @ kern/vfs_lookup.c:530 2nd 0xe4900b50 bufwait (bufwait) @ ufs/ffs/ffs_vnops.c:263 3rd 0xca14973c ufs (ufs) @ kern/vfs_subr.c:2498 stack backtrace: #0 0xc0c9b6e1 at witness_debugger+0x81 #1 0xc0c9b606 at witness_checkorder+0xd46 #2 0xc0c12292 at __lockmgr_args+0x482 #3 0xc0f11b98 at ffs_lock+0x98 #4 0xc11f9d98 at VOP_LOCK1_APV+0x118 #5 0xc0d0df7a at _vn_lock+0xba #6 0xc0cfbaa2 at vget+0x122 #7 0xc0cedcb1 at vfs_hash_get+0xd1 #8 0xc0f0c494 at ffs_vgetf+0x44 #9 0xc0f03b7b at softdep_sync_buf+0xb7b #10 0xc0f128aa at ffs_syncvnode+0x29a #11 0xc0ee6af4 at ffs_truncate+0x974 #12 0xc0f1c27e at ufs_direnter+0x5ee #13 0xc0f25d98 at ufs_makeinode+0x528 #14 0xc0f21b80 at ufs_create+0x30 #15 0xc11f69af at VOP_CREATE_APV+0x12f #16 0xc0d0d775 at vn_open_cred+0x2a5 #17 0xc0d0d4bd at vn_open+0x3d . Updating motd:. Mounting late file systems:. Starting ntpd. Starting powerd. Starting smartd. Apr 24 11:07:21 x4 smartd[651]: Device: /dev/ada0, WARNING: A firmware update for this drive may be available, Apr 24 11:07:21 x4 smartd[651]: see the following Seagate web pages: Apr 24 11:07:21 x4 smartd[651]: http://knowledge.seagate.com/articles/en_US/FAQ/207931en Apr 24 11:07:21 x4 smartd[651]: http://knowledge.seagate.com/articles/en_US/FAQ/213891en Configuring vt: keymap blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Local package initialization: backuplock order reversal: 1st 0xc978e5d4 ufs (ufs) @ kern/vfs_mount.c:1222 2nd 0xc978ecdc devfs (devfs) @ ufs/ffs/ffs_softdep.c:1908 stack backtrace: #0 0xc0c9b6e1 at witness_debugger+0x81 #1 0xc0c9b606 at witness_checkorder+0xd46 #2 0xc0c12292 at __lockmgr_args+0x482 #3 0xc0ce9bc3 at vop_stdlock+0x53 #4 0xc11f9d98 at VOP_LOCK1_APV+0x118 #5 0xc0d0df7a at _vn_lock+0xba #6 0xc0ef04c8 at softdep_flushworklist+0x68 #7 0xc0f1002a at ffs_sync+0x2aa #8 0xc0d0f69f at vfs_write_suspend+0x1bf #9 0xc0d0f8d5 at vfs_write_suspend_umnt+0x45 #10 0xc0f0f6a5 at ffs_unmount+0xa5 #11 0xc0cf3c62 at dounmount+0x5f2 #12 0xc0cf3565 at sys_unmount+0x315 #13 0xc11c6d28 at syscall+0x388 #14 0xc11b1acf at Xint0x80_syscall+0x2f ** /dev/label/tmp ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 345292 files, 51827626 used, 66486355 free (26851 frags, 8307438 blocks, 0.0% fragmentation) ***** FILE SYSTEM IS CLEAN ***** fsck -y /tmp. Starting default moused. Starting inetd. Sun Apr 24 11:09 FreeBSD/i386 (x4.osted.lan) (ttyu0) login: Apr 24 12:00:13 x4 su: pho to root on /dev/pts/0 20160424 12:00:27 all (1/387): symlink3.sh 20160424 12:21:28 all (2/387): mmap19.sh 20160424 12:22:07 all (3/387): sendfile3.sh lock order reversal: 1st 0xc9c72b04 so_snd_sx (so_snd_sx) @ kern/uipc_sockbuf.c:280 2nd 0xcb931cdc ufs (ufs) @ kern/kern_sendfile.c:667 stack backtrace: #0 0xc0c9b6e1 at witness_debugger+0x81 #1 0xc0c9b606 at witness_checkorder+0xd46 #2 0xc0c11f8d at __lockmgr_args+0x17d #3 0xc0f11b98 at ffs_lock+0x98 #4 0xc11f9d98 at VOP_LOCK1_APV+0x118 #5 0xc0d0df7a at _vn_lock+0xba #6 0xc0c39c9e at vn_sendfile+0x89e #7 0xc0c3b6cf at sendfile+0x1bf #8 0xc0c3b506 at sys_sendfile+0x16 #9 0xc11c6d28 at syscall+0x388 #10 0xc11b1acf at Xint0x80_syscall+0x2f Expensive timeout(9) function: 0xc0969cf0(0xc9052000) 0.019058464 s 20160424 12:23:28 all (4/387): wire_no_page.sh 20160424 12:23:39 all (5/387): udp.sh 20160424 12:34:09 all (6/387): schedfuzz.sh 20160424 12:34:09 all (7/387): jail3.sh 20160424 12:34:12 all (8/387): jail.sh 20160424 12:34:13 all (9/387): zfs3.sh 20160424 12:34:13 all (10/387): contigmalloc.sh panic: mutex vm page not owned at ../../../vm/vm_page.c:2948 cpuid = 2 KDB: stack backtrace: db_trace_self_wrapper(c15ab878,c1835480,0,c157f27c,c84e08c8,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0898 kdb_backtrace(c179b151,2,c15a39ff,c84e0954,2,...) at kdb_backtrace+0x2d/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x115/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- KDB: enter: panic [ thread pid 11399 tid 101309 ] Stopped at kdb_enter+0x3a: movl $0,kdb_why db> run pho script 'pho' not found db> set $lines 0 db> show allpcpu Current CPU: 2 cpuid = 0 dynamic pcpu = 0x799c00 curthread = 0xc8e5a680: pid 11 "idle: cpu0" curpcb = 0xe4b2ed40 fpcurthread = none idlethread = 0xc8e5a680: tid 100003 "idle: cpu0" APIC ID = 0 currentldt = 0x50 spin locks held: cpuid = 1 dynamic pcpu = 0x2328cc00 curthread = 0xc8e5a340: pid 11 "idle: cpu1" curpcb = 0xe4b31d40 fpcurthread = none idlethread = 0xc8e5a340: tid 100004 "idle: cpu1" APIC ID = 1 currentldt = 0x50 spin locks held: cpuid = 2 dynamic pcpu = 0x2328fc00 curthread = 0xc9c0b9c0: pid 11399 "ctest" curpcb = 0xc84e0d40 fpcurthread = 0xc9c0b9c0: pid 11399 "ctest" idlethread = 0xc8e5a000: tid 100005 "idle: cpu2" APIC ID = 2 currentldt = 0x50 spin locks held: cpuid = 3 dynamic pcpu = 0x23292c00 curthread = 0xc8e599c0: pid 11 "idle: cpu3" curpcb = 0xe4b37d40 fpcurthread = none idlethread = 0xc8e599c0: tid 100006 "idle: cpu3" APIC ID = 3 currentldt = 0x50 spin locks held: db> show alllocks Process 11401 (sh) thread 0xca48d000 (100408) exclusive lockmgr bufwait (bufwait) r = 0 (0xe48b97e8) locked @ vm/vm_pager.c:378 exclusive lockmgr ufs (ufs) r = 0 (0xcafa9e44) locked @ kern/imgact_elf.c:901 Process 11399 (ctest) thread 0xc9c0b9c0 (101309) exclusive rw kernel vm object (kernel vm object) r = 0 (0xc1ac9c50) locked @ vm/vm_kern.c:232 db> show lockedvnods Locked vnodes 0xcafa9e10: tag ufs, type VREG usecount 5, writecount 0, refcount 6 mountedhere 0 flags (VV_TEXT|VI_ACTIVE) v_object 0xcae8d280 ref 3 pages 3 cleanbuf 0 dirtybuf 0 lock type ufs: EXCL by thread 0xca48d000 (pid 11401, sh, tid 100408) #0 0xc0c128aa at __lockmgr_args+0xa9a #1 0xc0f11b98 at ffs_lock+0x98 #2 0xc11f9d98 at VOP_LOCK1_APV+0x118 #3 0xc0d0df7a at _vn_lock+0xba #4 0xc0bd3619 at exec_elf32_imgact+0xaa9 #5 0xc0bf4723 at kern_execve+0x473 #6 0xc0bf3f6a at sys_execve+0x6a #7 0xc11c6d28 at syscall+0x388 #8 0xc11b1acf at Xint0x80_syscall+0x2f ino 1126202, on dev ada0s1d db> show mount 0xc96d9000 /dev/ada0s1a on / (ufs) 0xc96425d8 devfs on /dev (devfs) 0xc96d8bb0 /dev/ada0s1f on /home (ufs) 0xc9642000 /dev/ada0s1d on /usr (ufs) 0xc9641bb0 /dev/ada0s1e on /var (ufs) 0xc96418c4 procfs on /proc (procfs) 0xc96d88c4 /dev/label/tmp on /tmp (ufs) More info: show mount db> show page vm_cnt.v_free_count: 818752 vm_cnt.v_cache_count: 0 vm_cnt.v_inactive_count: 9727 vm_cnt.v_active_count: 1946 vm_cnt.v_wire_count: 28068 vm_cnt.v_free_reserved: 1173 vm_cnt.v_free_min: 5484 vm_cnt.v_free_target: 18417 vm_cnt.v_inactive_target: 27625 db> ps pid ppid pgrp uid state wmesg wchan cmd 11401 10788 25704 0 D+ vnread 0xe48b9798 sh 11399 10788 25704 0 R+ CPU 2 ctest 11381 24561 24557 1001 S nanslp 0xc19ebb9b sleep 10788 10787 25704 0 S+ wait 0xcb24c35c sh 10787 10785 25704 0 S+ pause 0xca1c33c0 timeout 10786 25704 25704 0 S+ piperd 0xca0e0660 tee 10785 25704 25704 0 S+ wait 0xcbc2d6b8 sh 25704 25134 25704 0 S+ wait 0xcb251a14 sh 25134 25132 25134 0 SW+ wait 0xcb24c6b8 bash 25132 25131 25132 0 SW+ pause 0xca1c4064 csh 25131 24542 25131 1001 SW+ wait 0xcb24ca14 su 24568 24559 24568 1001 Ss+ select 0xc971a324 top 24564 24557 24557 1001 S piperd 0xc9773000 sh 24562 24557 24557 1001 S piperd 0xcae26330 awk 24561 24557 24557 1001 S wait 0xc9b366b8 sh 24559 24549 24549 1001 S select 0xc95d40e4 sshd 24558 24556 24558 1001 Ss kqread 0xc9746d80 tail 24557 24555 24557 1001 SWs wait 0xcb25135c sh 24556 24551 24551 1001 S select 0xc936aea4 sshd 24555 24550 24550 1001 S select 0xc971a364 sshd 24551 690 24551 0 Ss select 0xc971a264 sshd 24550 690 24550 0 Ss select 0xc971a564 sshd 24549 690 24549 0 Ss select 0xc95d4364 sshd 24542 24541 24542 1001 SWs+ wait 0xca1c3a14 bash 24541 24526 24526 1001 S select 0xc983f3a4 sshd 24526 690 24526 0 Ss select 0xc9719d24 sshd 841 1 841 0 Ss+ ttyin 0xc90b0670 getty 840 1 840 0 Ss+ ttyin 0xc90af670 getty 839 1 839 0 Ss+ ttyin 0xc90af870 getty 838 1 838 0 Ss+ ttyin 0xc90afa70 getty 837 1 837 0 Ss+ ttyin 0xc90afc70 getty 836 1 836 0 Ss+ ttyin 0xc90afe70 getty 835 1 835 0 Ss+ ttyin 0xc90b0070 getty 834 1 834 0 Ss+ ttyin 0xc90b0270 getty 833 1 833 0 Ss+ ttyin 0xc90b0470 getty 814 1 814 0 Ss select 0xc936b0a4 inetd 784 1 784 0 Ss select 0xc983f864 moused 701 1 701 0 Ss nanslp 0xc19ebb99 cron 696 1 696 25 SWs pause 0xc983a064 sendmail 693 1 693 0 Ss select 0xc971a3a4 sendmail 690 1 690 0 Ss select 0xc983f8e4 sshd 653 1 652 0 SW nanslp 0xc19ebb9a smartd 623 1 623 0 Ss select 0xc971a464 powerd 620 1 620 0 Ss (threaded) ntpd 100152 S select 0xc971a3e4 ntpd 568 561 561 0 S (threaded) nfsd 100118 S rpcsvc 0xc9c30290 nfsd: master 100120 S rpcsvc 0xc9bdc290 nfsd: service 100121 S rpcsvc 0xc9bdc090 nfsd: service 100122 S rpcsvc 0xc9bdbe90 nfsd: service 100123 S rpcsvc 0xc9bdbd90 nfsd: service 100124 S rpcsvc 0xc9bdbc90 nfsd: service 100125 S rpcsvc 0xc9bdbb90 nfsd: service 100126 S rpcsvc 0xc9bdba90 nfsd: service 100127 S rpcsvc 0xc901a590 nfsd: service 100128 S rpcsvc 0xc9bdb990 nfsd: service 100129 S rpcsvc 0xc901a490 nfsd: service 100130 S rpcsvc 0xc9bdb890 nfsd: service 100131 S rpcsvc 0xc901a390 nfsd: service 100132 S rpcsvc 0xc9bdb790 nfsd: service 100133 S rpcsvc 0xc901a290 nfsd: service 100134 S rpcsvc 0xc901a190 nfsd: service 100135 S rpcsvc 0xc901a090 nfsd: service 100136 S rpcsvc 0xc9bdb690 nfsd: service 100137 S rpcsvc 0xc9bdb590 nfsd: service 100138 S rpcsvc 0xc9bdb490 nfsd: service 100139 S rpcsvc 0xc9bdb390 nfsd: service 100140 S rpcsvc 0xc9bdb290 nfsd: service 100141 S rpcsvc 0xc9bdb190 nfsd: service 100142 S rpcsvc 0xc9bdb090 nfsd: service 100143 S rpcsvc 0xc9bdae90 nfsd: service 100144 S rpcsvc 0xc9bdad90 nfsd: service 100145 S rpcsvc 0xca141490 nfsd: service 100146 S rpcsvc 0xc9bdac90 nfsd: service 100147 S rpcsvc 0xc9bdab90 nfsd: service 100148 S rpcsvc 0xc9bdaa90 nfsd: service 100149 S rpcsvc 0xca141390 nfsd: service 100150 S rpcsvc 0xca141290 nfsd: service 561 1 561 0 Ss select 0xc95d4424 nfsd 555 1 555 0 Ss select 0xc936b1a4 mountd 548 544 544 0 S select 0xc971a4a4 nfsuserd 547 544 544 0 S select 0xc95d4464 nfsuserd 546 544 544 0 S select 0xc971a4e4 nfsuserd 545 544 544 0 S select 0xc95d44a4 nfsuserd 544 1 544 0 SWs pause 0xc97fe71c nfsuserd 526 1 526 0 Ss select 0xc983f964 casperd 525 1 525 0 Ss select 0xc983f8a4 casperd 503 1 503 0 Ss nanslp 0xc19ebb9b watchdogd 419 1 419 0 Ss select 0xc95d4624 rpcbind 415 1 415 0 Ss select 0xc971a764 syslogd 379 1 379 0 Ss select 0xc983f924 rtsold 338 1 338 0 Ss select 0xc95d45e4 devd 23 0 0 0 DL vlruwt 0xc938b000 [vnlru] 22 0 0 0 DL syncer 0xc1a66410 [syncer] 21 0 0 0 DL - 0xc1a65e48 [bufspacedaemon] 20 0 0 0 DL (threaded) [bufdaemon] 100083 D psleep 0xc1a65204 [bufdaemon] 100099 D sdflush 0xc9aad284 [/home worker] 100101 D sdflush 0xc9aace84 [/usr worker] 100102 D sdflush 0xc9aacc84 [/var worker] 100169 D sdflush 0xc8f95e84 [/tmp worker] 19 0 0 0 DL pgzero 0xc1a6d9a8 [pagezero] 18 0 0 0 DL psleep 0xc1a6d824 [vmdaemon] 17 0 0 0 DL (threaded) [pagedaemon] 100080 D psleep 0xc1acb104 [pagedaemon] 100087 D umarcl 0xc1a6b420 [uma] 16 0 0 0 DL - 0xc1a64c90 [soaiod4] 15 0 0 0 DL - 0xc1a64c90 [soaiod3] 9 0 0 0 DL - 0xc1a64c90 [soaiod2] 8 0 0 0 DL - 0xc1a64c90 [soaiod1] 7 0 0 0 DL - 0xc1942354 [rand_harvestq] 6 0 0 0 DL waiting_ 0xc1ac6a50 [sctp_iterator] 5 0 0 0 DL - 0xc9050a3c [fdc0] 14 0 0 0 DL (threaded) [usb] 100033 D - 0xc9064acc [usbus0] 100034 D - 0xc9064afc [usbus0] 100035 D - 0xc9064b2c [usbus0] 100036 D - 0xc9064b5c [usbus0] 100037 D - 0xc9064b8c [usbus0] 100039 D - 0xc90b8acc [usbus1] 100040 D - 0xc90b8afc [usbus1] 100041 D - 0xc90b8b2c [usbus1] 100042 D - 0xc90b8b5c [usbus1] 100043 D - 0xc90b8b8c [usbus1] 100045 D - 0xc90c1acc [usbus2] 100046 D - 0xc90c1afc [usbus2] 100047 D - 0xc90c1b2c [usbus2] 100048 D - 0xc90c1b5c [usbus2] 100049 D - 0xc90c1b8c [usbus2] 100050 D - 0xc90c7acc [usbus3] 100051 D - 0xc90c7afc [usbus3] 100052 D - 0xc90c7b2c [usbus3] 100053 D - 0xc90c7b5c [usbus3] 100054 D - 0xc90c7b8c [usbus3] 100055 D - 0xc90d3acc [usbus4] 100056 D - 0xc90d3afc [usbus4] 100057 D - 0xc90d3b2c [usbus4] 100058 D - 0xc90d3b5c [usbus4] 100059 D - 0xc90d3b8c [usbus4] 100061 D - 0xc9069ca4 [usbus5] 100062 D - 0xc9069cd4 [usbus5] 100063 D - 0xc9069d04 [usbus5] 100064 D - 0xc9069d34 [usbus5] 100065 D - 0xc9069d64 [usbus5] 4 0 0 0 DL (threaded) [cam] 100024 D - 0xc188e400 [doneq0] 100075 D - 0xc188e2ac [scanner] 3 0 0 0 DL crypto_r 0xc1a6a778 [crypto returns] 2 0 0 0 DL crypto_w 0xc1a6a6c0 [crypto] 13 0 0 0 DL (threaded) [geom] 100013 D - 0xc1ac1bcc [g_event] 100014 D - 0xc1ac1bd0 [g_up] 100015 D - 0xc1ac1bd4 [g_down] 12 0 0 0 WL (threaded) [intr] 100007 I [swi3: vm] 100008 I [swi1: netisr 0] 100009 I [swi4: clock (0)] 100010 I [swi4: clock (1)] 100011 I [swi4: clock (2)] 100012 I [swi4: clock (3)] 100019 I [swi5: fast taskq] 100026 I [swi6: task queue] 100027 I [swi6: Giant taskq] 100029 I [irq256: hdac0] 100030 I [irq257: re0] 100031 I [irq22: ahci0] 100032 I [irq16: hdac1 ohci0] 100038 I [irq17: ohci1 ohci3] 100044 I [irq18: ohci2 ohci4] 100060 I [irq19: ehci0] 100066 I [irq14: ata0] 100067 I [swi0: uart] 100069 I [irq1: atkbd0] 100070 I [irq12: psm0] 11 0 0 0 RL (threaded) [idle] 100003 Run CPU 0 [idle: cpu0] 100004 Run CPU 1 [idle: cpu1] 100005 CanRun [idle: cpu2] 100006 Run CPU 3 [idle: cpu3] 1 0 1 0 SLs wait 0xc8e51a14 [init] 10 0 0 0 DL audit_wo 0xc1ac9948 [audit] 0 0 0 0 DLs (threaded) [kernel] 100000 D swapin 0xc1ac1bf4 [swapper] 100016 D - 0xc8e57100 [firmware taskq] 100020 D - 0xc8e57000 [aiod_kick taskq] 100021 D - 0xc8e56f00 [acpi_task_0] 100022 D - 0xc8e56f00 [acpi_task_1] 100023 D - 0xc8e56f00 [acpi_task_2] 100025 D - 0xc8e56e00 [kqueue taskq] 100028 D - 0xc8e56680 [thread taskq] 100071 D - 0xc90d0800 [mca taskq] 100074 D - 0xc8e56e80 [CAM taskq] db> allt Tracing command sh pid 11401 tid 100408 td 0xca48d000 sched_switch(ca48d000,0,104,196,c8573550,...) at sched_switch+0x4da/frame 0xc8573518 mi_switch(104,0,c15ad4f5,205,c8cd5538,...) at mi_switch+0x1bf/frame 0xc8573550 sleepq_switch(ca48d000,0,c15ad4f5,27c,ca48d000,...) at sleepq_switch+0x127/frame 0xc8573584 sleepq_wait(e48b9798,54,c15f3e9c,0,0,...) at sleepq_wait+0x48/frame 0xc85735a8 _sleep(e48b9798,c8cd5538,54,c15f3e9c,0,...) at _sleep+0x352/frame 0xc8573604 bwait(e48b9798,54,c15f3e9c,0,c15f1243,...) at bwait+0x8f/frame 0xc8573640 vnode_pager_generic_getpages(cafa9e10,c8573874,1,0,0,0,0) at vnode_pager_generic_getpages+0x1183/frame 0xc85736fc vnode_pager_local_getpages(c8573770,c179d579,8,c15f3cec,2a9,...) at vnode_pager_local_getpages+0x42/frame 0xc8573728 VOP_GETPAGES_APV(c1873730,c8573770,2a9,4,c188b3c0,...) at VOP_GETPAGES_APV+0x135/frame 0xc8573758 vnode_pager_getpages(cae8d280,c8573874,1,0,0,...) at vnode_pager_getpages+0x68/frame 0xc85737a0 vm_pager_get_pages(cae8d280,c8573874,1,0,0,...) at vm_pager_get_pages+0x9a/frame 0xc8573810 vm_imgact_hold_page(cae8d280,3b3d,0,c11f9df0,804d000,...) at vm_imgact_hold_page+0xc3/frame 0xc8573890 vm_imgact_map_page(cae8d280,3b3d,0,804d000,7,...) at vm_imgact_map_page+0x32/frame 0xc85738d0 elf32_load_section(804c994,218,1a9,3,1000,...) at elf32_load_section+0x14b/frame 0xc8573910 exec_elf32_imgact(c8573ab0,c8573b98,4200844,1,ee000000,...) at exec_elf32_imgact+0xbb4/frame 0xc85739b8 kern_execve(ca48d000,c8573be0,0,28646138,28646204,...) at kern_execve+0x473/frame 0xc8573bc0 sys_execve(ca48d000,c8573ca8,c159e93c,4,cd384000,...) at sys_execve+0x6a/frame 0xc8573c20 syscall(c8573ce8) at syscall+0x388/frame 0xc8573cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc8573cdc --- syscall (59, FreeBSD ELF32, sys_execve), eip = 0x281714ff, esp = 0xbfbfe438, ebp = 0xbfbfe568 --- Tracing command ctest pid 11399 tid 101309 td 0xc9c0b9c0 kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command sleep pid 11381 tid 100699 td 0xcb051340 sched_switch(cb051340,0,104,196,c85b2a8c,...) at sched_switch+0x4da/frame 0xc85b2a54 mi_switch(104,0,c15ad4f5,205,c899f080,...) at mi_switch+0x1bf/frame 0xc85b2a8c sleepq_switch(cb051340,0,c15ad4f5,1bb,170,...) at sleepq_switch+0x127/frame 0xc85b2ac0 sleepq_catch_signals(c0c89eb0,cb051340,3,201,3,...) at sleepq_catch_signals+0x3b3/frame 0xc85b2afc sleepq_timedwait_sig(c19ebb9b,6c,147f,a0000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xc85b2b24 _sleep(c19ebb9b,0,16c,c15a8702,2c5806f5,...) at _sleep+0x30f/frame 0xc85b2b80 kern_nanosleep(bfbfece8,c85b2bf8,c85b2c00,0,a,...) at kern_nanosleep+0x137/frame 0xc85b2be0 sys_nanosleep(cb051340,c85b2ca8,c159e93c,4,cc57835c,...) at sys_nanosleep+0x68/frame 0xc85b2c20 syscall(c85b2ce8) at syscall+0x388/frame 0xc85b2cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc85b2cdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2814a113, esp = 0xbfbfeca8, ebp = 0xbfbfecb8 --- Tracing command sh pid 10788 tid 100655 td 0xcaf65340 sched_switch(caf65340,0,104,196,c853d9a4,...) at sched_switch+0x4da/frame 0xc853d96c mi_switch(104,0,c15ad4f5,205,c971e1c0,...) at mi_switch+0x1bf/frame 0xc853d9a4 sleepq_switch(caf65340,0,c15ad4f5,1bb,c853da1c,...) at sleepq_switch+0x127/frame 0xc853d9d8 sleepq_catch_signals(c15ad4f5,170,cb24c414,1dd,caf65340,...) at sleepq_catch_signals+0x3b3/frame 0xc853da14 sleepq_wait_sig(cb24c35c,6c,c15b15d0,100,0,...) at sleepq_wait_sig+0x14/frame 0xc853da38 _sleep(cb24c35c,cb24c404,16c,c15b15d0,0,...) at _sleep+0x33f/frame 0xc853da94 kern_wait6(caf65340,7,0,0,c853db2c,...) at kern_wait6+0x47d/frame 0xc853db00 sys_wait4(caf65340,c853dca8,c159e93c,4,0,...) at sys_wait4+0x8b/frame 0xc853dc20 syscall(c853dce8) at syscall+0x388/frame 0xc853dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc853dcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28195053, esp = 0xbfbfe640, ebp = 0xbfbfe658 --- Tracing command timeout pid 10787 tid 100989 td 0xccb9d000 sched_switch(ccb9d000,0,104,196,f3aa7ac0,...) at sched_switch+0x4da/frame 0xf3aa7a88 mi_switch(104,0,c15ad4f5,205,f3aa7b28,...) at mi_switch+0x1bf/frame 0xf3aa7ac0 sleepq_switch(ccb9d000,0,c15ad4f5,1bb,f3aa7b38,...) at sleepq_switch+0x127/frame 0xf3aa7af4 sleepq_catch_signals(c15ad4f5,170,ca1c3414,2d9,ccb9d000,...) at sleepq_catch_signals+0x3b3/frame 0xf3aa7b30 sleepq_wait_sig(ca1c33c0,74,c12310a3,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3aa7b54 _sleep(ca1c33c0,ca1c3404,174,c12310a3,0,...) at _sleep+0x33f/frame 0xf3aa7bb0 kern_sigsuspend(ccb9d000,0,0,0,0,...) at kern_sigsuspend+0xd4/frame 0xf3aa7bf0 sys_sigsuspend(ccb9d000,f3aa7ca8,c159e93c,4,ca1c335c,...) at sys_sigsuspend+0x55/frame 0xf3aa7c20 syscall(f3aa7ce8) at syscall+0x388/frame 0xf3aa7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3aa7cdc --- syscall (4, FreeBSD ELF32, sys_write), eip = 0x2814b093, esp = 0xbfbfe624, ebp = 0xbfbfe630 --- Tracing command tee pid 10786 tid 101153 td 0xcbcfd000 sched_switch(cbcfd000,0,104,196,f3b19a1c,...) at sched_switch+0x4da/frame 0xf3b199e4 mi_switch(104,0,c15ad4f5,205,c971dbc0,...) at mi_switch+0x1bf/frame 0xf3b19a1c sleepq_switch(cbcfd000,0,c15ad4f5,1bb,f3b19a94,...) at sleepq_switch+0x127/frame 0xf3b19a50 sleepq_catch_signals(c15ad4f5,170,ca0e07f0,132,cbcfd000,...) at sleepq_catch_signals+0x3b3/frame 0xf3b19a8c sleepq_wait_sig(ca0e0660,5c,c15b0e51,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3b19ab0 _sleep(ca0e0660,ca0e07e0,15c,c15b0e51,0,...) at _sleep+0x33f/frame 0xf3b19b0c pipe_read(cae57118,f3b19bf0,c96dbe00,0,cbcfd000,...) at pipe_read+0x2ca/frame 0xf3b19b50 dofileread(cae57118,f3b19bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3b19b88 kern_readv(cbcfd000,0,f3b19bf0,2,28413000,...) at kern_readv+0x93/frame 0xf3b19bd0 sys_read(cbcfd000,f3b19ca8,c159e93c,4,cb2516b8,...) at sys_read+0x59/frame 0xf3b19c20 syscall(f3b19ce8) at syscall+0x388/frame 0xf3b19cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3b19cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281b9293, esp = 0xbfbfe7a0, ebp = 0xbfbfe7b4 --- Tracing command sh pid 10785 tid 101053 td 0xcb052340 sched_switch(cb052340,0,104,196,c851f9a4,...) at sched_switch+0x4da/frame 0xc851f96c mi_switch(104,0,c15ad4f5,205,c9802300,...) at mi_switch+0x1bf/frame 0xc851f9a4 sleepq_switch(cb052340,0,c15ad4f5,1bb,c851fa1c,...) at sleepq_switch+0x127/frame 0xc851f9d8 sleepq_catch_signals(c15ad4f5,170,cbc2d770,14a,cb052340,...) at sleepq_catch_signals+0x3b3/frame 0xc851fa14 sleepq_wait_sig(cbc2d6b8,6c,c15b15d0,100,0,...) at sleepq_wait_sig+0x14/frame 0xc851fa38 _sleep(cbc2d6b8,cbc2d760,16c,c15b15d0,0,...) at _sleep+0x33f/frame 0xc851fa94 kern_wait6(cb052340,7,0,0,c851fb2c,...) at kern_wait6+0x47d/frame 0xc851fb00 sys_wait4(cb052340,c851fca8,c159e93c,4,cbc2d6b8,...) at sys_wait4+0x8b/frame 0xc851fc20 syscall(c851fce8) at syscall+0x388/frame 0xc851fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc851fcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28195053, esp = 0xbfbfe508, ebp = 0xbfbfe520 --- Tracing command sh pid 25704 tid 100201 td 0xcb051680 sched_switch(cb051680,0,104,196,f3aaa9a4,...) at sched_switch+0x4da/frame 0xf3aaa96c mi_switch(104,0,c15ad4f5,205,c971ea80,...) at mi_switch+0x1bf/frame 0xf3aaa9a4 sleepq_switch(cb051680,0,c15ad4f5,1bb,f3aaaa1c,...) at sleepq_switch+0x127/frame 0xf3aaa9d8 sleepq_catch_signals(c15ad4f5,170,cb251acc,2a,cb051680,...) at sleepq_catch_signals+0x3b3/frame 0xf3aaaa14 sleepq_wait_sig(cb251a14,6c,c15b15d0,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3aaaa38 _sleep(cb251a14,cb251abc,16c,c15b15d0,0,...) at _sleep+0x33f/frame 0xf3aaaa94 kern_wait6(cb051680,7,0,0,f3aaab2c,...) at kern_wait6+0x47d/frame 0xf3aaab00 sys_wait4(cb051680,f3aaaca8,c159e93c,4,0,...) at sys_wait4+0x8b/frame 0xf3aaac20 syscall(f3aaace8) at syscall+0x388/frame 0xf3aaacdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3aaacdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28195053, esp = 0xbfbfe780, ebp = 0xbfbfe798 --- Tracing command bash pid 25134 tid 100208 td 0xcb050340 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(cb050340,ffffffff,622e,18770,cb050340,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command csh pid 25132 tid 100190 td 0xca13d340 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(ca13d340,ffffffff,622c,1875e,ca13d340,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command su pid 25131 tid 100207 td 0xcb050680 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(cb050680,ffffffff,622b,1876f,cb050680,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command top pid 24568 tid 100157 td 0xca13a000 sched_switch(ca13a000,0,104,196,f3913914,...) at sched_switch+0x4da/frame 0xf39138dc mi_switch(104,0,c15ad4f5,205,c971ec80,...) at mi_switch+0x1bf/frame 0xf3913914 sleepq_switch(ca13a000,0,c15ad4f5,1bb,c971a310,...) at sleepq_switch+0x127/frame 0xf3913948 sleepq_catch_signals(c184981c,f39139ac,c0c1bad6,c971a320,0,...) at sleepq_catch_signals+0x3b3/frame 0xf3913984 sleepq_timedwait_sig(c971a324,0,f39139e8,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39139ac _cv_timedwait_sig_sbt(c971a324,c971a310,f6d6fd31,147e,10000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf39139fc seltdwait(147e,10000000,0,ca13a000,0,...) at seltdwait+0x8d/frame 0xf3913a30 kern_select(ca13a000,2,bfbfec08,0,0,...) at kern_select+0x910/frame 0xf3913bd8 sys_select(ca13a000,f3913ca8,c159e93c,4,c2027c90,...) at sys_select+0x66/frame 0xf3913c20 syscall(f3913ce8) at syscall+0x388/frame 0xf3913cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3913cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2824d283, esp = 0xbfbfeb94, ebp = 0xbfbfebb8 --- Tracing command sh pid 24564 tid 100174 td 0xca1eb680 sched_switch(ca1eb680,0,104,196,f394aa1c,...) at sched_switch+0x4da/frame 0xf394a9e4 mi_switch(104,0,c15ad4f5,205,c899f440,...) at mi_switch+0x1bf/frame 0xf394aa1c sleepq_switch(ca1eb680,0,c15ad4f5,1bb,f394aa94,...) at sleepq_switch+0x127/frame 0xf394aa50 sleepq_catch_signals(c15ad4f5,170,c9773190,90,ca1eb680,...) at sleepq_catch_signals+0x3b3/frame 0xf394aa8c sleepq_wait_sig(c9773000,5c,c15b0e51,100,0,...) at sleepq_wait_sig+0x14/frame 0xf394aab0 _sleep(c9773000,c9773180,15c,c15b0e51,0,...) at _sleep+0x33f/frame 0xf394ab0c pipe_read(cae58540,f394abf0,c8e23100,0,ca1eb680,...) at pipe_read+0x2ca/frame 0xf394ab50 dofileread(cae58540,f394abf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf394ab88 kern_readv(ca1eb680,0,f394abf0,2,bfbfe99f,...) at kern_readv+0x93/frame 0xf394abd0 sys_read(ca1eb680,f394aca8,c159e93c,4,c9b35000,...) at sys_read+0x59/frame 0xf394ac20 syscall(f394ace8) at syscall+0x388/frame 0xf394acdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf394acdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x28204293, esp = 0xbfbfe944, ebp = 0xbfbfe958 --- Tracing command awk pid 24562 tid 100167 td 0xc9b289c0 sched_switch(c9b289c0,0,104,196,f3930a1c,...) at sched_switch+0x4da/frame 0xf39309e4 mi_switch(104,0,c15ad4f5,205,c971ed40,...) at mi_switch+0x1bf/frame 0xf3930a1c sleepq_switch(c9b289c0,0,c15ad4f5,1bb,f3930a94,...) at sleepq_switch+0x127/frame 0xf3930a50 sleepq_catch_signals(c15ad4f5,170,cae264c0,f9,c9b289c0,...) at sleepq_catch_signals+0x3b3/frame 0xf3930a8c sleepq_wait_sig(cae26330,5c,c15b0e51,100,0,...) at sleepq_wait_sig+0x14/frame 0xf3930ab0 _sleep(cae26330,cae264b0,15c,c15b0e51,0,...) at _sleep+0x33f/frame 0xf3930b0c pipe_read(c977d930,f3930bf0,c8e23100,0,c9b289c0,...) at pipe_read+0x2ca/frame 0xf3930b50 dofileread(c977d930,f3930bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3930b88 kern_readv(c9b289c0,0,f3930bf0,2,28676000,...) at kern_readv+0x93/frame 0xf3930bd0 sys_read(c9b289c0,f3930ca8,c159e93c,4,c2027c90,...) at sys_read+0x59/frame 0xf3930c20 syscall(f3930ce8) at syscall+0x388/frame 0xf3930cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3930cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x2820d293, esp = 0xbfbfe9cc, ebp = 0xbfbfe9e0 --- Tracing command sh pid 24561 tid 100166 td 0xca0f0000 sched_switch(ca0f0000,0,104,196,f392d9a4,...) at sched_switch+0x4da/frame 0xf392d96c mi_switch(104,0,c15ad4f5,205,c971edc0,...) at mi_switch+0x1bf/frame 0xf392d9a4 sleepq_switch(ca0f0000,0,c15ad4f5,1bb,f392da1c,...) at sleepq_switch+0x127/frame 0xf392d9d8 sleepq_catch_signals(c15ad4f5,170,c9b36770,29a,ca0f0000,...) at sleepq_catch_signals+0x3b3/frame 0xf392da14 sleepq_wait_sig(c9b366b8,6c,c15b15d0,100,0,...) at sleepq_wait_sig+0x14/frame 0xf392da38 _sleep(c9b366b8,c9b36760,16c,c15b15d0,0,...) at _sleep+0x33f/frame 0xf392da94 kern_wait6(ca0f0000,7,0,0,f392db2c,...) at kern_wait6+0x47d/frame 0xf392db00 sys_wait4(ca0f0000,f392dca8,c159e93c,4,0,...) at sys_wait4+0x8b/frame 0xf392dc20 syscall(f392dce8) at syscall+0x388/frame 0xf392dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf392dcdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x28195053, esp = 0xbfbfe968, ebp = 0xbfbfe980 --- Tracing command sshd pid 24559 tid 100204 td 0xca1eb340 sched_switch(ca1eb340,0,104,196,f3ab391c,...) at sched_switch+0x4da/frame 0xf3ab38e4 mi_switch(104,0,c15ad4f5,205,c899f480,...) at mi_switch+0x1bf/frame 0xf3ab391c sleepq_switch(ca1eb340,0,c15ad4f5,1bb,f3ab3994,...) at sleepq_switch+0x127/frame 0xf3ab3950 sleepq_catch_signals(f3ab39b0,c0c1bad6,c95d40e0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3ab398c sleepq_wait_sig(c95d40e4,0,f3ab39e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3ab39b0 _cv_wait_sig(c95d40e4,c95d40d0,c15b0bcb,74d,c15b393e,...) at _cv_wait_sig+0x211/frame 0xf3ab39fc seltdwait(ffffffff,0,0,ca1eb340,0,...) at seltdwait+0xbf/frame 0xf3ab3a30 kern_select(ca1eb340,a,28a17088,28a170c0,0,...) at kern_select+0x910/frame 0xf3ab3bd8 sys_select(ca1eb340,f3ab3ca8,c159e93c,4,e4b20c90,...) at sys_select+0x66/frame 0xf3ab3c20 syscall(f3ab3ce8) at syscall+0x388/frame 0xf3ab3cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3ab3cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28514283, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command tail pid 24558 tid 100199 td 0xcb052000 sched_switch(cb052000,0,104,196,f3aa48fc,...) at sched_switch+0x4da/frame 0xf3aa48c4 mi_switch(104,0,c15ad4f5,205,c971ea00,...) at mi_switch+0x1bf/frame 0xf3aa48fc sleepq_switch(cb052000,0,c15ad4f5,1bb,170,...) at sleepq_switch+0x127/frame 0xf3aa4930 sleepq_catch_signals(c0c89eb0,cb052000,1,201,1,...) at sleepq_catch_signals+0x3b3/frame 0xf3aa496c sleepq_timedwait_sig(c9746d80,68,147f,10000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf3aa4994 _sleep(c9746d80,c9746d80,168,c159e476,abded2e2,...) at _sleep+0x30f/frame 0xf3aa49f0 kqueue_kevent(0,1,f3aa4bf0,f3aa4c00,0,...) at kqueue_kevent+0x38a/frame 0xf3aa4b2c kern_kevent_fp(cb052000,c977ee00,0,1,f3aa4bf0,...) at kern_kevent_fp+0xa0/frame 0xf3aa4b50 kern_kevent(cb052000,4,0,1,f3aa4bf0,...) at kern_kevent+0xe8/frame 0xf3aa4ba0 sys_kevent(cb052000,f3aa4ca8,c159e93c,4,c19f9510,...) at sys_kevent+0x135/frame 0xf3aa4c20 syscall(f3aa4ce8) at syscall+0x388/frame 0xf3aa4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3aa4cdc --- syscall (363, FreeBSD ELF32, sys_kevent), eip = 0x281a26db, esp = 0xbfbfeb90, ebp = 0xbfbfebb8 --- Tracing command sh pid 24557 tid 100203 td 0xcb051000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(cb051000,ffffffff,5fed,1876b,cb051000,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command sshd pid 24556 tid 100165 td 0xc9b2d000 sched_switch(c9b2d000,0,104,196,f392a91c,...) at sched_switch+0x4da/frame 0xf392a8e4 mi_switch(104,0,c15ad4f5,205,c971ed00,...) at mi_switch+0x1bf/frame 0xf392a91c sleepq_switch(c9b2d000,0,c15ad4f5,1bb,f392a994,...) at sleepq_switch+0x127/frame 0xf392a950 sleepq_catch_signals(f392a9b0,c0c1bad6,c936aea0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf392a98c sleepq_wait_sig(c936aea4,0,f392a9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf392a9b0 _cv_wait_sig(c936aea4,c936ae90,c15b0bcb,74d,c15b0c26,...) at _cv_wait_sig+0x211/frame 0xf392a9fc seltdwait(ffffffff,0,0,c9b2d000,0,...) at seltdwait+0xbf/frame 0xf392aa30 kern_select(c9b2d000,c,28a17088,28a170c0,0,...) at kern_select+0x910/frame 0xf392abd8 sys_select(c9b2d000,f392aca8,c159e93c,4,e4b1dc90,...) at sys_select+0x66/frame 0xf392ac20 syscall(f392ace8) at syscall+0x388/frame 0xf392acdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf392acdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28514283, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 24555 tid 100153 td 0xca0f1000 sched_switch(ca0f1000,0,104,196,f38fd91c,...) at sched_switch+0x4da/frame 0xf38fd8e4 mi_switch(104,0,c15ad4f5,205,c899f7c0,...) at mi_switch+0x1bf/frame 0xf38fd91c sleepq_switch(ca0f1000,0,c15ad4f5,1bb,f38fd994,...) at sleepq_switch+0x127/frame 0xf38fd950 sleepq_catch_signals(f38fd9b0,c0c1bad6,c971a360,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38fd98c sleepq_wait_sig(c971a364,0,f38fd9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38fd9b0 _cv_wait_sig(c971a364,c971a350,c15b0bcb,74d,c15b0c26,...) at _cv_wait_sig+0x211/frame 0xf38fd9fc seltdwait(ffffffff,0,0,ca0f1000,0,...) at seltdwait+0xbf/frame 0xf38fda30 kern_select(ca0f1000,c,28a17088,28a170c0,0,...) at kern_select+0x910/frame 0xf38fdbd8 sys_select(ca0f1000,f38fdca8,c159e93c,4,c2027c90,...) at sys_select+0x66/frame 0xf38fdc20 syscall(f38fdce8) at syscall+0x388/frame 0xf38fdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf38fdcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28514283, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 24551 tid 100193 td 0xc97ff000 sched_switch(c97ff000,0,104,196,f3a92954,...) at sched_switch+0x4da/frame 0xf3a9291c mi_switch(104,0,c15ad4f5,205,c971ee00,...) at mi_switch+0x1bf/frame 0xf3a92954 sleepq_switch(c97ff000,0,c15ad4f5,1bb,f3a929cc,...) at sleepq_switch+0x127/frame 0xf3a92988 sleepq_catch_signals(f3a929e8,c0c1bad6,c971a260,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3a929c4 sleepq_wait_sig(c971a264,0,f3a92a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3a929e8 _cv_wait_sig(c971a264,c971a250,c15b0bcb,74d,c15b0bcb,...) at _cv_wait_sig+0x211/frame 0xf3a92a34 seltdwait(ffffffff,0,0,c97ff000,0,...) at seltdwait+0xbf/frame 0xf3a92a68 kern_poll(c97ff000,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf3a92be8 sys_poll(c97ff000,f3a92ca8,c159e93c,4,e4b1ac90,...) at sys_poll+0x71/frame 0xf3a92c20 syscall(f3a92ce8) at syscall+0x388/frame 0xf3a92cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3a92cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b6f8b, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command sshd pid 24550 tid 100106 td 0xc9603000 sched_switch(c9603000,0,104,196,edf88954,...) at sched_switch+0x4da/frame 0xedf8891c mi_switch(104,0,c15ad4f5,205,c95e8040,...) at mi_switch+0x1bf/frame 0xedf88954 sleepq_switch(c9603000,0,c15ad4f5,1bb,edf889cc,...) at sleepq_switch+0x127/frame 0xedf88988 sleepq_catch_signals(edf889e8,c0c1bad6,c971a560,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf889c4 sleepq_wait_sig(c971a564,0,edf88a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf889e8 _cv_wait_sig(c971a564,c971a550,c15b0bcb,74d,c15b0bcb,...) at _cv_wait_sig+0x211/frame 0xedf88a34 seltdwait(ffffffff,0,0,c9603000,0,...) at seltdwait+0xbf/frame 0xedf88a68 kern_poll(c9603000,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xedf88be8 sys_poll(c9603000,edf88ca8,c159e93c,4,0,...) at sys_poll+0x71/frame 0xedf88c20 syscall(edf88ce8) at syscall+0x388/frame 0xedf88cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf88cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b6f8b, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command sshd pid 24549 tid 100192 td 0xcb0529c0 sched_switch(cb0529c0,0,104,196,f3a8f954,...) at sched_switch+0x4da/frame 0xf3a8f91c mi_switch(104,0,c15ad4f5,205,c971e940,...) at mi_switch+0x1bf/frame 0xf3a8f954 sleepq_switch(cb0529c0,0,c15ad4f5,1bb,f3a8f9cc,...) at sleepq_switch+0x127/frame 0xf3a8f988 sleepq_catch_signals(f3a8f9e8,c0c1bad6,c95d4360,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3a8f9c4 sleepq_wait_sig(c95d4364,0,f3a8fa20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3a8f9e8 _cv_wait_sig(c95d4364,c95d4350,c15b0bcb,74d,c15b0bcb,...) at _cv_wait_sig+0x211/frame 0xf3a8fa34 seltdwait(ffffffff,0,0,cb0529c0,0,...) at seltdwait+0xbf/frame 0xf3a8fa68 kern_poll(cb0529c0,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf3a8fbe8 sys_poll(cb0529c0,f3a8fca8,c159e93c,4,e4b20c90,...) at sys_poll+0x71/frame 0xf3a8fc20 syscall(f3a8fce8) at syscall+0x388/frame 0xf3a8fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3a8fcdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b6f8b, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command bash pid 24542 tid 100191 td 0xcb053000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(cb053000,ffffffff,5fde,1875f,cb053000,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command sshd pid 24541 tid 100164 td 0xc9b2d340 sched_switch(c9b2d340,0,104,196,f392791c,...) at sched_switch+0x4da/frame 0xf39278e4 mi_switch(104,0,c15ad4f5,205,c971ecc0,...) at mi_switch+0x1bf/frame 0xf392791c sleepq_switch(c9b2d340,0,c15ad4f5,1bb,f3927994,...) at sleepq_switch+0x127/frame 0xf3927950 sleepq_catch_signals(f39279b0,c0c1bad6,c983f3a0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf392798c sleepq_wait_sig(c983f3a4,0,f39279e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf39279b0 _cv_wait_sig(c983f3a4,c983f390,c15b0bcb,74d,c15b393e,...) at _cv_wait_sig+0x211/frame 0xf39279fc seltdwait(ffffffff,0,0,c9b2d340,0,...) at seltdwait+0xbf/frame 0xf3927a30 kern_select(c9b2d340,c,28a17088,28a170c0,0,...) at kern_select+0x910/frame 0xf3927bd8 sys_select(c9b2d340,f3927ca8,c159e93c,4,e4b20c90,...) at sys_select+0x66/frame 0xf3927c20 syscall(f3927ce8) at syscall+0x388/frame 0xf3927cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3927cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28514283, esp = 0xbfbfe794, ebp = 0xbfbfe7b8 --- Tracing command sshd pid 24526 tid 100189 td 0xca13d680 sched_switch(ca13d680,0,104,196,f3a86954,...) at sched_switch+0x4da/frame 0xf3a8691c mi_switch(104,0,c15ad4f5,205,c95e7840,...) at mi_switch+0x1bf/frame 0xf3a86954 sleepq_switch(ca13d680,0,c15ad4f5,1bb,f3a869cc,...) at sleepq_switch+0x127/frame 0xf3a86988 sleepq_catch_signals(f3a869e8,c0c1bad6,c9719d20,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3a869c4 sleepq_wait_sig(c9719d24,0,f3a86a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3a869e8 _cv_wait_sig(c9719d24,c9719d10,c15b0bcb,74d,c15b0bcb,...) at _cv_wait_sig+0x211/frame 0xf3a86a34 seltdwait(ffffffff,0,0,ca13d680,0,...) at seltdwait+0xbf/frame 0xf3a86a68 kern_poll(ca13d680,bfbfe878,1,0,0,...) at kern_poll+0x4d0/frame 0xf3a86be8 sys_poll(ca13d680,f3a86ca8,c159e93c,4,c2027c90,...) at sys_poll+0x71/frame 0xf3a86c20 syscall(f3a86ce8) at syscall+0x388/frame 0xf3a86cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3a86cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x284b6f8b, esp = 0xbfbfe804, ebp = 0xbfbfe820 --- Tracing command getty pid 841 tid 100179 td 0xca0dc9c0 sched_switch(ca0dc9c0,0,104,196,f39599b0,...) at sched_switch+0x4da/frame 0xf3959978 mi_switch(104,0,c15ad4f5,205,f3959a18,...) at mi_switch+0x1bf/frame 0xf39599b0 sleepq_switch(ca0dc9c0,0,c15ad4f5,1bb,f3959a28,...) at sleepq_switch+0x127/frame 0xf39599e4 sleepq_catch_signals(f3959a44,c0c1bad6,c90b0614,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3959a20 sleepq_wait_sig(c90b0670,0,f3959a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3959a44 _cv_wait_sig(c90b0670,c90b0604,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3959a90 tty_wait(c90b0600,c90b0670,f3959bf0,1,0,...) at tty_wait+0x4b/frame 0xf3959ab4 ttydisc_read(c90b0600,f3959bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3959af8 ttydev_read(c90e7400,f3959bf0,0,c9cb9028,0,...) at ttydev_read+0x55/frame 0xf3959b18 devfs_read_f(c9768c78,f3959bf0,ca0eb000,0,ca0dc9c0,...) at devfs_read_f+0xc7/frame 0xf3959b50 dofileread(c9768c78,f3959bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3959b88 kern_readv(ca0dc9c0,0,f3959bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3959bd0 sys_read(ca0dc9c0,f3959ca8,c159e93c,4,0,...) at sys_read+0x59/frame 0xf3959c20 syscall(f3959ce8) at syscall+0x388/frame 0xf3959cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3959cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 840 tid 100178 td 0xc9b1e000 sched_switch(c9b1e000,0,104,196,f39569b0,...) at sched_switch+0x4da/frame 0xf3956978 mi_switch(104,0,c15ad4f5,205,f3956a18,...) at mi_switch+0x1bf/frame 0xf39569b0 sleepq_switch(c9b1e000,0,c15ad4f5,1bb,f3956a28,...) at sleepq_switch+0x127/frame 0xf39569e4 sleepq_catch_signals(f3956a44,c0c1bad6,c90af614,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3956a20 sleepq_wait_sig(c90af670,0,f3956a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3956a44 _cv_wait_sig(c90af670,c90af604,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3956a90 tty_wait(c90af600,c90af670,f3956bf0,1,0,...) at tty_wait+0x4b/frame 0xf3956ab4 ttydisc_read(c90af600,f3956bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3956af8 ttydev_read(c93a4c00,f3956bf0,0,c9f8f3a0,0,...) at ttydev_read+0x55/frame 0xf3956b18 devfs_read_f(c9768cb0,f3956bf0,c964be00,0,c9b1e000,...) at devfs_read_f+0xc7/frame 0xf3956b50 dofileread(c9768cb0,f3956bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3956b88 kern_readv(c9b1e000,0,f3956bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3956bd0 sys_read(c9b1e000,f3956ca8,c159e93c,4,c2027c90,...) at sys_read+0x59/frame 0xf3956c20 syscall(f3956ce8) at syscall+0x388/frame 0xf3956cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3956cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 839 tid 100177 td 0xc9b1e340 sched_switch(c9b1e340,0,104,196,f39539b0,...) at sched_switch+0x4da/frame 0xf3953978 mi_switch(104,0,c15ad4f5,205,f3953a18,...) at mi_switch+0x1bf/frame 0xf39539b0 sleepq_switch(c9b1e340,0,c15ad4f5,1bb,f3953a28,...) at sleepq_switch+0x127/frame 0xf39539e4 sleepq_catch_signals(f3953a44,c0c1bad6,c90af814,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3953a20 sleepq_wait_sig(c90af870,0,f3953a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3953a44 _cv_wait_sig(c90af870,c90af804,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3953a90 tty_wait(c90af800,c90af870,f3953bf0,1,0,...) at tty_wait+0x4b/frame 0xf3953ab4 ttydisc_read(c90af800,f3953bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3953af8 ttydev_read(c93a4d00,f3953bf0,0,c9817718,0,...) at ttydev_read+0x55/frame 0xf3953b18 devfs_read_f(c9768738,f3953bf0,c96dc500,0,c9b1e340,...) at devfs_read_f+0xc7/frame 0xf3953b50 dofileread(c9768738,f3953bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3953b88 kern_readv(c9b1e340,0,f3953bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3953bd0 sys_read(c9b1e340,f3953ca8,c159e93c,4,e4b20c90,...) at sys_read+0x59/frame 0xf3953c20 syscall(f3953ce8) at syscall+0x388/frame 0xf3953cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3953cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 838 tid 100176 td 0xc9b1e680 sched_switch(c9b1e680,0,104,196,f39509b0,...) at sched_switch+0x4da/frame 0xf3950978 mi_switch(104,0,c15ad4f5,205,f3950a18,...) at mi_switch+0x1bf/frame 0xf39509b0 sleepq_switch(c9b1e680,0,c15ad4f5,1bb,f3950a28,...) at sleepq_switch+0x127/frame 0xf39509e4 sleepq_catch_signals(f3950a44,c0c1bad6,c90afa14,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3950a20 sleepq_wait_sig(c90afa70,0,f3950a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3950a44 _cv_wait_sig(c90afa70,c90afa04,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3950a90 tty_wait(c90afa00,c90afa70,f3950bf0,1,0,...) at tty_wait+0x4b/frame 0xf3950ab4 ttydisc_read(c90afa00,f3950bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3950af8 ttydev_read(c93a4e00,f3950bf0,0,c9cb8718,0,...) at ttydev_read+0x55/frame 0xf3950b18 devfs_read_f(c9731d58,f3950bf0,ca0ead00,0,c9b1e680,...) at devfs_read_f+0xc7/frame 0xf3950b50 dofileread(c9731d58,f3950bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3950b88 kern_readv(c9b1e680,0,f3950bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3950bd0 sys_read(c9b1e680,f3950ca8,c159e93c,4,c2027c90,...) at sys_read+0x59/frame 0xf3950c20 syscall(f3950ce8) at syscall+0x388/frame 0xf3950cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3950cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 837 tid 100175 td 0xc9b1e9c0 sched_switch(c9b1e9c0,0,104,196,f394d9b0,...) at sched_switch+0x4da/frame 0xf394d978 mi_switch(104,0,c15ad4f5,205,f394da18,...) at mi_switch+0x1bf/frame 0xf394d9b0 sleepq_switch(c9b1e9c0,0,c15ad4f5,1bb,f394da28,...) at sleepq_switch+0x127/frame 0xf394d9e4 sleepq_catch_signals(f394da44,c0c1bad6,c90afc14,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf394da20 sleepq_wait_sig(c90afc70,0,f394da7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf394da44 _cv_wait_sig(c90afc70,c90afc04,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf394da90 tty_wait(c90afc00,c90afc70,f394dbf0,1,0,...) at tty_wait+0x4b/frame 0xf394dab4 ttydisc_read(c90afc00,f394dbf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf394daf8 ttydev_read(c93a5000,f394dbf0,0,c972c028,0,...) at ttydev_read+0x55/frame 0xf394db18 devfs_read_f(c9732850,f394dbf0,c964c000,0,c9b1e9c0,...) at devfs_read_f+0xc7/frame 0xf394db50 dofileread(c9732850,f394dbf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf394db88 kern_readv(c9b1e9c0,0,f394dbf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf394dbd0 sys_read(c9b1e9c0,f394dca8,c159e93c,4,0,...) at sys_read+0x59/frame 0xf394dc20 syscall(f394dce8) at syscall+0x388/frame 0xf394dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf394dcdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 836 tid 100163 td 0xc9729000 sched_switch(c9729000,0,104,196,f39249b0,...) at sched_switch+0x4da/frame 0xf3924978 mi_switch(104,0,c15ad4f5,205,f3924a18,...) at mi_switch+0x1bf/frame 0xf39249b0 sleepq_switch(c9729000,0,c15ad4f5,1bb,f3924a28,...) at sleepq_switch+0x127/frame 0xf39249e4 sleepq_catch_signals(f3924a44,c0c1bad6,c90afe14,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3924a20 sleepq_wait_sig(c90afe70,0,f3924a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3924a44 _cv_wait_sig(c90afe70,c90afe04,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3924a90 tty_wait(c90afe00,c90afe70,f3924bf0,1,0,...) at tty_wait+0x4b/frame 0xf3924ab4 ttydisc_read(c90afe00,f3924bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3924af8 ttydev_read(c93a5100,f3924bf0,0,c9819a90,0,...) at ttydev_read+0x55/frame 0xf3924b18 devfs_read_f(c9731e38,f3924bf0,c8e24000,0,c9729000,...) at devfs_read_f+0xc7/frame 0xf3924b50 dofileread(c9731e38,f3924bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3924b88 kern_readv(c9729000,0,f3924bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3924bd0 sys_read(c9729000,f3924ca8,c159e93c,4,e4b20c90,...) at sys_read+0x59/frame 0xf3924c20 syscall(f3924ce8) at syscall+0x388/frame 0xf3924cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3924cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 835 tid 100168 td 0xc98119c0 sched_switch(c98119c0,0,104,196,f39339b0,...) at sched_switch+0x4da/frame 0xf3933978 mi_switch(104,0,c15ad4f5,205,f3933a18,...) at mi_switch+0x1bf/frame 0xf39339b0 sleepq_switch(c98119c0,0,c15ad4f5,1bb,f3933a28,...) at sleepq_switch+0x127/frame 0xf39339e4 sleepq_catch_signals(f3933a44,c0c1bad6,c90b0014,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3933a20 sleepq_wait_sig(c90b0070,0,f3933a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3933a44 _cv_wait_sig(c90b0070,c90b0004,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3933a90 tty_wait(c90b0000,c90b0070,f3933bf0,1,0,...) at tty_wait+0x4b/frame 0xf3933ab4 ttydisc_read(c90b0000,f3933bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3933af8 ttydev_read(c93a5200,f3933bf0,0,c972da90,0,...) at ttydev_read+0x55/frame 0xf3933b18 devfs_read_f(c9768a80,f3933bf0,c964cc00,0,c98119c0,...) at devfs_read_f+0xc7/frame 0xf3933b50 dofileread(c9768a80,f3933bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3933b88 kern_readv(c98119c0,0,f3933bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3933bd0 sys_read(c98119c0,f3933ca8,c159e93c,4,e4b1dc90,...) at sys_read+0x59/frame 0xf3933c20 syscall(f3933ce8) at syscall+0x388/frame 0xf3933cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3933cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 834 tid 100159 td 0xca0f0680 sched_switch(ca0f0680,0,104,196,f39199b0,...) at sched_switch+0x4da/frame 0xf3919978 mi_switch(104,0,c15ad4f5,205,f3919a18,...) at mi_switch+0x1bf/frame 0xf39199b0 sleepq_switch(ca0f0680,0,c15ad4f5,1bb,f3919a28,...) at sleepq_switch+0x127/frame 0xf39199e4 sleepq_catch_signals(f3919a44,c0c1bad6,c90b0214,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3919a20 sleepq_wait_sig(c90b0270,0,f3919a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3919a44 _cv_wait_sig(c90b0270,c90b0204,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xf3919a90 tty_wait(c90b0200,c90b0270,f3919bf0,1,0,...) at tty_wait+0x4b/frame 0xf3919ab4 ttydisc_read(c90b0200,f3919bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xf3919af8 ttydev_read(c93a5300,f3919bf0,0,c9847a90,0,...) at ttydev_read+0x55/frame 0xf3919b18 devfs_read_f(c9731ce8,f3919bf0,c8e23b00,0,ca0f0680,...) at devfs_read_f+0xc7/frame 0xf3919b50 dofileread(c9731ce8,f3919bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xf3919b88 kern_readv(ca0f0680,0,f3919bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xf3919bd0 sys_read(ca0f0680,f3919ca8,c159e93c,4,e4b1ac90,...) at sys_read+0x59/frame 0xf3919c20 syscall(f3919ce8) at syscall+0x388/frame 0xf3919cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3919cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command getty pid 833 tid 100093 td 0xc9603680 sched_switch(c9603680,0,104,196,edf379b0,...) at sched_switch+0x4da/frame 0xedf37978 mi_switch(104,0,c15ad4f5,205,edf37a18,...) at mi_switch+0x1bf/frame 0xedf379b0 sleepq_switch(c9603680,0,c15ad4f5,1bb,edf37a28,...) at sleepq_switch+0x127/frame 0xedf379e4 sleepq_catch_signals(edf37a44,c0c1bad6,c90b0414,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf37a20 sleepq_wait_sig(c90b0470,0,edf37a7c,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf37a44 _cv_wait_sig(c90b0470,c90b0404,c15b2e89,580,1,...) at _cv_wait_sig+0x211/frame 0xedf37a90 tty_wait(c90b0400,c90b0470,edf37bf0,1,0,...) at tty_wait+0x4b/frame 0xedf37ab4 ttydisc_read(c90b0400,edf37bf0,0,ab,c18521e0,...) at ttydisc_read+0x3a7/frame 0xedf37af8 ttydev_read(c93a5400,edf37bf0,0,c972e718,0,...) at ttydev_read+0x55/frame 0xedf37b18 devfs_read_f(c9731f18,edf37bf0,c964c100,0,c9603680,...) at devfs_read_f+0xc7/frame 0xedf37b50 dofileread(c9731f18,edf37bf0,ffffffff,ffffffff,0,...) at dofileread+0xa2/frame 0xedf37b88 kern_readv(c9603680,0,edf37bf0,2,bfbfede7,...) at kern_readv+0x93/frame 0xedf37bd0 sys_read(c9603680,edf37ca8,c159e93c,4,0,...) at sys_read+0x59/frame 0xedf37c20 syscall(edf37ce8) at syscall+0x388/frame 0xedf37cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf37cdc --- syscall (3, FreeBSD ELF32, sys_read), eip = 0x281d1293, esp = 0xbfbfedb4, ebp = 0xbfbfedc8 --- Tracing command inetd pid 814 tid 100151 td 0xc971b9c0 sched_switch(c971b9c0,0,104,196,f38f591c,...) at sched_switch+0x4da/frame 0xf38f58e4 mi_switch(104,0,c15ad4f5,205,c971f2c0,...) at mi_switch+0x1bf/frame 0xf38f591c sleepq_switch(c971b9c0,0,c15ad4f5,1bb,f38f5994,...) at sleepq_switch+0x127/frame 0xf38f5950 sleepq_catch_signals(f38f59b0,c0c1bad6,c936b0a0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38f598c sleepq_wait_sig(c936b0a4,0,f38f59e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38f59b0 _cv_wait_sig(c936b0a4,c936b090,c15b0bcb,74d,c15b0c26,...) at _cv_wait_sig+0x211/frame 0xf38f59fc seltdwait(ffffffff,0,0,c971b9c0,0,...) at seltdwait+0xbf/frame 0xf38f5a30 kern_select(c971b9c0,6,bfbfe078,0,0,...) at kern_select+0x910/frame 0xf38f5bd8 sys_select(c971b9c0,f38f5ca8,c159e93c,4,e4b1dc90,...) at sys_select+0x66/frame 0xf38f5c20 syscall(f38f5ce8) at syscall+0x388/frame 0xf38f5cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf38f5cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281e5283, esp = 0xbfbfe00c, ebp = 0xbfbfe030 --- Tracing command moused pid 784 tid 100160 td 0xca0f0340 sched_switch(ca0f0340,0,104,196,f391e91c,...) at sched_switch+0x4da/frame 0xf391e8e4 mi_switch(104,0,c15ad4f5,205,c899f880,...) at mi_switch+0x1bf/frame 0xf391e91c sleepq_switch(ca0f0340,0,c15ad4f5,1bb,f391e994,...) at sleepq_switch+0x127/frame 0xf391e950 sleepq_catch_signals(f391e9b0,c0c1bad6,c983f860,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf391e98c sleepq_wait_sig(c983f864,0,f391e9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf391e9b0 _cv_wait_sig(c983f864,c983f850,c15b0bcb,74d,1,...) at _cv_wait_sig+0x211/frame 0xf391e9fc seltdwait(ffffffff,0,0,ca0f0340,0,...) at seltdwait+0xbf/frame 0xf391ea30 kern_select(ca0f0340,400,bfbfebb8,0,0,...) at kern_select+0x910/frame 0xf391ebd8 sys_select(ca0f0340,f391eca8,c159e93c,4,c983b6b8,...) at sys_select+0x66/frame 0xf391ec20 syscall(f391ece8) at syscall+0x388/frame 0xf391ecdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf391ecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281fc283, esp = 0xbfbfea54, ebp = 0xbfbfea78 --- Tracing command cron pid 701 tid 100156 td 0xc97ff340 sched_switch(c97ff340,0,104,196,f390fa8c,...) at sched_switch+0x4da/frame 0xf390fa54 mi_switch(104,0,c15ad4f5,205,c971e780,...) at mi_switch+0x1bf/frame 0xf390fa8c sleepq_switch(c97ff340,0,c15ad4f5,1bb,170,...) at sleepq_switch+0x127/frame 0xf390fac0 sleepq_catch_signals(c0c89eb0,c97ff340,1,201,1,...) at sleepq_catch_signals+0x3b3/frame 0xf390fafc sleepq_timedwait_sig(c19ebb99,6c,149c,bff7cead,3,...) at sleepq_timedwait_sig+0x14/frame 0xf390fb24 _sleep(c19ebb99,0,16c,c15a8702,a7fdfd0c,...) at _sleep+0x30f/frame 0xf390fb80 kern_nanosleep(bfbfee28,f390fbf8,f390fc00,0,3b,...) at kern_nanosleep+0x137/frame 0xf390fbe0 sys_nanosleep(c97ff340,f390fca8,c159e93c,4,0,...) at sys_nanosleep+0x68/frame 0xf390fc20 syscall(f390fce8) at syscall+0x388/frame 0xf390fcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf390fcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x28170113, esp = 0xbfbfeca0, ebp = 0xbfbfecb0 --- Tracing command sendmail pid 696 tid 100111 td 0xc9601680 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(c9601680,ffffffff,2b8,1870f,c9601680,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command sendmail pid 693 tid 100158 td 0xca0f09c0 sched_switch(ca0f09c0,0,104,196,f3916914,...) at sched_switch+0x4da/frame 0xf39168dc mi_switch(104,0,c15ad4f5,205,c899f800,...) at mi_switch+0x1bf/frame 0xf3916914 sleepq_switch(ca0f09c0,0,c15ad4f5,1bb,c971a390,...) at sleepq_switch+0x127/frame 0xf3916948 sleepq_catch_signals(c184981c,f39169ac,c0c1bad6,c971a3a0,0,...) at sleepq_catch_signals+0x3b3/frame 0xf3916984 sleepq_timedwait_sig(c971a3a4,0,f39169e8,50000000,0,...) at sleepq_timedwait_sig+0x14/frame 0xf39169ac _cv_timedwait_sig_sbt(c971a3a4,c971a390,b4726edd,1482,50000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xf39169fc seltdwait(1482,50000000,0,ca0f09c0,0,...) at seltdwait+0x8d/frame 0xf3916a30 kern_select(ca0f09c0,5,bfbfd140,0,0,...) at kern_select+0x910/frame 0xf3916bd8 sys_select(ca0f09c0,f3916ca8,c159e93c,4,c19f9510,...) at sys_select+0x66/frame 0xf3916c20 syscall(f3916ce8) at syscall+0x388/frame 0xf3916cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf3916cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28482283, esp = 0xbfbfcff4, ebp = 0xbfbfd018 --- Tracing command sshd pid 690 tid 100097 td 0xc9390000 sched_switch(c9390000,0,104,196,edf4d91c,...) at sched_switch+0x4da/frame 0xedf4d8e4 mi_switch(104,0,c15ad4f5,205,c899fbc0,...) at mi_switch+0x1bf/frame 0xedf4d91c sleepq_switch(c9390000,0,c15ad4f5,1bb,edf4d994,...) at sleepq_switch+0x127/frame 0xedf4d950 sleepq_catch_signals(edf4d9b0,c0c1bad6,c983f8e0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf4d98c sleepq_wait_sig(c983f8e4,0,edf4d9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf4d9b0 _cv_wait_sig(c983f8e4,c983f8d0,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xedf4d9fc seltdwait(ffffffff,0,0,c9390000,0,...) at seltdwait+0xbf/frame 0xedf4da30 kern_select(c9390000,9,28a17148,0,0,...) at kern_select+0x910/frame 0xedf4dbd8 sys_select(c9390000,edf4dca8,c159e93c,4,c8e5235c,...) at sys_select+0x66/frame 0xedf4dc20 syscall(edf4dce8) at syscall+0x388/frame 0xedf4dcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf4dcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x28514283, esp = 0xbfbfe86c, ebp = 0xbfbfe890 --- Tracing command smartd pid 653 tid 100155 td 0xca13a340 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(ca13a340,ffffffff,28d,1873b,ca13a340,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command powerd pid 623 tid 100112 td 0xc97ff680 sched_switch(c97ff680,0,104,196,edfdb914,...) at sched_switch+0x4da/frame 0xedfdb8dc mi_switch(104,0,c15ad4f5,205,c9803440,...) at mi_switch+0x1bf/frame 0xedfdb914 sleepq_switch(c97ff680,0,c15ad4f5,1bb,c971a450,...) at sleepq_switch+0x127/frame 0xedfdb948 sleepq_catch_signals(c184981c,edfdb9ac,c0c1bad6,c971a460,0,...) at sleepq_catch_signals+0x3b3/frame 0xedfdb984 sleepq_timedwait_sig(c971a464,0,edfdb9e8,3ffffff,0,...) at sleepq_timedwait_sig+0x14/frame 0xedfdb9ac _cv_timedwait_sig_sbt(c971a464,c971a450,e361f09b,147e,3ffffff,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfdb9fc seltdwait(147e,3ffffff,0,246,c19eaaec,...) at seltdwait+0x8d/frame 0xedfdba30 kern_select(c97ff680,0,bfbfeda0,0,bfbfeda0,...) at kern_select+0x910/frame 0xedfdbbd8 sys_select(c97ff680,edfdbca8,c159e93c,4,c19f9510,...) at sys_select+0x66/frame 0xedfdbc20 syscall(edfdbce8) at syscall+0x388/frame 0xedfdbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfdbcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ce283, esp = 0xbfbfed14, ebp = 0xbfbfed38 --- Tracing command ntpd pid 620 tid 100152 td 0xca0f1340 sched_switch(ca0f1340,0,104,196,f38f991c,...) at sched_switch+0x4da/frame 0xf38f98e4 mi_switch(104,0,c15ad4f5,205,c899f780,...) at mi_switch+0x1bf/frame 0xf38f991c sleepq_switch(ca0f1340,0,c15ad4f5,1bb,f38f9994,...) at sleepq_switch+0x127/frame 0xf38f9950 sleepq_catch_signals(f38f99b0,c0c1bad6,c971a3e0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38f998c sleepq_wait_sig(c971a3e4,0,f38f99e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38f99b0 _cv_wait_sig(c971a3e4,c971a3d0,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xf38f99fc seltdwait(ffffffff,0,0,ca0f1340,0,...) at seltdwait+0xbf/frame 0xf38f9a30 kern_select(ca0f1340,1c,bfbfdee8,0,0,...) at kern_select+0x910/frame 0xf38f9bd8 sys_select(ca0f1340,f38f9ca8,c159e93c,4,0,...) at sys_select+0x66/frame 0xf38f9c20 syscall(f38f9ce8) at syscall+0x388/frame 0xf38f9cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xf38f9cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x2845e283, esp = 0xbfbfddf4, ebp = 0xbfbfde18 --- Tracing command nfsd pid 568 tid 100118 td 0xca0f19c0 sched_switch(ca0f19c0,0,104,196,edff4310,...) at sched_switch+0x4da/frame 0xedff42d8 mi_switch(104,0,c15ad4f5,205,c19fa300,...) at mi_switch+0x1bf/frame 0xedff4310 sleepq_switch(ca0f19c0,0,c15ad4f5,1bb,c9205100,...) at sleepq_switch+0x127/frame 0xedff4344 sleepq_catch_signals(c184981c,edff43a8,c0c1bad6,c9205110,0,...) at sleepq_catch_signals+0x3b3/frame 0xedff4380 sleepq_timedwait_sig(c9c30290,0,edff43e4,0,0,...) at sleepq_timedwait_sig+0x14/frame 0xedff43a8 _cv_timedwait_sig_sbt(c9c30290,c9205100,fffffa38,4,0,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedff43f8 svc_run_internal(c0eafda0,c9205100,ca088000,edff4520,0,...) at svc_run_internal+0xc69/frame 0xedff44dc svc_run(c9205000,0,c158faee,1ed,e241efa8,...) at svc_run+0x210/frame 0xedff4530 nfsrvd_nfsd(ca0f19c0,edff46a0,c,1000000,481,...) at nfsrvd_nfsd+0x20c/frame 0xedff4670 nfssvc_nfsd(ca0f19c0,edff4ca8,0,ca0f19c0,edff4cdc,...) at nfssvc_nfsd+0x1e3/frame 0xedff4c08 sys_nfssvc(ca0f19c0,edff4ca8,c159e93c,4,ca088000,...) at sys_nfssvc+0xc4/frame 0xedff4c20 syscall(edff4ce8) at syscall+0x388/frame 0xedff4cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedff4cdc --- syscall (155, FreeBSD ELF32, sys_nfssvc), eip = 0x280b005f, esp = 0xbfbfe7e4, ebp = 0xbfbfea58 --- Tracing command nfsd pid 568 tid 100120 td 0xc9601340 sched_switch(c9601340,0,104,196,edffaae0,...) at sched_switch+0x4da/frame 0xedffaaa8 mi_switch(104,0,c15ad4f5,205,edffab48,...) at mi_switch+0x1bf/frame 0xedffaae0 sleepq_switch(c9601340,0,c15ad4f5,1bb,edffab58,...) at sleepq_switch+0x127/frame 0xedffab14 sleepq_catch_signals(edffab74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedffab50 sleepq_wait_sig(c9bdc290,0,edffabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedffab74 _cv_wait_sig(c9bdc290,c9205100,c15e28e5,414,0,...) at _cv_wait_sig+0x211/frame 0xedffabc0 svc_run_internal(edffacd4,c0bfc9fe,c9205100,edfface8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xedffaca4 svc_thread_start(c9205100,edfface8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xedffacac fork_exit(c0eafda0,c9205100,edfface8) at fork_exit+0x7e/frame 0xedffacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedffacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100121 td 0xc9601000 sched_switch(c9601000,0,104,196,edffdae0,...) at sched_switch+0x4da/frame 0xedffdaa8 mi_switch(104,0,c15ad4f5,205,edffdb48,...) at mi_switch+0x1bf/frame 0xedffdae0 sleepq_switch(c9601000,0,c15ad4f5,1bb,edffdb58,...) at sleepq_switch+0x127/frame 0xedffdb14 sleepq_catch_signals(edffdb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedffdb50 sleepq_wait_sig(c9bdc090,0,edffdbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xedffdb74 _cv_wait_sig(c9bdc090,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xedffdbc0 svc_run_internal(edffdcd4,c0bfc9fe,c9205100,edffdce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xedffdca4 svc_thread_start(c9205100,edffdce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xedffdcac fork_exit(c0eafda0,c9205100,edffdce8) at fork_exit+0x7e/frame 0xedffdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedffdcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100122 td 0xc95e19c0 sched_switch(c95e19c0,0,104,196,f3895ae0,...) at sched_switch+0x4da/frame 0xf3895aa8 mi_switch(104,0,c15ad4f5,205,f3895b48,...) at mi_switch+0x1bf/frame 0xf3895ae0 sleepq_switch(c95e19c0,0,c15ad4f5,1bb,f3895b58,...) at sleepq_switch+0x127/frame 0xf3895b14 sleepq_catch_signals(f3895b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3895b50 sleepq_wait_sig(c9bdbe90,0,f3895bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3895b74 _cv_wait_sig(c9bdbe90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf3895bc0 svc_run_internal(f3895cd4,c0bfc9fe,c9205100,f3895ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf3895ca4 svc_thread_start(c9205100,f3895ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf3895cac fork_exit(c0eafda0,c9205100,f3895ce8) at fork_exit+0x7e/frame 0xf3895cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3895cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100123 td 0xc95e1680 sched_switch(c95e1680,0,104,196,f3898ae0,...) at sched_switch+0x4da/frame 0xf3898aa8 mi_switch(104,0,c15ad4f5,205,f3898b48,...) at mi_switch+0x1bf/frame 0xf3898ae0 sleepq_switch(c95e1680,0,c15ad4f5,1bb,f3898b58,...) at sleepq_switch+0x127/frame 0xf3898b14 sleepq_catch_signals(f3898b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf3898b50 sleepq_wait_sig(c9bdbd90,0,f3898bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf3898b74 _cv_wait_sig(c9bdbd90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf3898bc0 svc_run_internal(f3898cd4,c0bfc9fe,c9205100,f3898ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf3898ca4 svc_thread_start(c9205100,f3898ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf3898cac fork_exit(c0eafda0,c9205100,f3898ce8) at fork_exit+0x7e/frame 0xf3898cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3898cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100124 td 0xc95e1340 sched_switch(c95e1340,0,104,196,f389bae0,...) at sched_switch+0x4da/frame 0xf389baa8 mi_switch(104,0,c15ad4f5,205,f389bb48,...) at mi_switch+0x1bf/frame 0xf389bae0 sleepq_switch(c95e1340,0,c15ad4f5,1bb,f389bb58,...) at sleepq_switch+0x127/frame 0xf389bb14 sleepq_catch_signals(f389bb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf389bb50 sleepq_wait_sig(c9bdbc90,0,f389bbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf389bb74 _cv_wait_sig(c9bdbc90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf389bbc0 svc_run_internal(f389bcd4,c0bfc9fe,c9205100,f389bce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf389bca4 svc_thread_start(c9205100,f389bce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf389bcac fork_exit(c0eafda0,c9205100,f389bce8) at fork_exit+0x7e/frame 0xf389bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf389bcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100125 td 0xc95e1000 sched_switch(c95e1000,0,104,196,f389eae0,...) at sched_switch+0x4da/frame 0xf389eaa8 mi_switch(104,0,c15ad4f5,205,f389eb48,...) at mi_switch+0x1bf/frame 0xf389eae0 sleepq_switch(c95e1000,0,c15ad4f5,1bb,f389eb58,...) at sleepq_switch+0x127/frame 0xf389eb14 sleepq_catch_signals(f389eb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf389eb50 sleepq_wait_sig(c9bdbb90,0,f389ebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf389eb74 _cv_wait_sig(c9bdbb90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf389ebc0 svc_run_internal(f389ecd4,c0bfc9fe,c9205100,f389ece8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf389eca4 svc_thread_start(c9205100,f389ece8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf389ecac fork_exit(c0eafda0,c9205100,f389ece8) at fork_exit+0x7e/frame 0xf389ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf389ecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100126 td 0xc93929c0 sched_switch(c93929c0,0,104,196,f38a1ae0,...) at sched_switch+0x4da/frame 0xf38a1aa8 mi_switch(104,0,c15ad4f5,205,f38a1b48,...) at mi_switch+0x1bf/frame 0xf38a1ae0 sleepq_switch(c93929c0,0,c15ad4f5,1bb,f38a1b58,...) at sleepq_switch+0x127/frame 0xf38a1b14 sleepq_catch_signals(f38a1b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38a1b50 sleepq_wait_sig(c9bdba90,0,f38a1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a1b74 _cv_wait_sig(c9bdba90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38a1bc0 svc_run_internal(f38a1cd4,c0bfc9fe,c9205100,f38a1ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38a1ca4 svc_thread_start(c9205100,f38a1ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38a1cac fork_exit(c0eafda0,c9205100,f38a1ce8) at fork_exit+0x7e/frame 0xf38a1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100127 td 0xca1399c0 sched_switch(ca1399c0,0,104,196,f38a4ae0,...) at sched_switch+0x4da/frame 0xf38a4aa8 mi_switch(104,0,c15ad4f5,205,f38a4b48,...) at mi_switch+0x1bf/frame 0xf38a4ae0 sleepq_switch(ca1399c0,0,c15ad4f5,1bb,f38a4b58,...) at sleepq_switch+0x127/frame 0xf38a4b14 sleepq_catch_signals(f38a4b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38a4b50 sleepq_wait_sig(c901a590,0,f38a4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a4b74 _cv_wait_sig(c901a590,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38a4bc0 svc_run_internal(f38a4cd4,c0bfc9fe,c9205100,f38a4ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38a4ca4 svc_thread_start(c9205100,f38a4ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38a4cac fork_exit(c0eafda0,c9205100,f38a4ce8) at fork_exit+0x7e/frame 0xf38a4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100128 td 0xca139680 sched_switch(ca139680,0,104,196,f38a7ae0,...) at sched_switch+0x4da/frame 0xf38a7aa8 mi_switch(104,0,c15ad4f5,205,f38a7b48,...) at mi_switch+0x1bf/frame 0xf38a7ae0 sleepq_switch(ca139680,0,c15ad4f5,1bb,f38a7b58,...) at sleepq_switch+0x127/frame 0xf38a7b14 sleepq_catch_signals(f38a7b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38a7b50 sleepq_wait_sig(c9bdb990,0,f38a7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38a7b74 _cv_wait_sig(c9bdb990,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38a7bc0 svc_run_internal(f38a7cd4,c0bfc9fe,c9205100,f38a7ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38a7ca4 svc_thread_start(c9205100,f38a7ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38a7cac fork_exit(c0eafda0,c9205100,f38a7ce8) at fork_exit+0x7e/frame 0xf38a7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38a7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100129 td 0xca139340 sched_switch(ca139340,0,104,196,f38aaae0,...) at sched_switch+0x4da/frame 0xf38aaaa8 mi_switch(104,0,c15ad4f5,205,f38aab48,...) at mi_switch+0x1bf/frame 0xf38aaae0 sleepq_switch(ca139340,0,c15ad4f5,1bb,f38aab58,...) at sleepq_switch+0x127/frame 0xf38aab14 sleepq_catch_signals(f38aab74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38aab50 sleepq_wait_sig(c901a490,0,f38aabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38aab74 _cv_wait_sig(c901a490,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38aabc0 svc_run_internal(f38aacd4,c0bfc9fe,c9205100,f38aace8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38aaca4 svc_thread_start(c9205100,f38aace8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38aacac fork_exit(c0eafda0,c9205100,f38aace8) at fork_exit+0x7e/frame 0xf38aacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38aacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100130 td 0xca139000 sched_switch(ca139000,0,104,196,f38adae0,...) at sched_switch+0x4da/frame 0xf38adaa8 mi_switch(104,0,c15ad4f5,205,f38adb48,...) at mi_switch+0x1bf/frame 0xf38adae0 sleepq_switch(ca139000,0,c15ad4f5,1bb,f38adb58,...) at sleepq_switch+0x127/frame 0xf38adb14 sleepq_catch_signals(f38adb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38adb50 sleepq_wait_sig(c9bdb890,0,f38adbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38adb74 _cv_wait_sig(c9bdb890,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38adbc0 svc_run_internal(f38adcd4,c0bfc9fe,c9205100,f38adce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38adca4 svc_thread_start(c9205100,f38adce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38adcac fork_exit(c0eafda0,c9205100,f38adce8) at fork_exit+0x7e/frame 0xf38adcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38adcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100131 td 0xca1389c0 sched_switch(ca1389c0,0,104,196,f38b0ae0,...) at sched_switch+0x4da/frame 0xf38b0aa8 mi_switch(104,0,c15ad4f5,205,f38b0b48,...) at mi_switch+0x1bf/frame 0xf38b0ae0 sleepq_switch(ca1389c0,0,c15ad4f5,1bb,f38b0b58,...) at sleepq_switch+0x127/frame 0xf38b0b14 sleepq_catch_signals(f38b0b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38b0b50 sleepq_wait_sig(c901a390,0,f38b0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b0b74 _cv_wait_sig(c901a390,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38b0bc0 svc_run_internal(f38b0cd4,c0bfc9fe,c9205100,f38b0ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38b0ca4 svc_thread_start(c9205100,f38b0ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38b0cac fork_exit(c0eafda0,c9205100,f38b0ce8) at fork_exit+0x7e/frame 0xf38b0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100132 td 0xca138680 sched_switch(ca138680,0,104,196,f38b3ae0,...) at sched_switch+0x4da/frame 0xf38b3aa8 mi_switch(104,0,c15ad4f5,205,f38b3b48,...) at mi_switch+0x1bf/frame 0xf38b3ae0 sleepq_switch(ca138680,0,c15ad4f5,1bb,f38b3b58,...) at sleepq_switch+0x127/frame 0xf38b3b14 sleepq_catch_signals(f38b3b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38b3b50 sleepq_wait_sig(c9bdb790,0,f38b3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b3b74 _cv_wait_sig(c9bdb790,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38b3bc0 svc_run_internal(f38b3cd4,c0bfc9fe,c9205100,f38b3ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38b3ca4 svc_thread_start(c9205100,f38b3ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38b3cac fork_exit(c0eafda0,c9205100,f38b3ce8) at fork_exit+0x7e/frame 0xf38b3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100133 td 0xca138340 sched_switch(ca138340,0,104,196,f38b6ae0,...) at sched_switch+0x4da/frame 0xf38b6aa8 mi_switch(104,0,c15ad4f5,205,f38b6b48,...) at mi_switch+0x1bf/frame 0xf38b6ae0 sleepq_switch(ca138340,0,c15ad4f5,1bb,f38b6b58,...) at sleepq_switch+0x127/frame 0xf38b6b14 sleepq_catch_signals(f38b6b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38b6b50 sleepq_wait_sig(c901a290,0,f38b6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b6b74 _cv_wait_sig(c901a290,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38b6bc0 svc_run_internal(f38b6cd4,c0bfc9fe,c9205100,f38b6ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38b6ca4 svc_thread_start(c9205100,f38b6ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38b6cac fork_exit(c0eafda0,c9205100,f38b6ce8) at fork_exit+0x7e/frame 0xf38b6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100134 td 0xca138000 sched_switch(ca138000,0,104,196,f38b9ae0,...) at sched_switch+0x4da/frame 0xf38b9aa8 mi_switch(104,0,c15ad4f5,205,f38b9b48,...) at mi_switch+0x1bf/frame 0xf38b9ae0 sleepq_switch(ca138000,0,c15ad4f5,1bb,f38b9b58,...) at sleepq_switch+0x127/frame 0xf38b9b14 sleepq_catch_signals(f38b9b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38b9b50 sleepq_wait_sig(c901a190,0,f38b9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38b9b74 _cv_wait_sig(c901a190,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38b9bc0 svc_run_internal(f38b9cd4,c0bfc9fe,c9205100,f38b9ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38b9ca4 svc_thread_start(c9205100,f38b9ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38b9cac fork_exit(c0eafda0,c9205100,f38b9ce8) at fork_exit+0x7e/frame 0xf38b9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38b9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100135 td 0xca1379c0 sched_switch(ca1379c0,0,104,196,f38bcae0,...) at sched_switch+0x4da/frame 0xf38bcaa8 mi_switch(104,0,c15ad4f5,205,f38bcb48,...) at mi_switch+0x1bf/frame 0xf38bcae0 sleepq_switch(ca1379c0,0,c15ad4f5,1bb,f38bcb58,...) at sleepq_switch+0x127/frame 0xf38bcb14 sleepq_catch_signals(f38bcb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38bcb50 sleepq_wait_sig(c901a090,0,f38bcbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38bcb74 _cv_wait_sig(c901a090,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38bcbc0 svc_run_internal(f38bccd4,c0bfc9fe,c9205100,f38bcce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38bcca4 svc_thread_start(c9205100,f38bcce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38bccac fork_exit(c0eafda0,c9205100,f38bcce8) at fork_exit+0x7e/frame 0xf38bccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38bccd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100136 td 0xca137680 sched_switch(ca137680,0,104,196,f38bfae0,...) at sched_switch+0x4da/frame 0xf38bfaa8 mi_switch(104,0,c15ad4f5,205,f38bfb48,...) at mi_switch+0x1bf/frame 0xf38bfae0 sleepq_switch(ca137680,0,c15ad4f5,1bb,f38bfb58,...) at sleepq_switch+0x127/frame 0xf38bfb14 sleepq_catch_signals(f38bfb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38bfb50 sleepq_wait_sig(c9bdb690,0,f38bfbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38bfb74 _cv_wait_sig(c9bdb690,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38bfbc0 svc_run_internal(f38bfcd4,c0bfc9fe,c9205100,f38bfce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38bfca4 svc_thread_start(c9205100,f38bfce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38bfcac fork_exit(c0eafda0,c9205100,f38bfce8) at fork_exit+0x7e/frame 0xf38bfcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38bfcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100137 td 0xca137340 sched_switch(ca137340,0,104,196,f38c2ae0,...) at sched_switch+0x4da/frame 0xf38c2aa8 mi_switch(104,0,c15ad4f5,205,f38c2b48,...) at mi_switch+0x1bf/frame 0xf38c2ae0 sleepq_switch(ca137340,0,c15ad4f5,1bb,f38c2b58,...) at sleepq_switch+0x127/frame 0xf38c2b14 sleepq_catch_signals(f38c2b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38c2b50 sleepq_wait_sig(c9bdb590,0,f38c2bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c2b74 _cv_wait_sig(c9bdb590,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38c2bc0 svc_run_internal(f38c2cd4,c0bfc9fe,c9205100,f38c2ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38c2ca4 svc_thread_start(c9205100,f38c2ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38c2cac fork_exit(c0eafda0,c9205100,f38c2ce8) at fork_exit+0x7e/frame 0xf38c2cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c2cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100138 td 0xca137000 sched_switch(ca137000,0,104,196,f38c5ae0,...) at sched_switch+0x4da/frame 0xf38c5aa8 mi_switch(104,0,c15ad4f5,205,f38c5b48,...) at mi_switch+0x1bf/frame 0xf38c5ae0 sleepq_switch(ca137000,0,c15ad4f5,1bb,f38c5b58,...) at sleepq_switch+0x127/frame 0xf38c5b14 sleepq_catch_signals(f38c5b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38c5b50 sleepq_wait_sig(c9bdb490,0,f38c5bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c5b74 _cv_wait_sig(c9bdb490,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38c5bc0 svc_run_internal(f38c5cd4,c0bfc9fe,c9205100,f38c5ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38c5ca4 svc_thread_start(c9205100,f38c5ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38c5cac fork_exit(c0eafda0,c9205100,f38c5ce8) at fork_exit+0x7e/frame 0xf38c5cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c5cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100139 td 0xca0f29c0 sched_switch(ca0f29c0,0,104,196,f38c8ae0,...) at sched_switch+0x4da/frame 0xf38c8aa8 mi_switch(104,0,c15ad4f5,205,f38c8b48,...) at mi_switch+0x1bf/frame 0xf38c8ae0 sleepq_switch(ca0f29c0,0,c15ad4f5,1bb,f38c8b58,...) at sleepq_switch+0x127/frame 0xf38c8b14 sleepq_catch_signals(f38c8b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38c8b50 sleepq_wait_sig(c9bdb390,0,f38c8bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38c8b74 _cv_wait_sig(c9bdb390,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38c8bc0 svc_run_internal(f38c8cd4,c0bfc9fe,c9205100,f38c8ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38c8ca4 svc_thread_start(c9205100,f38c8ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38c8cac fork_exit(c0eafda0,c9205100,f38c8ce8) at fork_exit+0x7e/frame 0xf38c8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38c8cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100140 td 0xca13d000 sched_switch(ca13d000,0,104,196,f38cbae0,...) at sched_switch+0x4da/frame 0xf38cbaa8 mi_switch(104,0,c15ad4f5,205,f38cbb48,...) at mi_switch+0x1bf/frame 0xf38cbae0 sleepq_switch(ca13d000,0,c15ad4f5,1bb,f38cbb58,...) at sleepq_switch+0x127/frame 0xf38cbb14 sleepq_catch_signals(f38cbb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38cbb50 sleepq_wait_sig(c9bdb290,0,f38cbbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38cbb74 _cv_wait_sig(c9bdb290,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38cbbc0 svc_run_internal(f38cbcd4,c0bfc9fe,c9205100,f38cbce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38cbca4 svc_thread_start(c9205100,f38cbce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38cbcac fork_exit(c0eafda0,c9205100,f38cbce8) at fork_exit+0x7e/frame 0xf38cbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38cbcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100141 td 0xca13c9c0 sched_switch(ca13c9c0,0,104,196,f38ceae0,...) at sched_switch+0x4da/frame 0xf38ceaa8 mi_switch(104,0,c15ad4f5,205,f38ceb48,...) at mi_switch+0x1bf/frame 0xf38ceae0 sleepq_switch(ca13c9c0,0,c15ad4f5,1bb,f38ceb58,...) at sleepq_switch+0x127/frame 0xf38ceb14 sleepq_catch_signals(f38ceb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38ceb50 sleepq_wait_sig(c9bdb190,0,f38cebac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38ceb74 _cv_wait_sig(c9bdb190,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38cebc0 svc_run_internal(f38cecd4,c0bfc9fe,c9205100,f38cece8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38ceca4 svc_thread_start(c9205100,f38cece8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38cecac fork_exit(c0eafda0,c9205100,f38cece8) at fork_exit+0x7e/frame 0xf38cecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38cecd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100142 td 0xca13c680 sched_switch(ca13c680,0,104,196,f38d1ae0,...) at sched_switch+0x4da/frame 0xf38d1aa8 mi_switch(104,0,c15ad4f5,205,f38d1b48,...) at mi_switch+0x1bf/frame 0xf38d1ae0 sleepq_switch(ca13c680,0,c15ad4f5,1bb,f38d1b58,...) at sleepq_switch+0x127/frame 0xf38d1b14 sleepq_catch_signals(f38d1b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38d1b50 sleepq_wait_sig(c9bdb090,0,f38d1bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d1b74 _cv_wait_sig(c9bdb090,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38d1bc0 svc_run_internal(f38d1cd4,c0bfc9fe,c9205100,f38d1ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38d1ca4 svc_thread_start(c9205100,f38d1ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38d1cac fork_exit(c0eafda0,c9205100,f38d1ce8) at fork_exit+0x7e/frame 0xf38d1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d1cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100143 td 0xca13c340 sched_switch(ca13c340,0,104,196,f38d4ae0,...) at sched_switch+0x4da/frame 0xf38d4aa8 mi_switch(104,0,c15ad4f5,205,f38d4b48,...) at mi_switch+0x1bf/frame 0xf38d4ae0 sleepq_switch(ca13c340,0,c15ad4f5,1bb,f38d4b58,...) at sleepq_switch+0x127/frame 0xf38d4b14 sleepq_catch_signals(f38d4b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38d4b50 sleepq_wait_sig(c9bdae90,0,f38d4bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d4b74 _cv_wait_sig(c9bdae90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38d4bc0 svc_run_internal(f38d4cd4,c0bfc9fe,c9205100,f38d4ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38d4ca4 svc_thread_start(c9205100,f38d4ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38d4cac fork_exit(c0eafda0,c9205100,f38d4ce8) at fork_exit+0x7e/frame 0xf38d4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d4cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100144 td 0xca13c000 sched_switch(ca13c000,0,104,196,f38d7ae0,...) at sched_switch+0x4da/frame 0xf38d7aa8 mi_switch(104,0,c15ad4f5,205,f38d7b48,...) at mi_switch+0x1bf/frame 0xf38d7ae0 sleepq_switch(ca13c000,0,c15ad4f5,1bb,f38d7b58,...) at sleepq_switch+0x127/frame 0xf38d7b14 sleepq_catch_signals(f38d7b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38d7b50 sleepq_wait_sig(c9bdad90,0,f38d7bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38d7b74 _cv_wait_sig(c9bdad90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38d7bc0 svc_run_internal(f38d7cd4,c0bfc9fe,c9205100,f38d7ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38d7ca4 svc_thread_start(c9205100,f38d7ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38d7cac fork_exit(c0eafda0,c9205100,f38d7ce8) at fork_exit+0x7e/frame 0xf38d7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38d7cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100145 td 0xca13b9c0 sched_switch(ca13b9c0,0,104,196,f38daae0,...) at sched_switch+0x4da/frame 0xf38daaa8 mi_switch(104,0,c15ad4f5,205,f38dab48,...) at mi_switch+0x1bf/frame 0xf38daae0 sleepq_switch(ca13b9c0,0,c15ad4f5,1bb,f38dab58,...) at sleepq_switch+0x127/frame 0xf38dab14 sleepq_catch_signals(f38dab74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38dab50 sleepq_wait_sig(ca141490,0,f38dabac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38dab74 _cv_wait_sig(ca141490,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38dabc0 svc_run_internal(f38dacd4,c0bfc9fe,c9205100,f38dace8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38daca4 svc_thread_start(c9205100,f38dace8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38dacac fork_exit(c0eafda0,c9205100,f38dace8) at fork_exit+0x7e/frame 0xf38dacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38dacd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100146 td 0xca13b680 sched_switch(ca13b680,0,104,196,f38ddae0,...) at sched_switch+0x4da/frame 0xf38ddaa8 mi_switch(104,0,c15ad4f5,205,f38ddb48,...) at mi_switch+0x1bf/frame 0xf38ddae0 sleepq_switch(ca13b680,0,c15ad4f5,1bb,f38ddb58,...) at sleepq_switch+0x127/frame 0xf38ddb14 sleepq_catch_signals(f38ddb74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38ddb50 sleepq_wait_sig(c9bdac90,0,f38ddbac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38ddb74 _cv_wait_sig(c9bdac90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38ddbc0 svc_run_internal(f38ddcd4,c0bfc9fe,c9205100,f38ddce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38ddca4 svc_thread_start(c9205100,f38ddce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38ddcac fork_exit(c0eafda0,c9205100,f38ddce8) at fork_exit+0x7e/frame 0xf38ddcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38ddcd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100147 td 0xca13b340 sched_switch(ca13b340,0,104,196,f38e0ae0,...) at sched_switch+0x4da/frame 0xf38e0aa8 mi_switch(104,0,c15ad4f5,205,f38e0b48,...) at mi_switch+0x1bf/frame 0xf38e0ae0 sleepq_switch(ca13b340,0,c15ad4f5,1bb,f38e0b58,...) at sleepq_switch+0x127/frame 0xf38e0b14 sleepq_catch_signals(f38e0b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38e0b50 sleepq_wait_sig(c9bdab90,0,f38e0bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e0b74 _cv_wait_sig(c9bdab90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38e0bc0 svc_run_internal(f38e0cd4,c0bfc9fe,c9205100,f38e0ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38e0ca4 svc_thread_start(c9205100,f38e0ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38e0cac fork_exit(c0eafda0,c9205100,f38e0ce8) at fork_exit+0x7e/frame 0xf38e0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e0cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100148 td 0xca13b000 sched_switch(ca13b000,0,104,196,f38e3ae0,...) at sched_switch+0x4da/frame 0xf38e3aa8 mi_switch(104,0,c15ad4f5,205,f38e3b48,...) at mi_switch+0x1bf/frame 0xf38e3ae0 sleepq_switch(ca13b000,0,c15ad4f5,1bb,f38e3b58,...) at sleepq_switch+0x127/frame 0xf38e3b14 sleepq_catch_signals(f38e3b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38e3b50 sleepq_wait_sig(c9bdaa90,0,f38e3bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e3b74 _cv_wait_sig(c9bdaa90,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38e3bc0 svc_run_internal(f38e3cd4,c0bfc9fe,c9205100,f38e3ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38e3ca4 svc_thread_start(c9205100,f38e3ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38e3cac fork_exit(c0eafda0,c9205100,f38e3ce8) at fork_exit+0x7e/frame 0xf38e3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e3cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100149 td 0xca13a9c0 sched_switch(ca13a9c0,0,104,196,f38e6ae0,...) at sched_switch+0x4da/frame 0xf38e6aa8 mi_switch(104,0,c15ad4f5,205,f38e6b48,...) at mi_switch+0x1bf/frame 0xf38e6ae0 sleepq_switch(ca13a9c0,0,c15ad4f5,1bb,f38e6b58,...) at sleepq_switch+0x127/frame 0xf38e6b14 sleepq_catch_signals(f38e6b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38e6b50 sleepq_wait_sig(ca141390,0,f38e6bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e6b74 _cv_wait_sig(ca141390,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38e6bc0 svc_run_internal(f38e6cd4,c0bfc9fe,c9205100,f38e6ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38e6ca4 svc_thread_start(c9205100,f38e6ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38e6cac fork_exit(c0eafda0,c9205100,f38e6ce8) at fork_exit+0x7e/frame 0xf38e6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e6cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 568 tid 100150 td 0xca13a680 sched_switch(ca13a680,0,104,196,f38e9ae0,...) at sched_switch+0x4da/frame 0xf38e9aa8 mi_switch(104,0,c15ad4f5,205,f38e9b48,...) at mi_switch+0x1bf/frame 0xf38e9ae0 sleepq_switch(ca13a680,0,c15ad4f5,1bb,f38e9b58,...) at sleepq_switch+0x127/frame 0xf38e9b14 sleepq_catch_signals(f38e9b74,c0c1bad6,c9205110,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xf38e9b50 sleepq_wait_sig(ca141290,0,f38e9bac,101,0,...) at sleepq_wait_sig+0x14/frame 0xf38e9b74 _cv_wait_sig(ca141290,c9205100,c15e28e5,45c,0,...) at _cv_wait_sig+0x211/frame 0xf38e9bc0 svc_run_internal(f38e9cd4,c0bfc9fe,c9205100,f38e9ce8,c159ee90,...) at svc_run_internal+0xc7b/frame 0xf38e9ca4 svc_thread_start(c9205100,f38e9ce8,c159ee90,402,0,...) at svc_thread_start+0xd/frame 0xf38e9cac fork_exit(c0eafda0,c9205100,f38e9ce8) at fork_exit+0x7e/frame 0xf38e9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf38e9cd4 --- trap 0x20, eip = 0xc, esp = 0x33, ebp = 0xbfbfe937 --- Tracing command nfsd pid 561 tid 100119 td 0xca0f1680 sched_switch(ca0f1680,0,104,196,edff791c,...) at sched_switch+0x4da/frame 0xedff78e4 mi_switch(104,0,c15ad4f5,205,c899f740,...) at mi_switch+0x1bf/frame 0xedff791c sleepq_switch(ca0f1680,0,c15ad4f5,1bb,edff7994,...) at sleepq_switch+0x127/frame 0xedff7950 sleepq_catch_signals(edff79b0,c0c1bad6,c95d4420,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedff798c sleepq_wait_sig(c95d4424,0,edff79e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedff79b0 _cv_wait_sig(c95d4424,c95d4410,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xedff79fc seltdwait(ffffffff,0,0,ca0f1680,0,...) at seltdwait+0xbf/frame 0xedff7a30 kern_select(ca0f1680,7,bfbfec30,0,0,...) at kern_select+0x910/frame 0xedff7bd8 sys_select(ca0f1680,edff7ca8,c159e93c,4,e4b1dc90,...) at sys_select+0x66/frame 0xedff7c20 syscall(edff7ce8) at syscall+0x388/frame 0xedff7cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedff7cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bc283, esp = 0xbfbfea34, ebp = 0xbfbfea58 --- Tracing command mountd pid 555 tid 100108 td 0xc96019c0 sched_switch(c96019c0,0,104,196,edfbd91c,...) at sched_switch+0x4da/frame 0xedfbd8e4 mi_switch(104,0,c15ad4f5,205,c95e8080,...) at mi_switch+0x1bf/frame 0xedfbd91c sleepq_switch(c96019c0,0,c15ad4f5,1bb,edfbd994,...) at sleepq_switch+0x127/frame 0xedfbd950 sleepq_catch_signals(edfbd9b0,c0c1bad6,c936b1a0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedfbd98c sleepq_wait_sig(c936b1a4,0,edfbd9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedfbd9b0 _cv_wait_sig(c936b1a4,c936b190,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xedfbd9fc seltdwait(ffffffff,0,0,c96019c0,0,...) at seltdwait+0xbf/frame 0xedfbda30 kern_select(c96019c0,9,bfbfe848,0,0,...) at kern_select+0x910/frame 0xedfbdbd8 sys_select(c96019c0,edfbdca8,c159e93c,4,e4b1dc90,...) at sys_select+0x66/frame 0xedfbdc20 syscall(edfbdce8) at syscall+0x388/frame 0xedfbdcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfbdcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d5283, esp = 0xbfbfe7d4, ebp = 0xbfbfe7f8 --- Tracing command nfsuserd pid 548 tid 100117 td 0xca0f2000 sched_switch(ca0f2000,0,104,196,edff1914,...) at sched_switch+0x4da/frame 0xedff18dc mi_switch(104,0,c15ad4f5,205,c899f6c0,...) at mi_switch+0x1bf/frame 0xedff1914 sleepq_switch(ca0f2000,0,c15ad4f5,1bb,c971a490,...) at sleepq_switch+0x127/frame 0xedff1948 sleepq_catch_signals(c184981c,edff19ac,c0c1bad6,c971a4a0,0,...) at sleepq_catch_signals+0x3b3/frame 0xedff1984 sleepq_timedwait_sig(c971a4a4,0,edff19e8,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedff19ac _cv_timedwait_sig_sbt(c971a4a4,c971a490,21614fd9,1499,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedff19fc seltdwait(1499,e0000000,1,ca0f2000,0,...) at seltdwait+0x8d/frame 0xedff1a30 kern_select(ca0f2000,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedff1bd8 sys_select(ca0f2000,edff1ca8,c159e93c,4,c19f9510,...) at sys_select+0x66/frame 0xedff1c20 syscall(edff1ce8) at syscall+0x388/frame 0xedff1cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedff1cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bb283, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 547 tid 100116 td 0xca0f2340 sched_switch(ca0f2340,0,104,196,edfee914,...) at sched_switch+0x4da/frame 0xedfee8dc mi_switch(104,0,c15ad4f5,205,c899f680,...) at mi_switch+0x1bf/frame 0xedfee914 sleepq_switch(ca0f2340,0,c15ad4f5,1bb,c95d4450,...) at sleepq_switch+0x127/frame 0xedfee948 sleepq_catch_signals(c184981c,edfee9ac,c0c1bad6,c95d4460,0,...) at sleepq_catch_signals+0x3b3/frame 0xedfee984 sleepq_timedwait_sig(c95d4464,0,edfee9e8,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedfee9ac _cv_timedwait_sig_sbt(c95d4464,c95d4450,a9df530c,1498,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfee9fc seltdwait(1498,e0000000,1,ca0f2340,0,...) at seltdwait+0x8d/frame 0xedfeea30 kern_select(ca0f2340,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedfeebd8 sys_select(ca0f2340,edfeeca8,c159e93c,4,0,...) at sys_select+0x66/frame 0xedfeec20 syscall(edfeece8) at syscall+0x388/frame 0xedfeecdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfeecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bb283, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 546 tid 100115 td 0xca0f2680 sched_switch(ca0f2680,0,104,196,edfeb914,...) at sched_switch+0x4da/frame 0xedfeb8dc mi_switch(104,0,c15ad4f5,205,c899f640,...) at mi_switch+0x1bf/frame 0xedfeb914 sleepq_switch(ca0f2680,0,c15ad4f5,1bb,c971a4d0,...) at sleepq_switch+0x127/frame 0xedfeb948 sleepq_catch_signals(c184981c,edfeb9ac,c0c1bad6,c971a4e0,0,...) at sleepq_catch_signals+0x3b3/frame 0xedfeb984 sleepq_timedwait_sig(c971a4e4,0,edfeb9e8,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedfeb9ac _cv_timedwait_sig_sbt(c971a4e4,c971a4d0,3a24a018,1498,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfeb9fc seltdwait(1498,e0000000,1,ca0f2680,0,...) at seltdwait+0x8d/frame 0xedfeba30 kern_select(ca0f2680,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedfebbd8 sys_select(ca0f2680,edfebca8,c159e93c,4,e4b20c90,...) at sys_select+0x66/frame 0xedfebc20 syscall(edfebce8) at syscall+0x388/frame 0xedfebcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfebcdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bb283, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 545 tid 100114 td 0xc9102680 sched_switch(c9102680,0,104,196,edfe8914,...) at sched_switch+0x4da/frame 0xedfe88dc mi_switch(104,0,c15ad4f5,205,c899fc40,...) at mi_switch+0x1bf/frame 0xedfe8914 sleepq_switch(c9102680,0,c15ad4f5,1bb,c95d4490,...) at sleepq_switch+0x127/frame 0xedfe8948 sleepq_catch_signals(c184981c,edfe89ac,c0c1bad6,c95d44a0,0,...) at sleepq_catch_signals+0x3b3/frame 0xedfe8984 sleepq_timedwait_sig(c95d44a4,0,edfe89e8,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedfe89ac _cv_timedwait_sig_sbt(c95d44a4,c95d4490,38e33b36,1498,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedfe89fc seltdwait(1498,e0000000,1,c9102680,0,...) at seltdwait+0x8d/frame 0xedfe8a30 kern_select(c9102680,4,bfbfdc08,0,0,...) at kern_select+0x910/frame 0xedfe8bd8 sys_select(c9102680,edfe8ca8,c159e93c,4,c19f9c10,...) at sys_select+0x66/frame 0xedfe8c20 syscall(edfe8ce8) at syscall+0x388/frame 0xedfe8cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfe8cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281bb283, esp = 0xbfbfdb54, ebp = 0xbfbfdca0 --- Tracing command nfsuserd pid 544 tid 100095 td 0xc9811000 KDB: reentering KDB: stack backtrace: db_trace_self_wrapper(c15ab878,fc,c84e0408,8,0,...) at db_trace_self_wrapper+0x2a/frame 0xc84e0390 kdb_reenter(0,c18354d4,0,50001e,c18355b0,...) at kdb_reenter+0x76/frame 0xc84e03f8 trap(c84e0544) at trap+0x4d/frame 0xc84e0538 calltrap() at calltrap+0x6/frame 0xc84e0538 --- trap 0xc, eip = 0xc11b0ec9, esp = 0xc84e0584, ebp = 0xc84e05a0 --- db_trace_thread(c9811000,ffffffff,220,186ff,c9811000,...) at db_trace_thread+0x29/frame 0xc84e05a0 db_stack_trace_all(c0c7ccfa,0,ffffffff,c84e0644,1,...) at db_stack_trace_all+0xa2/frame 0xc84e060c db_command(c121dcbb,c84e0730,c055e7c6,c15a6ac2,0,...) at db_command+0x2d8/frame 0xc84e06cc db_command_loop(c15a6ac2,0,3b,c18353f0,c18354d4,...) at db_command_loop+0x50/frame 0xc84e06d8 db_trap(3,0,a,46,0,...) at db_trap+0xd6/frame 0xc84e0730 kdb_trap(3,0,c84e08b4,0,0,...) at kdb_trap+0x117/frame 0xc84e0768 trap(c84e08b4) at trap+0x86a/frame 0xc84e08a8 calltrap() at calltrap+0x6/frame 0xc84e08a8 --- trap 0x3, eip = 0xc0c7ccfa, esp = 0xc84e08f4, ebp = 0xc84e0900 --- kdb_enter(c15a6ac2,c15a6ac2,c15a39ff,c84e0954,2,...) at kdb_enter+0x3a/frame 0xc84e0900 vpanic(c15a39ff,c84e0954,c84e0954,c84e096c,c0c1c386,...) at vpanic+0x132/frame 0xc84e0934 panic(c15a39ff,c15b006e,c15f1243,b84,c3126d00,...) at panic+0x1b/frame 0xc84e0948 __mtx_assert(c1aca390,4,c15f1243,b84,b84,c15f1243,4,c3126d00) at __mtx_assert+0xe6/frame 0xc84e096c vm_page_lock_assert_KBI(c3126d00,4,c15f1243,b84,0,...) at vm_page_lock_assert_KBI+0x57/frame 0xc84e099c vm_page_free_toq(c3126d00,c3126d00) at vm_page_free_toq+0x55/frame 0xc84e09e0 vm_page_free(c3126d00,1312,34041,0,0,...) at vm_page_free+0x28/frame 0xc84e09f0 vm_page_alloc_contig(c1ac9c50,33d01,0,222,1312,...) at vm_page_alloc_contig+0x80c/frame 0xc84e0ac0 kmem_alloc_contig(c1a0a500,1312000,1,0,ffffffff,...) at kmem_alloc_contig+0x265/frame 0xc84e0bb8 contigmalloc(1312000,c18479ac,1,0,ffffffff,...) at contigmalloc+0x48/frame 0xc84e0bf0 cmalloc(c9c0b9c0,c84e0ca8,c159e93c,4,0,...) at cmalloc+0xc0/frame 0xc84e0c20 syscall(c84e0ce8) at syscall+0x388/frame 0xc84e0cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xc84e0cdc --- syscall (210, FreeBSD ELF32, cmalloc), eip = 0x280fa4f1, esp = 0xbfbfe75c, ebp = 0xbfbfe7ac --- Tracing command casperd pid 526 tid 100113 td 0xc91029c0 sched_switch(c91029c0,0,104,196,edfde91c,...) at sched_switch+0x4da/frame 0xedfde8e4 mi_switch(104,0,c15ad4f5,205,c899fc00,...) at mi_switch+0x1bf/frame 0xedfde91c sleepq_switch(c91029c0,0,c15ad4f5,1bb,edfde994,...) at sleepq_switch+0x127/frame 0xedfde950 sleepq_catch_signals(edfde9b0,c0c1bad6,c983f960,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedfde98c sleepq_wait_sig(c983f964,0,edfde9e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedfde9b0 _cv_wait_sig(c983f964,c983f950,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xedfde9fc seltdwait(ffffffff,0,0,c91029c0,0,...) at seltdwait+0xbf/frame 0xedfdea30 kern_select(c91029c0,7,bfbfe9c8,0,0,...) at kern_select+0x910/frame 0xedfdebd8 sys_select(c91029c0,edfdeca8,c159e93c,4,ca08935c,...) at sys_select+0x66/frame 0xedfdec20 syscall(edfdece8) at syscall+0x388/frame 0xedfdecdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfdecdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ec283, esp = 0xbfbfe954, ebp = 0xbfbfe978 --- Tracing command casperd pid 525 tid 100094 td 0xc9603340 sched_switch(c9603340,0,104,196,edf4091c,...) at sched_switch+0x4da/frame 0xedf408e4 mi_switch(104,0,c15ad4f5,205,c95e8000,...) at mi_switch+0x1bf/frame 0xedf4091c sleepq_switch(c9603340,0,c15ad4f5,1bb,edf40994,...) at sleepq_switch+0x127/frame 0xedf40950 sleepq_catch_signals(edf409b0,c0c1bad6,c983f8a0,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf4098c sleepq_wait_sig(c983f8a4,0,edf409e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf409b0 _cv_wait_sig(c983f8a4,c983f890,c15b0bcb,74d,c0ca923d,...) at _cv_wait_sig+0x211/frame 0xedf409fc seltdwait(ffffffff,0,0,c9603340,0,...) at seltdwait+0xbf/frame 0xedf40a30 kern_select(c9603340,6,bfbfe850,0,0,...) at kern_select+0x910/frame 0xedf40bd8 sys_select(c9603340,edf40ca8,c159e93c,4,c983aa14,...) at sys_select+0x66/frame 0xedf40c20 syscall(edf40ce8) at syscall+0x388/frame 0xedf40cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf40cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281ec283, esp = 0xbfbfe7f4, ebp = 0xbfbfe818 --- Tracing command watchdogd pid 503 tid 100109 td 0xc9810000 sched_switch(c9810000,0,104,196,edfcba8c,...) at sched_switch+0x4da/frame 0xedfcba54 mi_switch(104,0,c15ad4f5,205,c899f080,...) at mi_switch+0x1bf/frame 0xedfcba8c sleepq_switch(c9810000,0,c15ad4f5,1bb,170,...) at sleepq_switch+0x127/frame 0xedfcbac0 sleepq_catch_signals(c0c89eb0,c9810000,3,201,3,...) at sleepq_catch_signals+0x3b3/frame 0xedfcbafc sleepq_timedwait_sig(c19ebb9b,6c,14a5,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedfcbb24 _sleep(c19ebb9b,0,16c,c15a8702,f92531fb,...) at _sleep+0x30f/frame 0xedfcbb80 kern_nanosleep(bfbfece0,edfcbbf8,edfcbc00,0,3c,...) at kern_nanosleep+0x137/frame 0xedfcbbe0 sys_nanosleep(c9810000,edfcbca8,c159e93c,4,0,...) at sys_nanosleep+0x68/frame 0xedfcbc20 syscall(edfcbce8) at syscall+0x388/frame 0xedfcbcdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedfcbcdc --- syscall (240, FreeBSD ELF32, sys_nanosleep), eip = 0x2815f113, esp = 0xbfbfecd4, ebp = 0xbfbfed18 --- Tracing command rpcbind pid 419 tid 100092 td 0xc9729680 sched_switch(c9729680,0,104,196,edf3294c,...) at sched_switch+0x4da/frame 0xedf32914 mi_switch(104,0,c15ad4f5,205,c971ea40,...) at mi_switch+0x1bf/frame 0xedf3294c sleepq_switch(c9729680,0,c15ad4f5,1bb,c95d4610,...) at sleepq_switch+0x127/frame 0xedf32980 sleepq_catch_signals(c184981c,edf329e4,c0c1bad6,c95d4620,0,...) at sleepq_catch_signals+0x3b3/frame 0xedf329bc sleepq_timedwait_sig(c95d4624,0,edf32a20,e0000000,1,...) at sleepq_timedwait_sig+0x14/frame 0xedf329e4 _cv_timedwait_sig_sbt(c95d4624,c95d4610,21614fd9,1499,e0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedf32a34 seltdwait(1499,e0000000,1,c9729680,0,...) at seltdwait+0x8d/frame 0xedf32a68 kern_poll(c9729680,bfbfccc0,7,edf32c08,0,...) at kern_poll+0x4d0/frame 0xedf32be8 sys_poll(c9729680,edf32ca8,c159e93c,4,e4b1ac90,...) at sys_poll+0x71/frame 0xedf32c20 syscall(edf32ce8) at syscall+0x388/frame 0xedf32cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf32cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x2816bf8b, esp = 0xbfbfcbe4, ebp = 0xbfbfcbf8 --- Tracing command syslogd pid 415 tid 100105 td 0xc9810340 sched_switch(c9810340,0,104,196,edf8091c,...) at sched_switch+0x4da/frame 0xedf808e4 mi_switch(104,0,c15ad4f5,205,c9803380,...) at mi_switch+0x1bf/frame 0xedf8091c sleepq_switch(c9810340,0,c15ad4f5,1bb,edf80994,...) at sleepq_switch+0x127/frame 0xedf80950 sleepq_catch_signals(edf809b0,c0c1bad6,c971a760,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf8098c sleepq_wait_sig(c971a764,0,edf809e8,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf809b0 _cv_wait_sig(c971a764,c971a750,c15b0bcb,74d,1,...) at _cv_wait_sig+0x211/frame 0xedf809fc seltdwait(ffffffff,0,0,c9810340,0,...) at seltdwait+0xbf/frame 0xedf80a30 kern_select(c9810340,9,286220d8,0,0,...) at kern_select+0x910/frame 0xedf80bd8 sys_select(c9810340,edf80ca8,c159e93c,4,0,...) at sys_select+0x66/frame 0xedf80c20 syscall(edf80ce8) at syscall+0x388/frame 0xedf80cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf80cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x281d4283, esp = 0xbfbfdfc4, ebp = 0xbfbfdfe8 --- Tracing command rtsold pid 379 tid 100096 td 0xc9390340 sched_switch(c9390340,0,104,196,edf49954,...) at sched_switch+0x4da/frame 0xedf4991c mi_switch(104,0,c15ad4f5,205,c899fb80,...) at mi_switch+0x1bf/frame 0xedf49954 sleepq_switch(c9390340,0,c15ad4f5,1bb,edf499cc,...) at sleepq_switch+0x127/frame 0xedf49988 sleepq_catch_signals(edf499e8,c0c1bad6,c983f920,0,c184981c,...) at sleepq_catch_signals+0x3b3/frame 0xedf499c4 sleepq_wait_sig(c983f924,0,edf49a20,101,0,...) at sleepq_wait_sig+0x14/frame 0xedf499e8 _cv_wait_sig(c983f924,c983f910,c15b0bcb,74d,c15b0bcb,...) at _cv_wait_sig+0x211/frame 0xedf49a34 seltdwait(ffffffff,0,0,c9390340,0,...) at seltdwait+0xbf/frame 0xedf49a68 kern_poll(c9390340,bfbfee10,2,0,0,...) at kern_poll+0x4d0/frame 0xedf49be8 sys_poll(c9390340,edf49ca8,c159e93c,4,c8e526b8,...) at sys_poll+0x71/frame 0xedf49c20 syscall(edf49ce8) at syscall+0x388/frame 0xedf49cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf49cdc --- syscall (209, FreeBSD ELF32, sys_poll), eip = 0x28161f8b, esp = 0xbfbfedac, ebp = 0xbfbfedc0 --- Tracing command devd pid 338 tid 100104 td 0xc9810680 sched_switch(c9810680,0,104,196,edf75914,...) at sched_switch+0x4da/frame 0xedf758dc mi_switch(104,0,c15ad4f5,205,c9803340,...) at mi_switch+0x1bf/frame 0xedf75914 sleepq_switch(c9810680,0,c15ad4f5,1bb,c95d45d0,...) at sleepq_switch+0x127/frame 0xedf75948 sleepq_catch_signals(c184981c,edf759ac,c0c1bad6,c95d45e0,0,...) at sleepq_catch_signals+0x3b3/frame 0xedf75984 sleepq_timedwait_sig(c95d45e4,0,edf759e8,c0000000,3,...) at sleepq_timedwait_sig+0x14/frame 0xedf759ac _cv_timedwait_sig_sbt(c95d45e4,c95d45d0,56d69c38,14b9,c0000000,...) at _cv_timedwait_sig_sbt+0x23c/frame 0xedf759fc seltdwait(14b9,c0000000,3,c9810680,0,...) at seltdwait+0x8d/frame 0xedf75a30 kern_select(c9810680,6,bfbfcdc0,0,0,...) at kern_select+0x910/frame 0xedf75bd8 sys_select(c9810680,edf75ca8,c159e93c,4,e4b1dc90,...) at sys_select+0x66/frame 0xedf75c20 syscall(edf75ce8) at syscall+0x388/frame 0xedf75cdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xedf75cdc --- syscall (93, FreeBSD ELF32, sys_select), eip = 0x80e84a3, esp = 0xbfbfcd3c, ebp = 0xbfbfee54 --- Tracing command vnlru pid 23 tid 100086 td 0xc93909c0 sched_switch(c93909c0,0,104,196,edf19b84,...) at sched_switch+0x4da/frame 0xedf19b4c mi_switch(104,0,c15ad4f5,205,c9390c44,...) at mi_switch+0x1bf/frame 0xedf19b84 sleepq_switch(c93909c0,0,c15ad4f5,29f,c93909c0,...) at sleepq_switch+0x127/frame 0xedf19bb8 sleepq_timedwait(c938b000,60,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf19bdc _sleep(c938b000,c1a663bc,260,c15ba204,fffffed8,...) at _sleep+0x326/frame 0xedf19c38 vnlru_proc(0,edf19ce8,c159ee90,402,0,...) at vnlru_proc+0xbf/frame 0xedf19cac fork_exit(c0d00660,0,edf19ce8) at fork_exit+0x7e/frame 0xedf19cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf19cd4 --- trap 0, eip = 0, esp = 0xedf19d20, ebp = 0 --- Tracing command syncer pid 22 tid 100085 td 0xc9391000 sched_switch(c9391000,0,104,196,edf16b90,...) at sched_switch+0x4da/frame 0xedf16b58 mi_switch(104,0,c15ad4f5,205,c1a663f0,...) at mi_switch+0x1bf/frame 0xedf16b90 sleepq_switch(c9391000,0,c15ad4f5,29f,0,...) at sleepq_switch+0x127/frame 0xedf16bc4 sleepq_timedwait(c1a66410,0,edf16c24,0,0,...) at sleepq_timedwait+0x48/frame 0xedf16be8 _cv_timedwait_sbt(c1a66410,c1a663f0,fffffed8,0,0,...) at _cv_timedwait_sbt+0x23c/frame 0xedf16c38 sched_sync(0,edf16ce8,c159ee90,402,0,...) at sched_sync+0x6c0/frame 0xedf16cac fork_exit(c0d00f80,0,edf16ce8) at fork_exit+0x7e/frame 0xedf16cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf16cd4 --- trap 0, eip = 0, esp = 0xedf16d20, ebp = 0 --- Tracing command bufspacedaemon pid 21 tid 100084 td 0xc9391340 sched_switch(c9391340,0,104,196,edf13bc4,...) at sched_switch+0x4da/frame 0xedf13b8c mi_switch(104,0,c15ad4f5,205,c93915c4,...) at mi_switch+0x1bf/frame 0xedf13bc4 sleepq_switch(c9391340,0,c15ad4f5,29f,c9391340,...) at sleepq_switch+0x127/frame 0xedf13bf8 sleepq_timedwait(c1a65e48,5c,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf13c1c _sleep(c1a65e48,c1a65c00,25c,c15906c3,fffffed8,...) at _sleep+0x326/frame 0xedf13c78 bufspace_daemon(0,edf13ce8,c159ee90,402,0,...) at bufspace_daemon+0x1ff/frame 0xedf13cac fork_exit(c0ce2400,0,edf13ce8) at fork_exit+0x7e/frame 0xedf13cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf13cd4 --- trap 0, eip = 0, esp = 0xedf13d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100083 td 0xc9391680 sched_switch(c9391680,0,104,196,edf10bc4,...) at sched_switch+0x4da/frame 0xedf10b8c mi_switch(104,0,c15ad4f5,205,c9391904,...) at mi_switch+0x1bf/frame 0xedf10bc4 sleepq_switch(c9391680,0,c15ad4f5,29f,c9391680,...) at sleepq_switch+0x127/frame 0xedf10bf8 sleepq_timedwait(c1a65204,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf10c1c _sleep(c1a65204,c1a65180,54,c15b742a,fffffed8,...) at _sleep+0x326/frame 0xedf10c78 buf_daemon(0,edf10ce8,c159ee90,402,0,...) at buf_daemon+0x8c/frame 0xedf10cac fork_exit(c0ce2a50,0,edf10ce8) at fork_exit+0x7e/frame 0xedf10cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf10cd4 --- trap 0, eip = 0, esp = 0xedf10d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100099 td 0xc9729340 sched_switch(c9729340,0,104,196,edf54bb4,...) at sched_switch+0x4da/frame 0xedf54b7c mi_switch(104,0,c15ad4f5,205,c97295c4,...) at mi_switch+0x1bf/frame 0xedf54bb4 sleepq_switch(c9729340,0,c15ad4f5,29f,c9729340,...) at sleepq_switch+0x127/frame 0xedf54be8 sleepq_timedwait(c9aad284,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf54c0c _sleep(c9aad284,c9aad200,54,c15e9db1,7fffff6c,...) at _sleep+0x326/frame 0xedf54c68 softdep_flush(c96d8bb0,edf54ce8,c159ee90,402,0,...) at softdep_flush+0x192/frame 0xedf54cac fork_exit(c0ef4ad0,c96d8bb0,edf54ce8) at fork_exit+0x7e/frame 0xedf54cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf54cd4 --- trap 0, eip = 0, esp = 0xedf54d20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100101 td 0xc97289c0 sched_switch(c97289c0,0,104,196,edf5abb4,...) at sched_switch+0x4da/frame 0xedf5ab7c mi_switch(104,0,c15ad4f5,205,c9728c44,...) at mi_switch+0x1bf/frame 0xedf5abb4 sleepq_switch(c97289c0,0,c15ad4f5,29f,c97289c0,...) at sleepq_switch+0x127/frame 0xedf5abe8 sleepq_timedwait(c9aace84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf5ac0c _sleep(c9aace84,c9aace00,54,c15e9db1,7fffff6c,...) at _sleep+0x326/frame 0xedf5ac68 softdep_flush(c9642000,edf5ace8,c159ee90,402,0,...) at softdep_flush+0x192/frame 0xedf5acac fork_exit(c0ef4ad0,c9642000,edf5ace8) at fork_exit+0x7e/frame 0xedf5acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf5acd4 --- trap 0, eip = 0, esp = 0xedf5ad20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100102 td 0xc9728680 sched_switch(c9728680,0,104,196,edf5dbb4,...) at sched_switch+0x4da/frame 0xedf5db7c mi_switch(104,0,c15ad4f5,205,c9728904,...) at mi_switch+0x1bf/frame 0xedf5dbb4 sleepq_switch(c9728680,0,c15ad4f5,29f,c9728680,...) at sleepq_switch+0x127/frame 0xedf5dbe8 sleepq_timedwait(c9aacc84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf5dc0c _sleep(c9aacc84,c9aacc00,54,c15e9db1,7fffff6c,...) at _sleep+0x326/frame 0xedf5dc68 softdep_flush(c9641bb0,edf5dce8,c159ee90,402,0,...) at softdep_flush+0x192/frame 0xedf5dcac fork_exit(c0ef4ad0,c9641bb0,edf5dce8) at fork_exit+0x7e/frame 0xedf5dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf5dcd4 --- trap 0, eip = 0, esp = 0xedf5dd20, ebp = 0 --- Tracing command bufdaemon pid 20 tid 100169 td 0xc9811680 sched_switch(c9811680,0,104,196,f3936bb4,...) at sched_switch+0x4da/frame 0xf3936b7c mi_switch(104,0,c15ad4f5,205,c9811904,...) at mi_switch+0x1bf/frame 0xf3936bb4 sleepq_switch(c9811680,0,c15ad4f5,29f,c9811680,...) at sleepq_switch+0x127/frame 0xf3936be8 sleepq_timedwait(c8f95e84,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xf3936c0c _sleep(c8f95e84,c8f95e00,54,c15e9db1,7fffff6c,...) at _sleep+0x326/frame 0xf3936c68 softdep_flush(c96d88c4,f3936ce8,c159ee90,402,0,...) at softdep_flush+0x192/frame 0xf3936cac fork_exit(c0ef4ad0,c96d88c4,f3936ce8) at fork_exit+0x7e/frame 0xf3936cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf3936cd4 --- trap 0, eip = 0, esp = 0xf3936d20, ebp = 0 --- Tracing command pagezero pid 19 tid 100082 td 0xc93919c0 sched_switch(c93919c0,0,104,196,edf0db98,...) at sched_switch+0x4da/frame 0xedf0db60 mi_switch(104,0,c15ad4f5,205,c9391c44,...) at mi_switch+0x1bf/frame 0xedf0db98 sleepq_switch(c93919c0,0,c15ad4f5,29f,c93919c0,...) at sleepq_switch+0x127/frame 0xedf0dbcc sleepq_timedwait(c1a6d9a8,0,12b,0,0,...) at sleepq_timedwait+0x48/frame 0xedf0dbf0 _sleep(c1a6d9a8,c1acb080,0,c15f3ce5,fffea520,...) at _sleep+0x326/frame 0xedf0dc4c vm_pagezero(0,edf0dce8,c159ee90,402,0,...) at vm_pagezero+0x107/frame 0xedf0dcac fork_exit(c0f72310,0,edf0dce8) at fork_exit+0x7e/frame 0xedf0dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0dcd4 --- trap 0, eip = 0, esp = 0xedf0dd20, ebp = 0 --- Tracing command vmdaemon pid 18 tid 100081 td 0xc9392000 sched_switch(c9392000,0,104,196,edf0aacc,...) at sched_switch+0x4da/frame 0xedf0aa94 mi_switch(104,0,c15ad4f5,205,c1a6d80c,...) at mi_switch+0x1bf/frame 0xedf0aacc sleepq_switch(c9392000,0,c15ad4f5,27c,c9392000,...) at sleepq_switch+0x127/frame 0xedf0ab00 sleepq_wait(c1a6d824,74,c15b742a,0,0,...) at sleepq_wait+0x48/frame 0xedf0ab24 _sleep(c1a6d824,c1a6d80c,74,c15b742a,0,...) at _sleep+0x352/frame 0xedf0ab80 vm_daemon(0,edf0ace8,c159ee90,402,0,...) at vm_daemon+0x128/frame 0xedf0acac fork_exit(c0f641b0,0,edf0ace8) at fork_exit+0x7e/frame 0xedf0acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf0acd4 --- trap 0, eip = 0, esp = 0xedf0ad20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100080 td 0xc9392340 sched_switch(c9392340,0,104,196,edf07b24,...) at sched_switch+0x4da/frame 0xedf07aec mi_switch(104,0,c15ad4f5,205,c93925c4,...) at mi_switch+0x1bf/frame 0xedf07b24 sleepq_switch(c9392340,0,c15ad4f5,29f,c9392340,...) at sleepq_switch+0x127/frame 0xedf07b58 sleepq_timedwait(c1acb104,54,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedf07b7c _sleep(c1acb104,c1acb080,54,c15b742a,fffffed8,...) at _sleep+0x326/frame 0xedf07bd8 vm_pageout_worker(0,0,c938c6b8,0,0,0,c15eecf7,0,0,0) at vm_pageout_worker+0x328/frame 0xedf07c78 vm_pageout(0,edf07ce8,c159ee90,402,0,...) at vm_pageout+0x88/frame 0xedf07cac fork_exit(c0f611a0,0,edf07ce8) at fork_exit+0x7e/frame 0xedf07cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf07cd4 --- trap 0, eip = 0, esp = 0xedf07d20, ebp = 0 --- Tracing command pagedaemon pid 17 tid 100087 td 0xc96039c0 sched_switch(c96039c0,0,104,196,edf1cbcc,...) at sched_switch+0x4da/frame 0xedf1cb94 mi_switch(104,0,c15ad4f5,205,c1a08668,...) at mi_switch+0x1bf/frame 0xedf1cbcc sleepq_switch(c96039c0,0,c15ad4f5,27c,c96039c0,...) at sleepq_switch+0x127/frame 0xedf1cc00 sleepq_wait(c1a6b420,54,edf1cc6c,0,0,...) at sleepq_wait+0x48/frame 0xedf1cc24 _sleep(c1a6b420,c1a6b40c,54,c15ee79b,0,...) at _sleep+0x352/frame 0xedf1cc80 uma_reclaim_worker(0,edf1cce8,c159ee90,402,0,...) at uma_reclaim_worker+0x90/frame 0xedf1ccac fork_exit(c0f30910,0,edf1cce8) at fork_exit+0x7e/frame 0xedf1ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf1ccd4 --- trap 0, eip = 0, esp = 0xedf1cd20, ebp = 0 --- Tracing command soaiod4 pid 16 tid 100079 td 0xc9392680 sched_switch(c9392680,0,104,196,edf04bbc,...) at sched_switch+0x4da/frame 0xedf04b84 mi_switch(104,0,c15ad4f5,205,c9392904,...) at mi_switch+0x1bf/frame 0xedf04bbc sleepq_switch(c9392680,0,c15ad4f5,29f,c9392680,...) at sleepq_switch+0x127/frame 0xedf04bf0 sleepq_timedwait(c1a64c90,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedf04c14 _sleep(c1a64c90,c1a64c64,0,c15906c3,ffffdd50,...) at _sleep+0x326/frame 0xedf04c70 soaio_kproc_loop(4,edf04ce8,c159ee90,402,0,...) at soaio_kproc_loop+0x13a/frame 0xedf04cac fork_exit(c0caa290,4,edf04ce8) at fork_exit+0x7e/frame 0xedf04cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf04cd4 --- trap 0, eip = 0, esp = 0xedf04d20, ebp = 0 --- Tracing command soaiod3 pid 15 tid 100078 td 0xc90d2340 sched_switch(c90d2340,0,104,196,edf01bbc,...) at sched_switch+0x4da/frame 0xedf01b84 mi_switch(104,0,c15ad4f5,205,c90d25c4,...) at mi_switch+0x1bf/frame 0xedf01bbc sleepq_switch(c90d2340,0,c15ad4f5,29f,c90d2340,...) at sleepq_switch+0x127/frame 0xedf01bf0 sleepq_timedwait(c1a64c90,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedf01c14 _sleep(c1a64c90,c1a64c64,0,c15906c3,ffffdd50,...) at _sleep+0x326/frame 0xedf01c70 soaio_kproc_loop(3,edf01ce8,c159ee90,402,0,...) at soaio_kproc_loop+0x13a/frame 0xedf01cac fork_exit(c0caa290,3,edf01ce8) at fork_exit+0x7e/frame 0xedf01cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedf01cd4 --- trap 0, eip = 0, esp = 0xedf01d20, ebp = 0 --- Tracing command soaiod2 pid 9 tid 100077 td 0xc90d2680 sched_switch(c90d2680,0,104,196,edefebbc,...) at sched_switch+0x4da/frame 0xedefeb84 mi_switch(104,0,c15ad4f5,205,c90d2904,...) at mi_switch+0x1bf/frame 0xedefebbc sleepq_switch(c90d2680,0,c15ad4f5,29f,c90d2680,...) at sleepq_switch+0x127/frame 0xedefebf0 sleepq_timedwait(c1a64c90,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedefec14 _sleep(c1a64c90,c1a64c64,0,c15906c3,ffffdd50,...) at _sleep+0x326/frame 0xedefec70 soaio_kproc_loop(2,edefece8,c159ee90,402,0,...) at soaio_kproc_loop+0x13a/frame 0xedefecac fork_exit(c0caa290,2,edefece8) at fork_exit+0x7e/frame 0xedefecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefecd4 --- trap 0, eip = 0, esp = 0xedefed20, ebp = 0 --- Tracing command soaiod1 pid 8 tid 100076 td 0xc90d29c0 sched_switch(c90d29c0,0,104,196,edefbbbc,...) at sched_switch+0x4da/frame 0xedefbb84 mi_switch(104,0,c15ad4f5,205,c90d2c44,...) at mi_switch+0x1bf/frame 0xedefbbbc sleepq_switch(c90d29c0,0,c15ad4f5,29f,c90d29c0,...) at sleepq_switch+0x127/frame 0xedefbbf0 sleepq_timedwait(c1a64c90,0,1d,0,0,...) at sleepq_timedwait+0x48/frame 0xedefbc14 _sleep(c1a64c90,c1a64c64,0,c15906c3,ffffdd50,...) at _sleep+0x326/frame 0xedefbc70 soaio_kproc_loop(1,edefbce8,c159ee90,402,0,...) at soaio_kproc_loop+0x13a/frame 0xedefbcac fork_exit(c0caa290,1,edefbce8) at fork_exit+0x7e/frame 0xedefbcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedefbcd4 --- trap 0, eip = 0, esp = 0xedefbd20, ebp = 0 --- Tracing command rand_harvestq pid 7 tid 100073 td 0xc9100680 sched_switch(c9100680,0,104,196,edd72b9c,...) at sched_switch+0x4da/frame 0xedd72b64 mi_switch(104,0,c15ad4f5,205,c9100904,...) at mi_switch+0x1bf/frame 0xedd72b9c sleepq_switch(c9100680,0,c15ad4f5,29f,c9100680,...) at sleepq_switch+0x127/frame 0xedd72bd0 sleepq_timedwait(c1942354,0,0,0,0,...) at sleepq_timedwait+0x48/frame 0xedd72bf4 _sleep(c1942354,0,0,c15906c3,19999999,...) at _sleep+0x326/frame 0xedd72c50 random_kthread(0,edd72ce8,c159ee90,402,0,...) at random_kthread+0x24b/frame 0xedd72cac fork_exit(c0963550,0,edd72ce8) at fork_exit+0x7e/frame 0xedd72cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd72cd4 --- trap 0, eip = 0, esp = 0xedd72d20, ebp = 0 --- Tracing command sctp_iterator pid 6 tid 100072 td 0xc91009c0 sched_switch(c91009c0,0,104,196,edd6fbcc,...) at sched_switch+0x4da/frame 0xedd6fb94 mi_switch(104,0,c15ad4f5,205,c1ac6a18,...) at mi_switch+0x1bf/frame 0xedd6fbcc sleepq_switch(c91009c0,0,c15ad4f5,27c,c91009c0,...) at sleepq_switch+0x127/frame 0xedd6fc00 sleepq_wait(c1ac6a50,0,c15cf3f9,0,0,...) at sleepq_wait+0x48/frame 0xedd6fc24 _sleep(c1ac6a50,c1ac6a18,0,c15cf3f9,0,...) at _sleep+0x352/frame 0xedd6fc80 sctp_iterator_thread(0,edd6fce8,c159ee90,402,0,...) at sctp_iterator_thread+0x7c/frame 0xedd6fcac fork_exit(c0daddd0,0,edd6fce8) at fork_exit+0x7e/frame 0xedd6fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd6fcd4 --- trap 0, eip = 0, esp = 0xedd6fd20, ebp = 0 --- Tracing command fdc0 pid 5 tid 100068 td 0xc91019c0 sched_switch(c91019c0,0,104,196,edd62b78,...) at sched_switch+0x4da/frame 0xedd62b40 mi_switch(104,0,c15ad4f5,205,c9050af0,...) at mi_switch+0x1bf/frame 0xedd62b78 sleepq_switch(c91019c0,0,c15ad4f5,27c,c91019c0,...) at sleepq_switch+0x127/frame 0xedd62bac sleepq_wait(c9050a3c,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xedd62bd0 _sleep(c9050a3c,c9050af0,5c,c15906c3,0,...) at _sleep+0x352/frame 0xedd62c2c fdc_thread(c9050a00,edd62ce8,c159ee90,402,0,...) at fdc_thread+0x134c/frame 0xedd62cac fork_exit(c113cc20,c9050a00,edd62ce8) at fork_exit+0x7e/frame 0xedd62cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd62cd4 --- trap 0, eip = 0, esp = 0xedd62d20, ebp = 0 --- Tracing command usb pid 14 tid 100033 td 0xc9014000 sched_switch(c9014000,0,104,196,f13fabe8,...) at sched_switch+0x4da/frame 0xf13fabb0 mi_switch(104,0,c15ad4f5,205,c9064cf8,...) at mi_switch+0x1bf/frame 0xf13fabe8 sleepq_switch(c9014000,0,c15ad4f5,27c,c9064acc,...) at sleepq_switch+0x127/frame 0xf13fac1c sleepq_wait(c9064acc,0,f13fac70,1,0,...) at sleepq_wait+0x48/frame 0xf13fac40 _cv_wait(c9064acc,c9064cf8,c15755f2,76,c9064ad4,...) at _cv_wait+0x20b/frame 0xf13fac84 usb_process(c9064ac4,f13face8,c159ee90,402,0,...) at usb_process+0x140/frame 0xf13facac fork_exit(c0a877a0,c9064ac4,f13face8) at fork_exit+0x7e/frame 0xf13facd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf13facd4 --- trap 0, eip = 0, esp = 0xf13fad20, ebp = 0 --- Tracing command usb pid 14 tid 100034 td 0xc90139c0 sched_switch(c90139c0,0,104,196,f13fdbe8,...) at sched_switch+0x4da/frame 0xf13fdbb0 mi_switch(104,0,c15ad4f5,205,c9064cf8,...) at mi_switch+0x1bf/frame 0xf13fdbe8 sleepq_switch(c90139c0,0,c15ad4f5,27c,c9064afc,...) at sleepq_switch+0x127/frame 0xf13fdc1c sleepq_wait(c9064afc,0,f13fdc70,1,0,...) at sleepq_wait+0x48/frame 0xf13fdc40 _cv_wait(c9064afc,c9064cf8,c15755f2,76,c9064b04,...) at _cv_wait+0x20b/frame 0xf13fdc84 usb_process(c9064af4,f13fdce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xf13fdcac fork_exit(c0a877a0,c9064af4,f13fdce8) at fork_exit+0x7e/frame 0xf13fdcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf13fdcd4 --- trap 0, eip = 0, esp = 0xf13fdd20, ebp = 0 --- Tracing command usb pid 14 tid 100035 td 0xc9013680 sched_switch(c9013680,0,104,196,edce1be8,...) at sched_switch+0x4da/frame 0xedce1bb0 mi_switch(104,0,c15ad4f5,205,c9064cf8,...) at mi_switch+0x1bf/frame 0xedce1be8 sleepq_switch(c9013680,0,c15ad4f5,27c,c9064b2c,...) at sleepq_switch+0x127/frame 0xedce1c1c sleepq_wait(c9064b2c,0,edce1c70,1,0,...) at sleepq_wait+0x48/frame 0xedce1c40 _cv_wait(c9064b2c,c9064cf8,c15755f2,76,c9064b34,...) at _cv_wait+0x20b/frame 0xedce1c84 usb_process(c9064b24,edce1ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedce1cac fork_exit(c0a877a0,c9064b24,edce1ce8) at fork_exit+0x7e/frame 0xedce1cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce1cd4 --- trap 0, eip = 0, esp = 0xedce1d20, ebp = 0 --- Tracing command usb pid 14 tid 100036 td 0xc9013340 sched_switch(c9013340,0,104,196,edce4be8,...) at sched_switch+0x4da/frame 0xedce4bb0 mi_switch(104,0,c15ad4f5,205,c9064cf8,...) at mi_switch+0x1bf/frame 0xedce4be8 sleepq_switch(c9013340,0,c15ad4f5,27c,c9064b5c,...) at sleepq_switch+0x127/frame 0xedce4c1c sleepq_wait(c9064b5c,0,edce4c70,1,0,...) at sleepq_wait+0x48/frame 0xedce4c40 _cv_wait(c9064b5c,c9064cf8,c15755f2,76,c9064b64,...) at _cv_wait+0x20b/frame 0xedce4c84 usb_process(c9064b54,edce4ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedce4cac fork_exit(c0a877a0,c9064b54,edce4ce8) at fork_exit+0x7e/frame 0xedce4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce4cd4 --- trap 0, eip = 0, esp = 0xedce4d20, ebp = 0 --- Tracing command usb pid 14 tid 100037 td 0xc9013000 sched_switch(c9013000,0,104,196,edce7be8,...) at sched_switch+0x4da/frame 0xedce7bb0 mi_switch(104,0,c15ad4f5,205,c9064cf8,...) at mi_switch+0x1bf/frame 0xedce7be8 sleepq_switch(c9013000,0,c15ad4f5,27c,c9064b8c,...) at sleepq_switch+0x127/frame 0xedce7c1c sleepq_wait(c9064b8c,0,edce7c70,1,0,...) at sleepq_wait+0x48/frame 0xedce7c40 _cv_wait(c9064b8c,c9064cf8,c15755f2,76,c9064b94,...) at _cv_wait+0x20b/frame 0xedce7c84 usb_process(c9064b84,edce7ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedce7cac fork_exit(c0a877a0,c9064b84,edce7ce8) at fork_exit+0x7e/frame 0xedce7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedce7cd4 --- trap 0, eip = 0, esp = 0xedce7d20, ebp = 0 --- Tracing command usb pid 14 tid 100039 td 0xc8f11680 sched_switch(c8f11680,0,104,196,edcedbe8,...) at sched_switch+0x4da/frame 0xedcedbb0 mi_switch(104,0,c15ad4f5,205,c90b8cf8,...) at mi_switch+0x1bf/frame 0xedcedbe8 sleepq_switch(c8f11680,0,c15ad4f5,27c,c90b8acc,...) at sleepq_switch+0x127/frame 0xedcedc1c sleepq_wait(c90b8acc,0,edcedc70,1,0,...) at sleepq_wait+0x48/frame 0xedcedc40 _cv_wait(c90b8acc,c90b8cf8,c15755f2,76,c90b8ad4,...) at _cv_wait+0x20b/frame 0xedcedc84 usb_process(c90b8ac4,edcedce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcedcac fork_exit(c0a877a0,c90b8ac4,edcedce8) at fork_exit+0x7e/frame 0xedcedcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcedcd4 --- trap 0, eip = 0, esp = 0xedcedd20, ebp = 0 --- Tracing command usb pid 14 tid 100040 td 0xc90c09c0 sched_switch(c90c09c0,0,104,196,edcf0be8,...) at sched_switch+0x4da/frame 0xedcf0bb0 mi_switch(104,0,c15ad4f5,205,c90b8cf8,...) at mi_switch+0x1bf/frame 0xedcf0be8 sleepq_switch(c90c09c0,0,c15ad4f5,27c,c90b8afc,...) at sleepq_switch+0x127/frame 0xedcf0c1c sleepq_wait(c90b8afc,0,edcf0c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf0c40 _cv_wait(c90b8afc,c90b8cf8,c15755f2,76,c90b8b04,...) at _cv_wait+0x20b/frame 0xedcf0c84 usb_process(c90b8af4,edcf0ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcf0cac fork_exit(c0a877a0,c90b8af4,edcf0ce8) at fork_exit+0x7e/frame 0xedcf0cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf0cd4 --- trap 0, eip = 0, esp = 0xedcf0d20, ebp = 0 --- Tracing command usb pid 14 tid 100041 td 0xc90c0680 sched_switch(c90c0680,0,104,196,edcf3be8,...) at sched_switch+0x4da/frame 0xedcf3bb0 mi_switch(104,0,c15ad4f5,205,c90b8cf8,...) at mi_switch+0x1bf/frame 0xedcf3be8 sleepq_switch(c90c0680,0,c15ad4f5,27c,c90b8b2c,...) at sleepq_switch+0x127/frame 0xedcf3c1c sleepq_wait(c90b8b2c,0,edcf3c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf3c40 _cv_wait(c90b8b2c,c90b8cf8,c15755f2,76,c90b8b34,...) at _cv_wait+0x20b/frame 0xedcf3c84 usb_process(c90b8b24,edcf3ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcf3cac fork_exit(c0a877a0,c90b8b24,edcf3ce8) at fork_exit+0x7e/frame 0xedcf3cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf3cd4 --- trap 0, eip = 0, esp = 0xedcf3d20, ebp = 0 --- Tracing command usb pid 14 tid 100042 td 0xc90c0340 sched_switch(c90c0340,0,104,196,edcf6be8,...) at sched_switch+0x4da/frame 0xedcf6bb0 mi_switch(104,0,c15ad4f5,205,c90b8cf8,...) at mi_switch+0x1bf/frame 0xedcf6be8 sleepq_switch(c90c0340,0,c15ad4f5,27c,c90b8b5c,...) at sleepq_switch+0x127/frame 0xedcf6c1c sleepq_wait(c90b8b5c,0,edcf6c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf6c40 _cv_wait(c90b8b5c,c90b8cf8,c15755f2,76,c90b8b64,...) at _cv_wait+0x20b/frame 0xedcf6c84 usb_process(c90b8b54,edcf6ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcf6cac fork_exit(c0a877a0,c90b8b54,edcf6ce8) at fork_exit+0x7e/frame 0xedcf6cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf6cd4 --- trap 0, eip = 0, esp = 0xedcf6d20, ebp = 0 --- Tracing command usb pid 14 tid 100043 td 0xc90c0000 sched_switch(c90c0000,0,104,196,edcf9be8,...) at sched_switch+0x4da/frame 0xedcf9bb0 mi_switch(104,0,c15ad4f5,205,c90b8cf8,...) at mi_switch+0x1bf/frame 0xedcf9be8 sleepq_switch(c90c0000,0,c15ad4f5,27c,c90b8b8c,...) at sleepq_switch+0x127/frame 0xedcf9c1c sleepq_wait(c90b8b8c,0,edcf9c70,1,0,...) at sleepq_wait+0x48/frame 0xedcf9c40 _cv_wait(c90b8b8c,c90b8cf8,c15755f2,76,c90b8b94,...) at _cv_wait+0x20b/frame 0xedcf9c84 usb_process(c90b8b84,edcf9ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcf9cac fork_exit(c0a877a0,c90b8b84,edcf9ce8) at fork_exit+0x7e/frame 0xedcf9cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcf9cd4 --- trap 0, eip = 0, esp = 0xedcf9d20, ebp = 0 --- Tracing command usb pid 14 tid 100045 td 0xc90bf680 sched_switch(c90bf680,0,104,196,edcffbe8,...) at sched_switch+0x4da/frame 0xedcffbb0 mi_switch(104,0,c15ad4f5,205,c90c1cf8,...) at mi_switch+0x1bf/frame 0xedcffbe8 sleepq_switch(c90bf680,0,c15ad4f5,27c,c90c1acc,...) at sleepq_switch+0x127/frame 0xedcffc1c sleepq_wait(c90c1acc,0,edcffc70,1,0,...) at sleepq_wait+0x48/frame 0xedcffc40 _cv_wait(c90c1acc,c90c1cf8,c15755f2,76,c90c1ad4,...) at _cv_wait+0x20b/frame 0xedcffc84 usb_process(c90c1ac4,edcffce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedcffcac fork_exit(c0a877a0,c90c1ac4,edcffce8) at fork_exit+0x7e/frame 0xedcffcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcffcd4 --- trap 0, eip = 0, esp = 0xedcffd20, ebp = 0 --- Tracing command usb pid 14 tid 100046 td 0xc90bf340 sched_switch(c90bf340,0,104,196,edd02be8,...) at sched_switch+0x4da/frame 0xedd02bb0 mi_switch(104,0,c15ad4f5,205,c90c1cf8,...) at mi_switch+0x1bf/frame 0xedd02be8 sleepq_switch(c90bf340,0,c15ad4f5,27c,c90c1afc,...) at sleepq_switch+0x127/frame 0xedd02c1c sleepq_wait(c90c1afc,0,edd02c70,1,0,...) at sleepq_wait+0x48/frame 0xedd02c40 _cv_wait(c90c1afc,c90c1cf8,c15755f2,76,c90c1b04,...) at _cv_wait+0x20b/frame 0xedd02c84 usb_process(c90c1af4,edd02ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd02cac fork_exit(c0a877a0,c90c1af4,edd02ce8) at fork_exit+0x7e/frame 0xedd02cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd02cd4 --- trap 0, eip = 0, esp = 0xedd02d20, ebp = 0 --- Tracing command usb pid 14 tid 100047 td 0xc90bf000 sched_switch(c90bf000,0,104,196,edd05be8,...) at sched_switch+0x4da/frame 0xedd05bb0 mi_switch(104,0,c15ad4f5,205,c90c1cf8,...) at mi_switch+0x1bf/frame 0xedd05be8 sleepq_switch(c90bf000,0,c15ad4f5,27c,c90c1b2c,...) at sleepq_switch+0x127/frame 0xedd05c1c sleepq_wait(c90c1b2c,0,edd05c70,1,0,...) at sleepq_wait+0x48/frame 0xedd05c40 _cv_wait(c90c1b2c,c90c1cf8,c15755f2,76,c90c1b34,...) at _cv_wait+0x20b/frame 0xedd05c84 usb_process(c90c1b24,edd05ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd05cac fork_exit(c0a877a0,c90c1b24,edd05ce8) at fork_exit+0x7e/frame 0xedd05cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd05cd4 --- trap 0, eip = 0, esp = 0xedd05d20, ebp = 0 --- Tracing command usb pid 14 tid 100048 td 0xc90be9c0 sched_switch(c90be9c0,0,104,196,edd08be8,...) at sched_switch+0x4da/frame 0xedd08bb0 mi_switch(104,0,c15ad4f5,205,c90c1cf8,...) at mi_switch+0x1bf/frame 0xedd08be8 sleepq_switch(c90be9c0,0,c15ad4f5,27c,c90c1b5c,...) at sleepq_switch+0x127/frame 0xedd08c1c sleepq_wait(c90c1b5c,0,edd08c70,1,0,...) at sleepq_wait+0x48/frame 0xedd08c40 _cv_wait(c90c1b5c,c90c1cf8,c15755f2,76,c90c1b64,...) at _cv_wait+0x20b/frame 0xedd08c84 usb_process(c90c1b54,edd08ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd08cac fork_exit(c0a877a0,c90c1b54,edd08ce8) at fork_exit+0x7e/frame 0xedd08cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd08cd4 --- trap 0, eip = 0, esp = 0xedd08d20, ebp = 0 --- Tracing command usb pid 14 tid 100049 td 0xc90be680 sched_switch(c90be680,0,104,196,edd0bbe8,...) at sched_switch+0x4da/frame 0xedd0bbb0 mi_switch(104,0,c15ad4f5,205,c90c1cf8,...) at mi_switch+0x1bf/frame 0xedd0bbe8 sleepq_switch(c90be680,0,c15ad4f5,27c,c90c1b8c,...) at sleepq_switch+0x127/frame 0xedd0bc1c sleepq_wait(c90c1b8c,0,edd0bc70,1,0,...) at sleepq_wait+0x48/frame 0xedd0bc40 _cv_wait(c90c1b8c,c90c1cf8,c15755f2,76,c90c1b94,...) at _cv_wait+0x20b/frame 0xedd0bc84 usb_process(c90c1b84,edd0bce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd0bcac fork_exit(c0a877a0,c90c1b84,edd0bce8) at fork_exit+0x7e/frame 0xedd0bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0bcd4 --- trap 0, eip = 0, esp = 0xedd0bd20, ebp = 0 --- Tracing command usb pid 14 tid 100050 td 0xc90be340 sched_switch(c90be340,0,104,196,edd0fbe8,...) at sched_switch+0x4da/frame 0xedd0fbb0 mi_switch(104,0,c15ad4f5,205,c90c7cf8,...) at mi_switch+0x1bf/frame 0xedd0fbe8 sleepq_switch(c90be340,0,c15ad4f5,27c,c90c7acc,...) at sleepq_switch+0x127/frame 0xedd0fc1c sleepq_wait(c90c7acc,0,edd0fc70,1,0,...) at sleepq_wait+0x48/frame 0xedd0fc40 _cv_wait(c90c7acc,c90c7cf8,c15755f2,76,c90c7ad4,...) at _cv_wait+0x20b/frame 0xedd0fc84 usb_process(c90c7ac4,edd0fce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd0fcac fork_exit(c0a877a0,c90c7ac4,edd0fce8) at fork_exit+0x7e/frame 0xedd0fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd0fcd4 --- trap 0, eip = 0, esp = 0xedd0fd20, ebp = 0 --- Tracing command usb pid 14 tid 100051 td 0xc90be000 sched_switch(c90be000,0,104,196,edd12be8,...) at sched_switch+0x4da/frame 0xedd12bb0 mi_switch(104,0,c15ad4f5,205,c90c7cf8,...) at mi_switch+0x1bf/frame 0xedd12be8 sleepq_switch(c90be000,0,c15ad4f5,27c,c90c7afc,...) at sleepq_switch+0x127/frame 0xedd12c1c sleepq_wait(c90c7afc,0,edd12c70,1,0,...) at sleepq_wait+0x48/frame 0xedd12c40 _cv_wait(c90c7afc,c90c7cf8,c15755f2,76,c90c7b04,...) at _cv_wait+0x20b/frame 0xedd12c84 usb_process(c90c7af4,edd12ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd12cac fork_exit(c0a877a0,c90c7af4,edd12ce8) at fork_exit+0x7e/frame 0xedd12cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd12cd4 --- trap 0, eip = 0, esp = 0xedd12d20, ebp = 0 --- Tracing command usb pid 14 tid 100052 td 0xc90159c0 sched_switch(c90159c0,0,104,196,edd15be8,...) at sched_switch+0x4da/frame 0xedd15bb0 mi_switch(104,0,c15ad4f5,205,c90c7cf8,...) at mi_switch+0x1bf/frame 0xedd15be8 sleepq_switch(c90159c0,0,c15ad4f5,27c,c90c7b2c,...) at sleepq_switch+0x127/frame 0xedd15c1c sleepq_wait(c90c7b2c,0,edd15c70,1,0,...) at sleepq_wait+0x48/frame 0xedd15c40 _cv_wait(c90c7b2c,c90c7cf8,c15755f2,76,c90c7b34,...) at _cv_wait+0x20b/frame 0xedd15c84 usb_process(c90c7b24,edd15ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd15cac fork_exit(c0a877a0,c90c7b24,edd15ce8) at fork_exit+0x7e/frame 0xedd15cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd15cd4 --- trap 0, eip = 0, esp = 0xedd15d20, ebp = 0 --- Tracing command usb pid 14 tid 100053 td 0xc90d2000 sched_switch(c90d2000,0,104,196,edd18be8,...) at sched_switch+0x4da/frame 0xedd18bb0 mi_switch(104,0,c15ad4f5,205,c90c7cf8,...) at mi_switch+0x1bf/frame 0xedd18be8 sleepq_switch(c90d2000,0,c15ad4f5,27c,c90c7b5c,...) at sleepq_switch+0x127/frame 0xedd18c1c sleepq_wait(c90c7b5c,0,edd18c70,1,0,...) at sleepq_wait+0x48/frame 0xedd18c40 _cv_wait(c90c7b5c,c90c7cf8,c15755f2,76,c90c7b64,...) at _cv_wait+0x20b/frame 0xedd18c84 usb_process(c90c7b54,edd18ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd18cac fork_exit(c0a877a0,c90c7b54,edd18ce8) at fork_exit+0x7e/frame 0xedd18cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd18cd4 --- trap 0, eip = 0, esp = 0xedd18d20, ebp = 0 --- Tracing command usb pid 14 tid 100054 td 0xc90d19c0 sched_switch(c90d19c0,0,104,196,edd1bbe8,...) at sched_switch+0x4da/frame 0xedd1bbb0 mi_switch(104,0,c15ad4f5,205,c90c7cf8,...) at mi_switch+0x1bf/frame 0xedd1bbe8 sleepq_switch(c90d19c0,0,c15ad4f5,27c,c90c7b8c,...) at sleepq_switch+0x127/frame 0xedd1bc1c sleepq_wait(c90c7b8c,0,edd1bc70,1,0,...) at sleepq_wait+0x48/frame 0xedd1bc40 _cv_wait(c90c7b8c,c90c7cf8,c15755f2,76,c90c7b94,...) at _cv_wait+0x20b/frame 0xedd1bc84 usb_process(c90c7b84,edd1bce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd1bcac fork_exit(c0a877a0,c90c7b84,edd1bce8) at fork_exit+0x7e/frame 0xedd1bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1bcd4 --- trap 0, eip = 0, esp = 0xedd1bd20, ebp = 0 --- Tracing command usb pid 14 tid 100055 td 0xc90d1680 sched_switch(c90d1680,0,104,196,edd1fbe8,...) at sched_switch+0x4da/frame 0xedd1fbb0 mi_switch(104,0,c15ad4f5,205,c90d3cf8,...) at mi_switch+0x1bf/frame 0xedd1fbe8 sleepq_switch(c90d1680,0,c15ad4f5,27c,c90d3acc,...) at sleepq_switch+0x127/frame 0xedd1fc1c sleepq_wait(c90d3acc,0,edd1fc70,1,0,...) at sleepq_wait+0x48/frame 0xedd1fc40 _cv_wait(c90d3acc,c90d3cf8,c15755f2,76,c90d3ad4,...) at _cv_wait+0x20b/frame 0xedd1fc84 usb_process(c90d3ac4,edd1fce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd1fcac fork_exit(c0a877a0,c90d3ac4,edd1fce8) at fork_exit+0x7e/frame 0xedd1fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd1fcd4 --- trap 0, eip = 0, esp = 0xedd1fd20, ebp = 0 --- Tracing command usb pid 14 tid 100056 td 0xc90d1340 sched_switch(c90d1340,0,104,196,edd22be8,...) at sched_switch+0x4da/frame 0xedd22bb0 mi_switch(104,0,c15ad4f5,205,c90d3cf8,...) at mi_switch+0x1bf/frame 0xedd22be8 sleepq_switch(c90d1340,0,c15ad4f5,27c,c90d3afc,...) at sleepq_switch+0x127/frame 0xedd22c1c sleepq_wait(c90d3afc,0,edd22c70,1,0,...) at sleepq_wait+0x48/frame 0xedd22c40 _cv_wait(c90d3afc,c90d3cf8,c15755f2,76,c90d3b04,...) at _cv_wait+0x20b/frame 0xedd22c84 usb_process(c90d3af4,edd22ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd22cac fork_exit(c0a877a0,c90d3af4,edd22ce8) at fork_exit+0x7e/frame 0xedd22cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd22cd4 --- trap 0, eip = 0, esp = 0xedd22d20, ebp = 0 --- Tracing command usb pid 14 tid 100057 td 0xc90d1000 sched_switch(c90d1000,0,104,196,edd25be8,...) at sched_switch+0x4da/frame 0xedd25bb0 mi_switch(104,0,c15ad4f5,205,c90d3cf8,...) at mi_switch+0x1bf/frame 0xedd25be8 sleepq_switch(c90d1000,0,c15ad4f5,27c,c90d3b2c,...) at sleepq_switch+0x127/frame 0xedd25c1c sleepq_wait(c90d3b2c,0,edd25c70,1,0,...) at sleepq_wait+0x48/frame 0xedd25c40 _cv_wait(c90d3b2c,c90d3cf8,c15755f2,76,c90d3b34,...) at _cv_wait+0x20b/frame 0xedd25c84 usb_process(c90d3b24,edd25ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd25cac fork_exit(c0a877a0,c90d3b24,edd25ce8) at fork_exit+0x7e/frame 0xedd25cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd25cd4 --- trap 0, eip = 0, esp = 0xedd25d20, ebp = 0 --- Tracing command usb pid 14 tid 100058 td 0xc90cc9c0 sched_switch(c90cc9c0,0,104,196,edd28be8,...) at sched_switch+0x4da/frame 0xedd28bb0 mi_switch(104,0,c15ad4f5,205,c90d3cf8,...) at mi_switch+0x1bf/frame 0xedd28be8 sleepq_switch(c90cc9c0,0,c15ad4f5,27c,c90d3b5c,...) at sleepq_switch+0x127/frame 0xedd28c1c sleepq_wait(c90d3b5c,0,edd28c70,1,0,...) at sleepq_wait+0x48/frame 0xedd28c40 _cv_wait(c90d3b5c,c90d3cf8,c15755f2,76,c90d3b64,...) at _cv_wait+0x20b/frame 0xedd28c84 usb_process(c90d3b54,edd28ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd28cac fork_exit(c0a877a0,c90d3b54,edd28ce8) at fork_exit+0x7e/frame 0xedd28cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd28cd4 --- trap 0, eip = 0, esp = 0xedd28d20, ebp = 0 --- Tracing command usb pid 14 tid 100059 td 0xc90cc680 sched_switch(c90cc680,0,104,196,edd2bbe8,...) at sched_switch+0x4da/frame 0xedd2bbb0 mi_switch(104,0,c15ad4f5,205,c90d3cf8,...) at mi_switch+0x1bf/frame 0xedd2bbe8 sleepq_switch(c90cc680,0,c15ad4f5,27c,c90d3b8c,...) at sleepq_switch+0x127/frame 0xedd2bc1c sleepq_wait(c90d3b8c,0,edd2bc70,1,0,...) at sleepq_wait+0x48/frame 0xedd2bc40 _cv_wait(c90d3b8c,c90d3cf8,c15755f2,76,c90d3b94,...) at _cv_wait+0x20b/frame 0xedd2bc84 usb_process(c90d3b84,edd2bce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd2bcac fork_exit(c0a877a0,c90d3b84,edd2bce8) at fork_exit+0x7e/frame 0xedd2bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd2bcd4 --- trap 0, eip = 0, esp = 0xedd2bd20, ebp = 0 --- Tracing command usb pid 14 tid 100061 td 0xc90cc000 sched_switch(c90cc000,0,104,196,edd33be8,...) at sched_switch+0x4da/frame 0xedd33bb0 mi_switch(104,0,c15ad4f5,205,c9069ed0,...) at mi_switch+0x1bf/frame 0xedd33be8 sleepq_switch(c90cc000,0,c15ad4f5,27c,c9069ca4,...) at sleepq_switch+0x127/frame 0xedd33c1c sleepq_wait(c9069ca4,0,edd33c70,1,0,...) at sleepq_wait+0x48/frame 0xedd33c40 _cv_wait(c9069ca4,c9069ed0,c15755f2,76,c9069cac,...) at _cv_wait+0x20b/frame 0xedd33c84 usb_process(c9069c9c,edd33ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd33cac fork_exit(c0a877a0,c9069c9c,edd33ce8) at fork_exit+0x7e/frame 0xedd33cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd33cd4 --- trap 0, eip = 0, esp = 0xedd33d20, ebp = 0 --- Tracing command usb pid 14 tid 100062 td 0xc90cb9c0 sched_switch(c90cb9c0,0,104,196,edd36be8,...) at sched_switch+0x4da/frame 0xedd36bb0 mi_switch(104,0,c15ad4f5,205,c9069ed0,...) at mi_switch+0x1bf/frame 0xedd36be8 sleepq_switch(c90cb9c0,0,c15ad4f5,27c,c9069cd4,...) at sleepq_switch+0x127/frame 0xedd36c1c sleepq_wait(c9069cd4,0,edd36c70,1,0,...) at sleepq_wait+0x48/frame 0xedd36c40 _cv_wait(c9069cd4,c9069ed0,c15755f2,76,c9069cdc,...) at _cv_wait+0x20b/frame 0xedd36c84 usb_process(c9069ccc,edd36ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd36cac fork_exit(c0a877a0,c9069ccc,edd36ce8) at fork_exit+0x7e/frame 0xedd36cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd36cd4 --- trap 0, eip = 0, esp = 0xedd36d20, ebp = 0 --- Tracing command usb pid 14 tid 100063 td 0xc90cb680 sched_switch(c90cb680,0,104,196,edd39be8,...) at sched_switch+0x4da/frame 0xedd39bb0 mi_switch(104,0,c15ad4f5,205,c9069ed0,...) at mi_switch+0x1bf/frame 0xedd39be8 sleepq_switch(c90cb680,0,c15ad4f5,27c,c9069d04,...) at sleepq_switch+0x127/frame 0xedd39c1c sleepq_wait(c9069d04,0,edd39c70,1,0,...) at sleepq_wait+0x48/frame 0xedd39c40 _cv_wait(c9069d04,c9069ed0,c15755f2,76,c9069d0c,...) at _cv_wait+0x20b/frame 0xedd39c84 usb_process(c9069cfc,edd39ce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd39cac fork_exit(c0a877a0,c9069cfc,edd39ce8) at fork_exit+0x7e/frame 0xedd39cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd39cd4 --- trap 0, eip = 0, esp = 0xedd39d20, ebp = 0 --- Tracing command usb pid 14 tid 100064 td 0xc90cb340 sched_switch(c90cb340,0,104,196,edd3cbe8,...) at sched_switch+0x4da/frame 0xedd3cbb0 mi_switch(104,0,c15ad4f5,205,c9069ed0,...) at mi_switch+0x1bf/frame 0xedd3cbe8 sleepq_switch(c90cb340,0,c15ad4f5,27c,c9069d34,...) at sleepq_switch+0x127/frame 0xedd3cc1c sleepq_wait(c9069d34,0,edd3cc70,1,0,...) at sleepq_wait+0x48/frame 0xedd3cc40 _cv_wait(c9069d34,c9069ed0,c15755f2,76,c9069d3c,...) at _cv_wait+0x20b/frame 0xedd3cc84 usb_process(c9069d2c,edd3cce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd3ccac fork_exit(c0a877a0,c9069d2c,edd3cce8) at fork_exit+0x7e/frame 0xedd3ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd3ccd4 --- trap 0, eip = 0, esp = 0xedd3cd20, ebp = 0 --- Tracing command usb pid 14 tid 100065 td 0xc90cb000 sched_switch(c90cb000,0,104,196,edd3fbe8,...) at sched_switch+0x4da/frame 0xedd3fbb0 mi_switch(104,0,c15ad4f5,205,c9069ed0,...) at mi_switch+0x1bf/frame 0xedd3fbe8 sleepq_switch(c90cb000,0,c15ad4f5,27c,c9069d64,...) at sleepq_switch+0x127/frame 0xedd3fc1c sleepq_wait(c9069d64,0,edd3fc70,1,0,...) at sleepq_wait+0x48/frame 0xedd3fc40 _cv_wait(c9069d64,c9069ed0,c15755f2,76,c9069d6c,...) at _cv_wait+0x20b/frame 0xedd3fc84 usb_process(c9069d5c,edd3fce8,c159ee90,402,0,...) at usb_process+0x140/frame 0xedd3fcac fork_exit(c0a877a0,c9069d5c,edd3fce8) at fork_exit+0x7e/frame 0xedd3fcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd3fcd4 --- trap 0, eip = 0, esp = 0xedd3fd20, ebp = 0 --- Tracing command cam pid 4 tid 100024 td 0xc8e5b9c0 sched_switch(c8e5b9c0,0,104,196,e4b6eba4,...) at sched_switch+0x4da/frame 0xe4b6eb6c mi_switch(104,0,c15ad4f5,205,c188e380,...) at mi_switch+0x1bf/frame 0xe4b6eba4 sleepq_switch(c8e5b9c0,0,c15ad4f5,27c,c8e5b9c0,...) at sleepq_switch+0x127/frame 0xe4b6ebd8 sleepq_wait(c188e400,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b6ebfc _sleep(c188e400,c188e380,5c,c15906c3,0,...) at _sleep+0x352/frame 0xe4b6ec58 xpt_done_td(c188e380,e4b6ece8,c159ee90,402,0,...) at xpt_done_td+0x17e/frame 0xe4b6ecac fork_exit(c04da510,c188e380,e4b6ece8) at fork_exit+0x7e/frame 0xe4b6ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6ecd4 --- trap 0, eip = 0, esp = 0xe4b6ed20, ebp = 0 --- Tracing command cam pid 4 tid 100075 td 0xc9100000 sched_switch(c9100000,0,104,196,edd78ba4,...) at sched_switch+0x4da/frame 0xedd78b6c mi_switch(104,0,c15ad4f5,205,c188e2fc,...) at mi_switch+0x1bf/frame 0xedd78ba4 sleepq_switch(c9100000,0,c15ad4f5,27c,c9100000,...) at sleepq_switch+0x127/frame 0xedd78bd8 sleepq_wait(c188e2ac,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xedd78bfc _sleep(c188e2ac,c188e2fc,5c,c15906c3,0,...) at _sleep+0x352/frame 0xedd78c58 xpt_scanner_thread(0,edd78ce8,c159ee90,402,0,...) at xpt_scanner_thread+0xa2/frame 0xedd78cac fork_exit(c04da8c0,0,edd78ce8) at fork_exit+0x7e/frame 0xedd78cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd78cd4 --- trap 0, eip = 0, esp = 0xedd78d20, ebp = 0 --- Tracing command crypto returns pid 3 tid 100018 td 0xc8f10340 sched_switch(c8f10340,0,104,196,e4b5cbac,...) at sched_switch+0x4da/frame 0xe4b5cb74 mi_switch(104,0,c15ad4f5,205,c1a6a764,...) at mi_switch+0x1bf/frame 0xe4b5cbac sleepq_switch(c8f10340,0,c15ad4f5,27c,c8f10340,...) at sleepq_switch+0x127/frame 0xe4b5cbe0 sleepq_wait(c1a6a778,6c,c15e1ca0,0,0,...) at sleepq_wait+0x48/frame 0xe4b5cc04 _sleep(c1a6a778,c1a6a764,6c,c15e1ca0,0,...) at _sleep+0x352/frame 0xe4b5cc60 crypto_ret_proc(0,e4b5cce8,c159ee90,402,0,...) at crypto_ret_proc+0x1f5/frame 0xe4b5ccac fork_exit(c0e9b7f0,0,e4b5cce8) at fork_exit+0x7e/frame 0xe4b5ccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b5ccd4 --- trap 0, eip = 0, esp = 0xe4b5cd20, ebp = 0 --- Tracing command crypto pid 2 tid 100017 td 0xc8f10680 sched_switch(c8f10680,0,104,196,e4b59bbc,...) at sched_switch+0x4da/frame 0xe4b59b84 mi_switch(104,0,c15ad4f5,205,c1a6a6a8,...) at mi_switch+0x1bf/frame 0xe4b59bbc sleepq_switch(c8f10680,0,c15ad4f5,27c,c8f10680,...) at sleepq_switch+0x127/frame 0xe4b59bf0 sleepq_wait(c1a6a6c0,6c,c15e1c94,0,0,...) at sleepq_wait+0x48/frame 0xe4b59c14 _sleep(c1a6a6c0,c1a6a6a8,6c,c15e1c94,0,...) at _sleep+0x352/frame 0xe4b59c70 crypto_proc(0,e4b59ce8,c159ee90,402,0,...) at crypto_proc+0x2c1/frame 0xe4b59cac fork_exit(c0e9b3c0,0,e4b59ce8) at fork_exit+0x7e/frame 0xe4b59cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b59cd4 --- trap 0, eip = 0, esp = 0xe4b59d20, ebp = 0 --- Tracing command geom pid 13 tid 100013 td 0xc8e53000 sched_switch(c8e53000,0,104,196,e4b4dbbc,...) at sched_switch+0x4da/frame 0xe4b4db84 mi_switch(104,0,c15ad4f5,205,c19e8ac4,...) at mi_switch+0x1bf/frame 0xe4b4dbbc sleepq_switch(c8e53000,0,c15ad4f5,27c,c8e53000,...) at sleepq_switch+0x127/frame 0xe4b4dbf0 sleepq_wait(c1ac1bcc,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b4dc14 _sleep(c1ac1bcc,c19e8ac4,25c,c15906c3,0,...) at _sleep+0x352/frame 0xe4b4dc70 g_run_events(0,e4b4dce8,c159ee90,402,0,...) at g_run_events+0x67/frame 0xe4b4dcac fork_exit(c0b85050,0,e4b4dce8) at fork_exit+0x7e/frame 0xe4b4dcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b4dcd4 --- trap 0, eip = 0, esp = 0xe4b4dd20, ebp = 0 --- Tracing command geom pid 13 tid 100014 td 0xc8f11340 sched_switch(c8f11340,0,104,196,e4b50bac,...) at sched_switch+0x4da/frame 0xe4b50b74 mi_switch(104,0,c15ad4f5,205,c19e8b0c,...) at mi_switch+0x1bf/frame 0xe4b50bac sleepq_switch(c8f11340,0,c15ad4f5,27c,c8f11340,...) at sleepq_switch+0x127/frame 0xe4b50be0 sleepq_wait(c1ac1bd0,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b50c04 _sleep(c1ac1bd0,c19e8b0c,25c,c15906c3,0,...) at _sleep+0x352/frame 0xe4b50c60 g_io_schedule_up(c8f11340,0,c15924dc,60,e4b50cd4,...) at g_io_schedule_up+0x12a/frame 0xe4b50c94 g_up_procbody(0,e4b50ce8,c159ee90,402,0,...) at g_up_procbody+0x9d/frame 0xe4b50cac fork_exit(c0b850f0,0,e4b50ce8) at fork_exit+0x7e/frame 0xe4b50cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b50cd4 --- trap 0, eip = 0, esp = 0xe4b50d20, ebp = 0 --- Tracing command geom pid 13 tid 100015 td 0xc8f11000 sched_switch(c8f11000,0,104,196,e4b53ba8,...) at sched_switch+0x4da/frame 0xe4b53b70 mi_switch(104,0,c15ad4f5,205,c19e8aec,...) at mi_switch+0x1bf/frame 0xe4b53ba8 sleepq_switch(c8f11000,0,c15ad4f5,27c,c8f11000,...) at sleepq_switch+0x127/frame 0xe4b53bdc sleepq_wait(c1ac1bd4,5c,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b53c00 _sleep(c1ac1bd4,c19e8aec,25c,c15906c3,0,...) at _sleep+0x352/frame 0xe4b53c5c g_io_schedule_down(c8f11000,0,c15924dc,6d,e4b53cd4,...) at g_io_schedule_down+0xec/frame 0xe4b53c94 g_down_procbody(0,e4b53ce8,c159ee90,402,0,...) at g_down_procbody+0x9d/frame 0xe4b53cac fork_exit(c0b85190,0,e4b53ce8) at fork_exit+0x7e/frame 0xe4b53cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b53cd4 --- trap 0, eip = 0, esp = 0xe4b53d20, ebp = 0 --- Tracing command intr pid 12 tid 100007 td 0xc8e59680 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100008 td 0xc8e59340 sched_switch(c8e59340,0,109,196,0,...) at sched_switch+0x4da/frame 0xe4b3ec38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xe4b3ec70 ithread_loop(c8eab010,e4b3ece8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xe4b3ecac fork_exit(c0bff950,c8eab010,e4b3ece8) at fork_exit+0x7e/frame 0xe4b3ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b3ecd4 --- trap 0, eip = 0, esp = 0xe4b3ed20, ebp = 0 --- Tracing command intr pid 12 tid 100009 td 0xc8e59000 sched_switch(c8e59000,0,109,196,0,...) at sched_switch+0x4da/frame 0xe4b41c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xe4b41c70 ithread_loop(c8eab000,e4b41ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xe4b41cac fork_exit(c0bff950,c8eab000,e4b41ce8) at fork_exit+0x7e/frame 0xe4b41cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b41cd4 --- trap 0, eip = 0, esp = 0xe4b41d20, ebp = 0 --- Tracing command intr pid 12 tid 100010 td 0xc8e539c0 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100011 td 0xc8e53680 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100012 td 0xc8e53340 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100019 td 0xc8f10000 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100026 td 0xc8e5b340 sched_switch(c8e5b340,0,109,196,0,...) at sched_switch+0x4da/frame 0xe4b74c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xe4b74c70 ithread_loop(c8eaaf50,e4b74ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xe4b74cac fork_exit(c0bff950,c8eaaf50,e4b74ce8) at fork_exit+0x7e/frame 0xe4b74cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b74cd4 --- trap 0, eip = 0, esp = 0xe4b74d20, ebp = 0 --- Tracing command intr pid 12 tid 100027 td 0xc9015680 sched_switch(c9015680,0,109,196,0,...) at sched_switch+0x4da/frame 0xe4b77c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xe4b77c70 ithread_loop(c8eaaf40,e4b77ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xe4b77cac fork_exit(c0bff950,c8eaaf40,e4b77ce8) at fork_exit+0x7e/frame 0xe4b77cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b77cd4 --- trap 0, eip = 0, esp = 0xe4b77d20, ebp = 0 --- Tracing command intr pid 12 tid 100029 td 0xc9015000 sched_switch(c9015000,0,109,196,0,...) at sched_switch+0x4da/frame 0xe4bacc38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xe4bacc70 ithread_loop(c8eaadb0,e4bacce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xe4baccac fork_exit(c0bff950,c8eaadb0,e4bacce8) at fork_exit+0x7e/frame 0xe4baccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4baccd4 --- trap 0, eip = 0, esp = 0xe4bacd20, ebp = 0 --- Tracing command intr pid 12 tid 100030 td 0xc90149c0 sched_switch(c90149c0,0,109,196,0,...) at sched_switch+0x4da/frame 0xf12b4c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xf12b4c70 ithread_loop(c8eaadc0,f12b4ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xf12b4cac fork_exit(c0bff950,c8eaadc0,f12b4ce8) at fork_exit+0x7e/frame 0xf12b4cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12b4cd4 --- trap 0, eip = 0, esp = 0xf12b4d20, ebp = 0 --- Tracing command intr pid 12 tid 100031 td 0xc9014680 sched_switch(c9014680,0,109,196,0,...) at sched_switch+0x4da/frame 0xf12b8c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xf12b8c70 ithread_loop(c8eaada0,f12b8ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xf12b8cac fork_exit(c0bff950,c8eaada0,f12b8ce8) at fork_exit+0x7e/frame 0xf12b8cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf12b8cd4 --- trap 0, eip = 0, esp = 0xf12b8d20, ebp = 0 --- Tracing command intr pid 12 tid 100032 td 0xc9014340 sched_switch(c9014340,0,109,196,0,...) at sched_switch+0x4da/frame 0xf13f7c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xf13f7c70 ithread_loop(c8eaad90,f13f7ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xf13f7cac fork_exit(c0bff950,c8eaad90,f13f7ce8) at fork_exit+0x7e/frame 0xf13f7cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xf13f7cd4 --- trap 0, eip = 0, esp = 0xf13f7d20, ebp = 0 --- Tracing command intr pid 12 tid 100038 td 0xc8f119c0 sched_switch(c8f119c0,0,109,196,0,...) at sched_switch+0x4da/frame 0xedceac38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xedceac70 ithread_loop(c8eaad80,edceace8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xedceacac fork_exit(c0bff950,c8eaad80,edceace8) at fork_exit+0x7e/frame 0xedceacd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedceacd4 --- trap 0, eip = 0, esp = 0xedcead20, ebp = 0 --- Tracing command intr pid 12 tid 100044 td 0xc90bf9c0 sched_switch(c90bf9c0,0,109,196,0,...) at sched_switch+0x4da/frame 0xedcfcc38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xedcfcc70 ithread_loop(c8eaad70,edcfcce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xedcfccac fork_exit(c0bff950,c8eaad70,edcfcce8) at fork_exit+0x7e/frame 0xedcfccd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedcfccd4 --- trap 0, eip = 0, esp = 0xedcfcd20, ebp = 0 --- Tracing command intr pid 12 tid 100060 td 0xc90cc340 fork_trampoline() at fork_trampoline Tracing command intr pid 12 tid 100066 td 0xc9102340 sched_switch(c9102340,0,109,196,0,...) at sched_switch+0x4da/frame 0xedd44c38 mi_switch(109,0,c159f115,555,c19f8e00,...) at mi_switch+0x1bf/frame 0xedd44c70 ithread_loop(c8eaad30,edd44ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xedd44cac fork_exit(c0bff950,c8eaad30,edd44ce8) at fork_exit+0x7e/frame 0xedd44cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd44cd4 --- trap 0, eip = 0, esp = 0xedd44d20, ebp = 0 --- Tracing command intr pid 12 tid 100067 td 0xc9102000 sched_switch(c9102000,0,109,196,0,...) at sched_switch+0x4da/frame 0xedd55c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xedd55c70 ithread_loop(c8eaad10,edd55ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xedd55cac fork_exit(c0bff950,c8eaad10,edd55ce8) at fork_exit+0x7e/frame 0xedd55cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd55cd4 --- trap 0, eip = 0, esp = 0xedd55d20, ebp = 0 --- Tracing command intr pid 12 tid 100069 td 0xc9101680 sched_switch(c9101680,0,109,196,0,...) at sched_switch+0x4da/frame 0xedd65c38 mi_switch(109,0,c159f115,555,c159ee90,...) at mi_switch+0x1bf/frame 0xedd65c70 ithread_loop(c8eaad00,edd65ce8,c159ee90,402,0,...) at ithread_loop+0x1f0/frame 0xedd65cac fork_exit(c0bff950,c8eaad00,edd65ce8) at fork_exit+0x7e/frame 0xedd65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd65cd4 --- trap 0, eip = 0, esp = 0xedd65d20, ebp = 0 --- Tracing command intr pid 12 tid 100070 td 0xc9101340 fork_trampoline() at fork_trampoline Tracing command idle pid 11 tid 100003 td 0xc8e5a680 cpustop_handler(0,13,e4b2eb78,c11c58d7,e4b2ea50,...) at cpustop_handler+0x25/frame 0xe4b2ea28 ipi_nmi_handler(e4b2ea50,8,1,0,3009f5,...) at ipi_nmi_handler+0x36/frame 0xe4b2ea38 trap(e4b2eb84) at trap+0x37/frame 0xe4b2eb78 calltrap() at calltrap+0x6/frame 0xe4b2eb78 --- trap 0x13, eip = 0xc11dff35, esp = 0xe4b2ebc4, ebp = 0xe4b2ebc4 --- acpi_cpu_c1(e4b2ebd8,246,d2198e97,e4b2ec1c,c11cffa8,...) at acpi_cpu_c1+0x5/frame 0xe4b2ebc4 acpi_cpu_idle(a3774c3,0,a3774c3,e4b2ec38,c11e0313,...) at acpi_cpu_idle+0x32a/frame 0xe4b2ec08 cpu_idle_acpi(a3774c3,0,c19f8e88,15,c8e5a680,...) at cpu_idle_acpi+0x3f/frame 0xe4b2ec1c cpu_idle(0,e4b2ec80,c15a9876,a55,c19f9500,...) at cpu_idle+0xa3/frame 0xe4b2ec38 sched_idletd(0,e4b2ece8,c159ee90,402,0,...) at sched_idletd+0x403/frame 0xe4b2ecac fork_exit(c0c6a680,0,e4b2ece8) at fork_exit+0x7e/frame 0xe4b2ecd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b2ecd4 --- trap 0, eip = 0, esp = 0xe4b2ed20, ebp = 0 --- Tracing command idle pid 11 tid 100004 td 0xc8e5a340 cpustop_handler(1,13,e4b31b78,c11c58d7,e4b31a68,...) at cpustop_handler+0x25/frame 0xe4b31a28 ipi_nmi_handler(e4b31a68,c0c6858e,c19f959c,c90149c0,4,...) at ipi_nmi_handler+0x36/frame 0xe4b31a38 trap(e4b31b84) at trap+0x37/frame 0xe4b31b78 calltrap() at calltrap+0x6/frame 0xe4b31b78 --- trap 0x13, eip = 0xc11dff35, esp = 0xe4b31bc4, ebp = 0xe4b31bc4 --- acpi_cpu_c1(e4b31bd8,246,6d6fd31,e4b31c1c,c11cffa8,...) at acpi_cpu_c1+0x5/frame 0xe4b31bc4 acpi_cpu_idle(3ef4cbee,0,3ef4cbee,e4b31c38,c11e0313,...) at acpi_cpu_idle+0x32a/frame 0xe4b31c08 cpu_idle_acpi(3ef4cbee,0,c19f9588,e,c8e5a340,...) at cpu_idle_acpi+0x3f/frame 0xe4b31c1c cpu_idle(0,e4b31c80,c15a9876,a55,c19f9c00,...) at cpu_idle+0xa3/frame 0xe4b31c38 sched_idletd(0,e4b31ce8,c159ee90,402,0,...) at sched_idletd+0x403/frame 0xe4b31cac fork_exit(c0c6a680,0,e4b31ce8) at fork_exit+0x7e/frame 0xe4b31cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b31cd4 --- trap 0, eip = 0, esp = 0xe4b31d20, ebp = 0 --- Tracing command idle pid 11 tid 100005 td 0xc8e5a000 sched_switch(c8e5a000,0,108,192,0,...) at sched_switch+0x4da/frame 0xe4b34c00 mi_switch(108,0,c15a9876,a53,c19f8e00,...) at mi_switch+0x1bf/frame 0xe4b34c38 sched_idletd(0,e4b34ce8,c159ee90,402,0,...) at sched_idletd+0xe6/frame 0xe4b34cac fork_exit(c0c6a680,0,e4b34ce8) at fork_exit+0x7e/frame 0xe4b34cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b34cd4 --- trap 0, eip = 0, esp = 0xe4b34d20, ebp = 0 --- Tracing command idle pid 11 tid 100006 td 0xc8e599c0 cpustop_handler(3,13,e4b37b78,c11c58d7,e4b37a68,...) at cpustop_handler+0x25/frame 0xe4b37a28 ipi_nmi_handler(e4b37a68,c0c6858e,c19fa39c,c9014680,4,...) at ipi_nmi_handler+0x36/frame 0xe4b37a38 trap(e4b37b84) at trap+0x37/frame 0xe4b37b78 calltrap() at calltrap+0x6/frame 0xe4b37b78 --- trap 0x13, eip = 0xc11dff35, esp = 0xe4b37bc4, ebp = 0xe4b37bc4 --- acpi_cpu_c1(e4b37bd8,246,2f000000,e4b37c1c,c11cffa8,...) at acpi_cpu_c1+0x5/frame 0xe4b37bc4 acpi_cpu_idle(671dbbfe,0,671dbbfe,e4b37c38,c11e0313,...) at acpi_cpu_idle+0x32a/frame 0xe4b37c08 cpu_idle_acpi(671dbbfe,0,c19fa388,e,c8e599c0,...) at cpu_idle_acpi+0x3f/frame 0xe4b37c1c cpu_idle(0,e4b37c80,c15a9876,a55,c19f9c00,...) at cpu_idle+0xa3/frame 0xe4b37c38 sched_idletd(0,e4b37ce8,c159ee90,402,0,...) at sched_idletd+0x403/frame 0xe4b37cac fork_exit(c0c6a680,0,e4b37ce8) at fork_exit+0x7e/frame 0xe4b37cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b37cd4 --- trap 0, eip = 0, esp = 0xe4b37d20, ebp = 0 --- Tracing command init pid 1 tid 100002 td 0xc8e5a9c0 sched_switch(c8e5a9c0,0,104,196,e4b2a9a4,...) at sched_switch+0x4da/frame 0xe4b2a96c mi_switch(104,0,c15ad4f5,205,c89a0d80,...) at mi_switch+0x1bf/frame 0xe4b2a9a4 sleepq_switch(c8e5a9c0,0,c15ad4f5,1bb,e4b2aa1c,...) at sleepq_switch+0x127/frame 0xe4b2a9d8 sleepq_catch_signals(c15ad4f5,170,c8e51acc,2a,c8e5a9c0,...) at sleepq_catch_signals+0x3b3/frame 0xe4b2aa14 sleepq_wait_sig(c8e51a14,6c,c15b15d0,100,0,...) at sleepq_wait_sig+0x14/frame 0xe4b2aa38 _sleep(c8e51a14,c8e51abc,16c,c15b15d0,0,...) at _sleep+0x33f/frame 0xe4b2aa94 kern_wait6(c8e5a9c0,7,0,0,e4b2ab2c,...) at kern_wait6+0x47d/frame 0xe4b2ab00 sys_wait4(c8e5a9c0,e4b2aca8,c159e93c,4,e4b20c90,...) at sys_wait4+0x8b/frame 0xe4b2ac20 syscall(e4b2ace8) at syscall+0x388/frame 0xe4b2acdc Xint0x80_syscall() at Xint0x80_syscall+0x2f/frame 0xe4b2acdc --- syscall (7, FreeBSD ELF32, sys_wait4), eip = 0x8069ad7, esp = 0xbfbfe91c, ebp = 0xbfbfe930 --- Tracing command audit pid 10 tid 100001 td 0xc8e5b000 sched_switch(c8e5b000,0,104,196,e4b27bbc,...) at sched_switch+0x4da/frame 0xe4b27b84 mi_switch(104,0,c15ad4f5,205,c1ac98d4,...) at mi_switch+0x1bf/frame 0xe4b27bbc sleepq_switch(c8e5b000,0,c15ad4f5,27c,c1ac9948,...) at sleepq_switch+0x127/frame 0xe4b27bf0 sleepq_wait(c1ac9948,0,e4b27c44,1,0,...) at sleepq_wait+0x48/frame 0xe4b27c14 _cv_wait(c1ac9948,c1ac98d4,c15e4146,1ab,c19f8e00,...) at _cv_wait+0x20b/frame 0xe4b27c58 audit_worker(0,e4b27ce8,c159ee90,402,0,...) at audit_worker+0x94/frame 0xe4b27cac fork_exit(c0ebe1c0,0,e4b27ce8) at fork_exit+0x7e/frame 0xe4b27cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b27cd4 --- trap 0, eip = 0, esp = 0xe4b27d20, ebp = 0 --- Tracing command kernel pid 0 tid 100000 td 0xc1ac1f60 sched_switch(c1ac1f60,0,104,196,c2022bbc,...) at sched_switch+0x4da/frame 0xc2022b84 mi_switch(104,0,c15ad4f5,205,c1ac21e4,...) at mi_switch+0x1bf/frame 0xc2022bbc sleepq_switch(c1ac1f60,0,c15ad4f5,29f,c1ac1f60,...) at sleepq_switch+0x127/frame 0xc2022bf0 sleepq_timedwait(c1ac1bf4,54,9,0,0,...) at sleepq_timedwait+0x48/frame 0xc2022c14 _sleep(c1ac1bf4,0,54,c15ef477,fffff470,...) at _sleep+0x326/frame 0xc2022c70 swapper() at swapper+0x355/frame 0xc2022d38 begin() at begin+0x22 Tracing command kernel pid 0 tid 100016 td 0xc8f109c0 sched_switch(c8f109c0,0,104,196,e4b56bc0,...) at sched_switch+0x4da/frame 0xe4b56b88 mi_switch(104,0,c15ad4f5,205,c8e57118,...) at mi_switch+0x1bf/frame 0xe4b56bc0 sleepq_switch(c8f109c0,0,c15ad4f5,27c,c8f109c0,...) at sleepq_switch+0x127/frame 0xe4b56bf4 sleepq_wait(c8e57100,0,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b56c18 _sleep(c8e57100,c8e57118,0,c15906c3,0,...) at _sleep+0x352/frame 0xe4b56c74 taskqueue_thread_loop(c1a06f44,e4b56ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b56cac fork_exit(c0c8f2c0,c1a06f44,e4b56ce8) at fork_exit+0x7e/frame 0xe4b56cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b56cd4 --- trap 0, eip = 0, esp = 0xe4b56d20, ebp = 0 --- Tracing command kernel pid 0 tid 100020 td 0xc8f0f9c0 sched_switch(c8f0f9c0,0,104,196,e4b62bc0,...) at sched_switch+0x4da/frame 0xe4b62b88 mi_switch(104,0,c15ad4f5,205,c8e57018,...) at mi_switch+0x1bf/frame 0xe4b62bc0 sleepq_switch(c8f0f9c0,0,c15ad4f5,27c,c8f0f9c0,...) at sleepq_switch+0x127/frame 0xe4b62bf4 sleepq_wait(c8e57000,0,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b62c18 _sleep(c8e57000,c8e57018,0,c15906c3,0,...) at _sleep+0x352/frame 0xe4b62c74 taskqueue_thread_loop(c1ac6300,e4b62ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b62cac fork_exit(c0c8f2c0,c1ac6300,e4b62ce8) at fork_exit+0x7e/frame 0xe4b62cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b62cd4 --- trap 0, eip = 0, esp = 0xe4b62d20, ebp = 0 --- Tracing command kernel pid 0 tid 100021 td 0xc8f0f680 sched_switch(c8f0f680,0,104,196,e4b65bd8,...) at sched_switch+0x4da/frame 0xe4b65ba0 mi_switch(104,0,c15ad4f5,205,c1a082f0,...) at mi_switch+0x1bf/frame 0xe4b65bd8 sleepq_switch(c8f0f680,0,c15ad4f5,27c,0,...) at sleepq_switch+0x127/frame 0xe4b65c0c sleepq_wait(c8e56f00,0,c15a7a3e,c15906c3,0,...) at sleepq_wait+0x48/frame 0xe4b65c30 msleep_spin_sbt(c8e56f00,c8e56f18,c15906c3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b65c74 taskqueue_thread_loop(c1ab9204,e4b65ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b65cac fork_exit(c0c8f2c0,c1ab9204,e4b65ce8) at fork_exit+0x7e/frame 0xe4b65cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b65cd4 --- trap 0, eip = 0, esp = 0xe4b65d20, ebp = 0 --- Tracing command kernel pid 0 tid 100022 td 0xc8f0f340 sched_switch(c8f0f340,0,104,196,e4b68bd8,...) at sched_switch+0x4da/frame 0xe4b68ba0 mi_switch(104,0,c15ad4f5,205,c1a082f0,...) at mi_switch+0x1bf/frame 0xe4b68bd8 sleepq_switch(c8f0f340,0,c15ad4f5,27c,0,...) at sleepq_switch+0x127/frame 0xe4b68c0c sleepq_wait(c8e56f00,0,c15a7a3e,c15906c3,0,...) at sleepq_wait+0x48/frame 0xe4b68c30 msleep_spin_sbt(c8e56f00,c8e56f18,c15906c3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b68c74 taskqueue_thread_loop(c1ab9204,e4b68ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b68cac fork_exit(c0c8f2c0,c1ab9204,e4b68ce8) at fork_exit+0x7e/frame 0xe4b68cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b68cd4 --- trap 0, eip = 0, esp = 0xe4b68d20, ebp = 0 --- Tracing command kernel pid 0 tid 100023 td 0xc8f0f000 sched_switch(c8f0f000,0,104,196,e4b6bbd8,...) at sched_switch+0x4da/frame 0xe4b6bba0 mi_switch(104,0,c15ad4f5,205,c1a082f0,...) at mi_switch+0x1bf/frame 0xe4b6bbd8 sleepq_switch(c8f0f000,0,c15ad4f5,27c,0,...) at sleepq_switch+0x127/frame 0xe4b6bc0c sleepq_wait(c8e56f00,0,c15a7a3e,c15906c3,0,...) at sleepq_wait+0x48/frame 0xe4b6bc30 msleep_spin_sbt(c8e56f00,c8e56f18,c15906c3,0,0,...) at msleep_spin_sbt+0x228/frame 0xe4b6bc74 taskqueue_thread_loop(c1ab9204,e4b6bce8,c159ee90,402,0,...) at taskqueue_thread_loop+0xf3/frame 0xe4b6bcac fork_exit(c0c8f2c0,c1ab9204,e4b6bce8) at fork_exit+0x7e/frame 0xe4b6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b6bcd4 --- trap 0, eip = 0, esp = 0xe4b6bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100025 td 0xc8e5b680 sched_switch(c8e5b680,0,104,196,e4b71bc0,...) at sched_switch+0x4da/frame 0xe4b71b88 mi_switch(104,0,c15ad4f5,205,c8e56e18,...) at mi_switch+0x1bf/frame 0xe4b71bc0 sleepq_switch(c8e5b680,0,c15ad4f5,27c,c8e5b680,...) at sleepq_switch+0x127/frame 0xe4b71bf4 sleepq_wait(c8e56e00,0,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b71c18 _sleep(c8e56e00,c8e56e18,0,c15906c3,0,...) at _sleep+0x352/frame 0xe4b71c74 taskqueue_thread_loop(c1ac2490,e4b71ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b71cac fork_exit(c0c8f2c0,c1ac2490,e4b71ce8) at fork_exit+0x7e/frame 0xe4b71cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b71cd4 --- trap 0, eip = 0, esp = 0xe4b71d20, ebp = 0 --- Tracing command kernel pid 0 tid 100028 td 0xc9015340 sched_switch(c9015340,0,104,196,e4b7abc0,...) at sched_switch+0x4da/frame 0xe4b7ab88 mi_switch(104,0,c15ad4f5,205,c8e56698,...) at mi_switch+0x1bf/frame 0xe4b7abc0 sleepq_switch(c9015340,0,c15ad4f5,27c,c9015340,...) at sleepq_switch+0x127/frame 0xe4b7abf4 sleepq_wait(c8e56680,0,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xe4b7ac18 _sleep(c8e56680,c8e56698,0,c15906c3,0,...) at _sleep+0x352/frame 0xe4b7ac74 taskqueue_thread_loop(c1ac6288,e4b7ace8,c159ee90,402,0,...) at taskqueue_thread_loop+0x144/frame 0xe4b7acac fork_exit(c0c8f2c0,c1ac6288,e4b7ace8) at fork_exit+0x7e/frame 0xe4b7acd4 fork_trampoline() at fork_trampoline+0x8/frame 0xe4b7acd4 --- trap 0, eip = 0, esp = 0xe4b7ad20, ebp = 0 --- Tracing command kernel pid 0 tid 100071 td 0xc9101000 sched_switch(c9101000,0,104,196,edd6bbd8,...) at sched_switch+0x4da/frame 0xedd6bba0 mi_switch(104,0,c15ad4f5,205,c1a07948,...) at mi_switch+0x1bf/frame 0xedd6bbd8 sleepq_switch(c9101000,0,c15ad4f5,27c,0,...) at sleepq_switch+0x127/frame 0xedd6bc0c sleepq_wait(c90d0800,0,c15a7a3e,c15906c3,0,...) at sleepq_wait+0x48/frame 0xedd6bc30 msleep_spin_sbt(c90d0800,c90d0818,c15906c3,0,0,...) at msleep_spin_sbt+0x228/frame 0xedd6bc74 taskqueue_thread_loop(c1ab7610,edd6bce8,c159ee90,402,0,...) at taskqueue_thread_loop+0xf3/frame 0xedd6bcac fork_exit(c0c8f2c0,c1ab7610,edd6bce8) at fork_exit+0x7e/frame 0xedd6bcd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd6bcd4 --- trap 0, eip = 0, esp = 0xedd6bd20, ebp = 0 --- Tracing command kernel pid 0 tid 100074 td 0xc9100340 sched_switch(c9100340,0,104,196,edd75bc0,...) at sched_switch+0x4da/frame 0xedd75b88 mi_switch(104,0,c15ad4f5,205,c8e56e98,...) at mi_switch+0x1bf/frame 0xedd75bc0 sleepq_switch(c9100340,0,c15ad4f5,27c,c9100340,...) at sleepq_switch+0x127/frame 0xedd75bf4 sleepq_wait(c8e56e80,0,c15906c3,0,0,...) at sleepq_wait+0x48/frame 0xedd75c18 _sleep(c8e56e80,c8e56e98,0,c15906c3,0,...) at _sleep+0x352/frame 0xedd75c74 taskqueue_thread_loop(c188e324,edd75ce8,c159ee90,402,0,...) at taskqueue_thread_loop+0x144/frame 0xedd75cac fork_exit(c0c8f2c0,c188e324,edd75ce8) at fork_exit+0x7e/frame 0xedd75cd4 fork_trampoline() at fork_trampoline+0x8/frame 0xedd75cd4 --- trap 0, eip = 0, esp = 0xedd75d20, ebp = 0 --- db> dump Physical memory: 3427 MB Dumping 212 MB: 197 181 165 149 133 117 101 85 69 53 37 21 5 Dump complete db> reset cpu_reset: Restarting BSP cpu_reset_proxy: Stopped CPU 2 (kgdb) bt #0 doadump (textdump=0x0) at pcpu.h:206 #1 0xc055c3de in db_dump (dummy=0xc0c7ccfa, dummy2=Unhandled dwarf expression opcode 0x9d ) at ../../../ddb/db_command.c:533 #2 0xc055c1a8 in db_command (cmd_table=) at ../../../ddb/db_command.c:440 #3 0xc055bec0 in db_command_loop () at ../../../ddb/db_command.c:493 #4 0xc055e7c6 in db_trap (code=) at ../../../ddb/db_main.c:251 #5 0xc0c7d4b7 in kdb_trap (tf=) at ../../../kern/subr_kdb.c:654 #6 0xc11c610a in trap (frame=0xc84e08b4) at ../../../i386/i386/trap.c:702 #7 0xc11b1a1a in calltrap () at ../../../i386/i386/exception.s:172 #8 0xc0c7ccfa in kdb_enter (why=0xc15a6ac2 "panic", msg=) at cpufunc.h:60 #9 0xc0c3cdd2 in vpanic (fmt=, ap=) at ../../../kern/kern_shutdown.c:752 #10 0xc0c3ce0b in panic (fmt=0xc15a39ff "mutex %s not owned at %s:%d") at ../../../kern/kern_shutdown.c:690 #11 0xc0c1c386 in __mtx_assert (c=0x0, what=0x4, file=0x12
, line=0x0) at ../../../kern/kern_mutex.c:822 #12 0xc0f56587 in vm_page_lock_assert_KBI (m=0xc3126d00, a=0x4, file=0xc15f1243 "../../../vm/vm_page.c", line=0xb84) at ../../../vm/vm_page.c:3836 #13 0xc0f56985 in vm_page_free_toq (m=0xc3126d00) at ../../../vm/vm_page.c:2948 #14 0xc0f57098 in vm_page_free (m=0xc3126d00) at ../../../vm/vm_page.c:967 #15 0xc0f5a47c in vm_page_alloc_contig (object=0xc1ac9c50, pindex=0x34041, req=0x222, npages=0x1312, low=0x0, high=0xffffffff, alignment=0x1000, boundary=0x0, memattr=0x6) at ../../../vm/vm_page.c:1949 #16 0xc0f3bf25 in kmem_alloc_contig (vmem=0xc1a0a500, size=0x1312000, flags=0x1, low=0x0, high=0xffffffff, alignment=0x1000, boundary=0x0, memattr=0x6) at ../../../vm/vm_kern.c:235 #17 0xc0c16ea8 in contigmalloc (size=0x1312000, type=0x0, flags=0x1, low=0x0, high=0xffffffff, alignment=0x1000, boundary=0x0) at ../../../kern/kern_malloc.c:408 #18 0xca0775c0 in ?? () #19 0x01312000 in ?? () #20 0xc18479ac in M_DEVBUF_uninit_sys_uninit () #21 0x00000001 in ?? () #22 0x00000000 in ?? () Current language: auto; currently minimal (kgdb) f 12 #12 0xc0f56587 in vm_page_lock_assert_KBI (m=0xc3126d00, a=0x4, file=0xc15f1243 "../../../vm/vm_page.c", line=0xb84) at ../../../vm/vm_page.c:3836 3836 mtx_assert_(vm_page_lockptr(m), a, file, line); (kgdb) l 3831 3832 void 3833 vm_page_lock_assert_KBI(vm_page_t m, int a, const char *file, int line) 3834 { 3835 3836 mtx_assert_(vm_page_lockptr(m), a, file, line); 3837 } 3838 #endif 3839 3840 #ifdef INVARIANTS (kgdb) info loc No locals. (kgdb) p *m $1 = {plinks = {q = {tqe_next = 0xc3126d44, tqe_prev = 0xc363e7bc}, s = {ss = {sle_next = 0xc3126d44}, pv = 0xc363e7bc}, memguard = {p = 0xc3126d44, v = 0xc363e7bc}}, listq = { tqe_next = 0xc3126d44, tqe_prev = 0xc3126cc4}, object = 0x0, pindex = 0x4341, phys_addr = 0x1af41000, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xc3126d20}, pat_mode = 0x6}, wire_count = 0x0, busy_lock = 0x1, hold_count = 0x0, flags = 0x0, aflags = 0x2, oflags = 0x0, queue = 0xff, psind = 0x0, segind = 0x3, order = 0xb, pool = 0x0, act_count = 0x1, valid = 0x0, dirty = 0x0} (kgdb) f 15 #15 0xc0f5a47c in vm_page_alloc_contig (object=0xc1ac9c50, pindex=0x34041, req=0x222, npages=0x1312, low=0x0, high=0xffffffff, alignment=0x1000, boundary=0x0, memattr=0x6) at ../../../vm/vm_page.c:1949 1949 vm_page_free(m); (kgdb) l 1944 m < &m_ret[npages]; m++) { 1945 if ((req & VM_ALLOC_WIRED) != 0) 1946 m->wire_count = 0; 1947 if (m >= m_tmp) 1948 m->object = NULL; 1949 vm_page_free(m); 1950 } 1951 return (NULL); 1952 } 1953 } else (kgdb) info loc drop = (struct vnode *) 0x0 deferred_vdrop_list = {slh_first = 0x0} m = 0xc3126d00 m_tmp = 0xc3126cbc m_ret = 0xc3118fbc flags = 0x0 req_class = 0x2 (kgdb) $ svn diff -x -p /usr/src/sys Index: /usr/src/sys/kern/kern_malloc.c =================================================================== --- /usr/src/sys/kern/kern_malloc.c (revision 298511) +++ /usr/src/sys/kern/kern_malloc.c (working copy) @@ -50,6 +50,7 @@ __FBSDID("$FreeBSD$"); #include #include +#include #include #include #include @@ -472,6 +473,19 @@ malloc(unsigned long size, struct malloc_type *mtp } } #endif + if (flags & M_NOWAIT) { + KFAIL_POINT_CODE(DEBUG_FP, malloc, { + if (uma_dbg_nowait_fail_enabled_malloc( + mtp->ks_shortdesc)) { + /* XXX record call stack */ +#ifdef MALLOC_MAKE_FAILURES + atomic_add_int(&malloc_failure_count, 1); + t_malloc_fail = time_uptime; +#endif + return (NULL); + } + }); + } if (flags & M_WAITOK) KASSERT(curthread->td_intr_nesting_level == 0, ("malloc(M_WAITOK) in interrupt context")); Index: /usr/src/sys/vm/uma_core.c =================================================================== --- /usr/src/sys/vm/uma_core.c (revision 298511) +++ /usr/src/sys/vm/uma_core.c (working copy) @@ -64,6 +64,7 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include #include #include #include @@ -2104,6 +2105,23 @@ uma_zalloc_arg(uma_zone_t zone, void *udata, int f if (flags & M_WAITOK) { WITNESS_WARN(WARN_GIANTOK | WARN_SLEEPOK, NULL, "uma_zalloc_arg: zone \"%s\"", zone->uz_name); + } else { + KFAIL_POINT_CODE(DEBUG_FP, uma_zalloc_arg, { + /* + * XXX hack. Setting the fail point to 0 (default) + * causes it to ignore malloc zones, nonzero causes it + * to inject failures for malloc zones regardless of + * the malloc black/white lists. + */ + if (((zone->uz_flags & UMA_ZONE_MALLOC) == 0 || + RETURN_VALUE != 0) && + uma_dbg_nowait_fail_enabled_zalloc( + zone->uz_name)) { + /* XXX record call stack */ + atomic_add_long(&zone->uz_fails, 1); + return NULL; + } + }); } KASSERT(curthread->td_critnest == 0 || SCHEDULER_STOPPED(), ("uma_zalloc_arg: called with spinlock or critical section held")); Index: /usr/src/sys/vm/uma_dbg.c =================================================================== --- /usr/src/sys/vm/uma_dbg.c (revision 298511) +++ /usr/src/sys/vm/uma_dbg.c (working copy) @@ -42,6 +42,8 @@ __FBSDID("$FreeBSD$"); #include #include #include +#include +#include #include #include @@ -184,7 +186,146 @@ mtrash_init(void *mem, int size, int flags) return (0); } +/* XXX explain */ +struct rwlock g_uma_dbg_nowait_lock; +RW_SYSINIT(uma_dbg_nowait, &g_uma_dbg_nowait_lock, "uma dbg nowait"); + +#define NOWAIT_FAIL_LIST_BUFSIZE 4096 +char malloc_fail_blacklist[NOWAIT_FAIL_LIST_BUFSIZE] = "kobj"; +char malloc_fail_whitelist[NOWAIT_FAIL_LIST_BUFSIZE] = ""; +char zalloc_fail_blacklist[NOWAIT_FAIL_LIST_BUFSIZE] = + "BUF TRIE,ata_request,sackhole"; +char zalloc_fail_whitelist[NOWAIT_FAIL_LIST_BUFSIZE] = ""; + +static bool +str_in_list(const char *list, char delim, const char *str) +{ + const char *b, *e; + size_t blen, slen; + + b = list; + slen = strlen(str); + for (;;) { + e = strchr(b, delim); + blen = e == NULL ? strlen(b) : e - b; + if (blen == slen && strncmp(b, str, slen) == 0) + return true; + if (e == NULL) + break; + b = e + 1; + } + return false; +} + +static bool +uma_dbg_nowait_fail_enabled_internal(const char *blacklist, + const char *whitelist, const char *name) +{ + bool fail; + + /* Protect ourselves from the sysctl handlers. */ + rw_rlock(&g_uma_dbg_nowait_lock); + if (whitelist[0] == '\0') + fail = !str_in_list(blacklist, ',', name); + else + fail = str_in_list(whitelist, ',', name); + rw_runlock(&g_uma_dbg_nowait_lock); + + return fail; +} + +bool +uma_dbg_nowait_fail_enabled_malloc(const char *name) +{ + return uma_dbg_nowait_fail_enabled_internal(malloc_fail_blacklist, + malloc_fail_whitelist, name); +} + +bool +uma_dbg_nowait_fail_enabled_zalloc(const char *name) +{ + return uma_dbg_nowait_fail_enabled_internal(zalloc_fail_blacklist, + zalloc_fail_whitelist, name); +} + /* + * XXX provide SYSCTL_STRING_LOCKED / sysctl_string_locked_handler? + * This is basically just a different sysctl_string_handler. This one wraps + * the string manipulation in a lock and in a way that will not cause a sleep + * under that lock. + */ +static int +sysctl_debug_mnowait_failure_list(SYSCTL_HANDLER_ARGS) +{ + char *newbuf = NULL; + int error, newlen; + bool have_lock = false; + + if (req->newptr != NULL) { + newlen = req->newlen - req->newidx; + if (newlen >= arg2) { + error = EINVAL; + goto out; + } + newbuf = malloc(newlen, M_TEMP, M_WAITOK); + error = SYSCTL_IN(req, newbuf, newlen); + if (error != 0) + goto out; + } + + error = sysctl_wire_old_buffer(req, arg2); + if (error != 0) + goto out; + + rw_wlock(&g_uma_dbg_nowait_lock); + have_lock = true; + + error = SYSCTL_OUT(req, arg1, strnlen(arg1, arg2 - 1) + 1); + if (error != 0) + goto out; + + if (newbuf == NULL) + goto out; + + bcopy(newbuf, arg1, newlen); + ((char *)arg1)[newlen] = '\0'; + out: + if (have_lock) + rw_wunlock(&g_uma_dbg_nowait_lock); + free(newbuf, M_TEMP); + return error; +} + +SYSCTL_NODE(_debug, OID_AUTO, mnowait_failure, CTLFLAG_RW, 0, + "Control of M_NOWAIT memory allocation failure injection."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, malloc_blacklist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, malloc_fail_blacklist, + sizeof(malloc_fail_blacklist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.malloc and with an empty whitelist, CSV list of " + "zones which remain unaffected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, malloc_whitelist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, malloc_fail_whitelist, + sizeof(malloc_fail_whitelist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.malloc, CSV list of zones exclusively affected. " + "With an empty whitelist, all zones but those on the blacklist" + "are affected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, zalloc_blacklist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, zalloc_fail_blacklist, + sizeof(zalloc_fail_blacklist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.uma_zalloc_arg and with an empty whitelist, CSV " + "list of zones which remain unaffected."); + +SYSCTL_PROC(_debug_mnowait_failure, OID_AUTO, zalloc_whitelist, + CTLTYPE_STRING | CTLFLAG_RW | CTLFLAG_MPSAFE, zalloc_fail_whitelist, + sizeof(zalloc_fail_whitelist), sysctl_debug_mnowait_failure_list, "A", + "With debug.fail_point.uma_zalloc_arg, CSV list of zones exclusively " + "affected. With an empty whitelist, all zones but those on the blacklist" + "are affected."); + +/* * Checks an item to make sure it hasn't been overwritten since it was freed, * prior to freeing it back to available memory. * Index: /usr/src/sys/vm/uma_int.h =================================================================== --- /usr/src/sys/vm/uma_int.h (revision 298511) +++ /usr/src/sys/vm/uma_int.h (working copy) @@ -421,6 +421,9 @@ vsetslab(vm_offset_t va, uma_slab_t slab) void *uma_small_alloc(uma_zone_t zone, vm_size_t bytes, uint8_t *pflag, int wait); void uma_small_free(void *mem, vm_size_t size, uint8_t flags); + +bool uma_dbg_nowait_fail_enabled_malloc(const char *name); +bool uma_dbg_nowait_fail_enabled_zalloc(const char *name); #endif /* _KERNEL */ #endif /* VM_UMA_INT_H */ Index: /usr/src/sys/vm/vm_fault.c =================================================================== --- /usr/src/sys/vm/vm_fault.c (revision 298511) +++ /usr/src/sys/vm/vm_fault.c (working copy) @@ -137,7 +137,12 @@ release_page(struct faultstate *fs) vm_page_xunbusy(fs->m); vm_page_lock(fs->m); - vm_page_deactivate(fs->m); + if (fs->m->valid == 0) { + if (fs->m->wire_count == 0) + vm_page_free(fs->m); + } else { + vm_page_deactivate(fs->m); + } vm_page_unlock(fs->m); fs->m = NULL; } @@ -292,7 +297,8 @@ vm_fault_hold(vm_map_t map, vm_offset_t vaddr, vm_ struct faultstate fs; struct vnode *vp; vm_page_t m; - int ahead, behind, cluster_offset, error, locked; + int ahead, behind, cluster_offset, dead, error, locked, rv; + u_char behavior; hardfault = 0; growstack = TRUE; @@ -412,7 +418,7 @@ fast_failed: fs.lookup_still_valid = TRUE; - fs.first_m = NULL; + fs.m = fs.first_m = NULL; /* * Search for the page at object/offset. @@ -421,11 +427,20 @@ fast_failed: fs.pindex = fs.first_pindex; while (TRUE) { /* - * If the object is dead, we stop here + * If the object is marked for imminent termination, + * we retry here, since the collapse pass has raced + * with us. Otherwise, if we see terminally dead + * object, return fail. */ - if (fs.object->flags & OBJ_DEAD) { + if ((fs.object->flags & OBJ_DEAD) != 0) { + dead = fs.object->type == OBJT_DEAD; + if (fs.m != NULL && fs.m != fs.first_m) + release_page(&fs); unlock_and_deallocate(&fs); - return (KERN_PROTECTION_FAILURE); + if (dead) + return (KERN_PROTECTION_FAILURE); + pause("vmf_de", 1); + goto RetryFault; } /* @@ -551,9 +566,18 @@ readrest: * zero-filled pages. */ if (fs.object->type != OBJT_DEFAULT) { - int rv; - u_char behavior = vm_map_entry_behavior(fs.entry); - + if (!fs.lookup_still_valid) { + locked = vm_map_trylock_read(fs.map); + if (locked) + fs.lookup_still_valid = TRUE; + if (!locked || fs.map->timestamp != + map_generation) { + release_page(&fs); + unlock_and_deallocate(&fs); + goto RetryFault; + } + } + behavior = vm_map_entry_behavior(fs.entry); era = fs.entry->read_ahead; if (behavior == MAP_ENTRY_BEHAV_RANDOM || P_KILLED(curproc)) { @@ -604,6 +628,7 @@ readrest: } ahead = ulmin(ahead, atop(fs.entry->end - vaddr) - 1); if (era != nera) + /* XXX only read-lock on map */ fs.entry->read_ahead = nera; /* @@ -821,6 +846,7 @@ vnode_locked: if (vm_page_rename(fs.m, fs.first_object, fs.first_pindex)) { VM_OBJECT_WUNLOCK(fs.first_object); + release_page(&fs); unlock_and_deallocate(&fs); goto RetryFault; } Index: /usr/src/sys/vm/vm_object.c =================================================================== --- /usr/src/sys/vm/vm_object.c (revision 298511) +++ /usr/src/sys/vm/vm_object.c (working copy) @@ -1584,7 +1584,7 @@ vm_object_collapse_scan(vm_object_t object, int op continue; } - KASSERT(pp == NULL || pp->valid != 0, + KASSERT(pp == NULL || pp->wire_count > 0 || pp->valid != 0, ("unbusy invalid page %p", pp)); if (pp != NULL || vm_pager_has_page(object, new_pindex, NULL, @@ -1669,11 +1669,14 @@ vm_object_qcollapse(vm_object_t object) void vm_object_collapse(vm_object_t object) { + vm_object_t backing_object, new_backing_object; + VM_OBJECT_ASSERT_WLOCKED(object); - + + if ((object->flags & OBJ_DEAD) != 0) + return; + vm_object_pip_add(object, 1); while (TRUE) { - vm_object_t backing_object; - /* * Verify that the conditions are right for collapse: * @@ -1699,14 +1702,14 @@ vm_object_collapse(vm_object_t object) break; } - if ( - object->paging_in_progress != 0 || - backing_object->paging_in_progress != 0 - ) { + if (object->paging_in_progress > 1 /* one ref is from us */ || + backing_object->paging_in_progress != 0) { vm_object_qcollapse(object); VM_OBJECT_WUNLOCK(backing_object); break; } + vm_object_pip_add(backing_object, 1); + /* * We know that we can either collapse the backing object (if * the parent is the only reference to it) or (perhaps) have @@ -1789,6 +1792,7 @@ vm_object_collapse(vm_object_t object) KASSERT(backing_object->ref_count == 1, ( "backing_object %p was somehow re-referenced during collapse!", backing_object)); + vm_object_pip_wakeup(backing_object); backing_object->type = OBJT_DEAD; backing_object->ref_count = 0; VM_OBJECT_WUNLOCK(backing_object); @@ -1796,8 +1800,6 @@ vm_object_collapse(vm_object_t object) object_collapses++; } else { - vm_object_t new_backing_object; - /* * If we do not entirely shadow the backing object, * there is nothing we can do so we give up. @@ -1804,6 +1806,7 @@ vm_object_collapse(vm_object_t object) */ if (object->resident_page_count != object->size && !vm_object_scan_all_shadowed(object)) { + vm_object_pip_wakeup(backing_object); VM_OBJECT_WUNLOCK(backing_object); break; } @@ -1836,6 +1839,7 @@ vm_object_collapse(vm_object_t object) * its ref_count was at least 2, it will not vanish. */ backing_object->ref_count--; + vm_object_pip_wakeup(backing_object); VM_OBJECT_WUNLOCK(backing_object); object_bypasses++; } @@ -1844,6 +1848,7 @@ vm_object_collapse(vm_object_t object) * Try again with this object's new backing object. */ } + vm_object_pip_wakeup(object); } /* Index: /usr/src/sys/vm/vm_page.c =================================================================== --- /usr/src/sys/vm/vm_page.c (revision 298511) +++ /usr/src/sys/vm/vm_page.c (working copy) @@ -3288,7 +3288,8 @@ vm_page_cache(vm_page_t m) cache_was_empty = vm_radix_is_empty(&object->cache); if (vm_radix_insert(&object->cache, m)) { mtx_unlock(&vm_page_queue_free_mtx); - if (object->resident_page_count == 0) + if (object->type == OBJT_VNODE && + object->resident_page_count == 0) vdrop(object->handle); m->object = NULL; vm_page_free(m); -- Test scenario: misc/contigmalloc.sh