WikiEducator - Evaluation of eLearning for Best Practice/Resources

Material just in

This list will update as participants find new material and tag in del.icio.us

Please use the tag word "evaluationbestpractice" to categorise and share what you find.

Here you can only see the latest 10. To see the full list: http://del.icio.us/bronwynh/evaluationbestpractice

AES Publications: The Australasian evaluation society - journal, book reviews, stories, reports. Looks very useful. Journal articles have a practical and Australasian focus.
Evaluation Research: website on evaluation research. has some familiar terminology and some terms and approaches which look quite theoretical. The evaluation and planning cycle looks relevant.
Learning Resources: Statistics: Power from Data!: Graph types: a good site with descriptions about lots of different kinds of graphs.
impact evaluation: a general overview of impact evaluation - evidence-based practice. Not specifically about online learning but principles are the same.
The eLearning Guild : eBook - Tips - Online Instruction: 834Tips for Successful Online Instruction
Criteria for Evaluating the Quality of Online Courses: criteria used in the design of courses.
Quality Matters: list of forty elements available under eight categories which can provide ideas for evaluation criteria. Check out the copyright conditions before using.
Ten Tips for writing a blog post: a simple list for writing a good post.
International Journal of Emerging Technologies in Learning (iJET): open journal with relevant material, for example, Vol 4, No 1 (2009) article on quality assurance - Breaking Boundaries: Quality E-Learning for the Global Knowledge Society by Lalilta Rajasingham pp. 58-65
Electronic Village Online / Enhancing_Lessons: Enhancing Lessons with Web 2.0
29.pdf (application/pdf Object): Quality International benchmarks for distance Internet learning
Quality On the Line (IHEP)
ipod_initiative_04_05.pdf (application/pdf Object): evaluation of ipods at duke university
Online International Journal of Usability Studies - Do Usability Expert Evaluation and Testing Provide Novel and Useful Data For Game Development?: A case study was done to study whether usability expert evaluation and testing are suitable for game development. In the study, a computer game under development was first evaluated and then tested. Game developers were then asked to rate the findings and
Project Evaluation Toolkit: excellent site with everything you need for evaluation projects - last updated 2005.

Presentations

Bonnie and Suzy DVD in Nursing evaluation presentation on Elluminate. The full title of the presentation is: Evaluating the effectiveness of a DVD in the flexible mode of delivery in nursing education.
Presentation only with synced audio Evaluating the effectiveness of a DVD in the flexible mode of delivery in nursing education with Bonnie and Suzy.
The impact of a Learning Management System and the ways in which academic staff transferred their learning from one system to another was investigated by Selena, Trish and Lois. View the presentation made by Selena which is synched with audio.
A presentation of summative evaluation conducted by Sandra Elias looking at online discussion which was used for assessment in a nutrition course in a midwifery degree.

APA Referencing

APA (American Psychological Association) referencing is used in this course. There are lots of links to resources about this style of referencing on the Manukau Institute of Technology library website.

Reading

Journals and books for this subject are available from the Manukau Institute of Technology library.

Books

Information for this course has been compiled in Chapter Eight of the eLearning Guidebook.

Further information for this course is available in the book by Reeves, Thomas, C. and John G. Hedberg (2003), Interactive Learning Systems Evaluation, Englewood Cliffs: Educational Technology Publications. ISBN 0-87778-304-7. The companion web site makes available a full set of evaluation tools (forms and protocol).

Journals and conference proceedings

Journals

Australian Educational Computing. This is the refereed journal of the ACCE (Australian Council for Computers in Education) and is published twice a year.
Evaluation issue of the Australian Journal of Educational Technology (AJET) has lots of evaluation articles. (2002). Vol 18(2).
AJET homepage with access to all the online journal articles.
Education-line is an archive of bibliographies and full-text, online reports. It is a joint project of the British Education Index and a consortium of British professional educational associations.
The European Journal of Open and Distance Learning (EURODL). "An online journal on distance and e-learning, publishes the accounts of research, development and teaching for Europe in its most inclusive definition, exploring the potential of electronic publishing. Furthermore, EURODL presents scholarly work and solid information about open, distance and e-learning, education through telematics, multimedia, on-line learning and co-operation."
First Monday online journal.

Conference proceedings

Australasian Society for Computers in Learning in Tertiary Education ASCILITE]has an annual conference and online proceedings.

"It is a society for those involved in tertiary computer-based education and training, including educational interactive multimedia. It provides a forum to stimulate discussion of relevant issues in the educational use of technology, as well as promoting research and evaluation."

Evaluating the New Teaching Technologies Workshop (2000). proceedings.
Online Learning and Teaching Conference (2004) proceedings.
UniServe Science Symposiums proceedings.

Articles

Bates, Paul & Obexer, Regina. (2005). Evaluating student-centred teaching and learning strategies for Aviation students using a quality framework for online learning

environments. In ASCILITE 2005 conference proceedings: Balance, Fidelity, Mobility: Maintaining the Momentum.

Brittain, Sarah, Glowacki, Pietrek, Van Ittersum, Jared and Johnson, Lynn (2006). Podcasting Lectures: Formative evaluation strategies helped identify a solution to a learning dilemma. This is an article of an evaluation study conducted at the University of Michigan (U-M) School of Dentistry.
Elgort, I., Smith, A. G. & Toland, J. (2008). Is wiki an effective platform for group course work? Australasian Journal of Educational Technology, 24(2), 195-210.
Muirhead, R.J. (2007). E-learning: Is this teaching at students or teaching with students? Nursing Forum 42(4),178-184.
Phillips, R. (2005). We can’t evaluate e-learning if we don’t know what we mean by evaluating e-learning! Interact, 30, p 3 - 6. Learning Technology Support Service, University of Bristol.
Rourke, L., Anderson, T., Garrison, R. & Archer, W. (2001). Assessing Social Presence In Asynchronous Text-based Computer Conferencing. Journal of Distance Education/Revue de l'enseignement à distance.
Sleezer, C. M., Kelsey, K. D., & Wood, T. (2005). Assessing safety training needs at AVN 300: A case study. Proceedings of the Canadian Evaluation Society and the American Evaluation Association Joint Conference, October 24-30, 2005. Toronto, Ontario, Canada. An article about a needs analysis - demonstrating Stake's Responsive Evaluation Model.

Newsletters

Implementing e-learning guidelines newsletter for April 2008.

Evaluation Tools

There are a range of tools for use in evaluations on the websites listed here.
One site which is most useful is: http://www.evaluateitnow.com/ - a direct link to evaluation tools and matrices.
Explore the Evaluation Cookbook to decide on some sampling methods for your project.
Sample evaluation plan - Usability evaluation
Take a look at some example reports (scroll down to documents) at: Online information literacy project. You will note some reports are brief, e.g., Prototype Evaluation Report, and others such as the final report for the project are more detailed.
An example of how results could be laid out and the type of analyses which can be done – median, frequencies in this summative evaluation report of results.
Nielsen, J. (1994). Ten Usability Heuristics.

Websites

eLearning Guidelines for New Zealand: http://elg.massey.ac.nz/