Teaching with OER
Assessing Course Outcomes
Learning Objectives
At the end of this section, you should be able to:
- Describe why assessment is used for teaching and learning.
- Explain the difference between assessing traditional and open course materials.
Assessment is an integral part of the education process, a method used as a barometer for what changes may be necessary to improve teaching and learning. Assessment is not always a simple process, so it can help to get some support understanding key concepts.
Assessment in the Classroom
Assessment can occur at any time during or after a course. It is recommended that instructors assess their course regularly, but especially when incorporating new techniques or course materials for the first time. The National Research Council describes the assessment process as a constantly evolving enterprise:
“What is important is that assessment is an ongoing activity, one that relies on multiple strategies and sources for collecting information that bears on the quality of student work and that then can be used to help both the students and the teacher think more pointedly about how the quality might be improved.”[1]
One popular method of assessing a course is to investigate whether the learning outcomes you selected for the course have been met.
Learning Outcomes
Elhabashy defines Student Learning Outcomes (SLOs) as
“the specific observable or measurable results that are expected subsequent to a learning experience. These outcomes may involve knowledge (cognitive), skills (behavioral), or attitudes (affective) that provide evidence that learning has occurred as a result of a specified course, program activity, or process.”[2]
These learning outcomes are used as benchmarks for assessing student learning and, by proxy, your own teaching. Perhaps the most important type of SLOs are Course Learning Outcomes (CLOs). CLOs are the final outcomes that an instructor expects their class to have gained once they leave a course.[3] These should be measurable items, outcomes for which you can create effective assessments.
It is important to consult course learning outcomes before making any major changes to your syllabus or teaching materials. When creating OER for your course, consider if there are ways in which your OER can improve on student’s understanding of CLOs.
Types of Assessment
- Formative Assessment: An ongoing process with a wide variety of formats, formative assessment can include quizzes, papers, projects, and any other formal or informal tests provided to gauge your students’ understanding of course content.
- Summative Assessment: The final assessment of student learning after a course has completed, summative assessment can include final papers, projects, or exams. Summative assessment should be used to assess both standard teaching procedures and the effectiveness of any changes made following the formative assessments provided throughout your course.
- Student Self-Assessment: Methods for allowing your students to rate their own confidence in their work and their understanding of course content; examples include writing discussion board posts, drafting exam questions, and filling out confidence rating scales on exams.[4]
- Student Peer-Assessment: The process by which students evaluate the work of their peers within a course, peer assessment is often used as a learning tool to help students reconsider their own understanding of course content as they evaluate the work of their peers.[5]
- Student Assessment of Teaching (SATs): The manner in which students report on the effectiveness of an instructor’s teaching on their learning, often given at the end of a course but sometimes handled as an ongoing process. The most ubiquitous SATs are student surveys given at the end of a course.
For additional approaches to classroom assessment, the Iowa State University Center for Excellence in Learning & Teaching (CELT) has compiled a website listing quick assessment strategies.
After reviewing these more traditional assessment types, you might wonder how the assessment for a course using OER differs.
Assessment for OER
Assessment for courses utilizing OER does not have to be any different than for courses utilizing traditional materials. Nonetheless, some individuals have developed assessment techniques for the open classroom in particular. One of these is the RISE Framework.
The RISE Framework (Resource Inspection, Selection, and Enhancement) utilizes a 2 x 2 matrix of High Grade/Low Grade and High Use/Low Use to determine how much the use of OER has affected a student’s learning outcomes.[6] The RISE Framework is used to determine how well a student performed in a course and to contrast that outcome with how much they used their provided course materials. This method can help delineate between students who excel in a subject by default and those who have done well in a course thanks to the use of the provided course content. A package in R has been developed for running a RISE analysis quickly and easily. The RISE package for R is openly available in Zenodo.
In the end, what assessment techniques you employ in your course will be determined by a variety of factors, some of which will be out of your control. Nonetheless, it’s important to understand why you’re assessing your course and the impact that assessment can have, particularly for courses changing their materials.
- National Research Council. Classroom Assessment and the National Science Education Standards. Washington, DC: The National Academies Press, 2001. DOI: https://doi.org/10.17226/9847. ↵
- Elhabashy, Sameh. Formulate Consequential Student Learning Outcomes. Baltimore: John Hopkins University Press, 2017. ↵
- Elhabashy, Sameh. Formulate Consequential Student Learning Outcomes. ↵
- Sorenson-Unruh, Clarissa. "Ungrading: The First Exam." Reflective Teaching Evolution. May 1, 2019. https://clarissasorensenunruh.com/2019/05/01/ungrading-the-first-exam-part-3/ ↵
- Stanford Teaching Commons. "Peer Assessment." Accessed July 1, 2019. https://teachingcommons.stanford.edu/resources/teaching/evaluating-students/assessing-student-learning/peer-assessment ↵
- Bodily, Robert, Nyland, Rob, and Wiley, David. "The RISE Framework: Using Learning Analytics to Automatically Identify Open Educational Resources for Continuous Improvement." International Review of Research in Open and Distributed Learning 18, no. 2 (2017). DOI: https://doi.org/10.19173/irrodl.v18i2.2952 ↵
The outcomes that an instructor expects their students to display at the end of a learning experience (an activity, process, or course). (Source: Elhabashy, 2017).
The final outcomes that an instructor expects their students to gain by the time the students complete a course.
Feedback/Errata