Direct vs. Indirect Measures
Assessment measures typically come in two types: direct and indirect. Direct measures demonstrate how well students, programs, or units have achieved specific learning outcomes or objectives. A direct measure of assessment must be explicitly aligned to that specific outcome or objective. In academic assessment, direct measures are actual examples of student work; however, grades on assignments or final grades are not direct assessment. For grades on assignments to be direct, they must be embedded, meaning that the entire assignment or problems/sections within that assignment are explicitly tied to specific learning outcomes. In AES assessment, direct assessment means looking at performance measures such as retention, time, costs, or operational data.
Indirect measures rely on reflection on or perceptions of the achievement of learning outcomes or objectives. In academic assessment, indirect assessment gives context to direct assessment and can provide a broader view of student progress. In academic assessment, grades are indirect measures because, unless they are explicitly and solely aligned to specific learning outcomes, they often measure other things in addition to student learning, such as attendance, participation, or timeliness.
Direct Measures
- Embedded course and homework assignments tied to learning outcomes
- Specific problems or sections on exams and quizzes tied to learning outcomes
- Summative assignments scored with a rubric that identifies which parts are tied to learning outcomes:
- Research papers, lab reports, presentations, or case study analyses
- Capstone projects, portfolios, presentations, performances
- Pass rates or scores on licensure, certification, or subject-area tests, specifically tied to learning outcomes
- Retention data
- Time or costs involved in performance
- Demand, quality, efficiency, effectiveness markers
Indirect Measures
- Grades on assignments not explicitly tied to learning outcomes
- Surveys, focus groups, interviews
- Assessments of time spent on a particular activity
- Employer/internship supervisor ratings or feedback
- Registration or enrollment information
- Job placement information
- Event or initiative feedback
- Transfer rates
- Perceived timeliness
- Self-report surveys and questionnaires
- Captured through:
- Surveys
- Observations
- Performance ratings
- Focus groups