III. Selection of assessment type
D. Norm or criterion referenced
This text introduces the concept of assessment references in medical education, specifically norms and criteria. It emphasizes the importance of understanding these assessment types for educators and institutions in order to create a strong evaluation framework. The text suggests that how students are evaluated can greatly impact their educational journey.
BASIC Information
As medical students journey through their training, it's crucial to understand how their progress is evaluated. Assessments can be classified based on what they reference: norms (others' performances) or criteria (established standards).
VIDEO
Criterion vs Norm Referenced Assessment: Examples & EvaluationExample: If a PA student scores in the 90th percentile in a pharmacology exam, it means they performed better than 90% of the students who took the same test.
INTERMEDIATE Information
In medical training, how we evaluate shapes the educational journey. Let's delve deeper into the nuances of these assessment types.
READ
On the Appropriateness of Norm- and Criterion-referenced Assessments in Medical EducationPros:
Ranking and Differentiation: Allows institutions to rank students, useful for competitive placements or awards.
Broad Overview: Provides an insight into how the entire batch is performing.
Cons:
Not Absolute: A student's ranking could be high even if their actual performance is mediocre, provided their peers also performed at a similar level.
Can Promote Competition: Over-reliance can make the learning environment overly competitive, deterring collaboration.
Example: In a class, if everyone struggles with interpreting chest X-rays and scores low, a student might rank high with a meager score. They might be top of the class, but still lack crucial skills.
Pros:
Clear Expectations: Students know exactly what's expected of them.
Absolute Performance: Focuses on individual skills and knowledge, not relative performance.
Cons:
May Not Differentiate: If a significant number of students achieve the criteria, it might not distinguish between students who just met the criteria and those who significantly surpassed it.
Example: If passing requires identifying 8 out of 10 pathologies in chest X-rays correctly, students won’t be differentiated based on whether they got 8, 9, or all 10 right.
ADVANCED Information
For educators and institutions aiming to craft a robust evaluation framework, understanding the deeper intricacies of these assessment types is vital.
MEASUREMENT AND EVALUATION: CRITERION- VERSUS NORM-REFERENCED TESTING
Hybrid Models: Some assessments might use a mix. For instance, a PA student could be evaluated using criterion-referenced methods for clinical skills but norm-referenced for research projects where differentiation is valuable.
Setting Standards: While criterion-referenced assessment is absolute, deriving those criteria often involves understanding norms. For example, determining the requisite skills a PA should possess by graduation might involve looking at average industry norms.
Validity and Reliability: Whether norm or criterion-referenced, the assessment must accurately measure what it intends to (validity) and do so consistently (reliability).
Feedback and Learning: Especially in criterion-referenced assessment, feedback is vital. Even if a student meets criteria, there's always room for improvement.
Example: A student might successfully diagnose a condition based on a patient’s history and examination. While they've met the criteria, feedback can still be given on improving bedside manner or ensuring patient comfort.
In advanced pedagogy, the focus isn't just on choosing between norm and criterion referencing but on leveraging the strengths of each method. The ultimate goal is to ensure that when a PA graduates, they are not just competent in their role but are also lifelong learners, ready to adapt and grow in their medical careers.