WEEK 9: Grading & Post-test Analysis (18 OF 25)

VII. Key Components of Item Analysis

b. Discrimination Index: Identifying high-quality test items

The discrimination index is a metric used in item analysis to determine the quality of assessment questions. It measures how well a question can differentiate between high-performing and low-performing students. A positive discrimination index indicates that the question effectively distinguishes strong students from weaker ones, while a negative value suggests that low-performing students performed better than high-performing students on that question.

    BASIC Information

The discrimination index is a measure used in item analysis to identify high-quality assessment questions. It helps educators understand how effectively a question discriminates between high-performing and low-performing students. A positive discrimination index indicates that the question differentiates well between strong and weak students, making it a valuable addition to an assessment.

READ

Evaluation Of Discrimination Index Of Single Best Response Type Of Multiple Choice Questions In Physiology By Item Analysis.
In a PA program, the discrimination index could be used to evaluate a question on patient diagnosis, determining if it effectively distinguishes students who have grasped the concepts from those who haven't.

    INTERMEDIATE Information

The discrimination index is a key metric in item analysis that gauges the ability of an assessment question to differentiate between students who perform well overall and those who perform poorly. A positive discrimination index suggests that the question is effective in distinguishing strong students from weaker ones. Conversely, a negative value indicates that low-performing students outperformed high-performing students on that question.

READ

Correlation between difficulty & discrimination indices of MCQs in formative exam in Physiology
In a medicine study course, the discrimination index could be applied to a question about medical ethics, helping educators determine whether the question reliably identifies students who have a solid understanding of ethical principles.

    ADVANCED Information

Discrimination Index: Identifying High-Quality Test Items:

Calculation:
Subtract the proportion of low-performing students who answered correctly from the proportion of high-performing students who answered correctly.
Positive value: Indicates strong discrimination and effective differentiation.
Negative value: Indicates weak or reversed discrimination.

READ

Do Item-discrimination Indices Really Help Us to Improve Our Tests?
Interpretation:

Positive Discrimination Index:
Indicates that the question effectively distinguishes between strong and weak students.
Suggests that the question contributes meaningfully to the assessment's quality.
Negative Discrimination Index:
Suggests that the question is flawed or poorly worded.
Students who perform poorly overall answered it correctly, while strong students did not.

READ

To What Extent Are Item Discrimination Values Realistic? A New Index for Two-Dimensional Structures
Advanced Strategies:

Contextual Interpretation:
Consider the subject matter and learning objectives when interpreting the discrimination index.
A positive discrimination index is valuable when it aligns with the expected performance.
Examples:

PA Program:
Question: "Which diagnostic test should be ordered first for a patient with suspected pneumonia?"
Calculation: Positive discrimination index.
Interpretation: The question effectively distinguishes students who understand diagnostic priority.

In Summary: The discrimination index in item analysis assesses the ability of an assessment question to differentiate between high-performing and low-performing students. A positive discrimination index indicates effective question quality, while a negative index suggests a need for question revision. Advanced teachers contextualize the interpretation of the discrimination index, considering subject matter and learning objectives to determine its value in assessing student performance.


I need to go back and review the PREVIOUS TOPIC I'm comfortable now, take me to the NEXT TOPIC
WEEK 9: Grading & Post-test Analysis (17 OF 25)
VII. Key Components of Item Analysis
a. Difficulty Index: Calculating and interpreting item difficulty
WEEK 9: Grading & Post-test Analysis (19 OF 25)
VII. Key Components of Item Analysis
c. Distractor Analysis: Evaluating the effectiveness of wrong answer choices

REFERENCES

ChatGPT1 was used to generate most of the textual aspects of this page, as well as the HTML code, which were then checked for quality and corrected as necessary.
Midjourney Bot (in Discord) and Canva were used to generate images
1. ChatGPT. Version 4. OpenAI; 2023. Accessed August, 2023. OpenAI.com
2. Midjourney. Version 5.2. Midjourney; 2013. Accessed August, 2023. Midjourney.com
3. Discord. Discord, Inc.; 2023. Accessed August, 2023. Discord.com
4. Canva. Canva Pty Ltd; 2023. Accessed August, 2023. Canva.com