Basic Principles of Designing Tests Glossary

1. Validity- The extent to which a test measures what it claims to measure. Validity is crucial to ensure that the test accurately assesses the intended construct or skill.

2. Reliability-The consistency and stability of test scores over time and across different administrations. A reliable test produces consistent results under consistent conditions.

3. Objectivity- The degree to which different scorers can agree on the scores assigned to responses. Objectivity ensures that scoring is unbiased and consistent across different evaluators.

4. Authenticity- The extent to which test tasks reflect real-life situations or contexts relevant to the skills being assessed. Authentic tasks enhance the relevance and practicality of the test.

5. Fairness:- The principle that all test-takers should have an equal opportunity to demonstrate their abilities. Fair tests are free from bias and accommodate the diverse backgrounds and experiences of test-takers.

6. Construct Coverage- Ensuring that a test adequately samples the range of content or skills within the domain being assessed. Construct coverage ensures that the test provides a comprehensive representation of the target construct.

7. Standardization-The process of administering the test under uniform conditions to ensure consistency in administration and scoring. Standardization facilitates comparisons of individual performance and allows for normative interpretations.

8. Norm-Referenced Testing- Evaluation of an individual's performance relative to the performance of a group (norm group) with similar characteristics. Norm-referenced tests rank individuals based on their performance compared to others in the group.

9. Criterion-Referenced Testing- Evaluation of an individual's performance against predetermined criteria or standards. Criterion-referenced tests assess whether a test-taker has achieved specific learning objectives or mastery of a particular skill.

10. Item Analysis The process of evaluating the effectiveness of individual test items (questions) in discriminating between high and low performers. Item analysis helps identify items that are too easy, too difficult, or ambiguous, aiding in test refinement.

11.Bias Detection - The identification and mitigation of factors that may systematically disadvantage certain groups of test-takers based on characteristics such as race, gender, or socioeconomic status. Bias detection ensures that the test results are fair and equitable for all individuals.

12. Item Difficulty - A measure of the proportion of test-takers who answer an item correctly. Item difficulty helps determine the level of challenge posed by individual test items.

13. Item Discrimination - A measure of how effectively an item distinguishes between high and low performers on the test as a whole. Items with high discrimination values are effective in discriminating between levels of ability.

14. Item Response Theory (IRT) - A psychometric approach to test design and analysis that models the relationship between an individual's ability and their probability of correctly answering each test item. IRT allows for the estimation of item difficulty and discrimination parameters, facilitating the creation of reliable and valid tests.