9. QSR-PSY-009 — Reliability, Validity and Psychometric Evaluation of Questionnaire Scores
Description:
This Master Prompt would focus on evaluating whether questionnaire scores demonstrate sufficient measurement quality for their intended interpretation and use. It would guide researchers in assessing internal consistency, test-retest reliability, measurement stability, content validity, construct validity, convergent validity, discriminant validity, criterion-related validity, known-groups validity, dimensionality, and where appropriate EFA, CFA, Rasch modelling, item-response approaches, measurement invariance, and related psychometric methods.
A major emphasis would be placed on preventing researchers from declaring a questionnaire “validated” on the basis of Cronbach's alpha alone. Reliability, dimensional structure, and validity represent related but distinct forms of evidence. The uploaded literature demonstrates this clearly: one questionnaire-development study combined content validity, internal consistency and test-retest reliability ; another evaluated content, construct and criterion validity together with reliability ; and another used EFA, CFA, convergent validity, discriminant validity and internal consistency to establish a multidimensional questionnaire.