Psychometric Evaluation of a Questionnaire to Evaluate Organizational Capacity Development for Faculty Development Programs

Organizational capacity development is an important outcome of faculty development programs but there is a lack of an appropriate instrument for its evaluation. The aim of this study was to develop a questionnaire to evaluate organizational capacity development for faculty development programs and to test its psychometrics. The initial capacity development for faculty development questionnaire (CDQ-FD) of 26 items was developed based on a literature review and opinion of experts. Content Validity Ratio (CVR), Content Validity Index (CVI), Content Validity Index for Items (I-CVI) and the Content Validity Index for Scales (S-CVI) were computed for content validity. The score for CVR, CVI, I-CVI, and S-CVI was 0.71, 0.83, 0.87, and 0.90 respectively. Confirmatory Factor Analysis (CFA) and Exploratory Factor Analysis (EFA) were performed for construct validation. Exploratory factor analysis resulted in a three-factor model with total variance extraction of 64%. Cronbach's alpha and Spearman Brown coefficient were investigated for reliability assessment. The Cronbach’s alpha of overall scale was 0.8 and the test-retest reliability of the overall scale was 0.78. The final CDQ-FD contained 21 items and three categories. The CDQ-FD questionnaire appears to be a valid and reliable instrument for the evaluation of organizational capacity development for faculty development in medical education.