PERCEPTIONS OF COMPETENCY SCALE TOWARDS ARTIFICIAL INTELLIGENCE-BASED FEEDBACK: VALIDITY AND RELIABILITY STUDY


This research was conducted to develop a valid and reliable scale to measure middle school students' perceptions of competency regarding feedback received from artificial intelligence. Data were collected from students in the 5th, 6th, 7th, and 8th grades from five middle schools selected through typical case sampling. Preliminary trials of the scale were conducted with data from 405 middle school students, while the final scale was validated with data from 275 students. Data was analysed using SPSS 27.0 and LISREL 8.80. The initial version of the scale was developed as a 20-item scale with a 5-point Likert scale. Exploratory factor analysis resulted in the removal of overlapping items, refining the scale to a final version that includes 18 items. Results from the Exploratory Factor Analysis (EFA) and parallel analysis indicated that the scale has a single-factor structure, accounting for approximately 35% of the total variance. To verify the adequacy of the resulting 18-item unidimensional model, Confirmatory Factor Analysis (CFA) was performed. The reliability of the measurement tool was assessed using Cronbach’s alpha coefficient, and the findings revealed a high level of internal consistency, with a coefficient of 0.88.