Confirmatory Factor Analysis of a Evaluation Construct Based HOTS Instrument in Structural Mechanics for Vocational High School Students
Riyan Arthur (a*), Sugeng Priyanto (b), Arris Maulana (c) , Happy Karlina Marjo(d) , Amelia Vinayastri (e), Ahmad (f), Salma Maharani (g)

a) Educational Research and Evaluation, Postgraduate School, Universitas Negeri Jakarta, Indonesia
*arthur[at]unj.ac.id
b) Mechanical Engineering, Faculty of Engineering, Universitas Negeri Jakarta, Indonesia
c) Building Engineering Education, Faculty of Engineering, Universitas Negeri Jakarta,Indonesia
d) Guidance and Counseling, Faculty of Education, Universitas Negeri Jakarta, Indonesia
e) Educational Research and Evaluation, Postgraduate School, Universitas MuhammadiyahProf Dr Hamka, Indonesia
f) Non-formal Education, Faculty of Education, Universitas Negeri Malang, Indonesia
g) Educational Research and Evaluation, Postgraduate School, Universitas Negeri Jakarta, Indonesia

Abstract

This study examines the construct validity of an evaluation based Higher Order Thinking Skills instrument in Structural Mechanics for vocational high school students. The instrument was designed to measure students evaluation skills, including assessing procedures, comparing solution strategies, and making appropriate technical decisions in construction-related contexts. This study employed Confirmatory Factor Analysis with 400 valid responses from Grade X and Grade XI students in the Construction and Property Technology program at five public vocational high schools in Jakarta. The instrument consisted of multiple choice HOTS items developed based on Bloom revised taxonomy and was validated by nine experts prior to field testing. The CFA results indicated an adequate model fit, with chi square 71.690, df 54, p 0.054, CFI 0.958, TLI 0.949, RMSEA 0.029, and SRMR 0.037. The instrument demonstrated adequate construct validity, although several items require revision to improve measurement accuracy and consistency.

Keywords: Evaluation Assessment- Structural Mechanics- Vocational Education- Confirmatory Factor Analysis

Topic: Physics Education