Introduction: Academic engagement refers to the predisposition that students must actively participate in university life, attending classes, turning in work on time, and following teachers’ instructions. There is evidence that shows that academic engagement positively predicts student success. For this reason, its evaluation is of great relevance for university education when designing pedagogical practices that stimulate student engagement. The aim of this study was to adapt and validate the University Student Engagement Inventory (USEI) into Spanish, considering linguistic and cultural differences in three Spanish-speaking countries. Methods: 921 university students from Spain, Argentina and Uruguay participated in the study. The USEI, which consists of 15 statements grouped into three dimensions of engagement -behavioral, cognitive, emotional- was administered. Results: After three translators made the linguistic adaptation of the instrument, nine expert judges analyzed the content of the items, retaining as a result the totality of the items. Subsequently, the internal structure of the instrument was analyzed and verified -confirmatory factor analysis, cross-validation, factorial invariance, internal consistency-. Adequate evidence of concurrent external validity between USEI dimensions and learning approaches was also obtained. Conclusion: A Spanish version of the USEI was obtained with adequate psychometric properties that can be used in the field of application with the purpose of identifying students’ academic engagement and proposing actions aimed at improving their learnings.

Keywords:
University Student Engagement Inventory, Spanish adaptation, university students, psychometric properties, psychological assessment

21_RLP_54_22137_Adaptacion

Acosta-Gonzaga, E., & Ramírez-Arellano, A. (2020). Estudio comparativo de técnicas de analítica del aprendizaje para predecir el rendimiento académico de los estudiantes de educación superior. CienciaUAT, 15(1), 63-74. https://doi.org/10.29059/cienciauat.v15i1.1392

Ali, M. (2016). Are we asking the same questions in different contexts: Translation techniques in cross-culture studies in science education? Journal of Turkish Science Education, 13(1), 31-44. http://www.tused.org/index.php/tused/article/view/634

Alonso-Tapia, J., Merino-Tejedor, E., & Huertas, J. (2022). Academic engagement: Assessment, conditions, and effects—a study in higher education from the perspective of the person-situation interaction. European Journal of Psychology of Education. https://doi.org/10.1007/s10212-022-00621-0

American Psychological Association. (2017). Ethical Principles of Psychologists and Code of Conduct. https://www.apa.org/ethics/code/ethics-code-2017.pdf

Amerstorfer, C., & Freiin von Münster-Kistner, C. (2021). Student perceptions of academic engagement and student-teacher relationships in problem-based learning. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.713057

Appleton, J., Christenson, S., Kim, D., & Reschly, A. (2006). Measuring cognitive and psychological engagement: Validation of the Student Engagement Instrument. Journal of School Psychology, 44(5), 427-445. https://doi.org/10.1016/j.jsp.2006.04.002

Arastman, G., Gün, F., Turabik, T., & Akbaşli, S. (2019). School engagement as a predictor of burnout in university students. Pamukkale University Journal of Education, 45(45), 293-309. https://dergipark.org.tr/tr/download/article-file/607787

Aspeé, J., González, J., & Herrera, Y. (2021). Relación funcional entre procrastinación académica y compromiso en estudiantes de educación superior: una propuesta de análisis. Perspectiva Educacional, 60(1), 4-22. https://doi.org/10.4151/07189729-Vol.60-Iss.1-Art.1116

Assunção, H., Lin, S., Sit, P., Cheung, K., Harju-Luukkainen, H., Smith, T., Maloa, B., Campos, J., Ilic, I., Esposito, G., Francesca, F., & Marôco, J. (2020). University Student Engagement Inventory (USEI): Transcultural validity evidence across four continents. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02796

Brophy, J. (1983). Conceptualizing student motivation. Educational Psychologist, 18, 200-215. https://doi.org/10.1080/00461528309529274

Chapman, E. (2002). Alternative approaches to assessing student engagement rates. Practical Assessment, Research, and Evaluation, 8(13), 1-7. https://doi.org/10.7275/3e6e-8353

Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Erlbaum.

Contreras-Espinoza, S., & Novoa-Muñoz, F. (2018). Ventajas del alfa ordinal respecto al alfa de Cronbach ilustradas con la encuesta AUDIT-OMS. Revista Panamericana de Salud Pública, 42(e65), 1-6. https://doi.org/10.26633/RPSP.2018.65

Delfino, A. (2019). Student engagement and academic performance of students of Partido State University. Asian Journal of University Education, 15(1), 1-16. https://files.eric.ed.gov/fulltext/EJ1222588.pdf

Dennehy, E. (2015). Learning approaches and cultural influences: A comparative study of Confucian and western-heritage students. Journal of Further and Higher Education, 39(6), 818-838. https://doi.org/10.1080/0309877X.2013.869561

Doğan, U. (2014). Validity and reliability of Student Engagement Scale. Bartın Üniversitesi Eğitim Fakültesi Dergisi, 3(2), 390-403. https://dergipark.org.tr/tr/pub/buefad/issue/3815/51232

Freda, M., Raffaele, D., Esposito, G., Ragozini, G., & Testa, I. (2021). A new measure for the assessment of the university engagement: The SInAPSi academic engagement scale (SAES). Current Psychology. https://doi.org/10.1007/s12144-021-02189-2

Fredricks, J., Blumenfeld, P., & Paris, A. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59-109. https://doi.org/10.3102/00346543074001059

Fredricks, J. (2015). Academic engagement. En International encyclopedia of the social & behavioral sciences (pp. 31-36). Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.26085-6

Freiberg Hoffmann, A., & Romero Medina, A. (2020). Validación del Approaches and Study Skills Inventory for Students (ASSIST) en Universitarios de Buenos Aires, Argentina. Acción Psicológica, 16(2), 1–16. https://doi.org/10.5944/ap.16.2.23042

Gitomer, D. (2018). Classroom observations. En B. Frey (Ed.), The SAGE encyclopedia of educational research, measurement, and evaluation (pp. 289-293). SAGE.

Handelsman, M., Briggs, W., Sullivan, N., & Towler, A. (2005). A measure of college student course engagement. The Journal of Educational Research, 98(3), 184-192. https://doi.org/10.3200/JOER.98.3.184-192

Jordan-Muiños, F. (2021). Valor de corte de los índices de ajuste en el análisis factorial confirmatorio. Psocial, 7(1), 66-71. http://portal.amelica.org/ameli/journal/123/1232225009/

Khan, R., Atta, K., Sajjad, M., & Jawaid, M. (2021). Twelve tips to enhance student engagement in synchronous online teaching and learning. Medical Teacher, 44(6), 601-606. https://doi.org/10.1080/0142159X.2021.1912310

Kim, H., Hong, A., & Song, H. (2019). The roles of academic engagement and digital readiness in students’ achievements in university e-learning environments. International Journal of Educational Technology in Higher Education, 16(21). https://doi.org/10.1186/s41239-019-0152-3

Korhonen, V., Mattsson, M., Inkinen, M., & Toom, A. (2019). Understanding the multidimensional nature of student engagement during the first year of higher education. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.01056

Krach, S., McCreery, M., & Guerard, J. (2017). Cultural-linguistic test adaptations: Guidelines for selection, alteration, use, and review. School Psychology International, 38(1), 3-21. https://doi.org/10.1177/0143034316684672

Lawshe, C. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Lei, H., Cui, Y., & Zhou, W. (2018). Relationships between student engagement and academic achievement: A meta-analysis. Social Behavior and Personality: An International Journal, 46(3), 517-528. https://doi.org/10.2224/sbp.7054

Li, C. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936-949. https://doi.org/10.3758/s13428-015-0619-7

Liebana-Presa, C., Fernández-Martínez, M., Vázquez Casares, A., López-Alonso, A., & Rodríguez-Borrego, M. (2018). Burnout y engagement en estudiantes universitarios de enfermería. Enfermería Global, 17(2), 131-152. https://doi.org/10.6018/eglobal.17.2.268831

Lira-Munizaga, J., & Pérez-Salas, C. (2022). Compromiso académico en universitarios del Programa de Acceso a la Educación Superior (PACE). Calidad en la Educación, 56, 78-96. https://doi.org/10.31619/caledu.n56.1159

Maluenda-Albornoz, J., Contreras, M., Mujica, A., & Bernardo, A. (2020). Propiedades psicométricas del University Student Engagement Inventory en estudiantes de Ingeniería chilenos. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica, 57(4), 77-90. https://doi.org/10.21865/RIDEP57.4.06

Maluenda-Albornoz, J., Varas-Contreras, M., Riffo-Ferrada, M., & Díaz-Mujica, A. (2021). Predictores socio-académicos del study engagement en estudiantes de primer año de ingeniería. Estudios Pedagógicos, 47(1), 235-250. https://doi.org/10.4067/S0718-07052021000100235

Maluenda-Albornoz, J., Infante-Villagrán, V., Galve-González, C., Flores-Oyarzo, G., & Berríos-Riquelme, J. (2022). Early and dynamic socio-academic variables related to dropout intention: A predictive model made during the pandemic. Sustainability, 14(2), 831. https://doi.org/10.3390/su14020831

Maricuțoiu, L., & Sulea, C. (2019). Evolution of self-efficacy, student engagement and student burnout during a semester. A multilevel structural equation modeling approach. Learning and Individual Differences, 76, 101785. https://doi.org/10.1016/j.lindif.2019.101785

Marôco, J., Assunção, H., Harju-Luukkainen, H., Lin, S., Sit, P., Cheung, K., Maloa, B., Ilic, I., Smith, T., & Campos, J. (2020). Predictors of academic efficacy and dropout intention in university students: Can engagement suppress burnout? Plos One, 15(10), e0239816. https://doi.org/10.1371/journal.pone.0239816

Marôco, J., Marôco, A., Campos, J., & Fredricks, J. (2016). University student’s engagement: development of the University Student Engagement Inventory (USEI). Psicologia: Reflexão e Crítica, 29(1), 21. https://doi.org/10.1186/s41155-016-0042-8

Mohamed-Bayoumy, H., & Alsayed, S. (2021). Investigating relationship of perceived learning engagement, motivation, and academic performance among nursing students: A multisite study. Advances in Medical Education and Practice, 12, 351-369. https://doi.org/10.2147/AMEP.S272745

Morales-Rodríguez, F., Pérez-Mármol, J., & Brown, T. (2019). Education burnout and engagement in occupational therapy undergraduate students and its associated factors. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02889

Natriello, G. (1984). Problems in the evaluation of students and student disengagement from secondary schools. Journal of Research and Development in Education, 17, 14-24.

Polit, D., Beck, C., & Owen, S. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459-467. https://doi.org/10.1002/nur.20199

Putnick, D., & Bornstein, M. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71-90. https://doi.org/10.1016/j.dr.2016.06.004

Reeve, J., & Tseng, C. (2011). Agency as a fourth aspect of students’ engagement during learning activities. Contemporary Educational Psychology, 36(4), 257-267. https://doi.org/10.1016/j.cedpsych.2011.05.002

Rial-Boubeta, A., Varela-Mallou, J., Abalo-Piñeiro, J., & Lévy-Mangin, J. (2006). El análisis factorial confirmatorio. En L. Mangin & J. Varela Mallou (Eds.), Modelización con estructuras de covarianzas en ciencias sociales (pp. 119-154). Netbiblo.

Ribeiro, L., Rosário, P., Núñez, J., Gaeta, M., & Fuentes, S. (2019). First-year students background and academic achievement: The mediating role of student engagement. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02669

Robinson, M. (2018). Using multi-item psychometric scales for research and practice in human resource management. Human Resource Management, 57(3), 739-750. https://doi.org/10.1002/hrm.21852

Sakurai, Y., & Pyhältö, K. (2018). Understanding students’ academic engagement in learning amid globalising universities. En A. W. Wiseman (Ed.), Annual review of comparative and international education 2017 (pp. 31-38). Emerald. https://doi.org/10.1108/S1479-367920180000034003

Sinval, J., Casanova, J., Marôco, J., & Almeida, L. (2021). University student engagement inventory (USEI): Psychometric properties. Current Psychology, 40(4), 1608-1620. https://doi.org/10.1007/s12144-018-0082-6

Skinner, E., Kindermann, T., & Furrer, C. (2009). A motivational perspective on engagement and disaffection. Educational and Psychological Measurement, 69(3), 493-525. https://doi.org/10.1177/0013164408323233

Skinner, E. (2009). Using community development theory to improve student engagement in online discussion: a case study. Research in Learning Technology, 17(2), 89-100. https://doi.org/10.25304/rlt.v17.901

Sobrino-Triana, R. (2018). Las variedades de español según los hispanohablantes: corrección, incorrección y agrado lingüísticos. Cuadernos de Lingüística de El Colegio de México, 5(2), 79-119. https://doi.org/10.24201/clecm.v5i2.115

Taghani, A., & Razavi, M. (2021). The effect of metacognitive skills training of study strategies on academic self-efficacy and academic engagement and performance of female students in Taybad. Current Psychology. https://doi.org/10.1007/s12144-020-01278-y

Tait, H., Entwistle, N., & McCune, V. (1998). ASSIST: A re-conceptualization of the Approaches to Studying Inventory. En C. Rust (Ed.), Improving students as learners. Oxford Brookes University.

Tessema, M., & Ananda, T. (2018). University students’ engagement and academic achievement in Ethiopian public universities. Journal of Advances and Scholarly Researches in Allied Education, 15(12), 115-122. http://ignited.in/a/58396

Truta, C., Parv, L., & Topala, I. (2018). Academic engagement and intention to drop out: Levers for sustainability in higher education. Sustainability, 10(12), 4637. https://doi.org/10.3390/su10124637

United Nations Educational, Scientific and Cultural Organization (Unesco). (2022). Gender equality: how global universities are performing, part 2. https://bit.ly/3EnTTyM

Vallejo-Medina, P., Gómez-Lugo, M., Marchal-Bertrand, L., Saavedra-Roa, A., Soler, F., & Morales, A. (2017). Developing guidelines for adapting questionnaires into the same language in another culture. Terapia Psicológica, 35(2), 159-172. https://doi.org/10.4067/s0718-48082017000200159

Wang, J., & Wang, X. (2020). Structural equation modeling: Applications using Mplus. Willey.

Wang, M., Willett, J., & Eccles, J. (2011). The assessment of school engagement: Examining dimensionality and measurement invariance by gender and race/ethnicity. Journal of School Psychology, 49(4), 465-480. https://doi.org/10.1016/j.jsp.2011.04.001

Yusoff, M. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49-54. https://doi.org/10.21315/eimj2019.11.2.6