Introduction: The Perceived Stress Scale-4 (PSS-4) is an ultra-brief self-report measure to assess psychological stress. This study evaluated the psychometric properties of the PSS-4 in Colombia. Method: A total of 1,911 adult participants with a university education completed the PSS-4. The characteristics of the items and the subscales were explored. The dimensionality was assessed using principal component analysis and confirmatory factor analysis (CFA), incorporating an examination of invariance (configural, metric, scalar, and strict) across socio-demographic characteristics. Construct validity (convergent and discriminant), reliability indices, know-groups, and predictive validity were also computed. Results: CFA showed that the one-factor model (psychological stress) with method effects (correlated error terms on the negative-phrased items) was the most appropriate according to fit indices and parsimony considerations, being invariant across gender and age, but not across income level and work status. Internal consistency was adequate for the PSS-4. Significant positive correlations of the PSS-4 were identified with depression and anxiety, as well as significant negative correlations were identified with post-traumatic growth and resilience. The PSS-4 showed adequate capacity to predict potential depressive and anxiety symptoms, as well as protective factors such as resilience and post-traumatic growth. Higher scores on the PSS-4 were observed among young people, as well as among people with lower incomes and those who are unemployed. Conclusions: These findings suggest that the PSS-4 can be a reliable and valid tool for assessing psychological stress in Colombians with a university education.

Keywords:
Perceived Stress Scale, psychological stress, psychometric properties, reliability, validity

03_RLP_56_23164_Psychometrics_web

Adamson, M. M., Phillips, A., Seenivasan, S., Martinez, J., Grewal, H., Kang, X., Coetzee, J., Luttenbacher, I., Jester, A., Harris, O. A., & Spiegel, D. (2020). International prevalence and correlates of psychological stress during the global COVID-19 pandemic. International Journal of Environmental Research and Public Health, 17(24), 9248. https://doi.org/10.3390/ijerph17249248

Barbosa-Leiker, C., Kostick, M., Lei, M., McPherson, S., Roper, V., Hoekstra, T., & Wright, B. (2013). Measurement invariance of the perceived stress scale and latent mean differences across gender and time. Stress and Health, 29(3), 253-260. https://doi.org/10.1002/smi.2463

Boluarte-Carbajal, A., Salazar-Conde, M., Alata Vasquez, S., & Zegarra-López, A. (2023). Psychometric review of the perceived stress scale under CFA and Rasch models in Lima, Peru. Frontiers in Psychology, 14, 1160466. https://doi.org/10.3389/fpsyg.2023.1160466

Campo-Arias, A., Oviedo, H., & Herazo, E. (2014). Escala de Estrés Percibido-10: desempeño psicométrico en estudiantes de medicina de Bucaramanga, Colombia. Revista de la Facultad de Medicina, 62(3), 1-24. https://doi.org/10.15446/revfacmed.v62n3.43735

Caro-Fuentes, S. & Sanabria-Mazo, J. P. (2023). A systematic review of the psychometric properties of the Patient Health Questionnaire-4 (PHQ-4) in clinical and non-clinical populations. Journal of the Academy of Consultation-Liaison Psychiatry, 65(2), 178-194. https://doi.org/10.1016/j.jaclp.2023.11.685

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 24(4), 385-396. https://doi.org/10.2307/2136404

Connor, K. M. & Davidson, J. R. (2003). Development of a new resilience scale: The Connor-Davidson Resilience Scale (CD-RISC). Depression and Anxiety, 18(2), 76-82. https://doi.org/10.1002/da.10113

Enticott, J., Dawadi, S., Shawyer, F., Inder, B., Fossey, E., Teede, H., Rosenberg, S., Ozols, I., & Meadows, G. (2022). Mental Health in Australia: Psychological distress reported in six consecutive cross-sectional national surveys from 2001 to 2018. Frontiers in Psychiatry, 13, 815904. https://doi.org/mrqn

Feng, G., Xu, X., & Lei, J. (2023). Tracking perceived stress, anxiety, and depression in daily life: A double-downward spiral process. Frontiers in Psychology, 14, 1-10. https://doi.org/10.3389/fpsyg.2023.1114332

Finstad, G. L., Giorgi, G., Lulli, L. G., Pandolfi, C., Foti, G., León-Pérez, J. M., Cantero-Sánchez, F. J., & Mucci, N. (2021). Resilience, coping strategies, and posttraumatic growth in the workplace following COVID-19: A narrative review on the positive aspects of trauma. International Journal of Environmental Research and Public Health, 18(18), 9453. https://doi.org/10.3390/ijerph18189453

Goldberg, D. P., Reed, G. M., Robles, R., Minhas, F., Razzaque, B., Fortes, S., de Jesus, J., Pong-Lam, T., García, J. A., Gask, L., Dowell, A. C., Rosendal, M., Mbatia, J. K., & Saxena, S. (2017). Screening for anxiety, depression, and anxious depression in primary care: A field study for ICD-11 PHC. Journal of Affective Disorders, 213, 199-206. https://doi.org/10.1016/j.jad.2017.02.025

Gómez-Acosta, A., Ramos-Vera, C., & Sierra-Barón, W. (2023). Validation of an ultra-short version of the posttraumatic growth inventory in Colombian adults exposed to COVID-19. Death Studies, 47(4),  490-498. https://doi.org/10.1080/07481187.2022.2098415

González-Ramírez, M., Rodríguez-Ayán, M., & Hernández, R. (2013). The Perceived Stress Scale (PSS): Normative data and factor structure for a large-scale sample in Mexico. The Spanish Journal of Psychology, 16, E47. https://doi.org/10.1017/sjp.2013.35

Ingram I., Clarke, E., & Lichtenberg, J. W. (2016). Confirmatory factor analysis of the Perceived Stress Scale-4 in a community sample. Stress and Health, 32(2), 173-176. https://doi.org/10.1002/smi.2592

Kim H. J. (2016). Reliability and Validity of the 4-Item Version of the Korean Perceived Stress Scale. Research in Nursing & Health, 39(6), 472–479. https://doi.org/10.1002/nur.21745

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer.

Lee, B. (2022). Measurement invariance of the Perceived Stress Scale-10 across gender in Korean university students. International Journal of Mental Health, 52(1), 70-83. https://doi.org/10.1080/00207411.2022.2046924

Lee, E. H., Chung, B. Y., Suh, C. H., & Jung, J. Y. (2015). Korean versions of the Perceived Stress Scale (PSS-14, 10 and 4): Psychometric evaluation in patients with chronic disease. Scandinavian Journal of Caring Sciences, 29(1), 183–192. https://doi.org/10.1111/scs.12131

Liu, X., Zhao, Y., Li, J., Dai, J., Wang, X., & Wang, S. (2020). Factor structure of the 10-item Perceived Stress Scale and measurement invariance across genders among Chinese adolescents. Frontiers in Psychology, 11, 537. https://doi.org/10.3389/fpsyg.2020.00537

Liu, Y. Z., Wang, Y. X., & Jiang, C. L. (2017). Inflammation: The common pathway of stress-related diseases. Frontiers in Human Neuroscience, 11, 316. https://doi.org/10.3389/fnhum.2017.00316

Löwe, B., Wahl, I., Rose, M., Spitzer, C., Glaesmer, H., Wingenfeld, K., Schneider, A., & Brähler, E. (2010). A 4-item measure of depression and anxiety: Validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. Journal of Affective Disorders, 122(1-2), 86-95. https://doi.org/10.1016/j.jad.2009.06.019

Maroufizadeh, S., Foroudifard, F., Navid, B., Ezabadi, Z., Sobati, B., & Omani-Samani, R. (2018). The Perceived Stress Scale (PSS-10) in women experiencing infertility: A reliability and validity study. Middle East Fertility Society Journal, 23(4), 456-459. https://doi.org/10.1016/j.mefs.2018.02.003

McEwen, B. S. (2007). Physiology and neurobiology of stress and adaptation: Central role of the brain. Physiological Reviews, 87(3), 873-904. https://doi.org/10.1152/physrev.00041.2006

Mondo, M., Sechi, C., & Cabras, C. (2021). Psychometric evaluation of three versions of the Italian Perceived Stress Scale. Current Psychology, 40, 1884–1892. https://doi.org/10.1007/s12144-019-0132-8

Monroe, S. M. & Simons, A. D. (1991). Diathesis-stress theories in the context of life stress research: Implications for the depressive disorders. Psychological Bulletin, 110(3), 406-425. https://doi.org/10.1037/0033-2909.110.3.406

Newnham, E. A., Mergelsberg, E. L., Chen, Y., Kim, Y., Gibbs, L., Dzidic, P. L., DaSilva, M. I., Chan, E. Y., Shimomura, K., Narita, Z., Huang, Z., & Leaning, J. (2022). Long-term mental health trajectories after disasters and pandemics: A multilingual systematic review of prevalence, risk, and protective factors. Clinical Psychology Review, 97 102203. https://doi.org/10.1016/j.cpr.2022.102203

Perera, M. J., Brintz, C. E., Birnbaum-Weitzman, O., Penedo, F. J., Gallo, L. C., Gonzalez, P., Gouskova, N., Isasi, C. R., Navas-Nacher, E. L., Perreira, K. M., Roesch, S. C., Schneiderman, N., & Llabre, M. M. (2017). Factor structure of the Perceived Stress Scale-10 (PSS) across English and Spanish language responders in the HCHS/SOL Sociocultural Ancillary Study. Psychological Assessment, 29(3), 320–328. https://doi.org/10.1037/pas0000336

Reis, D., Lehr, D., Heber, E., & Ebert, D. D. (2019). The German version of the Perceived Stress Scale (PSS-10): Evaluation of dimensionality, validity, and measurement invariance with exploratory and confirmatory bifactor modeling. Assessment, 26(7), 1246-1259. https://doi.org/10.1177/1073191117715731

Remor, E. (2006), Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS). Spanish Journal of Psychology, 9(1), 86–93, https://doi.org/10.1017/S1138741600006004

Ruisoto, P., López-Guerra, V. M., Paladines, M. B., Vaca, S. L., & Cacho, R. (2020). Psychometric properties of the three versions of the Perceived Stress Scale in Ecuador. Physiology & Behavior, 224, 113045. https://doi.org/10.1016/j.physbeh.2020.113045

Sanabria-Mazo, J. P., Gómez-Acosta, A., Castro-Muñoz, J. A., Ferney-Rojas, Y., Feliu-Soler, A., Luciano, J. V., & Sanz, A. (2023). Dimensionality and reliability of the online version of the Patient Health Questionnaire-4 (PHQ-4) in a large Colombian sample: Results from the PSY-COVID study. Current Psychology. https://doi.org/10.1007/s12144-023-05180-1

Sanabria-Mazo, J. P., Useche-Aldana, B., Ochoa, P. P., Rojas-Gualdrón, D. F., Mateo-Canedo, C., Carmona-Cervelló, M., Crespo-Puig, N., Selva-Olid, C., Muro, A., Méndez-Ulrich, J. L., Feliu-Soler, A., Luciano, J. V., & Sanz, A. (2021a). Social inequities in the impact of COVID-19 lockdown measures on the mental health of a large sample of the Colombian population (PSY-COVID study). Journal of Clinical Medicine, 10(22), 5297. https://doi.org/10.3390/jcm10225297

Sanabria-Mazo, J. P., Useche-Aldana, B., Ochoa, P. P., Rojas-Gualdrón, D., & Sanz, A. (2021b). Impacto de la pandemia de COVID-19 en la salud mental en Colombia. Editorial CES.

Schneider, E. E., Schönfelder, S., Domke-Wolf, M., & Wessa, M. (2020). Measuring stress in clinical and nonclinical subjects using a German adaptation of the Perceived Stress Scale. International Journal of Clinical and Health Psychology, 20(2), 173–181. https://doi.org/10.1016/j.ijchp.2020.03.004

She, Z., Li, D., Zhang, W., Zhou, N., Xi, J., & Ju, K. (2021). Three versions of the Perceived Stress Scale: Psychometric evaluation in a nationally representative sample of Chinese adults during the COVID-19 pandemic. International Journal of Environmental Research and Public Health, 18(16), 8312. https://doi.org/10.3390/ijerph18168312

Stringer, H. (2023). Worker wellbeing is in demand. Monitor on Psychology, 54(1), 58-62. https://www.apa.org/monitor/2023/2023-01-monitor.pdf

Tedeschi, R. G. & Calhoun, L. G. (1996). The Posttraumatic Growth Inventory: Measuring the positive legacy of trauma. Journal of Traumatic Stress, 9(3), 455–471. https://doi.org/10.1007/BF02103658

Vallejo, M. A., Vallejo-Slocker, L., Fernández-Abascal, E. G., & Mañanes, G. (2018). Determining factors for stress perception assessed with the Perceived Stress Scale (PSS-4) in Spanish and other European samples. Frontiers in Psychology, 9, 37. https://doi.org/10.3389/fpsyg.2018.00037

van Sonderen, E., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. Plos One, 8(9), e68967. https://doi.org/10.1371/journal.pone.0068967

Warttig, S. L., Forshaw, M. J., South, J., & White, A. K. (2013). New, normative, English-sample data for the Short Form Perceived Stress Scale (PSS-4). Journal of Health Psychology, 18(12), 1617-1628. https://doi.org/10.1177/1359105313508346

Xiong, J., Lipsitz, O., Nasri, F., Lui, L. M., Gill, H., Phan, L., Chen-Li, C., Iacobucci, M., Ho, R., Majeed, A., & McIntyre, R. S. (2020). Impact of COVID-19 pandemic on mental health in the general population: A systematic review. Journal of Affective Disorders, 277, 55-64. https://doi.org/10.1016/j.jad.2020.08.001

Yılmaz-Koğar, E., & Koğar, H. (2023). A systematic review and meta-analytic confirmatory factor analysis of the Perceived Stress Scale (PSS-10 and PSS-14). Stress and Health, 40(1), e3285. https://doi.org/10.1002/smi.3285