Effects of Study-Integrated Well-Being Course Intervention for Different Burnout and Engagement Profiles of University Students

Main Article Content

Kristiina Räihä
Nina Katajavuori
Kimmo Vehkalahti
Henna Asikainen

Abstract

As the increase in university students’ mental health problems poses significant challenges to education, new research-based ways to support students’ well-being in higher education are urgently needed. Acceptance and Commitment Therapy (ACT) has been shown to be effective in enhancing different aspects of well-being in a variety of contexts. Although study burnout has been shown to have detrimental impacts on students’ well-being and studying, not much is known about the person-oriented features of burnout risk in relation to ACT-based intervention outcomes. The aim of this study was to compare the effects of an online ACT-based course on different aspects of university students’ well-being and study ability in latent groups of students that had different levels of study burnout and engagement at the beginning of the intervention. The results of latent profile analysis (LPA) showed that students (N=352) represented four profiles at the beginning of the course: indifferent (37.8%), engaged (29%), engaged-inefficacious (13.6%), and burned-out (19.6%). The results of mixed ANOVA with repeated measures showed that psychological flexibility, well-being, study engagement and organised studying increased, and study burnout risk decreased in the whole sample of course-participating students. The changes in students’ exhaustion, well-being, psychological flexibility, and organised studying did not differ between the four burnout and engagement profiles. The profiles differed in the changes of cynicism, inadequacy and engagement. The results of this study provide new knowledge of the person-oriented features of study burnout and indicate that ACT-based course interventions can be effective in enhancing different profiles representing university students’ well-being.

Article Details

How to Cite
Räihä, K., Katajavuori, N., Vehkalahti, K., & Asikainen, H. (2024). Effects of Study-Integrated Well-Being Course Intervention for Different Burnout and Engagement Profiles of University Students. Frontline Learning Research, 12(3), 45–68. https://doi.org/10.14786/flr.v12i3.1415
Section
Articles

References

Akaike, H. (1987). Factor analysis and AIC. Psychometrika 52, 317–332. https://doi.org/10.1007/BF02294359

Asikainen, H., & Katajavuori, N. (2021). Development of a Web-Based Intervention Course to Promote Students' Well-Being and Studying in Universities: Protocol for an Experimental Study Design. JMIR Research Protocols, 10(3), Article 23613. https://doi.org/10.2196/23613

Asikainen, H., & Katajavuori, N. (2023). Exhausting and difficult or easy: The association between psychological flexibility and study related burnout and experiences of studying during the pandemic. Frontiers in Education, 8, Article p1215549. https://doi.org/10.3389/feduc.2023.1215549

Asikainen, H., Nieminen, J. H., Häsä, J., & Katajavuori, N. (2022). University students’ interest and burnout profiles and their relation to approaches to learning and achievement. Learning and Individual Differences, 93. https://doi.org/10.1016/j.lindif.2021.102105

Auerbach R.P., Mortier P., Bruffaerts, R., Alonso, J., Benjet, C., Cuijpers, P., Demyttenaere, K., Ebert, D.D., Green, J.G., Hasking, P., Murray, E., Nock, M.K., Pinder-Amaker, S., Sampson, N.A., Stein, D.J., Vilagut G., Zaslavsky, A.M., & Kessler, R.C. (2018). WHO World Mental Health Surveys International College Student Project: Prevalence and distribution of mental disorders. Journal of Abnormal Psychology, 127(7), 623-638. https://doi.org/10.1037/abn0000362

Bakker, A. B., Demerouti, E., & Sanz-Vergel, A. (2023). Job demands–resources theory: Ten years later. Annual Review of Organizational Psychology and Organizational Behavior, 10, 25-53. https://doi.org/10.1146/annurev-orgpsych-120920-053933

Bergman, L. R., & Lundh, L.-G. (2015). Introduction: The Person-oriented approach: Roots and roads to the future. Journal for Person-oriented Research, 1(1–2), 1–6. https://doi.org/10.17505/jpor.2015.01

Bond, F. W., Lloyd, J., & Guenole, N. (2013). The work-related acceptance and action questionnaire: Initial psychometric findings and their implications for measuring psychological flexibility in specific contexts. Journal of Occupational and Organizational Psychology, 86(3), 331–347. https://doi.org/10.1111/joop.12001

Celeux, G., & Soromenho, G. (1996). An entropy criterion for assessing the number of clusters in a mixture model. Journal of Classification, 13, 195–212. https://doi.org/10.1007/BF01246098

Collins, L. M., & Lanza, S. T. (2009). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (Vol. 718). John Wiley & Sons.

Davis, S. K., & Hadwin, A. F. (2021). Exploring Differences in Psychological Well-Being and Self-Regulated Learning in University Student Success. Frontline Learning Research, 9(1), 30-43. https://doi.org/10.14786/flr.v9i1.581

Dodge, R., Daly, A. P., Huyton, J., & Sanders, L. D. (2012). The challenge of defining wellbeing. International Journal of Wellbeing, 2(3), 222–235. https://doi.org/10.5502/ijw.v2i3.4

Elmer, T., Mepham, K., & Stadtfeld, C. (2020). Students under lockdown: Comparisons of students’ social networks and mental health before and during the COVID-19 crisis in Switzerland. Plos one, 15(7), e0236337. https://doi.org/10.1371/journal.pone.0236337

Entwistle, N., & McCune, V. (2004). The conceptual bases of study strategy inventories. Educational Psychology Review, 16(4), 325-345. https://doi.org/10.1007/s10648-004-0003-0

Entwistle, N., McCune, V. & Hounsell, J. (2003). Investigating ways of enhancing university teaching-learning environments: Measuring students’ approaches to studying and perceptions of teaching. In E. de Corte, L. Verschaffel, N. Entwistle, & J. van Merriënboer (Eds.), Powerful learning environments: Unravelling basic components and dimensions (pp. 89-107). Oxford: Elsevier Science.

Fledderus, M., Bohlmeijer, E. T., Smit, F., & Westerhof, G. J. (2010). Mental health promotion as a new goal in public mental health care: A randomized controlled trial of an intervention enhancing psychological flexibility. American Journal of Public Health, 100(12), 2372-2372. https://doi.org/10.2105/ajph.2010.196196

Francis, A. W., Dawson, D. L., & Golijani-Moghaddam, N. (2016). The development and validation of the Comprehensive assessment of Acceptance and Commitment Therapy processes (CompACT). Journal of Contextual Behavioral Science, 5(3), 134-145. https://doi.org/10.1016/j.jcbs.2016.05.003

Frögéli, E., Djordjevic, A., Rudman, A., Livheim, F., & Gustavsson, P. (2016). A randomized controlled pilot trial of Acceptance and Commitment training (ACT) for preventing stress-related ill health among future nurses. Anxiety, Stress and Coping, 29(2), 202–218. http://dx.doi.org/10.1080/10615806.2015.1025765

Grégoire, S., Lachance, L., Bouffard, T., & Dionne, F. (2018). The Use of Acceptance and Commitment Therapy to Promote Mental Health and School Engagement in University Students: A Multisite Randomized Controlled Trial. Behavior Therapy, 49(3), 360–372. https://doi.org/10.1016/j.beth.2017.10.003

Hailikari, T., Nieminen, J., & Asikainen, H. (2022). The ability of psychological flexibility to predict study success and its relations to cognitive attributional strategies and academic emotions. Educational Psychology, 42(5), 626–643. https://doi.org/10.1080/01443410.2022.2059652

Hayes, S. C., Ciarrochi, J., Hofmann, S. G., Chin, F., & Sahdra, B. (2022). Evolving an idionomic approach to processes of change: Towards a unified personalized science of human improvement. Behaviour Research and Therapy, 156, Article 104155. https://doi.org/10.1016/j.brat.2022.104155

Hayes, S. C., Luoma, J. B., Bond, F. W., Masuda, A., & Lillis, J. (2006). Acceptance and Commitment Therapy: Model, processes, and outcomes. Behaviour Research and Therapy, 44(1), 1 –25. https://doi.org/10.1016/j.brat.2005.06.006

Hayes, S. C., Pistorello, J., & Levin, M. E. (2012). Acceptance and Commitment Therapy as a unified model of behavior change. The Counseling Psychologist, 40(7), 976–1002. https://doi.org/10.1177/0011000012460836

Hayes, S.C., Villatte, M., Levin, M., Hildebrandt, M. (2011). Open, aware, and active: contextual approaches as an emerging trend in the behavioral and cognitive therapies. Annual Review of Clinical Psychology, 7(1), 141-68. https://dx.doi.org/10.1146/annurev-clinpsy-032210-104449

Hickendorff, M., Edelsbrunner, P. A., McMullen, J., Schneider, M., & Trezise, K. (2018). Informative tools for characterizing individual differences in learning: Latent class, latent profile, and latent transition analysis. Learning and Individual Differences, 66, 4-15. https://doi.org/10.1016/j.lindif.2017.11.001

Honkonen, T., Ahola, K., Pertovaara, M., Isometsä, E., Kalimo, R., Nykyri, E., Aromaa, A. & Lönnqvist, J. (2006). The association between burnout and physical illness in the general population—results from the Finnish Health 2000 Study. Journal of Psychosomatic Research, 61(1), 59-66. https://doi.org/10.1016/j.jpsychores.2005.10.002

Howell, A. J. (2009). Flourishing: Achievement-related correlates of students’ well-being. The Journal of Positive Psychology, 4(1), 1–13. https://doi.org/10.1080/17439760802043459

Howell, A. J., & Passmore, H. A. (2019). Acceptance and commitment training (ACT) as a positive psychological intervention: A systematic review and initial meta-analysis regarding ACT’s role in well-being promotion among university students. Journal of Happiness Studies, 20, 1995-2010. https://doi.org/10.1007/s10902-018-0027-7

Hsu, T., Hoffman, L., & Thomas, E. (2023). Confirmatory Measurement Modeling and Longitudinal Invariance of the CompACT-15: A Short-Form Assessment of Psychological Flexibility. Psychological Assessment, 35, 430-442. https://doi.org/10.1037/pas0001214

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Iasiello, M., van Agteren, J., Schotanus-Dijkstra, M., Lo, L., Fassnacht, D. B., & Westerhof, G. J. (2022). Assessing mental wellbeing using the Mental Health Continuum—Short Form: A systematic review and meta-analytic structural equation modelling. Clinical Psychology: Science and Practice, 29(4), 442–456. https://doi.org/10.1037/cps0000074

Kachel, T., Huber, A., Strecker, C., Höge, T., & Höfer, S. (2020). Development of cynicism in medical students: exploring the role of signature character strengths and well-being. Frontiers in Psychology, 11, 328. https://doi.org/10.3389/fpsyg.2020.00328

Kashdan, T. B., & Rottenberg, J. (2010). Psychological flexibility as a fundamental aspect of health. Clinical Psychology Review, 30(4), 865–878. https://doi.org/10.1016/j.cpr.2010.03.001

Katajavuori, N., Vehkalahti, K., & Asikainen, H. (2021). Promoting university students’ well-being and studying with an Acceptance and Commitment Therapy (ACT)-based intervention. Current Psychology, 42, 4900–4912. https://doi.org/10.1007/s12144-021-01837-x

Ketonen, E. E., Haarala-Muhonen, A., Hirsto, L., Hänninen, J. J., Wähälä, K., & Lonka, K. (2016). Am I in the right place? Academic engagement and study success during the first years at university. Learning and Individual Differences, 51, 141–148. https://doi.org/10.1016/j.lindif.2016.08.017

Keyes, C. L. M. (1998). Social Well-Being. Social Psychology Quarterly, 61(2), 121–140. https://doi.org/10.2307/2787065

Keyes, C.L.M. (2002). The Mental Health Continuum: From Languishing to Flourishing in Life. Journal of Health and Social Research, 43(2), 207-222. https://doi.org/10.2307/3090197

Kinnunen, S. M., Puolakanaho, A., Mäkikangas, A., Tolvanen, A., & Lappalainen, R. (2020). Does a mindfulness-, acceptance-, and value-based intervention for burnout have long-term effects on different levels of subjective well-being? International Journal of Stress Management, 27(1), 82–87. https://dx.doi.org/10.1037/str0000132

Kinnunen, S. M., Puolakanaho, A., Tolvanen, A., Mäkikangas, A., & Lappalainen, R. (2019). Does mindfulness-, acceptance-, and value-based intervention alleviate burnout? A person-centered approach. International Journal of Stress Management, 26(1), 89–101. https://doi.org/10.1037/str0000095

Kunttu, K., Pesonen, T., & Saari, J. (2016). Student health survey 2016: A national survey among Finnish university students. Research Publications of The Finnish Student Health Service, 48. https://www.yths.fi/app/uploads/2020/03/KOTT_2016_ENG.pdf

Lamers, S. M., Westerhof, G. J., Bohlmeijer, E. T., ten Klooster, P. M., & Keyes, C. L. (2011). Evaluating the psychometric properties of the mental health continuum‐short form (MHC‐SF). Journal of clinical psychology, 67(1), 99-110. https://doi.org/10.1002/jclp.20741

Laursen, B., & Hoff, E. (2006). Person-centered and variable-centered approaches to longitudinal data author. Merrill-Palmer Quarterly, 52(3), 377–389. https://dx.doi.org/10.1353/mpq.2006.0029

Levin, M. E., Haeger, J. A., Pierce, B. G., & Twohig, M. P. (2017). Web-based acceptance and commitment therapy for mental health problems in college students: A randomized controlled trial. Behavior modification, 41(1), 141-162. https://doi.org/10.1177/0145445516659645

Madigan, D. J., & Curran, T. (2021). Does burnout affect academic achievement? A meta-analysis of over 100,000 students. Educational Psychology Review, 33(2), 387–405. https://doi.org/10.1007/s10648-020-09533-1

Madigan, D. J., Kim, L. E., & Glandorf, H. L. (2023). Interventions to reduce burnout in students: A systematic review and meta-analysis. European Journal of Psychology of Education, 1-27. https://doi.org/10.1007/s10212-023-00731-3

Mäkikangas, A., & Kinnunen, U. (2016). The person-oriented approach to burnout: A systematic review. Burnout Research, 3(1), 11–23. https://doi.org/10.1016/j.burn.2015.12.002

Maslach, C., Schaufeli, W. B., & Leiter, M. P. (2001). Job burnout. Annual Review of Psychology, 52, 397–422. https://doi.org/10.1146/annurev.psych.52.1.397

McLachlan, G. J. (1987). On Bootstrapping the Likelihood Ratio Test Statistic for the Number of Components in a Normal Mixture. Journal of the Royal Statistical Society, 36(3), 318–324. https://doi.org/10.2307/2347790

Olson N, Oberhoffer-Fritz R, Reiner B, Schulz T (2023). Study related factors associated with study engagement and student burnout among German university students. Frontiers in Public Health, 11. https://doi.org/10.3389/fpubh.2023.1168264

Ong, C. W., Lee, E. B., & Twohig, M. P. (2018). A meta-analysis of dropout rates in Acceptance and Commitment Therapy. Behaviour research and therapy, 104, 14-33. https://doi.org/10.1016/j.brat.2018.02.004

Onwezen, M. C., van Veldhoven, M. J. P. M., & Biron, M. (2014). The role of psychological flexibility in the demands–exhaustion–performance relationship. European Journal of Work and Organizational Psychology, 23(2), 163–176. https://doi.org/10.1080/1359432X.2012.742242

Pagnin, D., & De Queiroz, V. (2015). Influence of burnout and sleep difficulties on the quality of life among medical students. SpringerPlus, 4, 1-7. https://doi.org/10.1186/s40064-015-1477-6

Parikka S, Holm N, Ikonen J, Koskela T, Kilpeläinen H & Lundqvist A (2021). The Finnish Student Health and Wellbeing Survey KOTT. KOTT 2021 survey's weighted distributions https://www.terveytemme.fi/kott/taulukot/painotetut_jakaumat_en.html

Parpala, A., & Lindblom-Ylänne, S. (2012). Using a research instrument for developing quality at the university. Quality in Higher Education, 18(3), 313-328. https://doi.org/10.1080/13538322.2012.733493

Parpala, A., Katajavuori, N., Haarala-Muhonen, A., & Asikainen, H. (2021). How did students with different learning profiles experience ‘normal’ and online teaching situation during covid-19 spring? Social Sciences, 10(9), 337. https://dx.doi.org/10.3390/socsci10090337

Pérez-González, J. C., Filella, G., Soldevila, A., Faiad, Y., & Sanchez-Ruiz, M. J. (2022). Integrating self-regulated learning and individual differences in the prediction of university academic achievement across a three-year-long degree. Metacognition and Learning, 17(3), 1141-1165. https://doi.org/10.1007/s11409-022-09315-w

Räihä, K., Katajavuori, N., Vehkalahti, K., Huotilainen, M., & Asikainen, H. (2024). University students’ stress and burnout risk: results of an ACT-based online-course using self-assessments and HRV-measurements. Current Psychology, 1-14. https://doi.org/10.1007/s12144-024-05800-4

Räsänen, P., Lappalainen, P., Muotka, J., Tolvanen, A., & Lappalainen, R. (2016). An online guided ACT intervention for enhancing the psychological wellbeing of university students: A randomized controlled clinical trial. Behaviour Research and Therapy, 78, 30–42. https://doi.org/10.1016/j.brat.2016.01.001

Rehman, A. U., Bhuttah, T. M., & You, X. (2020). Linking burnout to psychological well-being: The mediating role of social support and learning motivation. Psychology Research and Behavior Management, 545-554. https://doi.org/10.2147/PRBM.S250961

Ríos‐Risquez, M. I., García‐Izquierdo, M., Sabuco‐Tebar, E. D. L. Á., Carrillo‐Garcia, C., & Solano‐Ruiz, C. (2018). Connections between academic burnout, resilience, and psychological well‐being in nursing students: A longitudinal study. Journal of advanced nursing, 74(12), 2777-2784. https://doi.org/10.1111/jan.13794

Rosenberg, J. M., Beymer, P. N., Anderson, D. J., Van Lissa, C. J., & Schmidt, J. A. (2019). TidyLPA: An R package to easily carry out latent profile analysis (LPA) using open-source or commercial software. Journal of Open Source Software, 3(30), 978. https://doi.org/10.21105/joss.00978

Ryff, C.D. (1998) Happiness is everything, or is it? Explorations on the meaning of psychological well-being. Journal of Personality and Social Psychology, 57(6):1069-1081. https://doi.org/10.1037/0022-3514.57.6.1069

Salmela-Aro, K., & Read, S. (2017). Study engagement and burnout profiles among Finnish higher education students. Burnout Research, 7, 21–28. https://doi.org/10.1016/j.burn.2017.11.001

Salmela-Aro, K., & Upadaya, K. (2012). The schoolwork engagement inventory: Energy, Dedication, and Absorption (EDA). European Journal of Psychological Assessment, 28(1), 60–67. https://doi.org/10.1027/1015-5759/a000091

Salmela-Aro, K., & Upadyaya, K. (2014). School burnout and engagement in the context of demands resources model. British Journal of Educational Psychology, 84(1), 137–151. https://doi.org/10.1111/bjep.12018

Salmela-Aro, K., & Upadyaya, K. (2017). Co-Development of Educational Aspirations and Academic Burnout from Adolescence to Adulthood in Finland. Research in Human Development, 14(2), 106–121. https://doi.org/10.1080/15427609.2017.1305809

Salmela-Aro, K., Moeller, J., Schneider, B., Spicer, J., & Lavonen, J. (2016). Integrating the light and dark sides of student engagement using person-oriented and situation-specific approaches. Learning and Instruction, 43, 61–70. https://doi.org/10.1016/j.learninstruc.2016.01.001

Salmela-Aro, K., Savolainen, H., & Holopainen, L. (2009). Depressive symptoms and school burnout during adolescence: Evidence from two cross-lagged longitudinal studies. Journal of Youth and Adolescence, 38(10), 1316–1327. https://doi.org/10.1007/s10964-008-9334-3

Salmela-Aro, K., Tang, X., Upadyaya, K. (2022). Study Demands-Resources Model of Student Engagement and Burnout. In: Reschly, (pp. 77-93) A.L., Christenson, S.L. (eds) Handbook of Research on Student Engagement. Springer, Cham. https://doi.org/10.1007/978-3-031-07853-8_4

Salmela-Aro, K., Upadyaya, K., Ronkainen, I., & Hietajärvi, L. (2022b). Study burnout and engagement during COVID-19 among university students: The role of demands, resources, and psychological needs. Journal of Happiness Studies, 23(6), 2685-2702. https://doi.org/10.1007/s10902-022-00518-1

Sarasjärvi, K. K., Vuolanto, P. H., Solin, P. C. M., Appelqvist-Schmidlechner, K. L., Tamminen, N. M., Elovainio, M., & Therman, S. (2022). Subjective mental well-being among higher education students in Finland during the first wave of COVID-19. Scandinavian Journal of Public Health, 50(6), 765–771. https://doi.org/10.1177/14034948221075433

Schaufeli, W. B., Martínez, I. M., Pinto, A. M., Salanova, M., & Barker, A. B. (2002). Burnout and engagement in university students a cross-national study. Journal of Cross-Cultural Psychology, 33(5), 464–481. https://doi.org/10.1177/0022022102033005003

Schaufeli, W.B., & Taris, T.W. (2014). A Critical Review of the Job Demands-Resources Model: Implications for Improving Work and Health. (pp. 43-68). In: G.F. Bauer, & O. Hämmig (Eds.) Bridging Occupational, Organizational and Public Health. A Transdisciplinary Approach. Springer. https://doi.org/10.1007/978-94-007-5640-3_4

Sclove L. S. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333-343. https://doi.org/10.1007/BF02294360

Spurk, D., Hirschi, A., Wang, M., Valero, D., & Kauffeld, S. (2020). Latent profile analysis: A review and “how to” guide of its application within vocational behavior research. Journal of vocational behavior, 120, 103445. https://doi.org/10.1016/j.jvb.2020.103445

Tein, J. Y., Coxe, S., & Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural equation modeling: a multidisciplinary journal, 20(4), 640-657. https://doi.org/10.1080/10705511.2013.824781

Tindle, R., Hemi, A., & Moustafa, A. A. (2022). Social support, psychological flexibility and coping mediate the association between COVID-19 related stress exposure and psychological distress. Scientific Reports, 12(1), 8688. https://doi.org/10.1038/s41598-022-12262-w

Towey-Swift, K. D., Lauvrud, C., & Whittington, R. (2023). Acceptance and Commitment Therapy (ACT) for professional staff burnout: a systematic review and narrative synthesis of controlled trials. Journal of Mental Health, 32(2), 452-464. https://doi.org/10.1080/09638237.2021.2022628

Trindade, I. A., Vagos, P., Moreira, H., Fernandes, D. V., & Tyndall, I. (2022). Further validation of the 18-item Portuguese CompACT scale using a multi-sample design: Confirmatory factor analysis and correlates of psychological flexibility. Journal of Contextual Behavioral Science, 25, 1-9. https://doi.org/10.1016/j.jcbs.2022.06.003

Tuominen-Soini, H., & Salmela-Aro, K. (2014). Schoolwork engagement and burnout among Finnish high school students and young adults: Profiles, progressions, and educational outcomes. Developmental Psychology, 50(3), 649–662. https://doi.org/10.1037/a0033898

Tynan, M., Afari, N., Dochat, C., Gasperi, M., Roesch, S., & Herbert, M. S. (2022). Confirmatory factor analysis of the Comprehensive Assessment of Acceptance and Commitment Therapy (CompACT) in active-duty military personnel. Journal of Contextual Behavioral Science, 25, 115-121. https://doi.org/10.1016/j.jcbs.2022.07.001

UNESCO. (2020). Nurturing the social and emotional wellbeing of children and young people during crises. UNESCO COVID-19 Education Response. https://unesdoc.unesco.org/ark:/48223/pf000037327

Viskovich, S., & Pakenham, K.I. (2020). Randomized controlled trial of a web-based Acceptance and Commitment Therapy (ACT) program to promote mental health in university students. Journal of Clinical Psychology, 76(6), 929-951. https://doi.org/10.1002/jclp.22848

Wersebe, H., Lieb, R., Meyer, A. H., Hofer, P., & Gloster, A. T. (2018). The link between stress, well-being, and psychological flexibility during an Acceptance and Commitment Therapy self-help intervention. International Journal of Clinical and Health Psychology, 18(1), 60-68. https://doi.org/10.1016/j.ijchp.2017.09.002