Abstract
This paper discusses the possibility of detecting personal stress making use of popular wearable devices available in the market. Different instruments found in the literature to measure stress-related features are reviewed, distinguishing between subjective tests and mechanisms supported by the analysis of physiological signals from clinical devices. Taking them as a reference, a solution to estimate stress based on the use of commercial-off-the-shelf wrist wearables and machine learning techniques is described. A mobile app was developed to induce stress in a uniform and systematic way. The app implements well-known stress inducers, such as the Paced Auditory Serial Addition Test, the Stroop Color-Word Interference Test, and a hyperventilation activity. Wearables are used to collect physiological data used to train classifiers that provide estimations on personal stress levels. The solution has been validated in an experiment involving 19 subjects, offering an average accuracy and F-measures close to 0.99 in an individual model and an accuracy and F-measure close to 0.85 in a global 2-level classifier model. Stress can be a worrying problem in different scenarios, such as in educational settings. Thus, the last part of the paper describes the proposal of a set of stress related indicators aimed to support the management of stress over time in such settings.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Beck A, Steer R (1990) Manual for the Beck anxiety inventory. San Antonio, TX Psychol Corp
Ben-Zeev D, Scherer EA, Wang R et al (2015) Next-generation psychiatric assessment: using smartphone sensors to monitor behavior and mental health. Psychiatr Rehabil J 38:218–226. https://doi.org/10.1037/prj0000130
Brown TA, Chorpita BF, Korotitsch W, Barlow DH (1997) Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples
Burns A, Greene BR, McGrath MJ et al (2010) SHIMMER™—a wireless sensor platform for noninvasive biomedical research. IEEE Sens J 10:1527–1534. https://doi.org/10.1109/JSEN.2010.2045498
Caddy B (2018) Stress tracking tech: Heart rate monitoring and guided breathing devices. https://www.wareable.com/wearable-tech/stress-beating-tech-to-keep-you-sane. Accessed 15 Nov 2018
Cano A, Miguel-Tobal JJ, González H, Iruarrizaga I (2007) Hiperventilación y experiencia de ansiedad. Ansiedad y Estrés 13:291–302
Cano-Vindel A, Miguel-Tobal JJ (1999) Evaluación de la ansiedad desde un enfoque interactivo y multidimensional: el Inventario de Situaciones y Respuestas de Ansiedad (ISRA). Psicol Contemp 6:14–21
Carroll B, Davidson J (2000) Screening Scale for DSM-IV GAD
Chandola T, Brunner E, Marmot M (2006) Chronic stress at work and the metabolic syndrome: prospective study. BMJ 332:521–525. https://doi.org/10.1136/bmj.38693.435301.80
Cohen S, Williamson G (1988) Perceived stress in a probability sample of the United States. In: Spacapan S, Oskamp S (eds) The Soc Psychol Heal Claremont Symp Appl Soc Psychol Newbury Park CA Sage
Cohen S, Kamarck T, Mermelstein R (1983) A global measure of perceived stress. J Health Soc Behav 385–396
Cola G, Vecchio A (2018) Wearable systems for e-health and wellbeing. Pers Ubiquitous Comput 22:225–225. https://doi.org/10.1007/s00779-017-1041-1
Colligan TW, Higgins EM (2006) Workplace Stress: Etiology and consequences. J Workplace Behav Health 21:89–97. https://doi.org/10.1300/J490v21n02_07
Cooper CL, Cartwright S (1997) An intervention strategy for workplace stress. J Psychosom Res 43:7–16. https://doi.org/10.1016/S0022-3999(96)00392-3
Costa A, Rincon JA, Carrascosa C et al (2019) Emotions detection on an ambient intelligent system using wearable devices. Futur Gener Comput Syst 92:479–489. https://doi.org/10.1016/J.FUTURE.2018.03.038
Dallman MF, Pecoraro N, Akana SF et al (2003) Chronic stress and obesity: a new view of “comfort food. PNAS 97:325–330. https://doi.org/10.1073/pnas.97.1.325
de Arriba-PĂ©rez F, Caeiro-RodrĂguez M, Santos-Gago JM (2016) Collection and processing of data from wrist wearable devices in heterogeneous and multiple-user scenarios. Sensors 16:1538. https://doi.org/10.3390/s16091538
de Arriba-PĂ©rez F, Caeiro-RodrĂguez M, Santos-Gago JM (2017) How do you sleep? Using off the shelf wrist wearables to estimate sleep quality, sleepiness level, chronotype and sleep regularity indicators. J Ambient Intell Humaniz Comput 1–21. https://doi.org/10.1007/s12652-017-0477-5
de Arriba-PĂ©rez F, Santos-Gago JM, Caeiro-RodrĂguez M, Fernández-Iglesias MJ (2018) Evaluation of commercial-off-the-shelf wrist wearables to estimate stress on students. JoVE. https://doi.org/10.3791/57590
Deberard C, Scott M, Glen I et al (2004) Predictors of academic achievement and retention among college freshmen: a longitudinal study. Coll Stud J 381:66–80
Din S, Paul A (2018) Smart health monitoring and management system: toward autonomous wearable sensing for internet of things using big data analytics. Futur Gener Comput Syst doi. https://doi.org/10.1016/J.FUTURE.2017.12.059
Dishman RK, Nakamura Y, Garcia ME et al (2000) Heart rate variability, trait anxiety, and perceived stress among physically fit men and women. Int J Psychophysiol 37:121–133. https://doi.org/10.1016/S0167-8760(00)00085-4
Ebbinghaus H (2013) Memory: a contribution to experimental psychology. Ann Neurosci 20:155–156. https://doi.org/10.5214/ans.0972.7531.200408
empatica (2016) E4 wristband. https://www.empatica.com/e4-wristband. Accessed 26 Jun 2017
Espinosa HG, Lee J, Keogh J et al (2015) On the use of inertial sensors in educational engagement activities. Procedia Eng 112:262–266. https://doi.org/10.1016/j.proeng.2015.07.242
Extremera N, Durán A, Rey L (2007) Inteligencia emocional y su relación con los niveles de burnout, engagement y estrés en estudiantes universitarios. 342:239–256
Fan Q, Wang Y (2010) The real-time realization of filtering of speech with DSP TMS320VC5416 Chip. In: 2010 International Conference on Educational and Information Technology. IEEE
GarcĂa-Ros R, PĂ©rez-González F, PĂ©rez-Blasco J, Natividad LA (2012) EvaluaciĂłn del estrĂ©s acadĂ©mico en estudiantes de nueva incorporaciĂłn a la universidad Academic stress in first-year college students. 143–154
Gonzáles–Romá V, Schaufeli W, Bakker A (2002) The measurement of burnout and engagement: a confirmatory factor analytic approach. Jou Happ Stu
Grös DF, Antony MM, Simms LJ, Mccabe RE (2007) Psychometric properties of the state–trait inventory for cognitive and somatic anxiety (STICSA): comparison to the state–trait anxiety inventory (STAI). Psychol Assess 19:369. https://doi.org/10.1037/1040-3590.19.4.369
Guo F, Li Y, Kankanhalli MS, Brown MS (2013) An evaluation of wearable activity monitoring devices. In: Proceedings of the 1st ACM international workshop on Personal data meets distributed multimedia - PDM’13. ACM Press, New York, New York, USA, pp 31–34
Hamilton M (1959) The assessment of anxiety states by rating. Br J Med Psychol 32:50–55. https://doi.org/10.1111/j.2044-8341.1959.tb00467.x
Harari GM, Lane ND, Wang R et al (2016) Using smartphones to collect behavioral data in psychological science. Perspect Psychol Sci 11:838–854. https://doi.org/10.1177/1745691616650285
Harari GM, Gosling SD, Wang R et al (2017) Patterns of behavior change in students over an academic term: a preliminary study of activity and sociability behaviors using smartphone sensing methods. https://doi.org/10.1016/j.chb.2016.10.027
Healey JA (2000) Wearable and automotive systems for affect recognition from physiology
Healey JA, Picard RW (2005) Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans Intell Transp Syst 6:156–166. https://doi.org/10.1109/TITS.2005.848368
Hernandez J, Morris RR, Picard RW (2011) Call center stress recognition with person-specific models. Springer, Berlin, pp 125–134
Highcharts (2017) Interactive JavaScript charts for your webpage|Highcharts. https://www.highcharts.com/. Accessed 11 Jan 2018
Ibáñez V, Silva J, Cauli O (2018) A survey on sleep assessment methods. PeerJ 6:e4849. https://doi.org/10.7717/peerj.4849
IDC (2016a) The worldwide wearables in 2015, according to IDC. http://www.idc.com/getdoc.jsp?containerId=prUS41037416. Accessed 26 Jun 2017
IDC (2016b) Worldwide wearables market increases 67.2% Amid seasonal retrenchment, According to IDC. http://www.idc.com/getdoc.jsp?containerId=prUS41284516. Accessed 26 Jun 2017
IDC (2016c) Basic wearables soar and smart wearables stall as worldwide wearables market climbs 26.1% in the second quarter. http://www.idc.com/getdoc.jsp?containerId=prUS41718216. Accessed 26 Jun 2017
IDC (2016d) IDC forecasts wearables shipments to reach 213.6 million units worldwide in 2020 with watches and wristbands driving volume while clothing and eyewear gain traction. http://www.idc.com/getdoc.jsp?containerId=prUS41530816. Accessed 26 Jun 2017
IDC (2017) IDC forecasts shipments of wearable devices to nearly double by 2021 as smart watches and new product categories gain traction. https://www.idc.com/getdoc.jsp?containerId=prUS43408517. Accessed 7 May 2018
Jersey (2016) Jersey. https://jersey.java.net/. Accessed 26 Jun 2017
Karthikeyan P, Murugappan M, Yaacob S (2012) Descriptive analysis of skin temperature variability of sympathetic nervous system activity in stress. J Phys Ther Sci 24:1341–1344. https://doi.org/10.1589/jpts.24.1341
Kikhia B, Stavropoulos TG, Meditskos G et al (2015) Utilizing ambient and wearable sensors to monitor sleep and stress for people with BPSD in nursing homes. J Ambient Intell Humaniz Comput 1–13. https://doi.org/10.1007/s12652-015-0331-6
Kitsantas A, Winsler A, Huie F (2008) Self-regulation and ability predictors of academic success during college: a predictive validity study. J Adv Acad. https://doi.org/10.4219/jaa-2008-867
Kompier M, Cooper C (1999) Preventing stress, improving productivity: European case studies in the workplace
Koskimäki H, Mönttinen H, Siirtola P et al (2017) Early detection of migraine attacks based on wearable sensors. In: Proceedings of the 2017 ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2017 ACM international symposium on wearable computers on—UbiComp’17. ACM Press, New York, New York, USA, pp 506–511
Kothgassner OD, Felnhofer A, Hlavacs H et al (2016) Salivary cortisol and cardiovascular reactivity to a public speaking task in a virtual and real-life environment. Comput Human Behav 62:124–135. https://doi.org/10.1016/J.CHB.2016.03.081
Lin T, Omata M, Hu W, Imamiya A (2005) Do physiological data relate to traditional usability indexes? In: Proc 17th Aust Conf Comput Interact Citizens Online Considerations Today Futur Comput Interact Spec Interes Gr Aust 1–10
Lovibond S, Lovibond P (1995) Manual for the depression anxiety stress scales. Hum Reprod
Lu L (1994) University transition: major and minor life stressors, personality characteristics and mental health. Psychol Med 24:81. https://doi.org/10.1017/S0033291700026854
Lundberg U, Kadefors R, Melin B et al (1994) Psychophysiological stress and emg activity of the trapezius muscle. Int J Behav Med 1:354–370. https://doi.org/10.1207/s15327558ijbm0104_5
Mario B, Massimiliano M, Chiara M et al (2009) White-coat effect among older patients with suspected cognitive impairment: prevalence and clinical implications. Int J Geriatr Psychiatry 24:509–517. https://doi.org/10.1002/gps.2145
Mariotti A (2015) The effects of chronic stress on health: new insights into the molecular mechanisms of brain–body communication. Futur Sci OA 1:fso.15.21. https://doi.org/10.4155/fso.15.21
Mark H, Ian W, Eibe F (2011) data mining: practical machine learning tools and techniques. Morgan Kaufmann Publishers
Maslach C, Jackson SE (1981) The measurement of experienced burnout*. J Occup Behav 2:99–113
Maslach C, Jackson SE, Schwab RL (1986a) The MBI-EDUCATORS Survey. The Maslach
Maslach C, Jackson S, Leiter M (1986b) Maslach Burnout Inventory. Palo Alto
Mastrandrea R, Fournet J, Barrat A (2015) Contact patterns in a high school: a comparison between data collected using wearable sensors, contact diaries and friendship surveys. PLoS One 10:e0136497. https://doi.org/10.1371/journal.pone.0136497
Mayo Clinic Staff (2016) Chronic stress puts your health at risk—Mayo Clinic. https://www.mayoclinic.org/healthy-lifestyle/stress-management/in-depth/stress/art-20046037. Accessed 24 Oct 2018
Microsoft (2015) Microsoft Band SDK. https://developer.microsoftband.com/Content/docs/MicrosoftBandSDK.pdf. Accessed 26 Jun 2017
Mohr DC, Jorm A, Saeb S et al (2016) The relationship between mobile phone location sensor data and depressive symptom severity. https://doi.org/10.7717/peerj.2537
Mokhayeri F, Akbarzadeh-T M-R, Toosizadeh S (2011) Mental stress detection using physiological signals based on soft computing techniques. In: 2011 18th Iranian conference of biomedical engineering (ICBME). IEEE, pp 232–237
MongoDB (2017) MongoDB for GIANT Ideas | MongoDB. https://www.mongodb.com/. Accessed 26 Jun 2017
Norton PJ (2007) Depression anxiety and stress scales (DASS-21): psychometric analysis across four racial groups. Anxiety Stress Coping 20:253–265. https://doi.org/10.1080/10615800701309279
Pedrotti M, Mirzaei MA, Tedesco A et al (2014) Automatic stress classification with pupil diameter analysis. Int J Hum Comput Interact 30:220–236. https://doi.org/10.1080/10447318.2013.848320
Polar (2017) Recovery status|Polar Global. https://www.polar.com/en/smart_coaching/features/recovery_status. Accessed 26 Jun 2017
Prieto LP, Sharma K, Dillenbourg P, RodrĂguez-Triana MJ (2016) Teaching analytics: towards automatic extraction of orchestration graphs using wearable sensors. Proc Sixth Int Conf Learn Anal Knowl 148–157. https://doi.org/10.1145/2883851.2883927
Rashkova MR, Ribagin LS, Toneva NG (2012) Correlation between salivary α-amylase and stress-related anxiety. Folia Med (Plovdiv) 54:46–51. https://doi.org/10.2478/v10153-011-0088-4
Reiss S, Peterson RA, Gursky DM, McNally RJ (1986) Anxiety sensitivity, anxiety frequency and the prediction of fearfulness. Behav Res Ther 24:1–8. https://doi.org/10.1016/0005-7967(86)90143-9
Rincon JA, Costa A, Villarrubia G et al (2018) Introducing dynamism in emotional agent societies. Neurocomputing 272:27–39. https://doi.org/10.1016/J.NEUCOM.2017.03.091
Sandhu MM, Javaid N, Jamil M et al (2015) Modeling mobility and psychological stress based human postural changes in wireless body area networks. Comput Human Behav 51:1042–1053. https://doi.org/10.1016/J.CHB.2014.09.032
Sano A, Eng B (2016) Measuring college students’ sleep, stress, mental health and wellbeing with wearable sensors and mobile phones. Massachusetts Institute of Technology
Santos A de (2012) Design, implementation and evaluation of an unconstrained and contactless biometric system based on hand geometry and stress detection. E.T.S.I. TelecomunicaciĂłn (UPM)
Schaufeli W, Leiter M (1996) Maslach burnout inventory-general survey. Maslach Burn Invent Man 1:19–26
Selye H (1973) The Evolution of the Stress Concept: The originator of the concept traces its development from the discovery in 1936 of the alarm reaction to modern therapeutic applications of syntoxic and catatoxic hormones. Am Sci 61:692–699
Setz C, Arnrich B, Schumm J et al (2010) Discriminating stress from cognitive load using a wearable EDA device. IEEE Trans Inf Technol Biomed 14:410–417. https://doi.org/10.1109/TITB.2009.2036164
Shimmer Shimmer Galvanic Skin Response Sensor | EDA sensor. http://www.shimmersensing.com/products/shimmer3-wireless-gsr-sensor. Accessed 18 Dec 2018
Spielberger CD, Gorsuch RL, Lushene RE (1970) Manual for the state-trait anxiety inventory
Stahl SE, An H-S, Dinkel DM et al (2016) How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? BMJ Open Sport Exerc Med 2:e000106. https://doi.org/10.1136/bmjsem-2015-000106
Statista (2017) Fitbit leads global wearables market. https://www.statista.com/chart/8420/wearable-device-shipments/. Accessed 16 May 2018
Statista (2018) Apple jumps to top of the global wearables market. https://www.statista.com/chart/13115/worldwide-wearable-device-shipments/. Accessed 16 May 2018
Stroop JR (1935) Studies of interference in serial verbal reactions. J Exp Psychol 18:643–662. https://doi.org/10.1037/h0054651
Taylor S, Zvolensky MJ, Cox BJ et al (2007) Robust dimensions of anxiety sensitivity: development and initial validation of the Anxiety Sensitivity Index-3. Psychol Assess 19:176–188. https://doi.org/10.1037/1040-3590.19.2.176
Tombaugh TN (2006) A comprehensive review of the Paced Auditory Serial Addition Test (PASAT). Arch Clin Neuropsychol 21:53–76. https://doi.org/10.1016/j.acn.2005.07.006
Travers CJ, Cooper CL (1997) El Estrés de los profesores: la presión en la actividad docente. Paidós
Vizer LM, Zhou L, Sears A (2009) Automated stress detection using keystroke and linguistic features: an exploratory study. Int J Hum Comput Stud 67:870–886. https://doi.org/10.1016/j.ijhcs.2009.07.005
Vrijkotte TGM, Van-Doornen LJP, De-Geus EJC (2000) Effects of work stress on ambulatory blood pressure, heart rate, and heart rate variability. Hypertension 35
Wallen MP, Gomersall SR, Keating SE et al (2016) Accuracy of heart rate watches: implications for weight management. PLoS One 11:e0154420. https://doi.org/10.1371/journal.pone.0154420
Wang R, Chen F, Chen Z et al (2014) StudentLife. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing—UbiComp’14 Adjunct. ACM Press, New York, New York, USA, pp 3–14
Wang R, Harari G, Hao P et al (2015) SmartGPA: how smartphones can assess and predict academic performance of college students. https://doi.org/10.1145/2750858.2804251
Wang R, Blackburn G, Desai M et al (2017) Accuracy of wrist-worn heart rate monitors. JAMA Cardiol 2:104. https://doi.org/10.1001/jamacardio.2016.3340
Wittchen H-U, Boyer P (1998) Screening for anxiety disorders: sensitivity and specificity of the Anxiety Screening Questionnaire (ASQ—15). Br J Psychiatry
wranx (2016) Ebbinghaus and the forgetting curve. http://www.wranx.com/ebbinghaus-and-the-forgetting-curve/. Accessed 26 Jun 2017
Xu J, Zhong B (2018) Review on portable EEG technology in educational research. Comput Human Behav 81:340–349. https://doi.org/10.1016/J.CHB.2017.12.037
Zhai J, Barreto A (2006) Stress detection in computer users based on digital signal processing of noninvasive physiological variables. In: 2006 international conference of the IEEE engineering in medicine and biology society. IEEE, pp 1355–1358
Zhai J, Barreto AB, Craig-Chin C-L (2005) Realization of stress detection using psychophysiological signals for improvement of human–computer interaction. In: Proceedings. IEEE SoutheastCon. IEEE, pp 415–420
Acknowledgements
This work is supported by the Spanish State Research Agency, the European Regional Development Fund (ERDF) under the PALLAS (TIN2016-80515-R AEI/EFRD, EU) project and the employment contract granted by the University of Vigo in July 2016 for the performance of PhD studies.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
de Arriba-PĂ©rez, F., Santos-Gago, J.M., Caeiro-RodrĂguez, M. et al. Study of stress detection and proposal of stress-related features using commercial-off-the-shelf wrist wearables. J Ambient Intell Human Comput 10, 4925–4945 (2019). https://doi.org/10.1007/s12652-019-01188-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-019-01188-3