Sensitivity to mental effort and test–retest reliability of heart rate variability measures in healthy seniors
Highlights
► A wide variety of heart rate variability measures have been used to quantify mental effort. ► In this study, mental effort in older adults was associated with changes in heart rate variability. ► In general measures with higher test–retest reliability had greater sensitivity to mental effort. ► Time domain measures were more sensitive to mental effort than frequency domain measures. ► Among non-linear measures, Poincaré was the most sensitive to mental effort.
Introduction
Mental effort, a varying capacity for cognitive processing closely related to arousal and attention, has been studied using physiological measures (Kahneman, 1973, Kramer and Weber, 2000, Oken et al., 2006). One such measurement is heart rate variability (HRV), the analysis of beat-to-beat intervals. HRV is sensitive to several clinical conditions, especially those associated with cardiac disease or autonomic neuropathy (Task Force of the European Society of Cardiology, 1996, Hennessy et al., 2001, Pope et al., 2001, Sandercock et al., 2005, Paul-Labrador et al., 2006). Additionally, HRV has been used to assess interventions that might impact sympathetic–parasympathetic balance in conditions not associated with cardiac disease or autonomic neuropathy (Fu et al., 2006, Paul-Labrador et al., 2006).
Previous research reported that HRV is sensitive to changes in mental effort (Mulder and Mulder, 1981, Aasman et al., 1987, Jorna, 1992, Veltman and Gaillard, 1993). With an increase in mental effort, there is a decrease in power around 0.10 Hz, in what they referred to as the mid-frequency band, 0.07–0.14 Hz (Jorna, 1992). This is now commonly known as the low frequency band, 0.04–0.15 Hz (Task Force of the European Society of Cardiology, 1996). The underlying mechanism may be due to increased sympathetic activation or the subjects’ pattern of breathing (Althaus et al., 1998). In other studies, apart from a strong inverse relationship between mental effort and HRV power, mean RR interval appears to be the most sensitive measure (Capa et al., 2008, De Rivecourt et al., 2008, Henelius et al., 2009, Weippert et al., 2009).
While HRV has useful applications both clinically and as an autonomic measure in physiological research- the inter-subject variability of HRV measures is rather high (Gerritsen et al., 2003, Pinna et al., 2007). Thus, it is difficult to generalize the results from any one given study to others with subjects of different demographic characteristics. Additionally, the within-subject reliability of HRV measures remains unclear. The degree of reproducibility of HRV measurements from short-term recordings in healthy people is inconsistent and can at best be considered moderate (Pinna et al., 2007, Sandercock et al., 2005), except under highly controlled resting conditions (Melanson, 2000). Studies of reliability of HRV parameters during mental effort tasks is lacking in the literature.
Of late, non-linear methods of HRV analysis have gained prominence, with the promise of unraveling the inherent complexity in heart rate rhythms and an aim to model the complex interplay of influencing factors (Schumacher, 2004, González and Pereda, 2004). These new methods seem to contribute to the prognosis and treatment of different diseases (Huikuri et al., 2009). While most studies using non-linear techniques have been carried out on long-term time series, like a 24-h ambulatory Holter monitor (Bigger et al., 1996, Huikuri et al., 2000, Maestri et al., 2007a, Maestri et al., 2007b), it is of immense interest and benefit to see if these results are reproducible in short-term HRV, which is critical for studying cardiovascular autonomic changes. Shorter time series analysis techniques are desirable because many human psychophysiologic studies under controlled lab conditions are limited in how long they can be optimally maintained. While several methods suitable to assess short-term non-linear properties have been proposed (Guzzetti et al., 2005, Balocchi et al., 2006), the reliability of these indices remains unclear. Studies carried out on patients with heart failure (Maestri et al., 2006, Maestri et al., 2007a, Maestri et al., 2007a) and short term records in control subjects (Maestri et al., 2007b) show a large variability in these indices Moreover, the reliability and usefulness of these indices as markers in the study of mental effort tasks has not been established. Hence, in the current study, we investigated the sensitivity and reliability of HRV to mental effort tasks in healthy seniors, using time domain, frequency domain and non-linear approaches to HRV analysis.
Section snippets
Participants
Forty participants from Portland, Oregon participated in the study. They were recruited for a clinical study on age-related cognitive function (Oken et al., 2008) and were compensated for their participation. The data for this analysis were obtained from testing sessions on 2 days separated by 2 weeks prior to the clinical study intervention. The Oregon Health & Science University Institutional Review Board approved the research, and each participant gave written informed consent.
Participants
Results
Data were obtained from 40 participants. One participant was excluded from Visit 1 and 6 from Visit 2, due to arrhythmia or signal artifacts.
Discussion
Although HRV is widely used as a physiological measure in cognitive function studies, the reliability of these measures during cognitive tasks is not known. In our study, most of the HRV parameters were reliable. Test–retest reliability (Kendall’s τ) closely correlated to the absolute reliability measures using mean difference scores and coefficient of repeatability, over both easy and hard trials. Among the most reliable-time domain > frequency domain > Poincaré estimates. Among other non-linear
Acknowledgements
This study was supported by NIH U19 AT002656 and K24 AT005121. Roger Ellingson, M.S. provided software support for the heart rate variability data analysis and Ms. Alexandra Amen helped with arranging the references.
References (74)
- et al.
Non-linear complexity measures of heart rate variability in acute schizophrenia
Clin Neurophysiol
(2007) - et al.
The interactive effect of achievement motivation and task difficulty on mental effort
Int J Psychophysiol
(2008) - et al.
Effects of long-term vegetarian diets on cardiovascular autonomic functions in healthy postmenopausal women
Am J Cardiol
(2006) Spectral analysis of heart rate and psychological state: a review of its validity as a workload index
Biol Psychol
(1992)- et al.
Association of cardiac autonomic neuropathy with alteration of sympatho-vagal balance through heart rate variability analysis
Med Eng Phys
(2010) - et al.
Vigilance, alertness, or sustained attention: physiological basis and measurement
Clin Neurophysiol
(2006) - et al.
Functional assessment of heart rate variability: physiological basis and practical applications
Int J Cardiol
(2002) - et al.
The reliability of short-term measurements of heart rate variability
Int J Cardiol
(2005) - et al.
Operator effort and the measurement of heart-rate variability
Hum Factors
(1987) - et al.
Power spectrum analysis of heart rate fluctuation: a quantitative probe of beat-to-beat cardiovascular control
Science
(1981)
Influence of respiratory activity on the cardiac response pattern to mental effort
Psychophysiology
Influence of age, gender, body mass index, and functional capacity on heart rate variability in a cohort of subjects without heart disease
Am J Cardiol
Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine
Sports Med
Neurocardiology: the benefits of irregularity. The basics of methodology, physiology and current clinical applications
Acta Cardiol
Revisiting the potential of time-domain indexes in short-term HRV analysis
Biomed Tech (Berl)
Approximate entropy of heart rate variability: validation of methods and application in heart failure
Cardiovasc Eng
Aging and non linear heart rate control in healthy population
Am J Physiol Heart Circ Physiol
Power law behavior of RR-interval variability in healthy middle-aged persons, patients with recent acute myocardial infarction, and patients with heart transplants
Circulation
Measuring agreement in method comparison studies
Stat Methods Med Res
Statistical methods for assessing agreement between two methods of clinical measurement
Lancet
Heart rate variability during repeated incremental head-up tilt discloses time dependence of individual autonomic dynamics
Clin Cardiol
Heart-rate variability and precompetitive anxiety in swimmers
Psicothema
Comparison and clinical application of frequency domain methods in analysis of neonatal heart rate time series
Ann Biomed Eng
Quantifying errors in spectral estimates of HRV due to beat replacement and resampling
IEEE Trans Biomed Eng
Fractal behaviour of heart rate variability reflects severity in stroke patients
Stud Health Technol Inform
Cardiovascular and eye activity measures as indices for momentary changes in mental effort during simulated flight
Ergonomics
Physiological basis of fractal complexity properties of heart rate variability in man
J Physiol
Measures of cardiovascular autonomic nervous function: agreement, reproducibility, and reference values in middle age and elderly subjects
Diabetologia
High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice
Cereb Cortex
Applications of fractal and non-linear time series analysis to the study of short-term cardiovascular control
Curr Vasc Pharmacol
Symbolic dynamics of heart rate variability: a probe to investigate cardiac autonomic modulation
Circulation
Clinical prognostic significance of heart abnormality and heart rate variability in patients with stroke
Neurol Res
Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology
Circulation
Mental workload classification using heart rate metrics
Conf Proc IEEE Eng Med Biol Soc
Sudden withdrawal of carbamazepine increases cardiac sympathetic activity in sleep
Neurology
Fractal correlation properties of R–R interval dynamics and mortality in patients with depressed left ventricular function after an acute myocardial infarction
Circulation
Cited by (91)
Classifying engagement in E-learning through GRU-TCN model using photoplethysmography signals
2024, Biomedical Signal Processing and ControlPsychophysiology and affective processing across the lifespan: Pathways to psychopathology
2024, Biological PsychologyReliability of short-term measurements of heart rate variability: Findings from a longitudinal study
2020, Biological PsychologyCitation Excerpt :Additionally, it is noteworthy that recent studies fall into three different categories (for an overview on experimental structures, see Laborde, Mosley, & Thayer, 2017; see also Thayer et al., 2012). That is, studies (1) investigated reliability of reactivity HRV (Cipryan & Litschmannova, 2013, 2014; Hallman et al., 2015; Kowalewski & Urban, 2004; Mukherjee, Yadav, Yung, Zajdel, & Oken, 2011), (2) baseline measurements (Dietrich et al., 2010; Kobayashi, 2009; Koskinen et al., 2009; Maestri et al., 2009; Pinna et al., 2007; Schroeder et al., 2004; Young & Leicht, 2011), (3) both reactivity and baseline HRV (Bertsch et al., 2012; Guijt, Sluiter, & Frings-Dresen, 2007). However, the effects of the experimental structure on test-retest-reliability are ambiguous (Bertsch et al., 2012; Guijt et al., 2007; Sandercock et al., 2005).