Elsevier

Clinical Neurophysiology

Volume 122, Issue 10, October 2011, Pages 2059-2066
Clinical Neurophysiology

Sensitivity to mental effort and test–retest reliability of heart rate variability measures in healthy seniors

https://doi.org/10.1016/j.clinph.2011.02.032Get rights and content

Abstract

Objectives

To determine (1) whether heart rate variability (HRV) was a sensitive and reliable measure in mental effort tasks carried out by healthy seniors and (2) whether non-linear approaches to HRV analysis, in addition to traditional time and frequency domain approaches were useful to study such effects.

Methods

Forty healthy seniors performed two visual working memory tasks requiring different levels of mental effort, while ECG was recorded. They underwent the same tasks and recordings 2 weeks later. Traditional and 13 non-linear indices of HRV including Poincaré, entropy and detrended fluctuation analysis (DFA) were determined.

Results

Time domain, especially mean R-R interval (RRI), frequency domain and, among non-linear parameters – Poincaré and DFA were the most reliable indices. Mean RRI, time domain and Poincaré were also the most sensitive to different mental effort task loads and had the largest effect size.

Conclusions

Overall, linear measures were the most sensitive and reliable indices to mental effort. In non-linear measures, Poincaré was the most reliable and sensitive, suggesting possible usefulness as an independent marker in cognitive function tasks in healthy seniors.

Significance

A large number of HRV parameters was both reliable as well as sensitive indices of mental effort, although the simple linear methods were the most sensitive.

Highlights

► A wide variety of heart rate variability measures have been used to quantify mental effort. ► In this study, mental effort in older adults was associated with changes in heart rate variability. ► In general measures with higher test–retest reliability had greater sensitivity to mental effort. ► Time domain measures were more sensitive to mental effort than frequency domain measures. ► Among non-linear measures, Poincaré was the most sensitive to mental effort.

Introduction

Mental effort, a varying capacity for cognitive processing closely related to arousal and attention, has been studied using physiological measures (Kahneman, 1973, Kramer and Weber, 2000, Oken et al., 2006). One such measurement is heart rate variability (HRV), the analysis of beat-to-beat intervals. HRV is sensitive to several clinical conditions, especially those associated with cardiac disease or autonomic neuropathy (Task Force of the European Society of Cardiology, 1996, Hennessy et al., 2001, Pope et al., 2001, Sandercock et al., 2005, Paul-Labrador et al., 2006). Additionally, HRV has been used to assess interventions that might impact sympathetic–parasympathetic balance in conditions not associated with cardiac disease or autonomic neuropathy (Fu et al., 2006, Paul-Labrador et al., 2006).

Previous research reported that HRV is sensitive to changes in mental effort (Mulder and Mulder, 1981, Aasman et al., 1987, Jorna, 1992, Veltman and Gaillard, 1993). With an increase in mental effort, there is a decrease in power around 0.10 Hz, in what they referred to as the mid-frequency band, 0.07–0.14 Hz (Jorna, 1992). This is now commonly known as the low frequency band, 0.04–0.15 Hz (Task Force of the European Society of Cardiology, 1996). The underlying mechanism may be due to increased sympathetic activation or the subjects’ pattern of breathing (Althaus et al., 1998). In other studies, apart from a strong inverse relationship between mental effort and HRV power, mean RR interval appears to be the most sensitive measure (Capa et al., 2008, De Rivecourt et al., 2008, Henelius et al., 2009, Weippert et al., 2009).

While HRV has useful applications both clinically and as an autonomic measure in physiological research- the inter-subject variability of HRV measures is rather high (Gerritsen et al., 2003, Pinna et al., 2007). Thus, it is difficult to generalize the results from any one given study to others with subjects of different demographic characteristics. Additionally, the within-subject reliability of HRV measures remains unclear. The degree of reproducibility of HRV measurements from short-term recordings in healthy people is inconsistent and can at best be considered moderate (Pinna et al., 2007, Sandercock et al., 2005), except under highly controlled resting conditions (Melanson, 2000). Studies of reliability of HRV parameters during mental effort tasks is lacking in the literature.

Of late, non-linear methods of HRV analysis have gained prominence, with the promise of unraveling the inherent complexity in heart rate rhythms and an aim to model the complex interplay of influencing factors (Schumacher, 2004, González and Pereda, 2004). These new methods seem to contribute to the prognosis and treatment of different diseases (Huikuri et al., 2009). While most studies using non-linear techniques have been carried out on long-term time series, like a 24-h ambulatory Holter monitor (Bigger et al., 1996, Huikuri et al., 2000, Maestri et al., 2007a, Maestri et al., 2007b), it is of immense interest and benefit to see if these results are reproducible in short-term HRV, which is critical for studying cardiovascular autonomic changes. Shorter time series analysis techniques are desirable because many human psychophysiologic studies under controlled lab conditions are limited in how long they can be optimally maintained. While several methods suitable to assess short-term non-linear properties have been proposed (Guzzetti et al., 2005, Balocchi et al., 2006), the reliability of these indices remains unclear. Studies carried out on patients with heart failure (Maestri et al., 2006, Maestri et al., 2007a, Maestri et al., 2007a) and short term records in control subjects (Maestri et al., 2007b) show a large variability in these indices Moreover, the reliability and usefulness of these indices as markers in the study of mental effort tasks has not been established. Hence, in the current study, we investigated the sensitivity and reliability of HRV to mental effort tasks in healthy seniors, using time domain, frequency domain and non-linear approaches to HRV analysis.

Section snippets

Participants

Forty participants from Portland, Oregon participated in the study. They were recruited for a clinical study on age-related cognitive function (Oken et al., 2008) and were compensated for their participation. The data for this analysis were obtained from testing sessions on 2 days separated by 2 weeks prior to the clinical study intervention. The Oregon Health & Science University Institutional Review Board approved the research, and each participant gave written informed consent.

Participants

Results

Data were obtained from 40 participants. One participant was excluded from Visit 1 and 6 from Visit 2, due to arrhythmia or signal artifacts.

Discussion

Although HRV is widely used as a physiological measure in cognitive function studies, the reliability of these measures during cognitive tasks is not known. In our study, most of the HRV parameters were reliable. Test–retest reliability (Kendall’s τ) closely correlated to the absolute reliability measures using mean difference scores and coefficient of repeatability, over both easy and hard trials. Among the most reliable-time domain > frequency domain > Poincaré estimates. Among other non-linear

Acknowledgements

This study was supported by NIH U19 AT002656 and K24 AT005121. Roger Ellingson, M.S. provided software support for the heart rate variability data analysis and Ms. Alexandra Amen helped with arranging the references.

References (74)

  • M. Althaus et al.

    Influence of respiratory activity on the cardiac response pattern to mental effort

    Psychophysiology

    (1998)
  • I. Antelmi et al.

    Influence of age, gender, body mass index, and functional capacity on heart rate variability in a cohort of subjects without heart disease

    Am J Cardiol

    (2005)
  • G. Atkinson et al.

    Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine

    Sports Med

    (1998)
  • A.E. Aubert et al.

    Neurocardiology: the benefits of irregularity. The basics of methodology, physiology and current clinical applications

    Acta Cardiol

    (1999)
  • R. Balocchi et al.

    Revisiting the potential of time-domain indexes in short-term HRV analysis

    Biomed Tech (Berl)

    (2006)
  • F. Beckers et al.

    Approximate entropy of heart rate variability: validation of methods and application in heart failure

    Cardiovasc Eng

    (2001)
  • F. Beckers et al.

    Aging and non linear heart rate control in healthy population

    Am J Physiol Heart Circ Physiol

    (2006)
  • J.T. Bigger et al.

    Power law behavior of RR-interval variability in healthy middle-aged persons, patients with recent acute myocardial infarction, and patients with heart transplants

    Circulation

    (1996)
  • J.M. Bland et al.

    Measuring agreement in method comparison studies

    Stat Methods Med Res

    (1999)
  • J.M. Bland et al.

    Statistical methods for assessing agreement between two methods of clinical measurement

    Lancet

    (1986)
  • M. Bootsma et al.

    Heart rate variability during repeated incremental head-up tilt discloses time dependence of individual autonomic dynamics

    Clin Cardiol

    (1996)
  • J.C. Cervantes Blasquez et al.

    Heart-rate variability and precompetitive anxiety in swimmers

    Psicothema

    (2009)
  • K.L. Chang et al.

    Comparison and clinical application of frequency domain methods in analysis of neonatal heart rate time series

    Ann Biomed Eng

    (2001)
  • G.D. Clifford et al.

    Quantifying errors in spectral estimates of HRV due to beat replacement and resampling

    IEEE Trans Biomed Eng

    (2005)
  • G. D’Addio et al.

    Fractal behaviour of heart rate variability reflects severity in stroke patients

    Stud Health Technol Inform

    (2009)
  • M. De Rivecourt et al.

    Cardiovascular and eye activity measures as indices for momentary changes in mental effort during simulated flight

    Ergonomics

    (2008)
  • D.P. Francis et al.

    Physiological basis of fractal complexity properties of heart rate variability in man

    J Physiol

    (2002)
  • J. Gerritsen et al.

    Measures of cardiovascular autonomic nervous function: agreement, reproducibility, and reference values in middle age and elderly subjects

    Diabetologia

    (2003)
  • A. Gevins et al.

    High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice

    Cereb Cortex

    (1997)
  • J.J. González et al.

    Applications of fractal and non-linear time series analysis to the study of short-term cardiovascular control

    Curr Vasc Pharmacol

    (2004)
  • S. Guzzetti et al.

    Symbolic dynamics of heart rate variability: a probe to investigate cardiac autonomic modulation

    Circulation

    (2005)
  • L. He et al.

    Clinical prognostic significance of heart abnormality and heart rate variability in patients with stroke

    Neurol Res

    (2010)
  • Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology

    Circulation

    (1996)
  • A. Henelius et al.

    Mental workload classification using heart rate metrics

    Conf Proc IEEE Eng Med Biol Soc

    (2009)
  • M.J. Hennessy et al.

    Sudden withdrawal of carbamazepine increases cardiac sympathetic activity in sleep

    Neurology

    (2001)
  • Hogarty KY, Kromrey JD. Robust effect size estimates and meta-analysis tests of homogeneity. Proceedings of SAS users...
  • H.V. Huikuri et al.

    Fractal correlation properties of R–R interval dynamics and mortality in patients with depressed left ventricular function after an acute myocardial infarction

    Circulation

    (2000)
  • Cited by (91)

    • Reliability of short-term measurements of heart rate variability: Findings from a longitudinal study

      2020, Biological Psychology
      Citation Excerpt :

      Additionally, it is noteworthy that recent studies fall into three different categories (for an overview on experimental structures, see Laborde, Mosley, & Thayer, 2017; see also Thayer et al., 2012). That is, studies (1) investigated reliability of reactivity HRV (Cipryan & Litschmannova, 2013, 2014; Hallman et al., 2015; Kowalewski & Urban, 2004; Mukherjee, Yadav, Yung, Zajdel, & Oken, 2011), (2) baseline measurements (Dietrich et al., 2010; Kobayashi, 2009; Koskinen et al., 2009; Maestri et al., 2009; Pinna et al., 2007; Schroeder et al., 2004; Young & Leicht, 2011), (3) both reactivity and baseline HRV (Bertsch et al., 2012; Guijt, Sluiter, & Frings-Dresen, 2007). However, the effects of the experimental structure on test-retest-reliability are ambiguous (Bertsch et al., 2012; Guijt et al., 2007; Sandercock et al., 2005).

    View all citing articles on Scopus
    View full text