Skip to main content


Swipe om te navigeren naar een ander artikel

01-08-2011 | Original Article | Uitgave 7-8/2011 Open Access

Netherlands Heart Journal 7-8/2011

GRACE and TIMI risk scores but not stress imaging predict long-term cardiovascular follow-up in patients with chest pain after a rule-out protocol

Netherlands Heart Journal > Uitgave 7-8/2011
P. M. van der Zee, H. J. Verberne, J. H. Cornel, O. Kamp, F. M. van der Zant, R. Bholasingh, R. J. De Winter


Accurate risk stratification is vital in patients with complaints suggestive of myocardial ischaemia [1, 2]. Although ECG and cardiac biomarkers are low-cost tools for identification of high-risk patients in need of intensive medical treatment, these tests are hampered by lack of sensitivity and are therefore insufficient for identifying all patients at high risk [3]. Exercise testing is widely performed for diagnostic and prognostic information, but its additional value is limited [4], and the testing is unfeasible in patients with an uninterpretable ECG and in patients unable to exercise [5, 6]. Stress imaging, such as myocardial perfusion scintigraphy (MPS) or dobutamine stress echocardiography (DSE), may provide an alternative. Available studies on prediction models in acute chest pain patients have a limited follow-up [710]. Although reports on the long-term prognostic value of MPS and DSE are extensive, they are limited by the selection of primarily stable patients [1115]. In a previous prospective study, we reported an important and independent short-term prognostic value of DSE in acute chest pain patients with a normal or non-diagnostic ECG and negative cardiac necrosis markers [16]. The present study investigates the long-term prognostic value DSE and MPS in these patients, in comparison to available clinical risk scores.


We conducted a prospective, multicentre study in patients presenting at the emergency room with chest pain as described earlier [16]. Patients who presented at the emergency room within 6 h after onset of chest pain and who had a normal or non-diagnostic ECG were eligible for inclusion. Excluded were patients younger than 18 years, patients who were unable to give informed consent, and patients with any of the following conditions: atrial fibrillation, conduction disturbances (second or third degree atrial-ventricular block or new bundle branch block), severe uncontrolled hypertension (>180/120 mmHg) despite adequate therapy, severe heart failure, cardiomyopathy, status after resuscitation, serious non-cardiac disease (e.g. infection and neoplastic conditions), and pregnancy. The study was performed in accordance with the principles set out in the declaration of Helsinki and was approved by local ethics committees on human research. Patients remained under observation until at least 12 h after the onset of symptoms. Evaluation included careful history taking, physical examination, serial 12-lead ECGs, continuous rhythm monitoring, and serial cardiac troponin T measurements. Serial ECGs were recorded according to protocol directly on admission, after the administration of sublingual nitrates, and during any new episode of chest pain while the patient remained under observation and before discharge. Troponin T was measured at admission (i.e., within 6 h of chest pain) and at 12 h after the onset of chest pain. After ruling out an acute coronary syndrome by a negative serial cardiac troponin T (defined as peak value 0.03 μg/L at 6 and 12 h after the onset of symptoms) and by serial ECGs, the remaining patients underwent a two-dimensional echocardiography. In a post-hoc analysis, all enrolled patients received a clinical score using the Global Registry of Acute Coronary Events (GRACE) [7] and Thrombolysis In Myocardial Infarction (TIMI) for NSTEMI/unstable angina [10]. The full details of the design and methods of the GRACE and TIMI risk scores have been previously published (available at www.​outcomes-umassmed.​org/​grace and www.​timi.​org, respectively).

Dobutamine stress echocardiography or echocardiogram

The DSE was performed according to the current guidelines [5]: dobutamine was infused intravenously based on 3-minute stages of 10, 20, 30, and 40 μg/kg/min. Atropine (0.25 to 1 mg intravenously) was given if 85% of the age-predicted maximal heart rate was not reached (i.e., target heart rate) or if other endpoints were not reached at peak dobutamine dose. Endpoints included severe and/or extensive new wall motion abnormality, significant tachyarrhythmias, significant changes on the ECG, severe chest pain, significant increase or decrease in blood pressure (>240/120 mmHg or reduction of systolic pressure >40 mmHg), or any intolerable side effect. A beta-blocker was administered intravenously to reverse the side effects, if they did not revert spontaneously and quickly after stopping the dobutamine infusion. For purpose of analysis, the left ventricular wall was divided into 16 segments and scored using a four-point scale (1, normal; 2, hypokinetic; 3, akinetic; and 4, dyskinetic) according to current guidelines [17]. A positive DSE was defined as the occurrence of new wall motion abnormality in at least one segment and was indicative for myocardial ischaemia. Myocardial ischaemia was not considered if akinetic segments at rest became dyskinetic during stress [18]. The images of the DSE were compared off-line side by side in quad screen format by two experienced investigators without knowledge of the patients’ clinical data. In case of disagreement, a majority decision was achieved by a third investigator (JHC, OK, RB). The results were dichotomised as either positive or negative for ischaemia.

Myocardial perfusion scintigraphy

Myocardial perfusion scintigraphy (MPS) was performed in an outpatient setting at the physician’s discretion, according to the guidelines of the American Society of Nuclear Cardiology [19] using a 2-day stress/rest protocol. A dose of 500 MBq of technetium-99 m–tetrofosmin was administered at rest and at peak exercise. All patients were stressed with a bicycle ergometer with a starting workload of 50 W, increasing by 25 W every 2 min. Endpoints for exercise included achievement of ≥85% of age-predicted heart rate, recognisable chest pain, and >2-mm ST-segment depression [20]. All patients fasted both days, and antianginal medication was discontinued before the exercise test and restarted after exercise. Gated myocardial single-photon emission computed tomography was performed with the patient in a prone position.
Stress and rest perfusion images were scored in consensus by two experienced nuclear medicine physicians (HJV and FMvdZ) using a five-point semi-quantitative score for each of 17 myocardial segments. Perfusion defect severity was classified as normal (0), equivocally abnormal (1), mildly abnormal (2), moderately abnormal (3), or severely abnormal (4). Subsequently, summed stress score, summed rest score (SRS), and the difference between those scores (summed difference score, SDS) were calculated. SDS ≥ 3 was considered to indicate myocardial ischaemia. A fixed defect was defined as a SRS score of ≥3. Mixed defects, partly reversible (SDS ≥ 3) and partly fixed, were analysed as reversible. The results were dichotomised as either positive or negative for ischaemia and either as normal (no perfusion abnormalities) or abnormal (combined ischaemia and fixed defects). Assessment was performed blinded to patient data.

Analysis of troponin T

Troponin T levels were determined with an enzyme-linked immunosorbent assay method on an Elecsys 300 analyser (Roche Diagnostics, Almere, the Netherlands) using a third-generation assay. A positive result was defined as a level ≥0.03 μg/L, on admission or at 12 h after onset of symptoms.


Endpoint of the study was cardiovascular mortality, defined as myocardial infarction, life-threatening arrhythmia, or pulmonary oedema (based on clinical assessment, cardiac isoenzymes, ECG, or autopsy), or cerebrovascular accident. Unexpected death without an identified non-cardiac cause was also classified as cardiovascular death. Information on mortality was obtained from the National Registry on Mortality. For cause of death, the patients’ general practitioners were contacted, and letters from hospital files were obtained, if necessary. Follow-up was complete for 96% (95% for rule-out ACS patients and 98% for ACS patients). Median follow-up was 9.4 years (8.9–10.0 years) [9.4 years (8.9–10.0 years) for rule-out ACS patients and 9.2 years (8.9–9.9 years) for ACS patients].

Statistical analysis

Continuous variables were expressed as mean ± SD when normally distributed, and median (interquartile range) if otherwise, and were compared using student’s T-test and Mann–Whitney-U test, respectively. Categorical variables were presented as frequencies, and compared using the chi-square test. Clinical variables were dichotomised with prospectively defined, clinically relevant cut-off points to improve readability of the data. Univariate and multivariate backward conditional Cox proportional hazard model was used to evaluate the associations between the outcome measures (primary endpoint: time to death). The variables incorporated into the GRACE and TIMI risk scores were excluded from the multivariate analysis. To estimate the discriminative value of Grace and TIMI risk scores, we calculated the C-statistic (area under the receiver operating characteristic curve). Survival analysis was performed with the Kaplan–Meier method and the log-rank test was used for comparisons of curves. The SPSS statistical package (SPSS PASW 18.0 for Windows, SPSS Inc., Chicago, Illinois) was used for analysis.


The study comprised a total of 557 patients who gave informed consent. Thirty-three patients had serious non-cardiac or cardiac diagnoses other than ACS. In the remaining 524 patients, 145 were diagnosed with ACS (positive serial troponin T ≥ 0.03 μg/L, recurrent angina and/or dynamic ECG changes during the observation period). These patients were defined as high-risk patients. The remaining 379 patients with ACS ruled out were discharged early, i.e. after the observation period. In these rule-out ACS patients, DSE was performed. Of these, 350 had an interpretable DSE. MPS was performed in 52 patients.
Table 1 shows the baseline characteristics of the entire cohort of chest pain patients presenting at the emergency room with a normal or non-diagnostic ECG. ACS patients were older and more often had a history of coronary artery disease. The use of beta-blockers and calcium antagonists was more prevalent in ACS patients whereas rule-out ACS patients more often had a normal ECG. DSE was positive in 23 rule-out ACS patients (7% of 350 interpretable DSE). MPS was abnormal in 8 patients (15% of 52 MPS performed), and showed myocardial ischaemia in 4 patients (7% of 52 MPS performed). The GRACE risk score was low in both groups (75 (57–96) in rule-out ACS vs. 75 (57–96) in ACS patients, as well as TIMI risk scores (1 (0–2) vs. 2 (1–3) (median, (25th, 75th percentiles)), respectively. Both GRACE and TIMI risk scores were significantly higher in ACS patients.
Table 1
Baseline characteristics according to stratum
Rule-out ACS (n = 379)
ACS (n = 145)
Age (years) mean ± SD
56 ± 12
62 ± 11
220 (58)
97 (67)
Diabetes mellitus
36 (10)
20 (14)
145 (38)
61 (42)
Current cigarette smoking
141 (37)
44 (30)
133 (35)
50 (35)
Family history of CAD
193 (51)
66 (46)
Documented CADa
80 (21)
43 (30)
Previous myocardial infarction
59 (16)
26 (18)
History of chronic heart failure
2 (1)
3 (2)
Peripheral artery disease
50 (13)
20 (14)
22 (6)
9 (6)
Medication on admission
123 (33)
59 (41)
104 (27)
59 (41)
Calcium antagonist
56 (15)
35 (24)
ACE inhibitor
43 (11)
20 (14)
65 (17)
27 (19)
Baseline ECG category
228 (60)
56 (39)
Cardiac imaging results
Positive DES
23/350 (7%)
Abnormal MPS
8/52 (15%)
Reversible perfusion defects on MPS
4/52 (7%)
GRACE risk score (25th, 75th percentiles)
75 (57–96)
89 (74–107)
TIMI risk score (25th, 75th percentiles)
1 (0–2)
2 (1–3)
aDocumented CAD defined as prior acute myocardial infarction, revascularisation, or documented coronary artery stenosis ≥ 50%) on coronary angiogram. ACE = angiotensin-converting enzyme; ACS = acute coronary syndrome; CAD = coronary artery disease, CVA = cerebrovascular accident; DSE dobutamine stress echocardiography =; MPS = Myocardial perfusion scintigraphy, TIA = transient ischaemic attack
During follow-up, death occurred in 78 patients (15%), 43 (11%) in the rule-out ACS group and 35 (24%) in the ACS group (p < 0.001). Causes of death are displayed in Table 2. Of all deceased patients, 45 (58%) had a cardiovascular cause of death. In the rule-out ACS group, 21 patients (49% of deaths in this group) died of a cardiovascular cause compared with 24 (69%) in the ACS group (p < 0.001).
Table 2
Cause of death according to risk group
Overall (n = 524)
Rule-out ACS (n = 379)
ACS (n = 145)
9.4 (8.9–10.0)
9.4 (8.9–10.0)
9.2 (8.9–9.9)
Death (all-cause)
78 (15%)
43 (11%)
35 (24%)
6.1 (2.5–7.6)
6.1 (2.5–7.7)
6.0 (2.5–7.6)
Cardiovascular death
45 (58%)
21 (49%)
24 (69%)
- Sudden unexpected death
- Acute myocardial infarction
- Heart failure
- Acute abdominal aortic aneurysm
- Unknown
ACS = acute coronary syndrome; CVA = cerebrovascular accident
The GRACE and TIMI risk scores demonstrated a very good discrimination for long-term cardiovascular mortality. For rule-out ACS patients, C-statistics were 0.829 and 0.803, and for ACS patient C-statistics were 0.807 and 0.715 for the GRACE and TIMI scores, respectively.
Table 3 shows the results of the univariate and multivariate Cox regression analysis for cardiovascular mortality of clinical parameters and cardiac imaging. An age above 65 years, documented coronary artery disease, a previous myocardial infarction, history of chronic heart failure, transient ischaemic attack or cerebrovascular accident, aspirin and ACE inhibitor use, an abnormal baseline electrocardiogram as well as GRACE and TIMI score were predictors of cardiovascular mortality. None of the patients with an MPS suggestive of myocardial ischaemia (n = 4) or abnormal MPS (n = 8) had cardiovascular mortality during follow-up. A positive DSE was not identified as a prognostic marker for cardiovascular mortality. In multivariate analysis, known chronic heart failure, ACE inhibitor use, and GRACE score were independent predictors of cardiovascular mortality. Figure 1 shows the Kaplan Meier curves stratified by GRACE risk score categorisation of patients for non–ST-segment elevation ACS. In patients with intermediate (109 to 140) and high (141 to 372) GRACE risk scores, cardiovascular mortality (75% and 23% respectively) was notably higher than in the low GRACE risk scores (1 to 108) rule-out ACS patients (2%).
Table 3
Univariate and multivariate Cox regression analysis for cardiovascular mortality of clinical parameters and cardiac imaging in rule-out ACS patients
Univariate analysis
Multivariate analysis
Point estimate
Point estimate
Age > 65 years
14.61 (4.91–43.45)
0.65 (0.28–1.55)
Diabetes mellitus
2.55 (0.86–7.58)
1.50 (0.64–3.53)
Current cigarette smoking
1.34 (0.85–2.11)
0.91 (0.370–2.26)
Family history of CAD
0.92 (0.39–2.15)
Documented CADa
5.24 (2.21–12.44)
Previous myocardial infarction
5.22 (2.21–12.29)
Known chronic heart failure
14.63 (1.96–109.43)
10.41 (1.17–92.37)
Peripheral artery disease
1.68 (0.56–4.99)
4.14 (1.39–12.32)
Aspirin use
3.60 (1.49–8.67)
Beta-blocker use
1.34 (0.54–3.32)
Calcium antagonist use
4.55 (1.92–10.80)
ACE inhibitor use
4.50 (1.82–11.16)
4.38 (1.70–11.29)
Statin use
0.23 (0.03–1.68)
Normal baseline ECG
0.15 (0.05–0.44)
Cardiac imaging results
Positive DSE
0.64 (0.09–4.75)
Abnormal MPS
Reversible perfusion defects on MPS
GRACE risk scoreb
6.82 (3.88–11.99)
7.41 (4.05–13.57)
TIMI risk score c
4.88 (2.07–11.49)
aDocumented CAD defined as prior acute myocardial infarction, revascularisation, or documented coronary artery stenosis ≥ 50%) on coronary angiogram. ACE = angiotensin-converting enzyme; ACS = acute coronary syndrome; CAD = coronary artery disease, CVA = cerebrovascular accident; DSE = dobutamine stress echocardiography; MPS = Myocardial perfusion scintigraphy, TIA = transient ischaemic attack
b according to GRACE risk score categorisation of patients for non–ST-segment elevation ACS: low (1–108), intermediate (109–140), and high (141–372) risk
c according to TIMI risk score categorisation for unstable angina/NSTEMI, low (0–2), intermediate (3–4), and high (5–7) risk


In our rule-out ACS population of chest pain patients with a normal or non-diagnostic electrocardiogram, long-term cardiovascular mortality during a 9-year follow-up was low (6%), and comparable to previous studies on chest pain patients without ST elevation on ECG [79]. The long-term cardiovascular prognosis of patients with a positive DSE or reversible or irreversible defects on MPS was as good as the prognosis of patients with normal DSE or MPS. However, GRACE and TIMI risk scores had predictive values with C-statistics comparable to the values found in the ACS populations for which they were designed [21, 22], but this is the first study, to our knowledge, to show a long-term value for these scoring systems in a rule-out ACS population.
Previous studies have shown a predictive value of DSE for cardiac adverse events [11, 12]. However, these studies involved single-centre experiences in very heterogeneous populations of consecutive patients undergoing DSE. Moreover, these studies did not evaluate cardiovascular mortality as a separate event. In another study by Steinberg [13], DSE was predictive for cardiovascular mortality, but the population consisted of patients referred for coronary angiography with mortality rates twice as high as in our study. In an emergency department setting of patients with suspected myocardial infarction, MPS was predictive for cardiac mortality, but again the cardiac mortality rate was more than twice as high as the cardiovascular mortality in our study [23]. The absence of a predictive value for DSE and MPS in our study might thus be related to the selection of patients with an already apparent low risk of cardiovascular mortality.
There are several limitations to our study. First, we only studied cardiovascular mortality with no secondary endpoints such as myocardial infarction and revascularisation. In a previous study, we have shown the strong and independent short-term predictive value of DSE for these endpoints in our populations [24]. However, for long-term risk stratification, mortality endpoints are more relevant as shown by a continuation of the survival curve [13], in contrast to converging and flattening curves of combined endpoints [11, 15].
Second, MPS was only performed in a very small subset of the population. Nonetheless, with an equally low cardiovascular mortality rate (4%, data not shown), this subset is comparable to the entire rule-out ACS cohort.
In conclusion, imaging for inducible myocardial ischaemia by DSE and MPS does not predict long-term cardiovascular mortality in chest pain patients with a normal or non-diagnostic electrocardiogram after ruling out ACS. The TIMI and GRACE scores, however, are accurate predictors in these patients with low long-term cardiovascular mortality.

Competing interests


Ethics approval

Approval from the ethics committees at each of the recruiting sites was obtained and patients’ consents were received.
Funding for this work was provided by the Netherlands Heart Foundation (grant NHS 96.172).

Open Access

This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Open AccessThis is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://​creativecommons.​org/​licenses/​by-nc/​2.​0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Onze productaanbevelingen

Netherlands Heart Journal

Het Netherlands Heart Journal wordt uitgegeven in samenwerking met de Nederlandse Vereniging voor Cardiologie en de Nederlandse Hartstichting. Het tijdschrift is Engelstalig en wordt gratis beschikbaa ...

Over dit artikel

Andere artikelen Uitgave 7-8/2011

Netherlands Heart Journal 7-8/2011 Naar de uitgave