ArticlePDF Available

Non-Response Bias in a Study of Cardiovascular Diseases, Functional Status and Self-Rated Health among Elderly Men

Authors:

Abstract and Figures

To investigate to what extent differences in health status between respondents and drop-outs affected the associations between cardiovascular diseases and functional status and self-rated health in a population-based longitudinal health survey in elderly men. During the 1993 survey of the Zutphen Elderly Study, a non-response survey was carried out. The prevalence of myocardial infarction and stroke, disabilities in basic activities of daily living (BADL) and mobility, and self-rated health were compared between non-respondents (n = 99) and respondents (n = 381). Associations between myocardial infarction and stroke on the one hand and functional status and self-rated health on the other were calculated for the total population and for the respondents to assess the amount of under- or overestimation of these associations. The health of non-respondents was worse than that of respondents in terms of stroke, disabilities in BADL and mobility and self-rated health. Due to this selective non-response, the associations between cardiovascular diseases and functional status and self-rated health were biased. Although most of the associations were slightly overestimated, the most important bias was the underestimation by 57% of the association between stroke and disabilities in BADL [total population: odds ratios (OR) = 6.1, 95% confidence interval (CI) = 2.7-13.9; respondents only: OR = 2.6, CI = 0.7-9.9]. Selective non-response might lead to bias in the prevalence of disease, disabilities and self-rated health as well as in the associations between disease and functional status and self-rated health. The direction and magnitude of this bias varies according to type of disease and health outcome and is therefore difficult to predict. The need to minimize non-response and to investigate its implications is recommended in every study.
Content may be subject to copyright.
Age and
Ageing
1998; 27: 35-40
Non-response bias in a study of
cardiovascular diseases, functional
status and self-rated health among
elderly men
NANCY
HOEYMANS12, EDITH J. M. FESKENS1, GEERTRUDIS A. M. VAN DEN BOS2, DAAN KROMHOUT1
'Department of Chronic Diseases and Environmental Epidemiology, National Institute of Public Health and the
Environment, PO Box 1, 3720 BA Bilthoven, The Netherlands
institute of Social Medicine, Academic Medical Centre, University of Amsterdam, Meibergdreef 15, I 105 AZ Amsterdam,
The Netherlands
Address correspondence to: N. Hoeymans. Fax: (+31) 30 2744450. E-mail: Nancy.Hoeymans@rivm.nl
Abstract
Objectives: to investigate to what extent differences in health status between respondents and drop-outs affected
the associations between cardiovascular diseases and functional status and self-rated health in a population-based
longitudinal health survey in elderly men.
Methods: during the 1993 survey of the Zutphen Elderly Study, a non-response survey was carried out. The
prevalence of myocardial infarction and stroke, disabilities in basic activities of daily living
(BADL)
and mobility, and
self-rated health were compared between non-respondents (n = 99) and respondents (n - 381). Associations
between myocardial infarction and stroke on the one hand and functional status and self-rated health on the other
were calculated for the total population and for the respondents to assess the amount of under- or overestimation of
these associations.
Results: the health of non-respondents was worse than that of respondents in terms of
stroke,
disabilities in
BADL
and mobility and self-rated health. Due to this selective non-response, the associations between cardiovascular
diseases and functional status and self-rated health were biased. Although most of the associations were slightly
overestimated, the most important bias was the underestimation by 57% of the association between stroke and
disabilities in
BADL
[total population: odds ratios (OR) =
6.1, 95%
confidence interval (CI) = 2.7-13-9; respondents
only: OR = 2.6, CI = 0.7-99].
Conclusion: selective non-response might lead to bias in the prevalence of disease, disabilities and self-rated
health as well as in the associations between disease and functional status and self-rated health. The direction
and magnitude of this bias varies according to type of disease and health outcome and is therefore difficult
to predict. The need to minimize non-response and to investigate its implications is recommended in every
study.
Keywords: functional status, non-respondents, myocardial infarction, stroke, study design
Introduction
In elderly people, cardiovascular diseases are an
important cause of diminished functional status and
well-being [
1
-
5].
However, studies on health outcomes
of cardiovascular diseases may be biased due to
selective non-response or drop-out. Many studies in
elderly populations have reported that the health status
of non-respondents is less than that of respondents
[6-10],
although examples of the opposite are also
found [11]. Furthermore, follow-up studies have
observed higher morbidity and mortality rates among
non-respondents than among respondents [12-14].
Non-response may lead to bias not only in prevalence
estimates of
diseases
and adverse health outcomes, but
also in the associations between diseases and health
outcomes [9, 13, 15, 16].
The Zutphen Elderly Study is a longitudinal study on
35
by guest on July 16, 2011ageing.oxfordjournals.orgDownloaded from
N. Hoeymans et al.
life-style, chronic diseases and health
and was
started in
1985.
A non-response survey was carried out during
the follow-up survey in 1993 to quantify possible bias
in measures of health status due to drop-out. The aim of
our study was to investigate to what extent differences
in health status between respondents and drop-outs
affected the association between myocardial infarction
and stroke on one hand and functional status and
self-
rated health on the other.
Methods
Study population
The Zutphen Elderly Study [17] was started in 1985 as a
continuation of the Zutphen Study [18], a longitudinal
population-based cardiovascular health study among
men born between 1900 and 1920 and living in the
town of Zutphen. In 1985, all survivors of the original
cohort and a random sample of all other men in the
same age range living in Zutphen were recruited. This
resulted in a target population of 1266 men, of whom
939 (74%) participated. This group formed the cohort
of the Zutphen Elderly Study. For the follow-up survey
of 1993, all 548 survivors of this cohort were
contacted. They received a letter in which the study
was explained and a response note in which they could
indicate whether they were willing to participate. A
reminder and a phone contact followed this initial
letter in order to reach as many men as possible. In
Spring 1993, the 390 men (71%) who indicated they
were willing to participate received a questionnaire by
mail and were visited 1 week later by one of our
research assistants to check the questionnaire for
inconsistencies or missing items and to carry out a
test for cognitive and one for physical function. The
questionnaire could also be completed by a relative or
caregiver.
In June 1993 those who indicated they did not want
to participate or who had not responded (n = 158)
received a very short questionnaire which they or a
relative or caregiver were asked to complete and send
back. In the accompanying letter it was explained that
it was important to have some information from non-
participants. When no reply was received after 2
weeks, non-respondents were interviewed by tele-
phone or visited at home.
Non-respondents who did not participate in the non-
response survey (n - 50) did not differ appreciably
from participants in the non-response survey (n
=
108)
as regards age, socio-economic status and baseline
health status. Regarding current health status, the
prevalence of myocardial infarction and stroke was
lower among these non-respondents than among the
participating non-respondents (myocardial infarction
14%,
stroke 4%). No information on functional status
and self-rated health was available for
this
group.
In this
report the term 'non-respondent' refers to participants
in the 1993 non-response survey. Complete data on
cardiovascular diseases, functional status and self-rated
health were available for
381
respondents and 99 non-
respondents.
Measurements
Questions on marital status, history of cardiovascular
diseases, functional status and self-rated health were
identical in the survey and in the non-response
questionnaire. Data on socio-economic status were
based on the 1985 survey. Socio-economic status was
recorded by life-long occupation in four levels: profes-
sionals, managers and teachers, small-business owners,
non-manual workers and manual workers. Marital
status was recorded in four categories: married, never
married, divorced and widowed.
Information on the prevalence of myocardial infarc-
tion and stroke was obtained from the (non-response)
questionnaire and verified with hospital discharge data
and written information from general practitioners. For
definite myocardial infarction the final diagnosis was
based on whether two of the following three criteria
were met: a specified medical history, i.e. severe chest
pain lasting for more than 20 min and not disappearing
in rest, characteristic electrocardiogram changes and
specific enzyme elevations. Stroke was denned as a
sudden onset of neurological paralysis lasting longer
than 24 h.
Functional status was measured as disabilities in
daily routine activities. The questionnaire we used
was adapted from the 11 countries study [19] and
described in detail in a previous publication [20]. In
short, the questionnaire consisted of 13 items each
mentioning one basic activity of daily living (BADL),
mobility or instrumental activity of daily living (IADL)
item. Participants who reported that they needed help
with at least one of the following activities: feeding
oneself,
getting in and out of bed, using the lavatory,
dressing and undressing, washing and bathing oneself
and walking between rooms were classified as
disabled in BADL. Respondents who stated that they
needed help with moving outdoors, using stairs,
walking at least 400 m or carrying a heavy object
for 100 m were classified as being disabled in mobility.
IADL disability was not taken into account in this
study.
Self-rated health was measured with a single-item
question: "We would like to know what you think
about your health. Please check what fits best in your
case.
Do you feel healthy, rather healthy, moderately
healthy or not healthy?" The value of this measure as a
predictor of mortality was shown in a previous study
[21].
For the logistic analyses, self-rated health was
dichotomized into good health (healthy or rather
healthy) and poor health (moderately healthy or not
healthy).
36
by guest on July 16, 2011ageing.oxfordjournals.orgDownloaded from
Non-response bias
Statistical analyses
Statistical analyses were carried out using
SAS,
version
6.11.
All tests were two-tailed and a /"-value of 0.05 or
lower was considered to be statistically significant.
Non-respondents were compared with respondents on
the demographic characteristics of age, marital status
and socio-economic status and on the health status
indicators prevalence of myocardial infarction and
stroke, disabilities in BADL and mobility and self-rated
health. Student
f-tests
for independent observations
were used for comparing means of continuous
variables and \2 tests for comparing prevalences.
Associations between myocardial infarction and
stroke on one hand and functional status and
self-
rated health on the other hand were analysed for the
total population and for the respondents only. The
prevalences of disabilities and poor self-rated health
among men with and without the disease were
assessed, adjusted for age. Age-adjusted odds ratios
(ORs) were calculated from logistic regression models.
We
assessed the under- or overestimation in the impact
of the diseases on functional status and self-rated health
that was due to non-response.
Results
Of the 158 non-respondents, 108 (68.4%) participated
in the non-response survey. The questionnaire was
returned by mail by 81 men, completed by telephone
by 10 and completed during a home visit by 17. Four
men were not approached, because they had stated
after the previous follow-up that they no longer wanted
to be contacted. The remaining non-respondents
refused to participate (n = 29) or could not be reached
in = 17).
Non-respondents and respondents did not differ
significantly in age and marital status (Table 1). The
socio-economic status of non-respondents was lower
than that of respondents. The health status was worse
among non-respondents than among respondents. This
was statistically significant for all health indicators,
except for
a
history of myocardial infarction. Adjustment
for
age,
marital status and socio-economic status did
not alter these differences.
Almost one-quarter (23.2%) of the non-response
questionnaires were completed by proxies, compared
with less than 5% in the response group (Table 2).
Table I. Demographic and health characteristics of respondents and non-respondents: Zutphen Elderly
Study,
1993
Mean age (SD)
Marital status (%)
Married
Never married
Divorced
Widowed
Socio-economic status
(%)"
Professionals, managers, teachers
Small business owners
Non-manual workers
Manual workers
Prevalence of chronic diseases (%)
Myocardial infarctionb
Stroke0
Functional status (% disabled)
Activities of daily living
Mobility
Self-rated health (%)
Healthy
Rather healthy
Moderately healthy
Not healthy
Respondents
in
=
381)
77.8 i4.4)
71.9
1.8
2.4
23.9
30.8
18.1
26.9
24.2
13.6
5.5
5.8
20.2
43.3
45.1
8.7
2.9
Non-respondents
in
=
99)
78.4 (5.2)
72.7
6.1
2.0
192
14.4
23.3
32.2
30.0
17.2
13.1
21.2
51.5
31.3
38.4
16.2
14.1
P-value
0.26
0.11
0.02
0.37
0.01
0.001
0.001
0.001
"Data on socio-economic status were available for only 364 respondents and 90 non-respondents.
"The
prevalence of myocardial infarction was
also
known on those non-respondents who did not
fill
out the non-response questionnaire (n
=
50).
The prevalence of myocardial infarction for the total group of non-respondents was 16.1.
cThe prevalence of stroke was also known on those non-respondents who did not fill out the non-response questionnaire (n = 50). The
prevalence of stroke for the total group of non-respondents was 10.1. This was still significantly different from the prevalence among
respondents
(P =
0.05).
37
by guest on July 16, 2011ageing.oxfordjournals.orgDownloaded from
N. Hoeymans et al.
Table 2. Self-rated health and functional status of respondents and non-respondents, classified as direct (non-)
respondents and proxies: Zutphen Elderly Study, 1993
Self-rated health
Healthy
Rather healthy
Moderately healthy
Not healthy
Functional status
Disabled in BADL
Disabled in mobility
No.
(and %) of subjects
Respondents
Direct
(n
=
364)
159 (43.7)
164(45.1)
31 (8.5)
10 (2.7)
19 (5.2)
66(18.1)
Proxies
= 17)
6 (35.3)
8 (47.1)
2(11.8)
1 (5.9)
3 (17.6)
11(64.7)
Non-respondents
Direct
(» = 76)
26 (34.2/
32(42.1)
9(11.8)
9(11.8)
8 (10.5)b
31 (40.8)a
Proxies
(n = 23)
5 (21.7)
6 (26.1)
7 (30.4)
5 (21.7)
13 (56.5)
20 (87.0)
BADL, basic activities of
daily
living.
"Significantly different from direct respondents, P
<
0.01.
""Borderline significantly different from direct respondents, P
=
0.08.
Proxies reported significantly worse health ratings and
functional status than the group of men who com-
pleted the questionnaire themselves. However, direct
non-respondents still differed significantly from direct
respondents in self-rated health and mobility and the
difference in proportion of men limited in
BADL was
of
borderline significance.
The impact of myocardial infarction on BADL
disabilities was not statistically significant, for respon-
dents or for the total population (Table 3). However,
men with a history of myocardial infarction had a
higher risk of disabilities in mobility [OR = 1.8; 95%
confidence interval (CD =
1.0-3.2]
and poor self-rated
health (OR
=
1.9;
95%
CI =
1.0-35).
Both effects were
slightly overestimated when only respondents were
considered. Stroke patients reported more disabilities
in
BADL
and mobility than men who had no history of
stroke
(BADL:
OR = 6.1; 95% CI = 2.7-139, mobility:
OR = 39; 95% CI =
1.9-8.3).
The non-responding
stroke patients, however, reported more disabilities
Table
3.
Age-adjusted associations [odds ratios
(OR)]
of a history of myocardial infarction and stroke with disabilities
and self-rated health, for respondents only and for the total
group,
and
%
over-
or under estimation in
OR
due to non-
response (OR error): Zutphen Elderly Study, 1993
Myocardial infarction
No.
of subjects
%
disabled/in poor health
Disabled in BADL
Disabled in mobility
Poor self-rated health
Stroke
No.
of subjects
%
disabled/in poor health
Disabled in BADL
Disabled in mobility
Poor self-rated health
Total
With
69
11.6
34.8
23.2
34
32.4
55.9
41.2
population
without
411
8.5
25.3
14.1
446
7.2
24.4
13.5
(n =
OR
1.6
1.8
1.9
6.1
3.9
4.5
480)
(95%
CI)
(0.7-3.6)
(1.0-3.2)
(1.0-3.5)
(2.7-13.9)
(1.9-8.3)
(2.1-9.3)
Respondents (n =
With
52
9.6
30.8
21.2
21
14.3
42.9
38.1
Without
329
5.2
18.5
10.0
360
5.3
18.9
10.0
381)
OR
2.1
2.2
2.4
2.6
3.0
5.5
(95%
CD
(0.7-6.2)
(11-4.3)
(11-5.2)
(0.7-9.9)
(1.2-7.8)
(2.1-14.3)
%
OR error*
31
22
26
-57
-23
27
BADL, basic activities of daily lMng.
*%
over- or under-estimation in OR due to non-response = (OR for response group-OR for total populationVOR for total population.
38
by guest on July 16, 2011ageing.oxfordjournals.orgDownloaded from
Non-response bias
than responding stroke patients, leading to a substan-
tial underestimation of the impact of stroke on
disabilities in BADL (57%) and to a lesser extent of
the impact on disabilities in mobility
(23%).
In contrast,
the impact of stroke on self-rated health (OR
=
4.5;
95%
CI = 2.1-9-3) was overestimated. All results were
adjusted for age. Additional adjustments for socio-
economic status and marital status did not change
these results.
Discussion
Non-respondents of the 1993 follow-up survey of the
Zutphen Elderly Study had a poorer health status than
respondents regarding the prevalence of stroke,
functional status and self-rated health. These differ-
ences led to a small overestimation of the risk of
disabilities and poor self-rated health for those with a
history of myocardial infarction and of the risk of poor
self-rated health for those who suffered a stroke. The
association between stroke and disabilities in activities
of daily living, however, was underestimated by 57%
because of non-response of the most severely disabled
stroke patients.
Differences in health status between respondents
and non-respondents, especially in self-rated health and
functional status, could have been because about one-
quarter of the non-response questionnaires were
completed by a proxy: spouse, child, caregiver etc.
Besides the probability that those who had proxies to
complete the questionnaire were really in a worse
health state, it has also been shown that health status
assessed by proxies gives a systematic underestimation
of the health status of the respondent [22-24].
Therefore, we also compared direct non-respondents
and respondents. Differences in self-rated health and
mobility between direct non-respondents and respon-
dents were smaller than between all non-respondents
and respondents, but remained statistically significant.
The finding that the difference in proportion of men
with BADL disabilities became borderline significant
could be due to the small number of men with
disabilities in BADL. Bias due to proxy measurements
cannot therefore fully explain the differences between
respondents and non-respondents.
Most of the non-response questionnaires were sent
back by mail
(75%).
The answers in the telephone and
face-to-race interviews might suffer from bias, due to
social desirability considerations in responding. How-
ever, additional analyses showed that health status did
not differ between these non-respondents and the non-
respondents who completed the questionnaire them-
selves. Based on these results we assume that our
results were not biased by this factor.
In our study, men with a history of myocardial
infarction did not report significantly more BADL
disabilities than men who did not suffer a myocardial
infarction, but they did report more disabilities in
mobility. Men with a history of stroke reported more
disabilities in BADL and mobility than men with no
such history. These results seem consistent with other
studies. Several studies have shown that stroke has a
strong negative impact on functional status [2-5, 25-
27].
Heart disease is found to have an impact on BADL
disabilities in some studies [25-28], but not in all [2].
Findings on the impact of cardiovascular diseases
on self-rated health are less consistent. Mulrow and
co-workers reported no significant effects of cardio-
vascular diseases on perceived health [2]. However, as
in our study, Stewart and colleagues observed signifi-
cantly worse health perceptions in those with a history
of myocardial infarction than in those without such a
history [1].
Non-response bias in these associations between
cardiovascular diseases and disabilities and self-rated
health was found. We expected that mainly the
healthiest myocardial infarction and stroke patients
would participate, leading to a systematic under-
estimation of the associations between these diseases
and health outcomes. However, this was only observed
for stroke and disabilities in BADL. The remaining
associations were biased in a different direction, albeit
to a lesser extent. The impact of myocardial infarction
on disabilities and poor self-rated health was slightly
overestimated,
as
was the impact of stroke on poor
self-
rated health. The finding that non-response bias
depended on type of disease was also reported by
Launer and co-workers [9], who found a biased OR of
stroke and diabetes on poor cognitive performance
due to non-response. Stroke patients with poor
cognitive function tended to participate more than
stroke patients with high performance, while diabetes
patients with poor cognitive performance tended to
refuse to participate.
Selective non-response might lead to bias in the
impact of cardiovascular diseases on functional
status and self-rated health. This bias can vary
according to type of disease and health outcome.
This study clearly shows the need for minimizing
non-response or drop-out and the need for research
on the implications of non-response in all studies.
Possible efforts that can be taken to minimize non-
response or drop-out are to emphasize the import-
ance of the participation of each individual in
the study, whether extremely healthy, extremely
unhealthy or anything between. It is also important
to underline the possibility that the questionnaire
can be completed by a proxy. Finally, a compensation
for participation in the study might lead to higher
response rates.
Acknowledgements
The Zutphen Elderly Study was financially supported
by the Netherlands Prevention Foundation, the Hague
39
by guest on July 16, 2011ageing.oxfordjournals.orgDownloaded from
... Studies from other areas within medicine, such as osteoporosis [13], have shown poorer health status, lower socioeconomic status, increased cognitive impairment, higher mortality rates and higher cancer rates in non-included vs. included patients [9,12,14,15]. Thus, the actual study sample may differ from the intended population. ...
... Although several baseline characteristics were similar between included and non-included patients, some parameters indicated lower health status in non-included patients, such as higher ASA score, higher prevalence of heart disease and higher need for resident aids. These results from DelPhi are in line with previous reports on non-included patients from other disease areas, such as osteoporosis [13], which also reported lower health status in non-included patients [9,12,14,15]. Some of these studies also reported lower socioeconomic status, increased cognitive impairment, higher mortality rates and higher cancer rates in non-included patients [9,12,14,15]. ...
... These results from DelPhi are in line with previous reports on non-included patients from other disease areas, such as osteoporosis [13], which also reported lower health status in non-included patients [9,12,14,15]. Some of these studies also reported lower socioeconomic status, increased cognitive impairment, higher mortality rates and higher cancer rates in non-included patients [9,12,14,15]. Despite some studies not reporting such differences [19,20], it is reasonable to claim that, in general, non-included patients have lower health status compared to included patients in clinical RCTs. ...
Article
Full-text available
Background Randomized controlled trials (RCT) are regarded as the gold standard for effect evaluation in clinical interventions. However, RCTs may not produce relevant results to all patient groups. We aimed to assess the external validity of a multicenter RCT (DelPhi trial). Methods The DelPhi RCT investigated whether elderly patients with displaced proximal humeral fractures (PHFs) receiving reversed total shoulder prosthetic replacement (RTSA) gained better functional outcomes compared to open reduction and internal fixation (ORIF) using an proximal humerus locking plate (PHILOS). Eligible patients were between 65 and 85 years old with severely displaced 11-B2 or 11-C2 fractures (AO/OTA-classification, 2007). We compared baseline and follow-up data of patients for two of the seven hospitals that were included in the DelPhi trial ( n = 54) with non-included patients ( n = 69). Comparisons were made based on reviewing medical records regarding demographic, health and fracture parameters. Results Forty-four percent of the eligible patients were included in the DelPhi trial. Comparing included and non-included patients indicated higher incidences of serious heart disease ( P = 0.044) and a tendency toward higher tobacco intake ( P = 0.067) in non-included patients. Furthermore, non-included patients were older ( P = 0.040) and had higher ASA classification ( P < 0.001) and were in more need for resident aid (in-home assistance) ( P = 0.022) than included patients. The cause of PHF was more frequently related to fall indoors in non-included vs. included patients ( P = 0.018) and non-included patients were more prone to other concomitant fractures ( P = 0.004). Having concomitant fractures was associated with osteoporosis ( P = 0.014). We observed no significant differences in rates of complications or deaths between included and non-included patients within 3 months after treatment. In descending order, non-included patients were treated conservatively, with PHILOS, RTSA, anatomic hemi-prothesis or an alternative type of ORIF. RTSA was the preferred treatment choice for C2-type fractures ( P < 0.001). Conclusions Results from the DelPhi RCT may not directly apply to older PHFs patients with lower health status or concomitant fractures. Level of evidence Level 4.
... It is particularly important to examine the effect of attrition when the sample is selected on the variable of interest or other characteristics correlated with the dependent variable (Deng, Hillygus, Reiter, Si, & Zheng, 2013;Goodman & Blum, 1996). The effect of attrition on study results is particularly apparent in health studies, where the outcome variable, health status, is a known determinant of attrition from the sample (Ahern & Le Brocque, 2005;Desmond, Bagiella, Moroney, & Stern, 1998;Graaf, Bijl, Smit, Ravelli, & Vollebergh, 2000;Hoeymans et al., 1998;Levin, Katzen, Klein, & Llabre, 2000;Michaud, Kapteyn, Smith, & Van Soest, 2011). Health status is a determinant of all the sources of attrition: failure to locate, refusal to participate, morbidity, and mortality (Graaf et al., 2000). ...
... Health status is a determinant of all the sources of attrition: failure to locate, refusal to participate, morbidity, and mortality (Graaf et al., 2000). In addition, demographic characteristics related to health, such as sex, old age, marital status, and educational attainment, are known determinants of attrition from the sample (Ahern & Le Brocque, 2005;Desmond et al., 1998;Graaf et al., 2000;Hoeymans et al., 1998;Levin et al., 2000). This implies that in cross-sectional health studies based on attrited samples, it is likely that inferences are made based on not only non-random samples, but also selected on the outcome variable of interest (Ahern & Le Brocque, 2005;Graaf et al., 2000). ...
Article
Full-text available
Cross-sectional data from the Survey of Health, Ageing and Retirement in Europe (SHARE) are a common source of information in comparative studies of population health in Europe. In the largest part, these data are based on longitudinal samples, which are subject to health-specific attrition. This implies that estimates of population health based on cross-sectional SHARE datasets are biased as the data are selected on the outcome variable of interest. We examine whether cross-sectional datasets are selected based on health status. We compare estimates of the prevalence of full health, healthy life years at age 50 (HLY), and rankings of 18 European countries by HLY based on the observed, cross-sectional SHARE wave 7 datasets and full samples. The full samples consist of SHARE observed and attrited respondents, whose health trajectories are imputed by microsimulation. Health status is operationalized across the global index of limitations in activities of daily living (GALI). HLY stands for life expectancy free of activity limitations. Cross-sectional datasets are selected based on health status, as health limitations increase the odds of attrition from the panel in older age groups and reduce them in younger ones. In older age groups, the prevalence of full health is higher in the observed cross-sectional data than in the full sample in most countries. In most countries, HLY is overestimated based on the cross-sectional data, and in some countries, the opposite effect is observed. While, due to the small sample sizes of national surveys, the confidence intervals are large, the direction of the effect is persistent across countries. We also observe shifts in the ranking of countries according to HLYs of the observed data versus the HLYs of the full sample. We conclude that estimates on population health based on cross-sectional datasets from longitudinal, attrited SHARE samples are over-optimistic.
... This case is apparent in health studies, where the outcome variable, health status, and health-related characteristics, i.e. sex, old age, marital status and educational attainment, are known determinants of sample attrition. 1,2 The problem of sample attrition and its potential bias in measuring phenomena and their relationships is well recognized in longitudinal studies, but rarely in cross-sectional studies based on longitudinal samples. Attrition affects measures based on cross-sectional data sets of the Income and Living Conditions Survey (EU-SILC), where three out of four sub-samples are longitudinal. ...
Article
Full-text available
Eurostat’s official Healthy Life Years (HLY) estimates are based on European Union Statistics on Income and Living Conditions (EU-SILC) cross-sectional data. As EU-SILC has a rotational sample design, the largest part of the samples are longitudinal, health-related attrition constituting a potential source of bias of these estimates. Bland-Altman plots assessing the agreement between pairs of HLY based on total and new rotational, representative samples demonstrated no significant, systematic attrition-related bias. However, the wide limits of agreement indicate considerable uncertainty, larger than accounted for in the confidence intervals of HLY estimates.
... For example, the study of non-attenders in the Tromsø 2 study did not include people 55 years and older. Still, other studies inform us that the older non-attenders have one thing in common with younger non-attenders; they tend to have more health problems (239,240). No surprise then, that hardly any institutionalized, very old people, i.e. people with ill-health in need of constant care, took part in the Tromsø 7 survey, as illustrated by the declining participation rate as people get older: 53 % in age group 80 -84 years, 30 % in age group 85 -89 years, and 16 % in age group 90 -94 years. ...
Thesis
Full-text available
Research has demonstrated that inflammation is a central part of several psychiatric disorders, of which depression in the most researched condition. Most studies have, however, been conducted on younger adults, and studies on elderly are scarce. This thesis explores the possible association between systemic markers of inflammation and characteristics of older psychiatric patients. In study I, we investigated possible correlations between the levels of 27 cytokines in plasma, and clinical and demographical variables, in diagnostically unselected in-patients that were 60 years and older (N = 98). We found no significant associations between cytokine levels and diagnoses, nor any other variables. However, we did find higher levels of 10 cytokines in the non-depressed patients, possibly as a result of the higher prevalence of cardiovascular disease and dementia. In study II, we explored whether changes in the level of 27 cytokines plasma during the treatment of diagnostically unselected psychiatric in-patients aged 60 years or more (N = 49) could be related to clinical and demographical variables, as well as self-reported clinical improvement. We found a positive correlation between clinical improvement and falling cytokine levels (p < 0.033), irrespective of psychiatric diagnoses or other variables. In study III, we investigated possible correlations between two levels of depression - moderate and moderate-severe depression - and CRP in serum, in younger (40 - 59 years) versus older adults (≥ 60 years) (N = 19,947). We found a multi-adjusted association between depression and elevated CRP in younger adults, but not in older adults. The studies of this thesis could not confirm an association between markers of systemic inflammation, and diagnoses and other characteristics of older adults with psychiatric disorders. In particular, this research could not, unlike most studies on younger adults, confirm a link between markers of systemic inflammation and depression in older adults.
... If large numbers of people do not consent, it may increase the probability of bias and undermine statistical power. For example, those who actively decline consent (non-consent) are more likely to be in poorer health and to underuse health services (15,16). It is therefore imperative that we understand the attitudes of participants whom we are approaching for consent. ...
Preprint
Full-text available
Background The linkage of primary care, hospital and other health registry data is a global goal, and a consent-based approach is often used. Understanding the attitudes of why participants take part is important, yet little is known about reasons for non-participation. The ATHENA COVID-19 feasibility study investigated: 1) health outcomes of people diagnosed with COVID-19 in Queensland, Australia through primary care health data linkage using consent, and 2) created a cohort of patients willing to be re-contacted in future to participate in clinical trials. This report describes the characteristics of participants declining to participate and reasons for non-consent. Methods Patients diagnosed with COVID-19 from January 1st, 2020, to December 31st, 2020, were invited to consent to having their primary healthcare data extracted from their GP into a Queensland Health database and linked to other data sets for ethically approved research. Patients were also asked to consent to future recontact for participation in clinical trials. Outcome measures were proportions of patients consenting to data extraction, permission to recontact, and reason for consent decline. Results 996 participants were approached and 853(86%) reached a consent decision. 581(69%), 623(73%) and 567(67%) consented to data extraction, recontact, or both, respectively. Mean (range) age of consenters and non-consenters were 50.6(range) and 46.1(range) years, respectively. Adjusting for age, gender and remoteness, older participants were more likely to consent than younger (aOR 1.02, 95%CI 1.01 to 1.03). The least socio-economically disadvantaged were more likely to consent than the most disadvantaged (aOR 2.20, 95% 1.33 to 3.64). There was no difference in consent proportions regarding gender or living in more remote regions. The main reasons for non-consent were ‘not interested in research’ (37%), ‘concerns about privacy’ (15%), ‘not registered with a GP’ (8%) and ‘too busy/no time’ (7%). ‘No reason’ was given in 20%. Conclusion Younger participants and the more socio-economically deprived are more likely to non-consent to primary care data linkage. Lack of patient interest in research, time required to participate and privacy concerns, were the most common reasons cited for non-consent. Future health care data linkage studies addressing these issues may prove helpful. Trial registration details not applicable
... Among non-respondents, there is commonly a disproportionate number of young [1][2][3][4][5][6][7][8], male [2][3][4][5][6][7][8][9][10], and unmarried people [1,2,5,8,[11][12][13][14], as well as those with lower education [1, 2, 5-8, 10, 12-15], and lower socioeconomic status [5,6,8,11,13,16]. Non-respondents are also more likely to be smokers [1,4,10,14,[17][18][19], and to have different patterns of alcohol consumption [10,16,[20][21][22], poorer physical and/or mental health [5,7,9,10,23], and higher rates of mortality and morbidity [20,[24][25][26][27][28][29]. If researchers fail to account for nonresponse bias, prevalence estimates (in particular) and analyses of associations between variables will likely be incorrect [9]. ...
Article
Full-text available
Background The continuum of resistance model’s premise is that delayed respondents to a survey are more similar to non-respondents than early respondents are. For decades, survey researchers have applied this model in attempts to evaluate and adjust for non-response bias. Despite a recent resurgence in the model’s popularity, its value has only been assessed in one large online population health survey. Methods Respondents to the Norwegian Counties Public Health Survey in Hordaland, Norway, were divided into three groups: those who responded within 7 days of the initial email/SMS invitation (wave 1, n = 6950); those who responded after 8 to 14 days and 1 reminder (wave 2, n = 4950); and those who responded after 15 or more days and 2 reminders (wave 3, n = 4045). Logistic regression analyses were used to compare respondents’ age, sex and educational level between waves, as well as the prevalence of poor general health, life dissatisfaction, mental distress, chronic health problems, weekly alcohol consumption, monthly binge drinking, daily smoking, physical activity, low social support and receipt of a disability pension. Results The overall response to the survey was 41.5%. Respondents in wave 1 were more likely to be older, female and more highly educated than those in waves 2 and 3. However, there were no substantial differences between waves for any health outcomes, with a maximal prevalence difference of 2.6% for weekly alcohol consumption (wave 1: 21.3%, wave 3: 18.7%). Conclusions There appeared to be a mild continuum of resistance for demographic variables. However, this was not reflected in health and related outcomes, which were uniformly similar across waves. The continuum of resistance model is unlikely to be useful to adjust for nonresponse bias in large online surveys of population health.
... Among non-respondents, there is commonly a disproportionate number of young, (1)(2)(3)(4)(5)(6)(7)(8) male, (2)(3)(4)(5)(6)(7)(8)(9)(10) and unmarried people, (1,2,5,8,(11)(12)(13)(14) as well as those with lower education, (1, 2, 5-8, 10, 12-15) and lower socioeconomic status. (5,6,8,11,13,16) Non-respondents are also more likely to be smokers, (1,4,10,14,(17)(18)(19) and to have different patterns of alcohol consumption, (10,16,(20)(21)(22) poorer physical and/or mental health, (5,7,9,10,23) and higher rates of mortality and morbidity. (20,(24)(25)(26)(27)(28)(29) If researchers fail to account for nonresponse bias, prevalence estimates (in particular) and analyses of associations between variables will likely be incorrect. ...
Preprint
Full-text available
Background The continuum of resistance model’s premise is that delayed respondents to a survey are more similar to non-respondents than early respondents are. For decades, survey researchers have applied this model in attempts to evaluate and adjust for non-response bias. Despite a recent resurgence in the model’s popularity, its value has not been assessed in a large online population health survey.Methods Respondents to the Norwegian Counties Public Health Survey in Hordaland, Norway, were divided into three groups: those who responded within 7 days of the initial email/SMS invitation (wave 1, n = 6950); those who responded after 8 to 14 days and 1 reminder (wave 2, n =4950); and those who responded after 15 or more days and 2 reminders (wave 3, n = 4045). Logistic regression analyses were used to compare respondents’ age, sex and educational level between waves, as well as the prevalence of poor general health, life dissatisfaction, mental distress, chronic health problems, weekly alcohol consumption, monthly binge drinking, daily smoking, physical activity, low social support and receipt of a disability pension.ResultsThe overall response to the survey was 41.5%. Respondents in wave 1 were more likely to be older, female and more highly educated than those in waves 2 and 3. However, there were no substantial differences between waves for any health outcomes, with a maximal prevalence difference of 2.6% for weekly alcohol consumption (wave 1: 21.3%, wave 3: 18.7%).Conclusions There appeared to be a mild continuum of resistance for demographic variables. However, this was not reflected in health and related outcomes, which were uniformly similar across waves. The continuum of resistance model is unlikely to be useful to adjust for nonresponse bias in large online surveys of population health.
... For example, someone with unhealthy behaviors such as smoking or excessive alcohol consumption may be somewhat less likely to respond to a survey about healthy lifestyles than is a person with healthier behaviors 4 . Such non-response bias can lead to serious underreporting of negative outcomes 4,5 . For example, failure to complete a survey may result from students without placement not wanting to report what they may perceive as failure 6 . ...
Article
Purpose : This study investigates the contextual association between types of community-level social participation and functional disability. Methods : We used 6-year prospective cohort data from the Japan Gerontological Evaluation Study 2010–2016, a nationwide survey of 35,519 functionally independent older adults (mean age: 73.30 ± 5.91 years, 49.6% females). The incidence of functional disability was obtained from municipal long-term care insurance databases. Social participation was assessed at individual and community levels and was categorized as: volunteer, sports, hobby and neighborhood groups, and senior citizen clubs. We calculated the 95% confidence interval (CI) and the hazard ratio (HR) by applying a three-level multilevel survival analysis. Results : During the 6-year observation period, the onset of functional disability occurred among 3,473 adults. A higher prevalence of sports (HR 0.88, 95% CI 0.80 to 0.96) and hobby group participation (HR 0.91, 95% CI 0.87 to 0.96) showed significant contextual relationships with functional disability after adjusting for potential confounders. Among females, community-level neighborhood group participation significantly lowered the incidence of functional disability (HR 0.87, 95% CI 0.76 to 0.998). Conclusions : We found a beneficial effect of a contextual relationship between community-level sports and hobby group participation and functional disability among older adults. Moreover, females benefited a lot from community-level social participation. We propose that promoting sports and hobby groups in a community may help to prevent functional disability among older adults.
Article
Full-text available
Enhancing daily functioning and well-being is an increasingly advocated goal in the treatment of patients with chronic conditions. We evaluated the functioning and well-being of 9385 adults at the time of office visits to 362 physicians in three US cities, using brief surveys completed by both patients and physicians. For eight of nine common chronic medical conditions, patients with the condition showed markedly worse physical, role, and social functioning; mental health; health perceptions; and/or bodily pain compared with patients with no chronic conditions. Each condition had a unique profile among the various health components. Hypertension had the least overall impact; heart disease and patient-reported gastrointestinal disorders had the greatest impact. Patients with multiple conditions showed greater decrements in functioning and well-being than those with only one condition. Substantial variations in functioning and well-being within each chronic condition group remain to be explained.
Article
Out of 11 136 Japanese men identified on the island of Oahu, Hawaii in 1965 by the Honolulu Heart Program, 8006 responded to a mailed questionnaire and were examined. Some 1871 responded only to the mailed questionnaire, and 1259 did not respond at all. After 15 years of follow-up, the examined men had significantly lower risk of death from all causes and death from cancer. Minor differences were also noted between the two groups in the risk of cancer of the lung, stomach, colon, and rectum. However, the examined men had a significantly higher risk of prostate cancer. In general, the strength of these non-response effects was mainly due to risk differences in the first five years of the 15-year follow-up period. The relative risk (RR) of each of the seven endpoint events tended towards 1.0 as each of the three successive five-year follow-up intervals were considered. An exception to this was the prostate cancer incidence RR which favoured the unexamined men throughout the entire 15 years, but significantly so only in the last five-year follow-up interval. When the 8006 examined and 1871 unexamined men who responded to the mailed questionnaire were evaluated with respect to the association of cigarette smoking with lung cancer incidence, the RR for smokers was 9.77 for the examined men, and 6.73 for the unexamined men. Since these RRs are not significantly different, there should be little bias in RR estimates of cigarette smoking for lung cancer if the observation was limited to only the examined men. With regard to the association of body mass index (BMI) with colon cancer in older men, the RRs for men in the highest BMI quintile were quite comparable, at 1.37 for the examined group and 1.60 for the unexamined men. We conclude that although some non-response effects on cancer incidence exist in this cohort, they do not appear to be serious enough to have changed conclusions drawn about risk relationships.
Article
The aim of this paper is to explore the differential impact of chronic conditions on disability, use of health care and healthy life expectancies. The condition-specific impact is described by comparing persons with a variety of chronic diseases. The classification of the 19 selected chronic conditions in terms of the burden for disability and use of health care showed 8 major conditions with a high illness burden: lung disease, heart disease, stroke, cancer, diabetes mellitus, rheumatism and arthritis complaints, neurological disorders and accident traumas. Co-morbidity has an additional impact on disability as well as on the use of medical care and long-term care. The general impact of chronic conditions is described by calculating healthy life expectancies and assessing the loss of healthy life resulting from chronic morbidity, disability and long-term care. Healthy life expectancies show marked gender differences in the burden of chronic diseases. The advantage to females in terms of life expectancy is a disadvantage In terms of healthy life expectancy. The discussion focuses on disease specificity, co-morbidity and population heterogeneity.
Article
To compare the accuracy of self-ratings with informant-ratings of physical functional capacity in the elderly, 150 elderly patients attending a geriatric day hospital (GDH) and their formal and informal community carers were administered a questionnaire about their ability to perform activities of daily living (ADL). Direct observation of the patients' performance by therapists at the GDH was used as a standard, after the reliability and validity of this approach had been evaluated. Self-ratings were shown to be more accurate and less biased than informant-ratings, both for individual ADL and overall functional capacity. The accuracy of all ratings tended to be greater for less complex or physically demanding ADL, and informants tended to consistently underestimate functional capacity. The concurrent validity of the adapted Barthel Index in a self-report format was also demonstrated. Wherever possible, information concerning the physical functional capacity of an elderly subject should in the first instance be sought from the subject himself, as the quality of such information may be superior to that of his carers.
Article
The aim was to investigate the pattern of age specific non-response bias in a two phase survey of disablement in the community. It seeks to examine patterns of response in different age groups to a household based postal questionnaire, and the implication of such trends for the estimation of prevalence of reported dependence. It also looks at the effect that the readiness to respond during the first phase postal questionnaire had on participation in the interview based second phase of the study. A two stage survey of disablement in the population was undertaken. A first phase postal questionnaire was sent to 25,168 households in Calderdale, West Yorkshire, England, to ascertain the prevalence of physical disability. The second phase comprised in depth interviews with a sample of individuals identified in the first phase as being disabled. A total of 21,889 postal questionnaires were returned (87%) representing households containing 42,826 people aged 16 years and over. A disproportionately stratified random sample of 950 respondents reporting disability was taken for the second phase. Of these 891 were still available, and 838 (94%) were interviewed. A study of the timing of response to a postal questionnaire showed that patterns differed for different age groups. The estimated prevalence of those aged 65 years and over who were dependent was steady over time whereas for those in the 16-64 age range the estimated prevalence fell as the survey progressed, indicating a tendency for those who were dependent to respond sooner. Examination of the relationship of responses at phase 1 and phase 2 showed that response to invitation to interview was much less in those who had responded later, and presumably more reluctantly, in the first phase. These findings raise questions about how different patterns of response might be indicative of bias which could differentially affect final age specific prevalence estimates. They also have methodological implications for the follow up of reluctant responders both to increase the response rate and to secure cooperation in the second phase of a two phase survey.
Article
This study examines the validity of proxy assessments as substitutes for patient assessments of patient physical and psychosocial health status. Data were obtained from 275 patient-proxy pairs who were enrolled in a national study of Adult Day Health Care. Patients and proxies (informal caregivers such as spouses) were asked to complete the Sickness Impact Profile (SIP) based on the patients health status. Findings showed that patient-generated and proxy-generated physical scores were highly correlated, although proxies rated patients as slightly more impaired than the patient's rated themselves. The correlation between psychosocial scores was not high enough to consider proxy responses as valid substitutes for patient responses. We explored these differences in response by comparing regression equations predicting patient-generated and proxy-generated physical and psychosocial SIP dimension scores. Variance in the patient-generated psychosocial score was explained by physical function, psychological distress, cognitive status and patient age. Proxy-generated psychosocial scores were primarily explained by the caregiver's psychological distress and perceived burden. These findings point out the importance of considering the source of patient health status estimates when interpreting the results of research studies.
Article
During 1981-1982, a cohort of elderly Japanese Americans living in Hawaii was recruited for an epidemiologic study of osteoporosis. The male subjects were simultaneously being examined for an epidemiologic study of heart disease. Baseline data collected from both the men and women at a previous heart disease examination were used to compare responders vs nonresponders. The target population for the osteoporosis study consisted of 1685 men and 1594 women. Of these, 1379 men (81.8%) and 1105 women (72.0%) participated in the initial osteoporosis examination. For each sex, nonrespondents were older and had higher systolic blood pressure levels than did the respondents. Male nonresponders had a higher stroke prevalence and more frequent recent use of vasodilator medicine. Female nonresponders had a less frequent history of having ever taken female hormones than did the responders. The responders and nonresponders were reasonably similar in other respects, as indicated by the comparison of more than 40 other variables. This suggests that nonresponse bias is probably not a major influence in exposure-disease associations in this osteoporosis cohort. We believe this is the first published report dealing with nonresponse characteristics in a cohort study of osteoporosis.
Article
This paper compares respondents and non-respondents from the community sample of the Saskatchewan Health Status Survey of the Elderly. Response bias was assessed by comparing the demographic characteristics and use of health care services of the two groups. A stratified two-stage area probability sample was drawn from a comprehensive sampling frame. There were 1614 subjects eligible; interviews were completed with 1267 (78.5%). In the very elderly (85 + years) cohort, disproportionately more urban dwellers and more males were interviewed; the sample was otherwise demographically representative of the elderly population. Non-respondents, especially the very elderly, used significantly more medical services than respondents, and had a higher number of hospital admissions. Non-respondents over age 75 experienced significantly longer average lengths of stay. On average, non-respondents used approximately 15% more hospital days. Non-respondents over age 75 appear to be more likely to experience ill health than respondents. Hence, statistics from this survey are conservative estimates of the ill health of the elderly.