Sherry B, Jefferds ME, Grummer-Strawn LM. Accuracy of Adolescent Self-report of Height and Weight in Assessing Overweight StatusA Literature Review. Arch Pediatr Adolesc Med. 2007;161(12):1154-1161. doi:10.1001/archpedi.161.12.1154
Copyright 2007 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.2007
To examine the accuracy of self-reported height and weight data to classify adolescent overweight status. Self-reported height and weight are commonly used with minimal consideration of accuracy.
Eleven studies (4 nationally representative, 7 convenience sample or locally based).
Peer-reviewed articles of studies conducted in the United States that compared self-reported and directly measured height, weight, and/or body mass index data to classify overweight among adolescents.
Self-reported and directly measured height and weight.
Main Outcome Measures
Overweight prevalence; missing data, bias, and accuracy.
Studies varied in examination of bias. Sensitivity of self-reported data for classification of overweight ranged from 55% to 76% (4 of 4 studies). Overweight prevalence was −0.4% to −17.7% lower when body mass index was based on self-reported data vs directly measured data (5 of 5 studies). Females underestimated weight more than males (ranges, −4.0 to −1.0 kg vs −2.6 to 1.5 kg, respectively) (9 of 9 studies); overweight individuals underestimated weight more than nonoverweight individuals (6 of 6 studies). Missing self-reported data ranged from 0% to 23% (9 of 9 studies). There was inadequate information on bias by age and race/ethnicity.
Self-reported data are valuable if the only source of data. However, self-reported data underestimate overweight prevalence and there is bias by sex and weight status. Lower sensitivities of self-reported data indicate that one-fourth to one-half of those overweight would be missed. Other potential biases in self-reported data, such as across subgroups, need further clarification. The feasibility of collecting directly measured height and weight data on a state/community level should be explored because directly measured data are more accurate.
One important aspect of addressing pediatric overweight as a national public health priority is to document and monitor the prevalence.1 Prevalence data describe the extent of the problem and show trends over time; they are also useful for targeting interventions to geographic areas or subgroups with the highest prevalence. Monitoring changes in prevalence is an important component of evaluating intervention programs to prevent and treat overweight; in particular, these data are useful for understanding and guiding program effectiveness, improvement, and maintenance. The most commonly used anthropometric screening tool for overweight is body mass index (BMI) (calculated as weight in kilograms divided by height in meters squared). Thus, height and weight data are essential for classifying overweight status. How these data are collected becomes an important issue as state health departments and researchers more actively try, with limited resources, to monitor the impact of programs to reduce the obesity epidemic.
Self-reported height and weight are sometimes used to determine and/or monitor overweight. The self-reported method is chosen in preference to direct measurement because self-reported data are easier, cheaper, and quicker to collect. Moreover, direct measurement of height and weight requires appropriate training and monitoring of personnel and the use of accurate, well-maintained equipment. Because of limited resources, self-reported data may be the only data available. Unfortunately, minimal attention is given to potential inaccuracies or bias introduced with the self-reported method. Moreover, articles in the literature may give no or limited mention of the quality of self-reported data. For example, Valenti et al2 reported overweight prevalence of Australian children with no mention of the quality of their parental-reported data; Sen3 examined the frequency of family dinner and weight status based on self-reported data from the National Longitudinal Survey of Youth. Sen cites the Strauss4 National Health and Nutrition Examination Survey III analysis, which reported that 94% of adolescents had their weight status correctly classified, as justification for the accuracy of self-reported data. As will be seen in this review, a single summary statistic can mask bias.
The goals of this review were to examine and summarize the accuracy of using self-reported data in contrast to directly measured data for identifying and monitoring overweight among US adolescents. We examined consistency across studies in the magnitude of bias by age, sex, race/ethnicity, and prevalence of overweight and the extent of prevalence bias by sensitivity and specificity.
We used a comprehensive literature search of the electronic databases PubMed and MEDLINE, including “in-process MEDLINE.” The search terms included body weight, body height, and body mass index; adolescent, youth, or teenage; self-report, self-disclosure, and self-assessment; reproducibility of results, sensitivity and specificity, analysis of variance, and multivariate analysis; valid, reliable, and accurate; and English language. We did not limit the years of our search. We identified 60 articles, but only 12 studies met our inclusion criteria of peer-reviewed articles conducted in the United States that compared self-reported and directly measured height and weight data or BMIs calculated from these different measures for adolescents. We excluded 1 additional study5 that did not include correlation coefficients between self-reported and directly measured data or sensitivity and specificity analyses but only presented self-reported and directly measured mean differences. Two studies4,6 used National Health and Nutrition Examination Survey III data for their analyses but examined different aspects of bias, so we included both.
For each study, we identified the geographic location; study design, including sampling protocol, setting, sequence of measurements, measurement protocols, definitions of at risk for overweight and/or overweight status, including reference sources and exclusion of biologically implausible values; and population characteristics, including age, race/ethnicity, sample size, and directly measured prevalence of overweight. For each study we extracted percentage of missing data; differences between the self-reported and directly measured height, weight, and BMI; stratification of these differences by age, sex, race/ethnicity, and overweight status, when available; regression analysis to identify predictors of self-reported bias; differences between self-reported and directly measured prevalence for both at risk for overweight and overweight; correlation coefficients between self-reported and directly measured height and weight and calculated BMI; and sensitivity, specificity, and positive predictive value data for prevalence. When data were not available, we contacted authors in an attempt to obtain complete information. For our review, 2 of us (B.S. and M.E.J.) independently summarized each study and resolved differences by discussion. We analyzed the consistency of patterns across the 11 studies for the previously listed parameters.
Meta-analysis or a moderator analysis was not appropriate to define an effect size for this review because there were only 11 studies and they varied substantially in sample size and composition, study design, and definition of overweight. Several studies included small convenience samples or were locally based, making their findings nongeneralizable to the overall US population of adolescents.
An overview of the 11 studies (4 based on nationally representative samples and 7 convenience sample or locally based studies) is summarized in Table 1. We stratified our summary of studies into these 2 categories to differentiate the generalizability of their results. All studies included children 11 years or older. Human subjects' approval was obtained for all of the 11 studies.
Data for the 4 nationally representative studies were collected during the early 1980s through the mid 1990s; all used standardized protocols for measurements. Intervals between collection of self-reported and directly measured data ranged from the same day8 to a few weeks.4,6,7 Only Himes and Faricy6 described exclusion of data with biologically implausible values: they excluded subjects with differences between self-reported and directly measured height or weight values more than 5 SDs of the overall mean differences.
Among the 7 convenience sample or locally based studies, data were collected over a wider period (1970s through 2000)9,10,14,15; 3 studies did not report year(s) of data collection.11- 13 Various measurement protocols were used: 29,12 used referenced protocols, 214,15 used standardized but unreferenced protocols, 111 described some procedures, and 210,13 did not describe. The interval between the collection of self-reported and directly measured data ranged from the same day to a month or so9- 11,13- 15; one did not report the interval.12 Two studies described exclusions of biologically implausible values: Shannon et al,11 “zero” values and height values greater than 400 in, and Stewart,9 height and weight values 4 or more SDs from mean difference of self-reported and directly measured data.
Moreover, these 11 studies used a variety of references and/or cutoffs to define overweight status. These variations made comparisons among studies difficult.
Among the national surveys, missing data (unknown/unusable) for self-reported values ranged from 14% to 37%.4,6- 8 Himes and Faricy6 showed an effect by age: 41% of 12-year-olds and 25% of 13-year-olds did not report their weight, in contrast to only 2% of the 14- to 16-year-olds. Their logistic regression model showed that younger age, being male, shorter directly measured height, and lighter directly measured weight were all independently and significantly associated with missing data.6
Only 5 convenience sample or locally based studies reported missing data, which ranged from 0% to 31%.10,11,13- 15 Shannon et al11 found no differences in missing self-reported data by height, weight, or sex, but they did not examine the effect by age in their study of 11- to 13-year-olds.
Table 2 shows the differences in mean (self-reported − directly measured) height, weight, and BMI by sex for the 9 studies with these data available. For height, weight, and BMI, the magnitude of mean bias by sex was greater for participants in the convenience sample or locally based studies than in the nationally representative studies.
Height was both overestimated and underestimated. For the 7 studies for both males and females, the range of mean height differences was relatively small at −1.1 cm to 2.4 cm, with the exception of Brener et al14 who found differences of 6.6 cm for males and 6.9 cm for females. Shannon et al11 described tall males and females underestimating their weight more than their shorter counterparts but did not control for age.
Differences in mean self-reported and directly measured weights for the 9 studies that stratified by sex showed that females generally underestimated their weight more than males (Table 2). Differences in means varied widely: females ranged from −4.0 to −1.0 kg and males, from −2.6 to 1.5 kg.
Two nationally representative studies6,8 and 3 convenience sample or locally based studies12,14,15 reported mean differences by sex for BMI (Table 2). Both males and females showed minimal mean differences in BMI (0 to 0.2 for males; −0.1 to −0.3 for females) in the nationally representative studies, whereas there were greater underestimations (−1.2 to −2.3 for males; −1.0 to −3.0 for females) in the convenience sample or locally based studies.
Bias by age or school grade was reported by 4 studies. For the 3 studies that statistically examined bias by increasing age, 2 found increasing differences between self-reported and directly measured height,14,15 2 found decreasing differences between self-reported and directly measured weight,12,15 and 2 found decreasing differences between self-reported and directly measured BMI12,14; for each of these indexes, 1 of these 3 studies found no difference. Using a mixed-effects general linear model, Himes and Story12 reported that age was an independent predictor of reporting error for weight and BMI, but not for height, with the degree of underestimation of both self-reported weight and calculated BMI based on self-reported data decreasing with increasing age (errors less negative for each additional year in age by 0.78 kg for weight and 0.35 for BMI, respectively). Brener et al14 found that, after controlling for sex and race/ethnicity in linear regression analyses, each year's increase in school grade was positively associated with an overestimate of self-reported height (β = 0.22; P < .001) and inversely associated with an underestimate of BMI based on self-reported values (β = −0.19; P = .002); they did not report any difference in weight bias by school grade.
Bias by self-reported race/ethnicity was examined statistically in 3 studies. Findings were disparate. Strauss4 reported no statistically significant differences in reporting of height and weight by race/ethnicity (white/Hispanic individuals, black individuals, and individuals of other race/ethnicity) stratified by sex. After controlling for sex and school grade in their regression analysis, Brener et al14 found that white individuals overestimated their height more than black or Hispanic individuals or those of other racial or ethnic groups (β = 0.09; P < .001). Himes et al15 found significant effects for males only, with Asian individuals more accurately self-reporting height and underestimating weight more than white, African American, or Hispanic individuals or those of other racial or ethnic groups.
Six of the 11 studies examined reporting bias by weight status and found that overweight youth underestimated their weight4,7,11- 13,15 and, if available, their resulting BMI,7,12 more than normal-weight youth. For example, Strauss4 found that mean differences between self-reported and directly measured weight were significantly greater among overweight (BMI > 95th percentile) adolescents vs those not overweight (−4.6 kg vs 0.2 kg, respectively; P < .001). An additional study9 found underreporting of weight increased as directly measured weight increased for their entire sample (aged 14-61 years). Studies varied in these comparisons, making it impossible to examine bias by percentage of underestimation of directly measured weight by directly measured weight status.
We examined both absolute error (absolute difference between self-reported and directly measured prevalence) and relative error (absolute error divided by directly measured prevalence) in the 5 studies that had data available (Table 3). These studies showed that adolescent self-reported height and weight data underestimated prevalence of overweight, risk for overweight, or both, with wide variability in both absolute and relative errors. The wide variety of references and definitions of overweight used limited comparisons. For example, for the prevalence of overweight based on the Centers for Disease Control and Prevention 2000 growth charts,19 for the BMI cutoff of the 95th percentile or higher, absolute errors ranged from −1.6% to −11.1% and relative errors, from −16.5% to −42.7% (Table 3).
Table 4 shows sex-specific correlation coefficients between self-reported and directly measured height, weight, and BMI for 9 studies. The correlation coefficients for height, weight, and BMI were lower for females than males, with 3 exceptions. Including both males and females, correlation coefficients for height ranged from 0.62 to 0.91; for weight, 0.84 to 0.98; and for BMI, 0.79 to 0.93.
Four studies examined self-reported and directly measured correlation coefficients by age6,7,10,14 and in general found higher coefficients for the older adolescents, yet none reported statistical differences. For example, Himes and Faricy6 reported variability by age stratified by sex and found lower values for 12-year-old boys and girls for height (0.57 vs 0.62, respectively) and BMI (0.70 vs 0.76, respectively) compared with 13- to 16-year-old boys and girls (both sexes, > 0.75 for height and > 0.83 for BMI), whereas Brener et al14 found high correlation coefficients (range, 0.86-0.96) for height, weight, and BMI for ninth- through 12th-grade adolescents.
Only Strauss4 and Brener et al14 examined correlation coefficients by race/ethnicity, stratified as white, black, and Hispanic individuals; Brener et al14 also included an “other” category. Strauss4 reported that BMI correlation coefficients for black individuals were significantly lower than those for white or Hispanic individuals (0.79 vs 0.89 and 0.85, respectively; P < .05 for black vs white or black vs Hispanic individuals). Brener et al14 did not carry out significance testing but reported lower height correlations for Hispanic individuals than for individuals from the 3 other racial or ethnic groups (0.77 vs ≥ 0.88); BMI correlation coefficients for the “other” category were lower (0.79 vs ≥ 0.89).
Two nationally representative studies7,8 and 2 convenience sample studies13,14 examined the validity of using self-reported height and weight-calculated BMI to identify overweight (Table 5). The values for sensitivity among these 4 studies suggest that only between 55% and 75% of those adolescents who were truly overweight would be classified as overweight if their self-reported weight and height were used to determine BMI.
Three studies reported sensitivity by sex7,8,13 (Table 5), one reported by race/ethnicity,8 and another reported by age13; no consistent patterns emerged for these subgroups. Using a BMI cutoff of the 95th percentile or higher, Goodman et al8 reported no difference in sensitivity by sex or race/ethnicity. Using a BMI cutoff of the 85th percentile or higher, Davis and Gergen7 reported no significant difference in sensitivity among Mexican American individuals by sex or by age (12-14 years, 15-17 years, or 18-19 years) for males and females (values not reported). Using a similar BMI cutoff for overweight, Hauck et al13 found that sensitivity for Native American individuals was lower among younger (12-14 years) than among older (15-19 years) males, yet higher among younger vs older females. Specificity was greater than 95% for the 4 studies, regardless of the cutoff or stratification (Table 5).
Our review identified 4 consistent patterns in bias across the studies when self-reported data were used to classify overweight among adolescents: (1) the prevalence of overweight was consistently underestimated by self-reported data, although the relative error ranged widely, from −2.4% to −42.7%; (2) sensitivity data showed that 25% to 45% of those overweight would be missed if self-reported data were used; (3) females underestimated their weight and BMI more than males; and (4) overweight youth underestimated their weight and BMI more than normal-weight youth.
We identified 3 additional issues, relevant to surveillance, targeting, program evaluation, and research, in need of further examination: (1) lack of or inconsistent information on other subgroup differences; (2) lack of information on whether biases are consistent over time; and (3) lack of consensus regarding an acceptable level of difference between self-reported and directly measured height and weight data and how this might vary depending on purpose of use.
The sensitivity data show that self-reported height and weight are relatively weak estimates of directly measured values for categorizing overweight status, which is similar or slightly worse than findings for adults. In comparison with adolescent data, the sensitivity data for adult US men and women aged 20 to 59 years are generally at the upper end of the range or higher than that for adolescents (Bowlin et al,20 77% and 72%, respectively; Kuczmarski et al,21 86%-95%; and Nieto-García et al,22 74%). Furthermore, the adult data show evidence of lower values among certain subgroups. For example, Bowlin et al20 found that for 20- to 29-year-old women, sensitivity was 60%, whereas Nieto-García et al22 found that for 60- to 69-year-olds, sensitivity was 64%.
In contrast to sensitivity analysis, we found that the correlation coefficients between self-reported and directly measured height, weight, and BMI were relatively high. However, correlation coefficients are strongly affected by extreme values, and they do not examine the accuracy of the classification of overweight status, our goal.
Additional research needs are to assess (1) the accuracy of self-reported data by order of self-reported and directly measured data collection; (2) whether advance knowledge of directly measured data influences self-reported data; (3) whether other potentially important factors not considered in this review, such as mental health status, socioeconomic status, or physical activity status, may also affect bias of self-reported data; and (4) comparisons of data based on standard accepted definitions of overweight status and anthropometric reference. One example of an additional important factor could be depression. Overweight people are more likely to be depressed,23 and we found greater underestimates of weight among overweight adolescents. If depression is independently associated with underreporting of overweight status, then self-reported bias could also vary by level of depression.
Our findings raise questions about the practical implications for the use of self-reported data. The prevalence of overweight is assessed in populations for a variety of purposes, including identifying the problem, monitoring trends over time, program targeting, program evaluation, research, and advocating for funds for interventions. The utility of self-reported height and weight data depends on the purpose for which they are used. Self-reported data are almost always easier to collect and provide documentation of the problem of overweight even if the data are underestimates.
Prevalence based on self-reported data can be useful for monitoring overweight over time if the magnitude of biases remains constant over time. For short-term follow-up, the assumption of constant bias is probably reasonable, but no studies examined whether there have been changes in reporting bias over long periods. The fact that the degree of underreporting of prevalence varies widely among subgroups, from being almost undetectable in some studies (eg, males in Davis and Gergen7) to missing almost half of the problem in others,14 certainly raises the concern that reporting biases among subgroups are not constant across populations and settings.
The utility of self-reported data for targeting programs toward those at greatest risk depends on whether different population subgroups underreport BMI similarly. Females tend to underestimate their weight more than males, potentially leading to a false conclusion that males should be targeted more directly for overweight prevention programs. Heavier youth underestimate weight more than normal-weight youth, leading to an underestimate of the size of the target group. Other subgroup differences (in particular age, race/ethnicity, and missing data) have not been adequately studied, so it is impossible to know whether targeting based on self-reported data are appropriate.
Program evaluation of the effectiveness of obesity prevention and treatment interventions typically occurs over a relatively short time, such that it may be reasonable to expect that the degree of bias associated with self-reported data will not change between baseline and follow-up assessments. However, this expectation probably depends on the nature of the intervention, and one needs to think about the potential for bias based on the content of the intervention. For example, an intervention focused on BMI awareness or weekly monitoring of a person's own weight would probably change that person's knowledge of his or her directly measured weight and his or her ability to accurately report it. In such a case, evaluation might show increases in overweight because of the improved reporting even if the prevalence of overweight went down. Alternatively, there might be other factors associated with underreporting, such as the social desirability to be thin or poor body image, so that some participants would still underreport weight despite knowing their directly measured weight. Because the reasons for underreporting are multiple and complex, it is difficult to anticipate how an intervention might affect self-reported height and weight data.
Research often attempts to identify factors associated with overweight and nonoverweight as a dichotomous variable. To the extent that self-reported data misclassify adolescent overweight status and that this misclassification is unrelated to the factors of interest, research findings will be biased toward the null hypothesis. This bias implies that important factors associated with overweight will be overlooked. Where significant associations are found, however, one can expect that a real association does exist.
Where the estimated prevalence of overweight is high, the existence of self-reported height and weight data can be useful in advocating for programs and policies that address overweight and may be a prerequisite for securing funds to address the problem. However, policy makers and funders may be unimpressed with understated prevalence numbers and give inadequate attention to the problem, particularly in the long-term as the newness of the obesity epidemic passes.
One example of frequently used self-reported height and weight data is the Center for Disease Control and Prevention Youth Risk Behavior Surveillance System.24 This surveillance system regularly collects self-reported height and weight data and is often the only source of information on the prevalence of overweight among youth attending high school in a state. Without feasible alternative mechanisms to collect directly measured data, these self-reported data fill an important gap and are necessary for documenting the problem, advocating for funds for interventions, and monitoring trends over time.
Finally, this review has both strengths and limitations. To the best of our knowledge, this is the first literature review of this topic for adolescents. We identified 4 consistent biases and described the implications of these findings for using self-reported data. As for weaknesses, the lack of comparability among studies for cutoffs and references used to define overweight status, measurement protocols, intervals between self-reported and directly measured data, and data stratification and statistical analyses made it impossible to produce overall summary results. Second, the lack of adequate data in several studies prevented us from examining additional needed subgroup analyses and other potential important sources of bias, such as consistency of bias over time.
Researchers and public health practitioners should carefully consider the caveats described in this article when interpreting results based on self-reported data. Because of the limitations of relying on self-reported height and weight data for surveillance of overweight, public health practitioners should explore the feasibility of collecting directly measured heights and weights at the state and local levels for surveillance purposes. Historically, states collected directly measured height and weight data for a variety of purposes, particularly for screening. Arkansas measures the height and weight of children in schools for screening and surveillance.25 Missouri collected height and weight data during physical education classes as part of the curriculum for surveillance purposes.26 In New York, education law requires that children have health appraisals, including measurement of height and weight, at school entrance, as well as when students are in the second, fourth, seventh, and 10th grades. The New York Department of Health and some school districts are in discussions as to how to systematically collect and report these data to the Department of Health (Barbara A. Dennison, MD, written communication, April 2006). Experiences with these state programs, as well as other programs, related to data quality, representativeness, and cost could help determine the feasibility of developing state and local systems for collecting directly measured height and weight data for surveillance purposes.
Self-reported data are valuable if the only source of data. However, self-reported data underestimate overweight prevalence and there is bias by sex and weight status. Lower sensitivities of self-reported data indicate that one-fourth to one-half of those overweight would be missed. Other potential biases in self-reported data, such as differences across subgroups and inconsistency over time, need further clarification. The feasibility of collecting directly measured height and weight data on a state or community level should be explored because directly measured data are more accurate.
Correspondence: Bettylou Sherry, PhD, RD, Division of Nutrition and Physical Activity, Centers for Disease Control and Prevention, 4770 Buford Hwy, MS K25, Atlanta, GA 30341 (email@example.com).
Accepted for Publication: May 24, 2007.
Author Contributions:Study concept and design: Sherry, Jefferds, and Grummer-Strawn. Acquisition of data: Sherry and Jefferds. Analysis and interpretation of data: Sherry, Jefferds, and Grummer-Strawn. Drafting of the manuscript: Sherry and Jefferds. Critical revision of the manuscript for important intellectual content: Sherry, Jefferds, and Grummer-Strawn. Statistical analysis: Sherry and Grummer-Strawn. Administrative, technical, and material support: Jefferds. Study supervision: Sherry and Grummer-Strawn.
Financial Disclosure: None reported.
Additional Contributions: Nancy D. Brener, PhD, Laura K. Kann, PhD, and Deborah A. Galuska, PhD, reviewed the manuscript.