[Skip to Navigation]
Sign In
Figure 1.  Change in Obesity Status 1 Year After the Initial Screening According to Baseline Waist Circumference Within the Optimal Bandwidths
Change in Obesity Status 1 Year After the Initial Screening According to Baseline Waist Circumference Within the Optimal Bandwidths

The dots and error bars indicate point estimates and 95% CIs, respectively. The vertical solid line indicates the threshold level of waist circumference. Body mass index (BMI) is calculated as weight in kilograms divided by height in meters squared.

Figure 2.  Change in Cardiovascular Risk Factors 1 Year After the Initial Screening According to Baseline Waist Circumference Within the Optimal Bandwidths
Change in Cardiovascular Risk Factors 1 Year After the Initial Screening According to Baseline Waist Circumference Within the Optimal Bandwidths

The dots and error bars indicate point estimates and 95% CIs, respectively. The vertical solid line indicates the threshold level of waist circumference. DBP indicates diastolic blood pressure; HbA1c, hemoglobin A1c, LDL, low-density lipoprotein; SBP, systolic blood pressure.

SI conversion factors: To convert LDL cholesterol to mmol/L, multiply by 0.0259. To convert percentage of total hemoglobin to proportion of total hemoglobin, multiply by 0.01.

Table 1.  Participant Characteristics in the Total Sample and Participants Within Optimal Bandwidths
Participant Characteristics in the Total Sample and Participants Within Optimal Bandwidths
Table 2.  Association of Assignment to the Health Guidance Intervention With Health Outcomes Using Fuzzy Regression Discontinuity Designa
Association of Assignment to the Health Guidance Intervention With Health Outcomes Using Fuzzy Regression Discontinuity Designa
Table 3.  Association of Actual Receipt of the Health Guidance Intervention With Health Outcomes (2017-2018 Data)a
Association of Actual Receipt of the Health Guidance Intervention With Health Outcomes (2017-2018 Data)a
Supplement.

eAppendix A: The Japanese government’s guideline for the provision of the national health guidance intervention.

eAppendix B: Assignment to the health guidance intervention based on the waist circumference value.

eFigure 1: Flow of the screening program for obesity and cardiovascular risk factors in Japan.

eFigure 2: Participant selection in regression discontinuity design.

eFigure 3: Proportion of participants who were assigned to the health guidance intervention based on their value of the waist circumference.

eAppendix C: Fuzzy RD design.

eAppendix D: Test for manipulation of the waist circumference value.

eFigure 4: Distribution of participants by waist circumference.

eAppendix E: Continuity of observed covariates at the threshold level.

eTable 1: Continuity test of observed covariates.

eAppendix F: Robustness for bandwidth selection in the RDD analysis.

eTable 2: Robustness for bandwidth selection in the RDD analysis.

eAppendix G: Effect of covariates adjustment in the RD analysis.

eTable 3: Unadjusted model.

eAppendix H: Effect of the prior assignment in the RD analysis.

eTable 4: Impact of guidance assignment on health outcomes in the subset without prior assignment.

eAppendix I: Robustness for the loss to follow-up in the RD analysis.

eTable 5: Impact of assignment to the health guidance intervention on health outcomes, using weighted RDD to account for the missing data.

eAppendix J: Falsification test using pre-intervention outcomes.

eTable 6: Falsification test examining the impact of the health guidance intervention on health outcomes measured one year before the screening.

eAppendix K: Changes in drug use and lifestyle.

eTable 7: Effect of the guidance assignment on changes in drug use, smoking, and exercise habits.

eAppendix L: Impact of the health guidance intervention among women employees.

eTable 8: Impact of assignment to the health guidance intervention on health outcomes among women using fuzzy regression discontinuity design.

eAppendix M: Review of health screenings and lifestyle interventions around the world.

eTable 9: Review of the effects of screenings and lifestyle interventions on health outcomes.

eReferences.

1.
Wang  YC, McPherson  K, Marsh  T, Gortmaker  SL, Brown  M.  Health and economic burden of the projected obesity trends in the USA and the UK.   Lancet. 2011;378(9793):815-825. doi:10.1016/S0140-6736(11)60814-3PubMedGoogle ScholarCrossref
2.
Ng  M, Fleming  T, Robinson  M,  et al.  Global, regional, and national prevalence of overweight and obesity in children and adults during 1980-2013: a systematic analysis for the Global Burden of Disease Study 2013.   Lancet. 2014;384(9945):766-781. doi:10.1016/S0140-6736(14)60460-8PubMedGoogle ScholarCrossref
3.
Seidell  JC, Halberstadt  J.  The global burden of obesity and the challenges of prevention.   Ann Nutr Metab. 2015;66(suppl 2):7-12. doi:10.1159/000375143PubMedGoogle ScholarCrossref
4.
World Health Organization. Obesity and overweight. Accessed December 29, 2019. https://www.who.int/news-room/fact-sheets/detail/obesity-and-overweight
5.
Kaplan  LM, Golden  A, Jinnett  K,  et al.  Perceptions of barriers to effective obesity care: results from the National ACTION Study.   Obesity (Silver Spring). 2018;26(1):61-69. doi:10.1002/oby.22054PubMedGoogle ScholarCrossref
6.
Dwyer-Lindgren  L, Mackenbach  JP, van Lenthe  FJ, Flaxman  AD, Mokdad  AH.  Diagnosed and undiagnosed diabetes prevalence by county in the US, 1999-2012.   Diabetes Care. 2016;39(9):1556-1562. doi:10.2337/dc16-0678PubMedGoogle ScholarCrossref
7.
Nwankwo  T, Yoon  SS, Burt  V, Gu  Q.  Hypertension among adults in the United States: National Health and Nutrition Examination Survey, 2011-2012.   NCHS Data Brief. 2013;(133):1-8.PubMedGoogle Scholar
8.
Krogsbøll  LT, Jørgensen  KJ, Gøtzsche  PC.  General health checks in adults for reducing morbidity and mortality from disease.   Cochrane Database Syst Rev. 2019;1(1):CD009009. doi:10.1002/14651858.CD009009.pub3PubMedGoogle Scholar
9.
Japanese Ministry of Health, Labour and Welfare.  Annual Health, Labour and Welfare Report 2008-2009. Japanese Ministry of Health, Labour and Welfare;2010.
10.
Tsushita  K, S Hosler  A, Miura  K,  et al.  Rationale and descriptive analysis of specific health guidance: the nationwide lifestyle intervention program targeting metabolic syndrome in Japan.   J Atheroscler Thromb. 2018;25(4):308-322. doi:10.5551/jat.42010PubMedGoogle ScholarCrossref
11.
Japanese Ministry of Health, Labour and Welfare.  Status of Specific Health Checkups and Specific Health Guidance in 2017. Japanese Ministry of Health, Labour and Welfare;2019.
12.
Nishizawa  H, Shimomura  I.  Population approaches targeting metabolic syndrome focusing on Japanese trials.   Nutrients. 2019;11(6):E1430. doi:10.3390/nu11061430PubMedGoogle Scholar
13.
Curry  SJ, Krist  AH, Owens  DK,  et al; US Preventive Services Task Force.  Behavioral weight loss interventions to prevent obesity-related morbidity and mortality in adults: US Preventive Services Task Force recommendation statement.   JAMA. 2018;320(11):1163-1171. doi:10.1001/jama.2018.13022PubMedGoogle ScholarCrossref
14.
Japanese Ministry of Health, Labour and Welfare. Review of government’s projects. Accessed May 5, 2020. https://www.mhlw.go.jp/jigyo_shiwake/
15.
Lee  DS, Lemieux  T.  Regression discontinuity designs in economics.   J Econ Lit. 2010;48(2):281-355. doi:10.1257/jel.48.2.281Google ScholarCrossref
16.
Bor  J, Moscoe  E, Mutevedzi  P, Newell  ML, Bärnighausen  T.  Regression discontinuity designs in epidemiology: causal inference without randomized trials.   Epidemiology. 2014;25(5):729-737. doi:10.1097/EDE.0000000000000138PubMedGoogle ScholarCrossref
17.
Moscoe  E, Bor  J, Bärnighausen  T.  Regression discontinuity designs are underutilized in medicine, epidemiology, and public health: a review of current and best practice.   J Clin Epidemiol. 2015;68(2):122-133. doi:10.1016/j.jclinepi.2014.06.021PubMedGoogle ScholarCrossref
18.
Venkataramani  AS, Bor  J, Jena  AB.  Regression discontinuity designs in healthcare research.   BMJ. 2016;352:i1216. doi:10.1136/bmj.i1216PubMedGoogle ScholarCrossref
19.
Maas  IL, Nolte  S, Walter  OB,  et al.  The regression discontinuity design showed to be a valid alternative to a randomized controlled trial for estimating treatment effects.   J Clin Epidemiol. 2017;82:94-102. doi:10.1016/j.jclinepi.2016.11.008PubMedGoogle ScholarCrossref
20.
O’Keeffe  AG, Geneletti  S, Baio  G, Sharples  LD, Nazareth  I, Petersen  I.  Regression discontinuity designs: an approach to the evaluation of treatment efficacy in primary care using observational data.   BMJ. 2014;349:g5293. doi:10.1136/bmj.g5293PubMedGoogle ScholarCrossref
21.
Gelman  A, Imbens  G.  Why high-order polynomials should not be used in regression discontinuity designs.   J Bus Econ Stat. 2019;37(3):447-456. doi:10.1080/07350015.2017.1366909Google ScholarCrossref
22.
Calonico  S, Cattaneo  MD, Titiunik  R.  Robust nonparametric confidence intervals for regression-discontinuity designs.   Econometrica. 2014;82(6):2295-2326. doi:10.3982/ECTA11757Google ScholarCrossref
23.
Parzen  M, Lipsitz  SR, Ibrahim  JG, Lipshultz  S.  A weighted estimating equation for linear regression with missing covariate data.   Stat Med. 2002;21(16):2421-2436. doi:10.1002/sim.1195PubMedGoogle ScholarCrossref
24.
Knowler  WC, Barrett-Connor  E, Fowler  SE,  et al; Diabetes Prevention Program Research Group.  Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin.   N Engl J Med. 2002;346(6):393-403. doi:10.1056/NEJMoa012512PubMedGoogle ScholarCrossref
25.
Nakao  YM, Miyamoto  Y, Ueshima  K,  et al.  Effectiveness of nationwide screening and lifestyle intervention for abdominal obesity and cardiometabolic risks in Japan: the metabolic syndrome and comprehensive lifestyle intervention study on nationwide database in Japan (MetS ACTION-J study).   PLoS One. 2018;13(1):e0190862. doi:10.1371/journal.pone.0190862PubMedGoogle Scholar
Original Investigation
October 5, 2020

Association of the National Health Guidance Intervention for Obesity and Cardiovascular Risks With Health Outcomes Among Japanese Men

Author Affiliations
  • 1Human Health Sciences, Kyoto University Graduate School of Medicine, Kyoto, Japan
  • 2Graduate School of Economics, the University of Tokyo, Tokyo, Japan
  • 3Division of General Internal Medicine and Health Services Research, David Geffen School of Medicine at UCLA, Los Angeles, California
  • 4Department of Health Policy and Management, UCLA Fielding School of Public Health, Los Angeles, California
JAMA Intern Med. 2020;180(12):1630-1637. doi:10.1001/jamainternmed.2020.4334
Key Points

Question  Is the Japanese national health guidance intervention for obesity and cardiovascular risks associated with improved population health outcomes?

Findings  In this national cohort study of 74 693 working-age men in Japan, assignment to the health guidance intervention was associated with a small decrease in weight (−0.29 kg; 95% CI, −0.50 to −0.08) 1 year after the screening, an association that attenuated over time and was no longer significant by years 3 to 4. No evidence was found that the health guidance intervention was associated with changes in blood pressure, hemoglobin A1c level, or low-density lipoprotein cholesterol level in years 1 to 4.

Meaning  Among working-age men in Japan, the national health guidance intervention was not associated with clinically meaningful weight loss or other cardiovascular risk factor reduction; further research is warranted to understand the specific design of lifestyle intervention programs that are more effective in improving population health.

Abstract

Importance  Obesity and cardiovascular risks have become major public health problems. However, evidence is limited as to whether population-level lifestyle interventions for obesity and cardiovascular risk factors are associated with improved population health outcomes.

Objective  To investigate the association of the national health guidance intervention in Japan with population health outcomes.

Design, Setting, and Participants  This cohort study used a regression discontinuity design that included men aged 40 to 74 years who participated in the national health screening program in Japan from April 2013 to March 2018.

Exposures  Assignment to the national health guidance intervention (counseling on healthy lifestyle and appropriate clinical follow-up for individuals found to have waist circumference of 85 cm or greater with 1 or more cardiovascular risk factors during annual national health screening program).

Main Outcomes and Measures  Changes in obesity status (body weight, body mass index, waist circumference), and cardiovascular risk factors (blood pressure, hemoglobin A1c level, and low-density lipoprotein cholesterol level) 1 to 4 years after screening.

Results  Of 74 693 men (mean [SD] age, 52.1 [7.8] years; mean [SD] baseline waist circumference, 86.3 [9.0] cm), the assignment to the health guidance intervention was associated with lower weight (adjusted difference, −0.29 kg; 95% CI, −0.50 to −0.08; P = .005), body mass index (−0.10; 95% CI, −0.17 to −0.03; P = .008), and waist circumference (−0.34 cm; 95% CI, −0.59 to −0.04; P = .02) 1 year after screening. The observed association of the guidance assignment attenuated over time and was no longer significant by years 3 to 4. No evidence was found that the health guidance intervention was associated with changes in participants’ systolic blood pressure, diastolic blood pressure, hemoglobin A1c level, or low-density lipoprotein cholesterol level in years 1 to 4.

Conclusions and Relevance  Among working-age men in Japan, the national health guidance intervention was not associated with clinically meaningful weight loss or other cardiovascular risk factor reduction. Further research is warranted to understand the specific design of lifestyle interventions that are effective in improving obesity and cardiovascular risk factors.

Introduction

Obesity is an important modifiable risk factor that leads to many diseases, including diabetes, hypertension, dyslipidemia, coronary heart disease, and stroke.1-3 Globally, an estimated 1.9 billion adults are overweight, and an additional 650 million are obese.4 Obesity can potentially be mitigated by lifestyle modifications, including a healthy diet and increased physical activity. Moreover, obesity-related health complications can be substantially reduced by using effective, inexpensive medications. Nevertheless, as many as half of the obese individuals are unaware of the health risks thus incurred.5 Consequently, many of them have undiagnosed diabetes and hypertension,6,7 indicating that there are missed opportunities to decrease the global burden of disease related to obesity. With the aim of reducing the risk of cardiovascular diseases, screening programs for obesity and cardiovascular risk factors and associated lifestyle intervention programs have been implemented in many countries. However, evidence is limited as to whether population-level screening programs and accompanied lifestyle interventions for obesity and cardiovascular risk factors reduce mortality or the incidence of cardiovascular diseases.8

In 2008, Japan introduced a nationwide screening program to identify individuals with high obesity and cardiovascular risks (known as metabolic syndrome) and to provide health guidance to reduce weight and improve cardiovascular risk.9,10 All adults aged 40 to 74 years were required by law to participate every year, and approximately 29 million people in Japan received the screening program in 2017.11 An important feature of the national program is that, in addition to screening individuals, it provides lifestyle intervention programs for patients at high cardiovascular risk, which is more intensive than many similar programs in other countries. Given that many other countries, employers, and insurers globally are considering similar lifestyle intervention programs to improve population health and lower health expenditures,12,13 it is important to study the impact of this national health guidance intervention using a robust, quasi-experimental design.

We investigated the association of the assignment to the health guidance intervention on participants’ health outcomes among working-age men who participated in the Japanese national screening program. To estimate the association of the health guidance intervention with health outcomes, we used a quasiexperimental regression discontinuity (RD) design. This approach takes advantage of the fact that participants who fall just above or below an arbitrary set threshold value of a continuous variable (waist circumference) are similar in every aspect except for that only those whose waist circumference was above the threshold had a higher probability of assignment to the intervention (the national health guidance intervention).

Methods
Data Source

We analyzed a nationwide cohort with annual health screening data between April 2013 and March 2018 from one of the largest employment-based health insurers in Japan (the national sample of employees of civil engineering and construction companies). The database includes information on demographic characteristics (age and sex), obesity status (weight, body mass index [BMI], and waist circumference), cardiovascular risk factors (systolic and diastolic blood pressure, hemoglobin A1c [HbA1c] level, and low-density lipoprotein [LDL] cholesterol level), medication use, and lifestyle (smoking status, alcohol use, and exercise habits). Baseline variables were measured using the results of the first health screening in 2014. Health outcomes were measured during the health screening in subsequent years (2015-2018). This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.

National Health Guidance Intervention in Japan

The screening program consists of multiple steps to identify high-risk populations and provide counseling for adopting healthy lifestyles and seeking medical treatment (ie, the health guidance intervention) to those participants identified as being at high risk. Participants with waist circumferences greater than the sex-specific thresholds (85 cm for men and 90 cm for women) and had 1 or more cardiovascular risk factors (hypertension, diabetes, or dyslipidemia) were required to undergo the health guidance intervention (in addition to receiving a summary report of screening results). Those who were taking antihypertensive, antidiabetic, and antihyperlipidemic drugs—individuals who presumably are cared for and given guidance by clinicians—were not required to undergo the health guidance intervention. Participants who did not meet these criteria received a summary report of screening results via mail (did not undergo the health guidance intervention). The insurers used mail or telephone calls to reach out to participants who were assigned to the health guidance intervention (ie, those determined to be at high risk).

Japan’s national health guidance intervention includes content related to exercise, diet, and medical visits. The intervention is provided by trained instructors supervised by physicians, public health nurses, and dietitians (many instructors themselves are qualified as dietitians or public health nurses). The health guidance intervention was provided through an initial interview by the instructor (individual support ≥20 minutes or group support ≥80 minutes), followed by continuous support for a duration of 3 months or more if determined necessary by the assigned instructor based on the participant’s cardiovascular risk factors (eAppendix A in the Supplement). For those participants who still have a waist circumference greater than the threshold (plus 1 or more risk factors) after receiving the health guidance intervention in the prior year, another health guidance intervention would be provided as a de novo intervention (not as a continuation of guidance provided in the first year). The government subsidizes the cost of the guidance conducted by insurers. The estimated cost of the health guidance intervention was $150 million (1 US dollar = 106 Japanese yen) per year.14 More details about the government’s guideline for the national health guidance intervention is available in eAppendix A and eFigure 1 in the Supplement.

Participants

Among 127 322 men aged 40 to 74 years who were eligible for the screening program, 102 764 (80.7%) received baseline screening. We excluded participants without follow-up screening (n = 11 684). After excluding those with any missing covariates (n = 16 387), we analyzed 74 693 men (eFigure 2 in the Supplement). We focused on the working-age male population because of the small number of women who were corporate employees (n = 11 235), of which only a small proportion (11%) met criteria to receive the health guidance intervention. Nevertheless, as a secondary analysis, we also examined the association of the health guidance intervention with health outcomes among female employees.

Health Outcomes

Our main outcomes were changes in obesity status—body weight, BMI, and waist circumference—1 year after the screening program. Our secondary outcomes were changes in cardiovascular risk factors 1 year after the screening program—systolic blood pressure, diastolic blood pressure, HbA1c level, and LDL cholesterol level. We also examined longer term (2-4 years after the screening) association of the national health guidance intervention (using the 2016-2018 data).

Statistical Analysis

To estimate the association of the health guidance intervention with health outcomes, we used a quasiexperimental RD design. The RD design takes advantage of clinical or policy decision rules in which participants are differentially assigned to interventions or control groups if they fall above or below an arbitrary cutoff for a continuous variable.15-19 In this study, we used the RD model with waist circumference as the assignment variable, noting that participants with waist circumferences above the arbitrary cutoff (85 cm) had a higher probability of receiving an intervention (ie, health guidance intervention) relative to those with waist circumferences below this cutoff. The RD design compares individuals whose value of the assignment variable (waist circumference) is within the selected bandwidth (6 cm in our study) just above vs below the cutoff level. The RD method is appropriate in this case because individuals who fell just above or below the cutoff value were similar in most aspects except whether they received the intervention. The RD design is preferable to a difference-in-differences method because the latter has an untestable assumption that the outcome variable of treatment and control groups follow parallel trajectories in the absence of the intervention. In sharp RD designs, the value of the assignment variable deterministically determines whether participants receive the intervention; the receipt of intervention is probabilistically determined in fuzzy RD designs.20 In this study, we used the fuzzy RD design because the assignment to health guidance intervention was determined based not only on the value of waist circumference, but on several other factors (eAppendix C in the Supplement). Our data confirmed that the probability of assignment to the health guidance intervention changed dramatically at the threshold level of waist circumference, supporting the validity of our method (eFigure 3 in the Supplement).

In our main RD model, we used a local linear RD estimation with robust bias-corrected CIs to avoid overfitting of the data.21 To account for potential differences in other characteristics around the threshold of waist circumference, we adjusted for participants’ age, current smoking status (yes/no), alcohol use (not every day; every day, small amount; or every day, large amount), exercise habit (yes/no), systolic and diastolic blood pressure, HbA1c level, LDL cholesterol level, and medication use (indicator variables for antihypertensive drugs, antidiabetic drugs, and antihyperlipidemic drugs) at baseline (measured during the initial screening). We implemented the bias-corrected nonparametric inference procedure, which would be robust to wide bandwidth selection.22 In the RD model, we used a triangular kernel function, which gave more weight to participants near the threshold level.

The primary focus of this study was to examine the association of the assignment to the health guidance intervention with health outcomes (ie, the intention-to-treat effect). However, we were also interested in the association of the actual receipt of the health guidance intervention with outcomes (ie, the treatment-on-the-treated [ToT] effect). Data on actual receipt of the health guidance intervention were available only for 2017 to 2018; therefore, we investigated the association of the receipt (the ToT effect) of the health guidance intervention in 2017 with health outcomes in 2018 using the RD model.

Secondary Analyses

We conducted several secondary analyses. First, we investigated how the probability of assignment to the health guidance intervention changed around the cutoff value of the participants’ waist circumferences. Second, we tested whether the density of waist circumference changed smoothly at the threshold using the McCray test.23 Third, to test the smooth continuity of observed covariates at the threshold level of waist circumference, we conducted the RD model using covariates as the outcome variable and waist circumference as the explanatory variable. Fourth, we varied bandwidth to test the robustness of our findings based on the selection of bandwidth. Fifth, to evaluate whether our findings were sensitive to the selection of adjustment variables in the RD model, we reanalyzed the data without adjusting for covariates. Sixth, to investigate the effect of some participants having received the same health guidance intervention in the prior year, we reanalyzed the data, restricting our sample to participants who were not assigned to the health guidance intervention in 2013. Seventh, the data on health outcomes were missing for 11.4% (11 684 of 102 764) of participants due to loss to follow-up. To test how this affects our findings, we conducted a weighted RD analysis in which weights were generated on the basis of the inverse probability of health outcome data being observed.23 Eighth, as a falsification test, we conducted the RD assessing the association of assignment to the health guidance intervention in 2014 with their health outcomes in 2013. Ninth, we examined the impact of the health guidance intervention on changes in the proportion of participants taking relevant drugs (antihypertensive, antidiabetic, and antihyperlipidemic drugs), their smoking status, and exercise habits. Finally, to test whether the association of the health guidance intervention with health outcomes varies between men and women employees, we also investigated the association of the health guidance intervention with health outcomes among working women.

All tests were 2-sided; P values less than .05 were considered statistically significant. All analyses were performed using Stata, version 16.1 (StataCorp).

Ethical Review of Study

The institutional review board of Kyoto University approved all study procedures (approval No. R0817). The institutional review board waived informed consent for participants owing to the use of deidentified data.

Results
Participant Characteristics

A total of 74 693 men were included in our RD analysis (39 161 within bandwidth). The mean (SD) age was 52.1 (7.8) years; the mean (SD) waist circumference was 86.3 (9.0) cm; and the mean (SD) BMI was 24.5 (3.4) at baseline. Table 1 summarizes the characteristics of participants within the optimal bandwidth of waist circumference. We found no evidence of discontinuity for observed covariates at the threshold of waist circumference, suggesting the smooth distribution of observed covariates at the threshold (eAppendix E and eTable 1 in the Supplement). These results support the validity of the quasirandomization of participants to the intervention and control groups on both sides of the cutoff value. We found that 15.9% of participants (6176 of 38 894) who were assigned to the health guidance intervention actually received the guidance in 2017 (the proportion of the participants who complied with the requirement to receive health guidance intervention).

Distribution of Baseline Waist Circumference

Waist circumference was distributed with a median (interquartile range) of 85.5 (80.3-91.5) cm, and 53.1% of participants (54 548 of 102 764) had waist circumferences above the threshold. The smooth distribution (no evidence of manipulation) of waist circumference around the threshold level is shown in eFigure 4 in the Supplement.

Association of the National Health Guidance Intervention With Health Outcomes

Figure 1 shows the RD plots of change in obesity status (weight, BMI, and waist circumference) around the threshold level. We observed a sharp downward discontinuity in the changes in weight, BMI, and waist circumference. We found that the assignment to health guidance intervention was associated with lower weight (adjusted difference, −0.29 kg; 95% CI, −0.50 to −0.08; P = .005), BMI (−0.10; 95% CI, −0.17 to −0.03; P = .008) and waist circumference (−0.34 cm; 95% CI, −0.59 to −0.04; P = .02) 1 year after screening (Table 2). The observed weight loss attenuated over time, and it was no longer significant by years 3 to 4.

Figure 2 illustrates the RD plots of change in cardiovascular risk factors (systolic blood pressure, diastolic blood pressure, HbA1c level, and LDL cholesterol level) around the threshold level. We found no evidence that the assignment to the health guidance intervention was associated with changes in cardiovascular risk factors in 1 to 4 years (Table 2).

The RD analysis of the ToT effect (using participants who did not meet the criteria to receive the guidance as the control group) showed that receipt of the guidance was associated with lower weight (−1.56 kg; 95% CI, −3.10 to −0.22; P = .02) and lower BMI (−0.61; 95% CI, −1.19 to −0.14; P = .01) 1 year after the screening, whereas we found no evidence that receipt of the guidance was associated with changes in the cardiovascular risk factors (Table 3).

Secondary Analyses

The probability of assignment to the health guidance intervention sharply increased as the participant’s waist circumference rose above the threshold level, as expected (eFigure 3 in the Supplement). The result of the McCray test showed no evidence of manipulation of the waist circumference value by participants or examiners during the screening (eAppendix B in the Supplement). We found no discontinuities in observed covariates at the threshold of waist circumference (eTable 1 in the Supplement).

Our findings were qualitatively unaffected by the use of different bandwidth selections, the analysis without covariates adjustments; restriction of our sample to participants who were not assigned to the health guidance intervention a year before; or accounting for missing data on health outcomes using inverse probability weights in the regression models (eTables 2-5 in the Supplement). The results of our falsification test showed no evidence of the effect of the guidance in 2013 on health outcomes in 2014, as expected (eTable 6 in the Supplement). We found no evidence that health guidance intervention was associated with changes in the rates of drug use, smoking status, and exercise habits (eTable 7 in the Supplement). We found similar results for women, but CIs were larger owing to a smaller sample size (eTable 8 in the Supplement).

Discussion

Among working-age men who underwent the national health screening program in Japan, we found that the government-implemented health guidance intervention was associated with very small weight loss; the magnitude of weight loss was not clinically meaningful and no longer significant in the longer follow-up. We found no evidence that the health guidance intervention was associated with improvement in cardiovascular risk factors.

The observed effect size of a weight reduction of approximately 0.4% (a reduction of 0.29 kg from the baseline mean weight of 71.4 kg) was modest at best. However, it was the intention-to-treat effect (an estimated effect of assignment to the health guidance intervention), and we also found that ToT effect (effect of receipt of the guidance) was 5 to 6 times greater. The observed weight loss (ToT effect) of −2.2% (1.56 kg reduction) in our study was smaller than other lifestyle interventions for obesity, such as the 6.0% weight loss seen with the Diabetes Prevention Program.24 This is probably because the threshold of waist circumference was relatively low; therefore, the population that received the intervention was relatively healthy. It may also be the case that the influence of an intervention for obesity implemented in the real world (effectiveness) may be smaller than what we find in randomized clinical trials (RCTs) (efficacy) because participants recruited in randomized clinical trials are usually self-selected, highly motivated individuals.

We found no evidence that health guidance intervention was associated with improvements in blood pressure, HbA1c level, and LDL cholesterol level. There are several potential explanations. First, the marginal population with waist circumferences around the threshold value was relatively healthy; therefore, the magnitude of the improvement, even if it existed, might be too small to be detected even with the large sample size of our study. Second, the health guidance intervention focused on improving obesity, and improving cardiovascular risk factors was secondary. Third, given that participants were relatively healthy, the proportion of participants who required medical interventions, which may be needed to improve cardiovascular risk factors, was small. Lastly, although the health guidance intervention in Japan was implemented as a mandatory program, it has not been effectively enforced (only 15.9% of eligible participants actually received the intervention in 2017), which may explain why we did not observe clinically meaningful improvements in health outcomes.

Our findings were consistent with existing evidence8 that found very small, short-term (no clinically meaningful) effects of lifestyle interventions on weight loss (findings from previous studies are summarized in eAppendix M in the Supplement). Given that the exact design of lifestyle interventions varies from one to another, it is possible that more intensive programs—such as the one implemented in Japan—may be more effective than other programs. Our findings differed from a study by Nakao et al25 that compared individuals who attended the health guidance intervention (compliers) vs those who did not (noncompliers) and reported dramatic improvements in both weight and cardiovascular risk factors. However, compliers and noncompliers differed in ways that could not be accounted for by adjusting for only observed variables (compliers might be more motivated to improve lifestyle than noncompliers); therefore, their findings might overestimate the impact of the guidance. To address this issue, as secondary analyses, they also used the facility-level proportion of participants who underwent the health guidance intervention as an instrument in the instrumental variable method. However, facilities that attracted more health-conscious participants are likely to experience a larger improvement in health outcomes, and such violation of the exclusion restriction of the instrumental variable method leads to biased estimates. Our choice of the RD method, which is often used in situations that do not permit randomized clinical trials, leverages the fact that individuals just above and below the threshold value of the assignment variable are likely similar and that treatment assignment above the arbitrary cutoff simulates randomization. This design is another, potentially more robust, method to evaluate the association of the health guidance intervention with health outcomes.

Limitations

Our study has limitations. First, the lack of data on more detailed information about the health guidance intervention each participant received (eg, whether participants underwent individual vs group interviews) precluded us from evaluating whether the association of the health guidance intervention varied by how it was delivered. Second, we could not identify the exact reason as to why the observed association attenuated over time. We could not disentangle 2 potential mechanisms: the guidance had only a short-term impact, as is the case with many lifestyle interventions, or it was due to treatment contamination of the study population (ie, more individuals who were just below the threshold at the initial screening gain weight and became eligible for the guidance over time). Finally, given that our study focused on corporate employees in Japan, the findings may not be generalizable to individuals who are unemployed or to populations of other countries.

Conclusions

In summary, among working-age men in Japan, we found that the government-led national health guidance intervention was not associated with clinically meaningful or sustained weight loss. We found no evidence that health guidance intervention was associated with improvements in cardiovascular risk factors. Given the high cost of national program implementation, the intervention deployed in this intensive risk reduction program needs to be reevaluated and retooled to more effectively improve population health outcomes.

Back to top
Article Information

Accepted for Publication: July 13, 2020.

Published Online: October 5, 2020. doi:10.1001/jamainternmed.2020.4334

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Fukuma S et al. JAMA Internal Medicine.

Corresponding Author: Shingo Fukuma, MD, PhD, Human Health Sciences, Kyoto University Graduate School of Medicine, 54 Shogoin-Kawahara, Sakyo, Kyoto, 606-8507, Japan (fukuma.shingo.3m@kyoto-u.ac.jp).

Author Contributions: Dr Fukuma had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Study concept and design: All authors.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Fukuma, Ikenoue, Tsugawa.

Critical revision of the manuscript for important intellectual content: Fukuma, Iizuka, Tsugawa.

Statistical analysis: Fukuma, Iizuka.

Obtained funding: Fukuma.

Administrative, technical, or material support: Fukuma, Ikenoue.

Study supervision: Tsugawa.

Conflict of Interest Disclosures: Dr Fukuma reported receiving grants from the Japan Society for the Promotion of Science (JSPS) during the conduct of the study and grants from Sompo Health Support outside the submitted work. No other disclosures were reported.

Additional Contributions: We thank the Health Insurance Association for Architecture and Civil Engineering companies (Kunio Mizuta and Akio Yoda) for their support in developing the database, and Hirotaka Kato, PhD (David Geffen School of Medicine at UCLA), Yoshiyuki Saito, PharmD (Kyoto University Graduate School of Medicine), and Yukari Yamada PhD (Kyoto University Graduate School of Medicine), for helpful feedback. These individuals were not compensated for their contributions.

References
1.
Wang  YC, McPherson  K, Marsh  T, Gortmaker  SL, Brown  M.  Health and economic burden of the projected obesity trends in the USA and the UK.   Lancet. 2011;378(9793):815-825. doi:10.1016/S0140-6736(11)60814-3PubMedGoogle ScholarCrossref
2.
Ng  M, Fleming  T, Robinson  M,  et al.  Global, regional, and national prevalence of overweight and obesity in children and adults during 1980-2013: a systematic analysis for the Global Burden of Disease Study 2013.   Lancet. 2014;384(9945):766-781. doi:10.1016/S0140-6736(14)60460-8PubMedGoogle ScholarCrossref
3.
Seidell  JC, Halberstadt  J.  The global burden of obesity and the challenges of prevention.   Ann Nutr Metab. 2015;66(suppl 2):7-12. doi:10.1159/000375143PubMedGoogle ScholarCrossref
4.
World Health Organization. Obesity and overweight. Accessed December 29, 2019. https://www.who.int/news-room/fact-sheets/detail/obesity-and-overweight
5.
Kaplan  LM, Golden  A, Jinnett  K,  et al.  Perceptions of barriers to effective obesity care: results from the National ACTION Study.   Obesity (Silver Spring). 2018;26(1):61-69. doi:10.1002/oby.22054PubMedGoogle ScholarCrossref
6.
Dwyer-Lindgren  L, Mackenbach  JP, van Lenthe  FJ, Flaxman  AD, Mokdad  AH.  Diagnosed and undiagnosed diabetes prevalence by county in the US, 1999-2012.   Diabetes Care. 2016;39(9):1556-1562. doi:10.2337/dc16-0678PubMedGoogle ScholarCrossref
7.
Nwankwo  T, Yoon  SS, Burt  V, Gu  Q.  Hypertension among adults in the United States: National Health and Nutrition Examination Survey, 2011-2012.   NCHS Data Brief. 2013;(133):1-8.PubMedGoogle Scholar
8.
Krogsbøll  LT, Jørgensen  KJ, Gøtzsche  PC.  General health checks in adults for reducing morbidity and mortality from disease.   Cochrane Database Syst Rev. 2019;1(1):CD009009. doi:10.1002/14651858.CD009009.pub3PubMedGoogle Scholar
9.
Japanese Ministry of Health, Labour and Welfare.  Annual Health, Labour and Welfare Report 2008-2009. Japanese Ministry of Health, Labour and Welfare;2010.
10.
Tsushita  K, S Hosler  A, Miura  K,  et al.  Rationale and descriptive analysis of specific health guidance: the nationwide lifestyle intervention program targeting metabolic syndrome in Japan.   J Atheroscler Thromb. 2018;25(4):308-322. doi:10.5551/jat.42010PubMedGoogle ScholarCrossref
11.
Japanese Ministry of Health, Labour and Welfare.  Status of Specific Health Checkups and Specific Health Guidance in 2017. Japanese Ministry of Health, Labour and Welfare;2019.
12.
Nishizawa  H, Shimomura  I.  Population approaches targeting metabolic syndrome focusing on Japanese trials.   Nutrients. 2019;11(6):E1430. doi:10.3390/nu11061430PubMedGoogle Scholar
13.
Curry  SJ, Krist  AH, Owens  DK,  et al; US Preventive Services Task Force.  Behavioral weight loss interventions to prevent obesity-related morbidity and mortality in adults: US Preventive Services Task Force recommendation statement.   JAMA. 2018;320(11):1163-1171. doi:10.1001/jama.2018.13022PubMedGoogle ScholarCrossref
14.
Japanese Ministry of Health, Labour and Welfare. Review of government’s projects. Accessed May 5, 2020. https://www.mhlw.go.jp/jigyo_shiwake/
15.
Lee  DS, Lemieux  T.  Regression discontinuity designs in economics.   J Econ Lit. 2010;48(2):281-355. doi:10.1257/jel.48.2.281Google ScholarCrossref
16.
Bor  J, Moscoe  E, Mutevedzi  P, Newell  ML, Bärnighausen  T.  Regression discontinuity designs in epidemiology: causal inference without randomized trials.   Epidemiology. 2014;25(5):729-737. doi:10.1097/EDE.0000000000000138PubMedGoogle ScholarCrossref
17.
Moscoe  E, Bor  J, Bärnighausen  T.  Regression discontinuity designs are underutilized in medicine, epidemiology, and public health: a review of current and best practice.   J Clin Epidemiol. 2015;68(2):122-133. doi:10.1016/j.jclinepi.2014.06.021PubMedGoogle ScholarCrossref
18.
Venkataramani  AS, Bor  J, Jena  AB.  Regression discontinuity designs in healthcare research.   BMJ. 2016;352:i1216. doi:10.1136/bmj.i1216PubMedGoogle ScholarCrossref
19.
Maas  IL, Nolte  S, Walter  OB,  et al.  The regression discontinuity design showed to be a valid alternative to a randomized controlled trial for estimating treatment effects.   J Clin Epidemiol. 2017;82:94-102. doi:10.1016/j.jclinepi.2016.11.008PubMedGoogle ScholarCrossref
20.
O’Keeffe  AG, Geneletti  S, Baio  G, Sharples  LD, Nazareth  I, Petersen  I.  Regression discontinuity designs: an approach to the evaluation of treatment efficacy in primary care using observational data.   BMJ. 2014;349:g5293. doi:10.1136/bmj.g5293PubMedGoogle ScholarCrossref
21.
Gelman  A, Imbens  G.  Why high-order polynomials should not be used in regression discontinuity designs.   J Bus Econ Stat. 2019;37(3):447-456. doi:10.1080/07350015.2017.1366909Google ScholarCrossref
22.
Calonico  S, Cattaneo  MD, Titiunik  R.  Robust nonparametric confidence intervals for regression-discontinuity designs.   Econometrica. 2014;82(6):2295-2326. doi:10.3982/ECTA11757Google ScholarCrossref
23.
Parzen  M, Lipsitz  SR, Ibrahim  JG, Lipshultz  S.  A weighted estimating equation for linear regression with missing covariate data.   Stat Med. 2002;21(16):2421-2436. doi:10.1002/sim.1195PubMedGoogle ScholarCrossref
24.
Knowler  WC, Barrett-Connor  E, Fowler  SE,  et al; Diabetes Prevention Program Research Group.  Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin.   N Engl J Med. 2002;346(6):393-403. doi:10.1056/NEJMoa012512PubMedGoogle ScholarCrossref
25.
Nakao  YM, Miyamoto  Y, Ueshima  K,  et al.  Effectiveness of nationwide screening and lifestyle intervention for abdominal obesity and cardiometabolic risks in Japan: the metabolic syndrome and comprehensive lifestyle intervention study on nationwide database in Japan (MetS ACTION-J study).   PLoS One. 2018;13(1):e0190862. doi:10.1371/journal.pone.0190862PubMedGoogle Scholar
×