[Skip to Navigation]
Original Investigation
July 7, 2021

Development and Validation of Image-Based Deep Learning Models to Predict Surgical Complexity and Complications in Abdominal Wall Reconstruction

Author Affiliations
  • 1Department of Surgery, Franciscus Gasthuis en Vlietland, Rotterdam, the Netherlands
  • 2Division of Gastrointestinal and Minimally Invasive Surgery, Department of Surgery, Carolinas Medical Center, Charlotte, North Carolina
  • 3Department of Surgery, Carolinas Medical Center, Charlotte, North Carolina
  • 4Department of Surgery, University of Pennsylvania, Philadelphia
  • 5Department of Colorectal Surgery, Royal Devon and Exeter NHS Foundation Trust, Royal Devon and Exeter Hospital, Exeter, United Kingdom
  • 6Division of Plastic Surgery, Department of Surgery, Perelman School of Medicine, Philadelphia, Pennsylvania
JAMA Surg. Published online July 7, 2021. doi:10.1001/jamasurg.2021.3012
Key Points

Question  Can deep learning models (DLMs) using routine preoperative imaging predict surgical complexity and outcomes in abdominal wall reconstruction?

Findings  In this quality improvement study, 3 DLMs were developed and validated from 369 patients and 9303 images. DLMs predicting complexity (receiver operating curve = 0.744) and infection (receiver operating curve = 0.898) performed strongly and surgical complexity DLM was more accurate than expert surgeons; prediction of postoperative pulmonary failure was less effective (receiver operating curve = 0.545).

Meaning  DLMs built using routine preoperative imaging may successfully predict surgical complexity and postoperative outcomes in abdominal wall reconstruction.

Abstract

Importance  Image-based deep learning models (DLMs) have been used in other disciplines, but this method has yet to be used to predict surgical outcomes.

Objective  To apply image-based deep learning to predict complexity, defined as need for component separation, and pulmonary and wound complications after abdominal wall reconstruction (AWR).

Design, Setting, and Participants  This quality improvement study was performed at an 874-bed hospital and tertiary hernia referral center from September 2019 to January 2020. A prospective database was queried for patients with ventral hernias who underwent open AWR by experienced surgeons and had preoperative computed tomography images containing the entire hernia defect. An 8-layer convolutional neural network was generated to analyze image characteristics. Images were batched into training (approximately 80%) or test sets (approximately 20%) to analyze model output. Test sets were blinded from the convolutional neural network until training was completed. For the surgical complexity model, a separate validation set of computed tomography images was evaluated by a blinded panel of 6 expert AWR surgeons and the surgical complexity DLM. Analysis started February 2020.

Exposures  Image-based DLM.

Main Outcomes and Measures  The primary outcome was model performance as measured by area under the curve in the receiver operating curve (ROC) calculated for each model; accuracy with accompanying sensitivity and specificity were also calculated. Measures were DLM prediction of surgical complexity using need for component separation techniques as a surrogate and prediction of postoperative surgical site infection and pulmonary failure. The DLM for predicting surgical complexity was compared against the prediction of 6 expert AWR surgeons.

Results  A total of 369 patients and 9303 computed tomography images were used. The mean (SD) age of patients was 57.9 (12.6) years, 232 (62.9%) were female, and 323 (87.5%) were White. The surgical complexity DLM performed well (ROC = 0.744; P < .001) and, when compared with surgeon prediction on the validation set, performed better with an accuracy of 81.3% compared with 65.0% (P < .001). Surgical site infection was predicted successfully with an ROC of 0.898 (P < .001). However, the DLM for predicting pulmonary failure was less effective with an ROC of 0.545 (P = .03).

Conclusions and Relevance  Image-based DLM using routine, preoperative computed tomography images was successful in predicting surgical complexity and more accurate than expert surgeon judgment. An additional DLM accurately predicted the development of surgical site infection.

Limit 200 characters
Limit 25 characters
Conflicts of Interest Disclosure

Identify all potential conflicts of interest that might be relevant to your comment.

Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.

Err on the side of full disclosure.

If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.

Not all submitted comments are published. Please see our commenting policy for details.

Limit 140 characters
Limit 3600 characters or approximately 600 words
    ×