High-Throughput, Contact-Free Detection of Atrial Fibrillation From Video With Deep Learning | Atrial Fibrillation | JAMA Cardiology | JAMA Network
[Skip to Navigation]
Access to paid content on this site is currently suspended due to excessive activity being detected from your IP address Please contact the publisher to request reinstatement.
Freedman  B, Camm  J, Calkins  H,  et al; AF-Screen Collaborators.  Screening for atrial fibrillation: a report of the AF-SCREEN international collaboration.  Circulation. 2017;135(19):1851-1867. doi:10.1161/CIRCULATIONAHA.116.026693PubMedGoogle ScholarCrossref
Yan  BP, Lai  WHS, Chan  CKY,  et al.  Contact-free screening of atrial fibrillation by a smartphone using facial pulsatile photoplethysmographic signals.  J Am Heart Assoc. 2018;7(8):e008585. doi:10.1161/JAHA.118.008585PubMedGoogle Scholar
Sun  Y, Thakor  N.  Photoplethysmography revisited: from contact to noncontact, from point to imaging.  IEEE Trans Biomed Eng. 2016;63(3):463-477. doi:10.1109/TBME.2015.2476337PubMedGoogle ScholarCrossref
Poh  MZ, Poh  YC, Chan  PH,  et al.  Diagnostic assessment of a deep learning system for detecting atrial fibrillation in pulse waveforms.  Heart. 2018;104(23):1921-1928. doi:10.1136/heartjnl-2018-313147PubMedGoogle ScholarCrossref
Research Letter
November 27, 2019

High-Throughput, Contact-Free Detection of Atrial Fibrillation From Video With Deep Learning

Author Affiliations
  • 1Division of Cardiology, Department of Medicine and Therapeutics, Faculty of Medicine, The Chinese University of Hong Kong, Hong Kong SAR, China
  • 2Division of Cardiology, Department of Medicine and Therapeutics, Prince of Wales Hospital, Hong Kong SAR, China
  • 3Heart and Vascular Institute, The Chinese University of Hong Kong, Hong Kong SAR, China
  • 4Heart Research Institute, Charles Perkins Centre, and Concord Hospital Cardiology, University of Sydney, Australia
  • 5Cardiio Inc, Cambridge, Massachusetts
JAMA Cardiol. 2020;5(1):105-107. doi:10.1001/jamacardio.2019.4004

Approaches for atrial fibrillation (AF) detection can screen only 1 patient at a time.1 In 2018,2 we demonstrated a novel method of AF detection by analyzing facial photoplethysmographic (FPPG) signals without physical contact using a smartphone camera.2 In this proof-of-concept study, we prospectively evaluated the feasibility of high-throughput AF detection by analyzing FPPG signals3 from multiple patients concurrently using a single digital camera and a pretrained deep convolutional neural network (DCNN).4

After institutional approval from the Joint Chinese University of Hong Kong–New Territories East Cluster Clinical Research Ethics Committee and individual written informed consent, 20 patients (mean [SD] age, 76.6 [7.6] years; 12 men [60%]) with permanent AF and 24 control individuals (mean [SD] age, 56.8 [20.2] years; 14 men [58.3%]) in sinus rhythm (SR) were recruited. A digital camera (50D; Canon) was used to film 5 patients sitting in a row 150 cm away (Figure). We recorded 64 videos (1-minute duration, 24 FPS), each capturing 5 patients simultaneously in 32 different heart-rhythm permutations based on a 5-participant binary (AF/SR) matrix and repeated once using patients chosen at random. Patients were instructed to keep their head stationary and not talk. The FPPG signals from patients were automatically extracted from the videos, resampled to 30 Hz, and analyzed in segments of 512 samples using Cardiio Deep Rhythm (Cardiio Inc), a DCNN previously trained for detecting AF from PPG waveforms.4 Pulse irregularity in more than 50% FPPG segments for each patient was considered positive for AF. The investigator applying DCNN was blinded to the reference electrocardiogram (ECG) and participant binary matrix.