Analysis of Vaccine Effectiveness Against COVID-19 and the Emergence of Delta and Other Variants of Concern in Utah

This cross-sectional study analyzes the effectiveness of COVID-19 vaccines against Delta and other variants in Utah.


Introduction
Since the emergence of SARS-CoV-2, vaccines have been heralded as the best way to curtail the COVID-19 pandemic.Clinical trials have shown SARS-CoV-2 vaccines to be highly efficacious against both disease and infection. 1However, those vaccines currently in use were primarily tested against early lineages.Data on vaccine effectiveness against variants of concern (VOCs) remains limited, including the Delta variant (B.1.617.2).
The spread of VOCs with significantly higher transmissibility (eg, the Delta variant), has raised concerns about ability for vaccines to sustainably control SARS-CoV-2.These concerns are exacerbated by the increasing number of cases reported in fully vaccinated individuals as the Delta variant spreads globally, potentially signaling a decreased vaccine effectiveness for VOCs. 2 A preliminary study 3 in the UK on the vaccine effectiveness of the BNT162b2 (Pfizer/BioNTech) and ChAdOx1 (AstraZeneca) vaccines found a 6% reduction in efficacy for the BNT162b2 vaccine and a 12% reduction for the ChAdOx1 vaccine.However, because of Delta's recent emergence and low case numbers, this study only included 27 fully vaccinated cases altogether.

Methods
This cross-sectional study uses the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.This work was based on aggregate publicly available data and hence deemed not to be human participant research nor to require informed consent, per the Common Rule.
The Utah Department of Health (UDOH) began monitoring VOCs in October 2020 and first identified 2 cases with Delta in mid-April 2021. 4In this analysis, we use publicly available data from UDOH, 4 including unlinked daily numbers of cases alongside their vaccination status and proportion of variant among cases.Currently, UDOH sequences 10% of reported cases and collects vaccination coverage for all cases.
The percent of breakthrough cases in Utah was increasing at a concerning rate (Figure 1) with the emergence and spread of Delta (Figure 2).To determine the effectiveness of the vaccines deployed in Utah against testing positive to SARS-CoV-2, we estimated the combined daily vaccine effectiveness (VE t ) using the field evaluation approach in Orenstein et al. 5 We then extend this method to understand the rate of breakthrough infections in the face of a rapidly changing variant landscape.To estimate the vaccine effectiveness against Delta alone, we partition VE t into the vaccine effectiveness of the Delta variant (VE δ ) and the vaccine effectiveness of all other variants (VE 1δ ) such that VE t = VE 1δ × P 1δ + VE δ × P δ , with P δ as the proportion of sequenced cases that were from the Delta variant, and P 1-δ as the proportion sequenced that is not Delta.R version 3.6.2(R Project for Statistical Computing) was used for calculations, and data analysis was performed from January to October 2021.No statistical testing was conducted as part of this analysis.
Author affiliations and article information are listed at the end of this article.The 14-day moving mean of the percentage of breakthrough cases against the percentage of the population vaccinated (blue) from January 16 to October 9, 2021, with the theoretical curves for the expected percentage of breakthrough cases with vaccine effectiveness ranging from 80% to 95% (gray dashed lines).
This decline occurred simultaneously as a rapid increase in the proportion of cases infected with the Delta variant (Figure 2B).Since the first case of Delta was detected, Delta has rapidly outcompeted all other variants, and, as of October 3, 2021, it represents 93.3% of all SARS-CoV-2 viruses sequenced in Utah (Figure 2B).If we attribute the entire change in vaccine effectiveness to the Delta variant (ie, VE t = VE 1δ × P 1δ + VE δ × P δ ), the estimated vaccine effectiveness against Delta would be 81.2%(95% CI, 80.8%-81.6%).

Discussion
Our results suggest a modest reduction in vaccine effectiveness against COVID-19 in Utah associated with the expansion of the Delta lineage in the state.This reduction in the effectiveness of available vaccines associated with the arrival of novel VOCs, rather than waning immunity, is concerning.These should serve as a caution throughout the US that the Delta variant can bring renewed outbreaks, even in highly vaccinated populations.If there is a consistent trend of increasing immune escape as new variants arise, it could eventually undermine the effectiveness of current vaccines and necessitate mass revaccination.
This study was limited.We used publicly available data that was collected for outbreak surveillance.The breakthrough case definition allows for self-reporting of vaccination status, resulting in fully vaccinated individuals reporting at higher rates (ie, 10% overreporting of vaccination would bring the vaccine effectiveness to 83.8%).Also, only 10% to15% of cases were sequenced each day, prioritizing breakthrough cases and outbreaks, potentially causing an oversampling of Delta variants.Furthermore, there is a delay of up to 2 weeks in reporting sequence data; therefore, estimates of breakthrough infection by variant are lagged by 2 weeks.Additionally, we do not account for known demographic differences (eg, urbanicity) in unvaccinated and breakthrough infections.While the association between trends seen in Delta and the observed vaccine effectiveness is consistent with reductions in vaccine effectiveness being related to Delta's emergence, we cannot rule out the possibility of the waning of vaccine-induced immunity playing some role with the available data.

Figure 1 .
Figure 1.Daily Percentage of Breakthrough Cases and Population That is Fully Vaccinated 30

Figure 2 .
Figure 2. Daily Vaccine Effectiveness Against SARS-CoV-2, and Sequencing Results by Week in UtahA