Source-linked AI summary
Cough Against COVID: Evidence of COVID-19 Signature in Cough Sounds
Piyush Bagad, Aman Dalmia, Jigar Doshi, Arsha Nagrani, Parag Bhamare, Amrita Mahale, Saurabh Rane, Neeraj Agarwal, Rahul Panicker
TL;DR
The paper addresses the difficulty of expanding COVID-19 testing amid limited supplies, trained staff, and lab infrastructure. It evaluates an AI model for detecting COVID-19 from cough sounds and reports a significant signal, including among asymptomatic patients. The authors report that their triaging tool can improve healthcare-system testing capacity.
Problem
COVID-19 testing capacity is constrained by limited test supplies, trained staff, and laboratory infrastructure.
Source: §7 · p. 7Method
The authors collect cough sounds paired with RT-PCR results and evaluate an AI model for COVID-19 triage.
Source: §8 · p. 7Results
Takeaways & Limitations
At current model performance, the proposed triaging tool can improve healthcare-system testing capacity by 43%.
Source: §8 · p. 8Facility-level label distributions differ, so a classifier trained naively on the combined dataset could learn location rather than COVID-19 cough characteristics.
Source: §6.6 · p. 7
Abstract
from arXiv · showhide
Testing capacity for COVID-19 remains a challenge globally due to the lack of adequate supplies, trained personnel, and sample-processing equipment. These problems are even more acute in rural and underdeveloped regions. We demonstrate that solicited-cough sounds collected over a phone, when analysed by our AI model, have statistically significant signal indicative of COVID-19 status (AUC 0.72, t-test,p <0.01,95% CI 0.61-0.83). This holds true for asymptomatic patients as well. Towards this, we collect the largest known(to date) dataset of microbiologically confirmed COVID-19 cough sounds from 3,621 individuals. When used in a triaging step within an overall testing protocol, by enabling risk-stratification of individuals before confirmatory tests, our tool can increase the testing capacity of a healthcare system by 43% at disease prevalence of 5%, without additional supplies, trained personnel, or physical infrastructure
1 Introduction
COVID-19 testing at scale is constrained by operational demands, while common symptoms are nonspecific and many infected people are asymptomatic. The paper investigates cough-based AI triage and reports a statistically significant COVID-19 signal and increased testing capacity.
- The authors frame scalable triage as a response to the need for frequent testing and quarantine to reduce transmission.Source: §1 · p. 1
- COVID-19 symptoms such as fever, cough, and breathing difficulties are nonspecific, and most COVID-19-positive individuals show none of them.Source: §1 · p. 1
- At 5–30% prevalence, the tool is reported to increase testing capacity by 43–33%.Source: §1 · p. 1
- The paper investigates whether an AI model can detect a COVID-19 signature in solicited cough sounds.Source: §1 · p. 1
- The model reports 72% AUC on held-out dataset subsections and a statistically significant cough signal (p < 1e−3, 95% CI 0.61—0.83).The paper also reports detectable signal among asymptomatic patients.Source: §1 · p. 1
2 Motivation and Related Work
Prior work applied machine learning to respiratory sounds and explored cough-based detection of several diseases, including COVID-19. The authors distinguish their study through a larger dataset with healthcare-authority labels and evidence of detection among asymptomatic patients.
- Other work used machine learning to interpret smartphone and wearable audio for screening diseases such as asthma and wheezing.Source: §2 · p. 2
- Prior research also examined respiratory sounds and digital-stethoscope lung-auscultation data for COVID-19.Source: §2 · p. 2
- Earlier work explored cough sounds for tuberculosis detection and recovery tracking, and a preliminary COVID-19 study used 48 tested patients (Imran et al. 2020).Source: §2 · p. 2
- A crowdsourced dataset of cough, breathing, and voice sounds was released for research on sound-based point-of-care COVID-19 diagnosis.Source: §2 · p. 2
- The authors report a dataset of 3,621 individuals, including 2,001 test-positive individuals, compared with 48 tested patients in (Imran et al. 2020).They contrast these healthcare-authority labels with the self-reported COVID-19 status in (Brown et al. 2020).Source: §2 · p. 2
- The paper reports detecting COVID-19 from cough sounds among asymptomatic patients, alongside its dataset and label-smoothing contributions.Source: §2 · p. 2
3 Data
The study combines cough recordings and RT-PCR results from Indian testing facilities and isolation wards with open-source audio used to pretrain its networks. The curated analysis set includes 1,039 individuals, and the recordings were collected through a multistage protocol.
3 Data
- The data section describes facility-collected COVID-19 cough data alongside open-source cough datasets used to pretrain the deep networks.Source: §3 · p. 2
Data collection
- Collection from testing facilities and isolation wards used enrollment, cough recording, and test-result retrieval as its three stages.Participants provided three solicited cough recordings, along with speech and deep-breathing recordings.Source: Data collection · p. 3
Dataset
- The curated analysis dataset contains 3,117 cough recordings from 1,039 individuals, including 376 RT-PCR-positive individuals.The wider collection had reached 3,621 individuals, of whom 2,001 tested positive.Source: Dataset · p. 3
3.2 Open-source non-COVID cough datasets
- The study also used open-source audio for pretraining, totaling 31,909 segments, including 4,793 cough sounds.The sources included FreeSound, Flusense, and Coswara; the COVID-19 status of Coswara coughs was unknown.Source: §3.2 · p. 4
4 Method
The paper uses an end-to-end CNN to classify COVID-19 from cough audio, with preprocessing, augmentation, and pretraining supporting the model. Predictions are aggregated from audio segments to the individual level.
4.1 Input
- Inputs are log-mel spectrogram patches generated from single-channel, 16-kHz audio, with training using randomly sampled 2-second segments.The input patches contain 64 mel-spaced frequency bins and 201 time bins.Source: §4.1 · p. 4
4.2 CNN architecture
- The CNN predicts COVID-19 from cough spectrograms using a ResNet-18 backbone, adaptive pooling, and linear layers with a two-neuron softmax output.Dropout and ReLU follow the linear layers.Source: §4.2 · p. 4, Figure 5 · p. 5
Augmentation
- Online augmentation adds randomly scaled environmental noise and applies time and frequency masking to spectrograms during training.Noise is sampled from ESC-50 and scaled by a random factor between 0.4 and 0.75.Source: Augmentation · pp. 4–5
Pre-training
- The model is pretrained on open-source data for cough-versus-non-cough detection, a proxy task used to initialize its weights.The ResNet-18 backbone is initialized from ImageNet weights before this pretraining stage.Source: Pre-training · p. 5
Label smoothing
- Label smoothing is used for COVID-19 training because RT-PCR labels may be wrong, potentially penalizing correct model predictions.The smoothing value is randomly selected between 0.1 and 0.3.Source: Label smoothing · p. 5, Implementation details · p. 5
4.4 Inference; Individual-level aggregation
- For inference, the median of segment-level softmax outputs gives a cough-sample prediction, and the maximum across three cough samples gives an individual prediction.Audio is divided into 2-second segments with a 500-ms hop; inputs shorter than 2 seconds are zero-padded.Source: §4.4 · p. 5, Individual-level aggregation · p. 5
5 Experimental Evaluation
The evaluation compares COVID-19 classification across three symptom-defined tasks, using facility-balanced validation and cross-validation. It also tests shallow baselines, ensembling, and training-pipeline choices.
5.1 Tasks
- The three tasks distinguish COVID-19 test-positive from test-negative individuals overall, among those without cough, and among those without cough, fever, or breathlessness.The latter two groups are termed Asymptomatic (no C) and Asymptomatic (no C/F/D).Source: §5.1 · p. 5
5.2 Triple-stratified cross-validation
- Training and validation use disjoint individuals, while validation is balanced by facility and COVID-19 class before five-fold cross-validation.The validation split is approximately 10% of the data; Table 1 reports fold-wise ranges of cough-sample counts by task.Source: §5.2 · pp. 5–6, Table 1 · p. 6
5.3 Evaluation metrics
- The study reports ROC-AUC, sensitivity, and specificity, emphasizing specificity at 90% sensitivity for the triaging use case.Hyperparameters are selected on the first fold and applied unchanged to the other folds.Source: §5.3 · p. 6
5.4 Comparison to shallow baselines
- CNN performance is compared with logistic regression, gradient boosting, XGBoost, and SVM classifiers using hand-crafted audio features.The features include tempo, RMS energy, and MFCCs.Source: §5.4 · p. 6
5.5 Stacked ensemble
- A stacked XGBoost regressor combines individual-level predictions from ResNet-18 models with and without label smoothing and an XGBoost classifier.The regressor uses the component models’ predicted probabilities as features.Source: §5.5 · p. 6
5.6 Ablation analysis
- The ablation analysis examines pretraining, label smoothing, and input segment length, comparing 1-second and 2-second segments.The 1-second model receives separate hyperparameter tuning.Source: §5.6 · p. 6
6 Discussion
The discussion reports that the CNN detects a statistically significant COVID-19 signal in cough sounds and that the signal remains detectable among asymptomatic individuals. It also describes improved performance with ensembling, label smoothing, pretraining, and 2-second segments, while noting limits in dataset composition and validation.
6 Discussion
- The CNN outperforms shallow models by at least 7% in AUC, with a significant COVID-19 cough signature (p < 1e-3; 95% CI 0.61—0.83).Figure 6a compares ROC curves across model families.Source: §6 · p. 6, Figure 6 · p. 6
6.1 Effect of ensembling
- Ensembling the deep and shallow models improves performance over any individual model, with further gains suggested by more diverse models and better ensemble methods.Figure 7a presents the ensemble comparison.Source: §6.1 · p. 6, Figure 7 · p. 7
6.2 Effect of label smoothing
- Label smoothing improves AUC, specificity at 90% sensitivity, and model calibration.The authors suggest that explicitly addressing label noise may improve performance; smoothing also moves the optimal classification threshold closer to 0.5.Source: §6.2 · pp. 6–7, Table 2 · p. 7
6.3 Effect of pre-training
- Pretraining improves mean AUC by 17%.Table 3 reports the effect of pretrained weights.Source: §6.3 · p. 7, Table 3 · p. 7
6.4 Optimal segment length
- Two-second segments perform better than 1-second segments; the authors suspect silence at sample edges makes random crops more likely to receive noisy labels.Figure 6b compares the segment lengths.Source: Figure 6 · p. 6, §6.4 · p. 7
6.5 Asymptomatic individuals
- For asymptomatic individuals, performance remains above random and the cough signal is statistically significant (p < 1e-2), although symptomatic performance is significantly better.Figure 7b compares symptomatic and asymptomatic groups.Source: §6.5 · p. 7, Figure 7 · p. 7
6.6 Performance across sex and location
- Performance is similar for male (0.71 ± 0.11) and female (0.72 ± 0.11) individuals, but facility-specific label distributions risk inflating performance unless validation controls for location.The validation set uses testing facilities with equal positive and negative counts per location; future work is to explore algorithmic mitigation.Source: §6.6 · p. 7
7 Use Case: COVID-19 Triaging Tool
Testing expansion is constrained by limited supplies, trained staff, and lab infrastructure. The proposed triaging tool prioritizes likely positives for confirmatory testing and is estimated to increase effective capacity by 43% at 5% prevalence.
7 Use Case: COVID-19 Triaging Tool
- Limited testing kits, trained staff, and lab infrastructure hinder efforts to expand testing capacity.The passage presents accurate, quick, non-invasive triaging as an urgent need for prioritizing likely positives.Source: §7 · p. 7
- 43%: At 5% disease prevalence, the triaging tool increases effective testing capacity by 43% (a 1.43x lift).The tool uses a 90% sensitivity threshold and has 31% specificity; likely negatives can be identified while positives are referred for confirmatory RT-PCR.Source: §7 · p. 7
- 90% sensitivity corresponds to 31% specificity for the best model at the selected triage threshold.The proposed workflow identifies likely COVID-19-negative individuals and refers positives for confirmatory RT-PCR.Source: §7 · p. 7
8 Conclusion and Future Work
The paper presents a non-invasive machine-learning triage tool trained on cough sounds paired with RT-PCR results, reporting detectable COVID-19 signal even in entirely asymptomatic patients. At current model performance, it reports a 43% increase in testing capacity and identifies additional inputs and smartphone inference as future work.
8 Conclusion and Future Work
- The model detects COVID-19 signal in cough sounds from the collected dataset, including patients who are entirely asymptomatic.The tool is described as a non-invasive, machine-learning-based COVID-19 triaging tool built using cough sounds paired with RT-PCR results for thousands of individuals.Source: §8 · pp. 7–8
- 43%: At current model performance, the tool can improve a healthcare system’s testing capacity by 43%.Table 4 is described as reporting effective-capacity increases at different disease prevalence levels; the supplied passage does not give its cell values.Source: §8 · p. 8, Table 4 · p. 8
- Future work will incorporate breathing sounds, voice samples, and symptoms, and explore computationally efficient smartphone inference.The authors state that these directions could support self-screening, proactive testing, and continuous monitoring.Source: §8 · p. 8
A Data
The data pipeline collects individual metadata, audio, and RT-PCR results through separate apps, then links and validates records before constructing cross-validation folds designed to limit facility-related label bias.
A.1 Collection
- The collection pipeline gathers demographic, health, symptom, and additional metadata alongside audio recordings and RT-PCR results through three separate apps.The metadata include age, location, sex, symptoms, comorbidities, travel and contact history, and habits such as smoking or tobacco use.Source: §A.1 · p. 10, Figure 8 · p. 11
Record linkage
- Records from the three apps are linked semi-manually using fuzzy matches on names and phone numbers, after which identifiers are removed.The authors note that linkage is non-trivial because of entry errors and shared phone numbers within families.Source: Record linkage · p. 10
Manual validation
- Each audio recording is manually checked for the required sound, and only entries that pass validation enter the usable dataset.Validation covers cough, speech, and breathing samples.Source: Manual validation · p. 10
A.3 Splits for Cross Validation
- Five nonoverlapping folds are constructed with validation sets balanced by positive and negative cases from each facility.Validation uses testing facilities F1 and F3 to guard against facility classification; F4 is excluded because it has few samples.Source: §A.3 · p. 10
B Method
The experiments use a fixed seed across the packages involved in randomness.
B Method
- Seed 42 is set identically across experiments for PyTorch, Python random, and NumPy.The passage lists the corresponding random-seed functions for each package.Source: §B.1 · p. 11
File-level aggregation
Aggregation compares cough-segment predictions at file and individual levels, while ensembling combines model predictions. The section also describes calculating testing-capacity lift when model-negative individuals are not sent for RT-PCR.
File-level aggregation
- For individual-level aggregation, max over probabilities from individual file predictions performs best.The table caption also reports that median and mean perform equally well for file-level aggregation.Source: File-level aggregation · p. 11, Table 5 · p. 11
Ensembling
- Ranking predictions instead of using uncalibrated probabilities gives a minor performance lift from 0.680 to 0.686.Source: Ensembling · p. 11
- A stacked ensemble using XGBoost on predictions from 3 models improves AUC from 0.68 to 0.72.Source: Ensembling · p. 11
Computation of lift from prevalence
- Testing-capacity lift is calculated as a function of disease prevalence, sensitivity, and specificity, with model-negative individuals excluded from RT-PCR testing.At the selected operating point, sensitivity is 90% and the number of model false negatives is described as extremely low.Source: Computation of lift from prevalence · p. 12