Portal de Periódicos da CAPES

Rapid Salivary Test suitable for a mass screening program to detect SARS-CoV-2: A diagnostic accuracy study

2020; Elsevier BV; Volume: 81; Issue: 3 Linguagem: Inglês

10.1016/j.jinf.2020.06.042

1532-2742

Lorenzo Azzi, Andreina Baj, Tiziana Alberio, Marta Lualdi, Giovanni Veronesi, Giulio Carcano, Walter Ageno, Cinzia Gambarini, Lorenzo Maffioli, Salomone Di Saverio, Daniela Dalla Gasperina, Angelo Genoni, Elias Premi, Simone Donati, Claudio Azzolini, Anna Maria Grandi, Francesco Dentali, Flavio Tangianu, Fausto Sessa, Vittorio Maurino, L Tettamanti, Claudia Siracusa, Andrea Vigezzi, Elisa Monti, Valentina Iori, Domenico Iovino, Giuseppe Ietto, Paolo Grossi, Angelo Tagliabue, Mauro Fasano,

COVID-19 diagnosis using AI

In April 2020, we published in this journal an article which highlighted the role of saliva as a reliable biological fluid to detect SARS-CoV-2.1Azzi L. Carcano G. Gianfagna F. Grossi P.A. Gasperina D.Dalla Genoni A.P. et al.Saliva is a reliable tool to detect SARS-CoV-2.J Infect. 2020; 81: e45-e50Abstract Full Text Full Text PDF PubMed Scopus (460) Google Scholar When we published the paper, Italy was on full lockdown at the peak of the COVID-19 epidemic. Then, on June 3rd, 2020, the Italian government started the so-called "Phase 2″, which included the re-opening of working and social activities. In this framework, the issue of how to identify the asymptomatic individuals who, unwittingly, can spread SARS-CoV-2 infection and pose a threat to the public health has been raised worldwide.2Gandhi M. Yokoe D.S. Havlir D.V Asymptomatic transmission, the Achille's Heel of current strategies to control Covid-19.N Engl J Med. 2020; 382: 2158-2160Crossref PubMed Scopus (786) Google Scholar It is now imperative to guarantee the health and safety of the people called back to work, and to create a safety protocol in commercial and meeting spaces, which means preventing infected people from causing new epidemic outbreaks. For this purpose, a well-established mass screening program is required to meet several needs: first, it should provide the result in a few minutes, it should be easily delivered on the territory, it should be performed in a simple way also by non-medical healthcare professionals, and eventually it should be non-invasive, repeatable and reliable. To date, the diagnosis of SARS-CoV-2 infection is made by identifying the viral RNA in samples collected through a nasopharyngeal swab or other respiratory samples.3Wang Y. Kang H. Liu X. Tong Z Combination of RT-qPCR testing and clinical features for diagnosis of COVID-19 facilitates management of SARS-CoV-2 outbreak.J Med Virol. 2020; ([Epub ahead of print])https://doi.org/10.1002/jmv.25721Crossref Scopus (312) Google Scholar This technique, however, has several limitations for its application in a mass screening, among which the most important ones are the time necessary for the diagnosis, the crowding of those centers appointed to analyze the specimens, and the non-negligible risk of viral transmission to the healthcare workers.4Ng K. Poon B.H. Kiat Puar T.H. Shan Quah J.L. Loh W.J. Wong Y.J. et al.COVID-19 and the risk to health care workers: a case report.Ann Intern Med. 2020; 172: 766-767Crossref PubMed Scopus (1) Google Scholar The use of saliva as a diagnostic sample has several advantages, since it can be easily provided by the patient and it does not require specialized personnel for its collection.5Xu R. Cui B. Duan X. Zhang P. Zhou X. Yuan Q Saliva: potential diagnostic value and transmission of 2019-nCoV.Int J Oral Sci. 2020; 12: 11Crossref PubMed Scopus (270) Google Scholar After these considerations, we conducted a diagnostic accuracy study to validate the use of a Rapid Salivary Test (RST) as a point-of-need antigen test suitable for a mass screening program. Subjects who underwent the nasopharyngeal swab procedure for the diagnosis of SARS-CoV-2 infection were consecutively recruited in three independent medical areas in our hospital: the COVID-19 wards (inpatients, with the exclusion of those subjects admitted to the Intensive Care Unit), the Emergency Room (patients at high risk of disease) and the area for the healthcare workers (subjects at low risk of disease). At the same time of the nasopharyngeal swab procedure in the morning, each recruited subject provided a salivary sample of about 1 mL by the drooling technique.6Golatowski C. Salazar M.G. Dhople V.M. Hammer E. Kocher T. Jehmlich N. et al.Comparative evaluation of saliva collection methods for proteome analysis.Clin Chim Acta. 2013; 419: 42-46Crossref PubMed Scopus (79) Google Scholar The RST consisted of an antigen test based on a customized Lateral flow assay (LFA) kit which was used to detect the presence of the virus in the saliva by identifying the viral Spike protein (Fig. 1). The nasopharyngeal swab was analyzed by independent blinded clinicians through real-time reverse transcription (rRT)-PCR accordingly to the International guidelines.7https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/laboratory-guidance.Google Scholar In addition, the salivary sample collected for the RST was also examined by rRT-PCR to provide data about the presence of the virus in the saliva and to better analyze any discrepancy between the results of the RST and the nasopharyngeal swab. A total number of 122 patients were recruited in this study (Fig. S1 – STARD flow diagram, Appendix). The mean age was 53.5 +/- 19.8 years, and there was a M:F = 1:2 ratio (Table S1, Appendix). Three subjects were excluded from the analysis because their RST failed and was not repeated. Thus, 119 subjects were included into the analysis. The results are reported in Table 1a. The sensitivity of the RST was 0.93 (95% CI: 0.77–0.99), while its specificity was apparently low, i.e., 0.42 (95% CI: 0.32–0.53). There were not differences between the recruited subgroups or among the asymptomatic and symptomatic individuals.Table 1aAssessment of sensitivity and specificity of the RST test (with 95% confidence interval) with respect to the nasopharyngeal swab, in the overall sample and stratified according to the setting of recruitment and presence of COVID-19 symptoms at the time of the swab test.Sensitivity assessmentSpecificity assessmentn, N^Sensitivity (95%CI)n, N*Specificity (95%CI)All subjects26, 280.93 (0.77; 0.99)38, 910.42 (0.32; 0.53)Setting of the nasopharyngeal swab procedureCOVID-19 hospitalized patients23, 250.92 (0.74; 0.99)4, 130.31 (0.09; 0.61)ER patients2, 21.0 (0.16; 1.0)7, 180.39 (0.17; 0.64)Healthcare workers1, 11.0 (-)27, 600.45 (0.32; 0.58)COVID-19 symptomsAny symptom22, 240.92 (0.73; 0.99)7, 170.41 (0.18; 0.67)No symptoms4, 41.0 (0.40; 1.0)31, 740.42 (0.31; 0.54)°: 3 subjects with a technically failed RST test (1 positive and 2 negative to the nasopharyngeal swab) were excluded.^: n=number of subjects with positive RST, N=number of subjects with positive nasopharyngeal swab.*: n=number of subjects with negative RST, N=number of subjects with negative nasopharyngeal swab95%Confidence Interval (CI) from exact binomial distribution. (-): not reported. Open table in a new tab °: 3 subjects with a technically failed RST test (1 positive and 2 negative to the nasopharyngeal swab) were excluded. ^: n=number of subjects with positive RST, N=number of subjects with positive nasopharyngeal swab. *: n=number of subjects with negative RST, N=number of subjects with negative nasopharyngeal swab 95%Confidence Interval (CI) from exact binomial distribution. (-): not reported. One hundred fourteen subjects had their salivary sample also analyzed by rRT-PCR (Table 1b). A very striking feature was observed when comparing the results of the salivary rRT-PCR with those of the nasopharyngeal swab in the subjects who had been previously classified as false negatives and false positives with the RST (Fig. S2a, Appendix). The two subjects who were classified as false negatives tested also negative by salivary rRT-PCR, thus the viral RNA was not detected in the saliva.Table 1bAssessment of sensitivity and specificity of the RST test (with 95% confidence interval) with respect to results recorded by salivary rRT-PCR, in the overall sample and stratified according to the setting of recruitment and presence of COVID-19 symptom at the time of the swab test.Sensitivity assessmentSpecificity assessmentn, N^Sensitivity (95%CI)n, N*Specificity (95%CI)All subjects°50, 550.91 (0.80; 0.97)35, 580.60 (0.47; 0.73)Setting of the nasopharyngeal swab procedureHospitalized patients with suspect COVID-1924, 241.0 (0.86; 1.00)6, 110.55 (0.23; 0.83)ER patients9, 110.82 (0.48; 0.98)5, 80.63 (0.24; 0.91)Healthcare workers17, 200.85 (0.62; 0.97)24, 390.62 (0.45; 0.77)COVID-19 symptomsAny symptom25, 270.92 (0.76; 0.99)7, 110.64 (0.31; 0.89)No symptoms25, 280.89 (0.72; 0.98)28, 470.60 (0.44; 0.74)°: 3 subjects with technically failed RST test (2 positive and 1 negative to the rRT-PCR), and 6 subjects with technically failed rRT-PCR value (all RST positive) were excluded.^: n=number of subjects with positive RST, N=number of subjects with positive nasopharyngeal swab.*: n=number of subjects with negative RST, N=number of subjects with negative nasopharyngeal swab95%Confidence Interval (CI) from exact binomial distribution. (-): not reported. Open table in a new tab °: 3 subjects with technically failed RST test (2 positive and 1 negative to the rRT-PCR), and 6 subjects with technically failed rRT-PCR value (all RST positive) were excluded. ^: n=number of subjects with positive RST, N=number of subjects with positive nasopharyngeal swab. *: n=number of subjects with negative RST, N=number of subjects with negative nasopharyngeal swab 95%Confidence Interval (CI) from exact binomial distribution. (-): not reported. Startingly, 57% of the false positive cases had their saliva positive also when analyzed with rRT-PCR, which means that the virus was actually present and that the nasopharyngeal swab was less sensitive in these cases. These discrepancies between the salivary rRT-PCR and the nasopharyngeal swab were also confirmed by sequencing a sample of the positive specimens (Fig. S3, Table S2, Appendix). There were no differences in the viral load values among RST True positive (median value: 472 copies/μl, IQR: 145–975) and False positive subjects (median value: 371 copies/μl, IQR: 149–727; Kruskal–Wallis test p = 0.6) nor between asymptomatic or symptomatic individuals (median values: 480 vs 195 copies/μl, respectively; Kruskal–Wallis test p = 0.6) (Fig. S2b, Table S3, Appendix). In our study we recorded a high sensitivity (i.e., 93%) and a mediocre specificity (i.e., 42%) of the RST. These results were explained by two reasons. Firstly, the specificity suffered the fact that the majority of the presumed false positive individuals with the RST were rather positive also by salivary rRT-PCR, giving reason to the index test. Therefore, their nasopharyngeal swab (i.e., reference standard) provided a false negative result. Secondly, a certain degree of difficulty in reading the strip was reported by the observers, especially for low-intensity signals. In these cases, the observers tended to overestimate the positivity of the test, and this accounts for most of the remaining false positive cases. This fault will be corrected in the following stage of our project, when it translates into an industrial prototype which will be tested on the general population in the next weeks. In conclusion, the RST based on LFA to detect the presence of SARS-CoV-2 may represent an innovative step in the diagnosis of the infection and in the armamentarium against the pandemic. Accordingly, it should be part of those policies of containment of the infection that the political decision-makers have to implement on the basis of Public Health Safety. A detailed report of the clinical design of the study and of the laboratory procedures can be found in the Supplementary Appendix. Local Ethical Committee (Comitato Etico dell'Insubria): protocol n° 68/2020. ClinicalTrials.gov: NCT04357327. This study adhered to the STARD-15 Guidelines. The authors declare the absence of any conflict of interests. Alberio Tiziana, Azzi Lorenzo, Baj Andreina, Fasano Mauro and Lualdi Marta are the co-inventors of the Rapid Salivary Test described in this paper and of the Italian patent filing number 102,020,000,006,400 registered on 2020, March 26th. This study was funded by the Department of Medicine and Surgery, University of Insubria.