Citation: Yafei Zhang, Changtai Wang, Mingfeng Han, Jun Ye, Yong Gao, Zhongping Liu, Tengfei He, Tuantuan Li, Mengyuan Xu, Luping Zhou, Guizhou Zou, Mengji Lu, Zhenhua Zhang. Discrimination of False Negative Results in RT-PCR Detection of SARS-CoV-2 RNAs in Clinical Specimens by Using an Internal Reference .VIROLOGICA SINICA, 2020, 35(6) : 758-767.  http://dx.doi.org/10.1007/s12250-020-00273-8

Discrimination of False Negative Results in RT-PCR Detection of SARS-CoV-2 RNAs in Clinical Specimens by Using an Internal Reference

  • Corresponding author: Mengji Lu, mengji.lu@uni-due.de, ORCID: 0000-0003-4287-9941
    Zhenhua Zhang, zzh1974cn@163.com, ORCID: 0000-0002-8480-9004
  • Electronic supplementary material The online version of this article (https://doi.org/10.1007/s12250-020-00273-8) contains supplementary material, which is available to authorized users.
  • Received Date: 25 May 2020
    Accepted Date: 15 July 2020
    Published Date: 04 August 2020
    Available online: 01 December 2020
  • Reverse transcription-polymerase chain reaction (RT-PCR) is an essential method for specific diagnosis of SARS-CoV-2 infection. Unfortunately, false negative test results are often reported. In this study, we attempted to determine the principal causes leading to false negative results of RT-PCR detection of SARS-CoV-2 RNAs in respiratory tract specimens. Multiple sputum and throat swab specimens from 161 confirmed COVID-19 patients were tested with a commercial fluorescent RT-PCR kit targeting the ORF1ab and N regions of SARS-CoV-2 genome. The RNA level of a cellular housekeeping gene ribonuclease P/MRP subunit p30 (RPP30) in these specimens was also assessed by RT-PCR. Data for a total of 1052 samples were retrospectively re-analyzed and a strong association between positive results in SARS-CoV-2 RNA tests and high level of RPP30 RNA in respiratory tract specimens was revealed. By using the ROC-AUC analysis, we identified Ct cutoff values for RPP30 RT-PCR which predicted false negative results for SARS-CoV-2 RT-PCR with high sensitivity (95.03%–95.26%) and specificity (83.72%–98.55%) for respective combination of specimen type and amplification reaction. Using these Ct cutoff values, false negative results could be reliably identified. Therefore, the presence of cellular materials, likely infected host cells, are essential for correct SARS-CoV-2 RNA detection by RT-PCR in patient specimens. RPP30 could serve as an indicator for cellular content, or a surrogate indicator for specimen quality. In addition, our results demonstrated that false negativity accounted for a vast majority of contradicting results in SARS-CoV-2 RNA test by RT-PCR.

  • 加载中
  • 10.1007s12250-020-00273-8-ESM.pdf
    10.1007s12250-020-00273-8-ESM1.pdf
    1. Chan JF, Yip CC, To KK, Tang TH, Wong SC, Leung K, Fung AY, Ng AC, Zou Z, Tsoi H, Choi GK, Tam AR, Cheng VC, Chan K, Tsang OT, Yuen K (2020) Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19-RdRp/Hel real-time reverse transcription-polymerase chain reaction assay validated in vitro and with clinical specimens. J Clin Microbiol 58:e00310-e00320

    2. Chen D, Xu W, Lei Z, Huang Z, Liu J, Gao Z, Peng L (2020a) Recurrence of positive SARS-CoV-2 RNA in COVID-19: a case report. Int J Infect Dis 93:297-299
        doi: 10.1016/j.ijid.2020.03.003

    3. Chen L, Liu W, Zhang Q, Xu K, Ye G, Wu W, Sun Z, Liu F, Wu K, Zhong B, Mei Y, Zhang W, Chen Y, Li Y, Shi M, Lan K, Liu Y (2020b) RNA based mNGS approach identifies a novel human coronavirus from two individual pneumonia cases in 2019 Wuhan outbreak. Emerg Microbes Infect 9:313-319
        doi: 10.1080/22221751.2020.1725399

    4. Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, Munday JD, Kucharski AJ, Edmunds WJ, Funk S, Eggo RM, Sun F, Flasche S, Quilty BJ, Davies N, Liu Y, Clifford S, Klepac P, Jit M, Diamond C, Gibbs H, van Zandvoort K (2020) Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. Lancet Glob Health 8:e488-e496
        doi: 10.1016/S2214-109X(20)30074-7

    5. Jiang X, Rayner S, Luo MH (2020) Does SARS-CoV-2 has a longer incubation period than SARS and MERS? J Med Virol 92:476-478
        doi: 10.1002/jmv.25708

    6. Li D, Wang D, Dong J, Wang N, Huang H, Xu H, Xia C (2020a) False-negative results of real-time reverse-transcriptase polymerase chain reaction for severe acute respiratory syndrome coronavirus 2: role of deep-learning-based CT diagnosis and insights from two cases. Korean J Radiol 21:505-508
        doi: 10.3348/kjr.2020.0146

    7. Li LQ, Huang T, Wang YQ, Wang ZP, Liang Y, Huang TB, Zhang HY, Sun WM, Wang YP (2020b) 2019 novel coronavirus patients' clinical characteristics, discharge rate and fatality rate of meta-analysis. J Med Virol. https://doi.org/10.1002/jmv.25757
        doi: 10.1002/jmv.25757

    8. Nishiura H, Kobayashi T, Suzuki A, Jung SM, Hayashi K, Kinoshita R, Yang Y, Yuan B, Akhmetzhanov AR, Linton NM, Miyama T (2020) Estimation of the asymptomatic ratio of novel coronavirus infections (COVID-19). Int J Infect Dis 94:154-155
        doi: 10.1016/j.ijid.2020.03.020

    9. Pan Y, Zhang D, Yang P, Poon LLM, Wang Q (2020) Viral load of SARS-CoV-2 in clinical samples. Lancet Infect Dis 20:411-412
        doi: 10.1016/S1473-3099(20)30113-4

    10. Tian S, Hu N, Lou J, Chen K, Kang X, Xiang Z, Chen H, Wang D, Liu N, Liu D, Chen G, Zhang Y, Li D, Li J, Lian H, Niu S, Zhang L, Zhang J (2020) Characteristics of COVID-19 infection in Beijing. J Infect 80:401-406
        doi: 10.1016/j.jinf.2020.02.018

    11. Wang Y, Wang Y, Chen Y, Qin Q (2020) Unique epidemiological and clinical features of the emerging 2019 novel coronavirus pneumonia (COVID-19) implicate special control measures. J Med Virol. https://doi.org/10.1002/jmv.25748
        doi: 10.1002/jmv.25748

    12. Won J, Lee S, Park M, Kim TY, Park MG, Choi BY, Kim D, Chang H, Kim VN, Lee CJ (2020) Development of a laboratory-safe and low-cost detection protocol for SARS-CoV-2 of the coronavirus disease 2019 (COVID-19). Exp Neurobiol 29:107-119
        doi: 10.5607/en20009

    13. World Healthy Organization (WHO) (2020) Coronavirus disease (COVID-19) pandemic. https://www.who.int/emergencies/diseases/novel-coronavirus-2019. Accessed 23 May 2020

    14. Xie X, Zhong Z, Zhao W, Zheng C, Wang F, Liu J (2020) Chest CT for typical 2019-nCoV pneumonia: relationship to negative RT-PCR testing. Radiology. https://doi.org/10.1148/radiol.2020200343
        doi: 10.1148/radiol.2020200343

    15. Yang S, Cao P, Du P, Wu Z, Zhuang Z, Yang L, Yu X, Zhou Q, Feng X, Wang X, Li W, Liu E, Chen J, Chen Y, He D, On BOCE (2020a) Early estimation of the case fatality rate of COVID-19 in mainland China: a data-driven analysis. Ann Transl Med 8:128
        doi: 10.21037/atm.2020.02.66

    16. Yang X, Yu Y, Xu J, Shu H, Xia J, Liu H, Wu Y, Zhang L, Yu Z, Fang M, Yu T, Wang Y, Pan S, Zou X, Yuan S, Shang Y (2020b) Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med 8:475-481
        doi: 10.1016/S2213-2600(20)30079-5

    17. Yang Y, Yang M, Shen C, Wang F, Yuan J, Li J, Zhang M, Wang Z, Xing L, Wei J, Peng L, Wong G, Zheng H, Liao M, Feng K, Li J, Yang Q, Zhao J, Zhang Z, Liu L, Liu Y (2020c) Evaluating the accuracy of different respiratory specimens in the laboratory diagnosis and monitoring the viral shedding of 2019-nCoV infections. medRxiv. https://doi.org/10.1101/2020.02.11.20021493
        doi: 10.1101/2020.02.11.20021493

    18. Ye G, Pan Z, Pan Y, Deng Q, Chen L, Li J, Li Y, Wang X (2020) Clinical characteristics of severe acute respiratory syndrome coronavirus 2 reactivation. J Infect 80:e14-e17

    19. Zhao S, Lin Q, Ran J, Musa SS, Yang G, Wang W, Lou Y, Gao D, Yang L, He D, Wang MH (2020) Preliminary estimation of the basic reproduction number of novel coronavirus (2019-nCoV) in China, from 2019 to 2020: a data-driven analysis in the early phase of the outbreak. Int J Infect Dis 92:214-217
        doi: 10.1016/j.ijid.2020.01.050

    20. Zhou P, Yang XL, Wang XG, Hu B, Zhang L, Zhang W, Si HR, Zhu Y, Li B, Huang C, Chen H, Chen J, Luo Y, Guo H, Jiang R, Liu M, Chen Y, Shen X, Wang X, Zheng X, Zhao K, Chen Q, Deng F, Liu L, Yan B, Zhan F, Wang Y, Xiao G, Shi Z (2020) A pneumonia outbreak associated with a new coronavirus of probable bat origin. Nature 579:270-273
        doi: 10.1038/s41586-020-2012-7

    21. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, Zhao X, Huang B, Shi W, Lu R, Niu P, Zhan F, Ma X, Xu W, Wu G, Gao GF, Tan W, China NCIA (2020) A Novel Coronavirus from patients with pneumonia in China, 2019. N Engl J Med 382:727-733
        doi: 10.1056/NEJMoa2001017

    22. Zou L, Ruan F, Huang M, Liang L, Huang H, Hong Z, Yu J, Kang M, Song Y, Xia J, Guo Q, Song T, He J, Yen HL, Peiris M, Wu J (2020) SARS-CoV-2 viral load in upper respiratory specimens of infected patients. N Engl J Med 382:1177-1179
        doi: 10.1056/NEJMc2001737

  • 加载中

Figures(6) / Tables(2)

Article Metrics

Article views(5933) PDF downloads(74) Cited by()

Related
Proportional views

    Discrimination of False Negative Results in RT-PCR Detection of SARS-CoV-2 RNAs in Clinical Specimens by Using an Internal Reference

      Corresponding author: Mengji Lu, mengji.lu@uni-due.de
      Corresponding author: Zhenhua Zhang, zzh1974cn@163.com
    • 1. Department of Infectious Diseases, The Second Hospital of Anhui Medical University, Hefei 230601, China
    • 2. Institute of Clinical Virology, The Second Hospital of Anhui Medical University, Hefei 230601, China
    • 3. Department of Internal Medicine, The Second Hospital of Fuyang, Fuyang 236015, China
    • 4. Institute for Virology, University Hospital of Essen, University of Duisburg-Essen, 45147 Essen, Germany

    Abstract: Reverse transcription-polymerase chain reaction (RT-PCR) is an essential method for specific diagnosis of SARS-CoV-2 infection. Unfortunately, false negative test results are often reported. In this study, we attempted to determine the principal causes leading to false negative results of RT-PCR detection of SARS-CoV-2 RNAs in respiratory tract specimens. Multiple sputum and throat swab specimens from 161 confirmed COVID-19 patients were tested with a commercial fluorescent RT-PCR kit targeting the ORF1ab and N regions of SARS-CoV-2 genome. The RNA level of a cellular housekeeping gene ribonuclease P/MRP subunit p30 (RPP30) in these specimens was also assessed by RT-PCR. Data for a total of 1052 samples were retrospectively re-analyzed and a strong association between positive results in SARS-CoV-2 RNA tests and high level of RPP30 RNA in respiratory tract specimens was revealed. By using the ROC-AUC analysis, we identified Ct cutoff values for RPP30 RT-PCR which predicted false negative results for SARS-CoV-2 RT-PCR with high sensitivity (95.03%–95.26%) and specificity (83.72%–98.55%) for respective combination of specimen type and amplification reaction. Using these Ct cutoff values, false negative results could be reliably identified. Therefore, the presence of cellular materials, likely infected host cells, are essential for correct SARS-CoV-2 RNA detection by RT-PCR in patient specimens. RPP30 could serve as an indicator for cellular content, or a surrogate indicator for specimen quality. In addition, our results demonstrated that false negativity accounted for a vast majority of contradicting results in SARS-CoV-2 RNA test by RT-PCR.

    • COVID-19 is caused by SARS-CoV-2, a novel beta coronavirus and now affecting more than 210 countries, areas or territories (WHO 2020; Zhou et al. 2020; Zhu et al. 2020). The World Health Organization (WHO) has declared the COVID-19 outbreak as a global pandemic. SARS-CoV-2 is highly contagious with an estimated R0 of 2–3 and causes COVID-19 with a wide range of clinical manifestations including asymptomatic infection to severe pneumonia with deadly outcome (Hellewell et al. 2020; Tian et al. 2020; Wang et al. 2020; Zhao et al. 2020). According to different reports published so far, COVID-19 has a mortality rate of 2%–10% (Li et al. 2020b; Yang et al. 2020a).

      COVID-19 has an incubation period of 2–14 days (Jiang et al. 2020). In the early phase of the clinical course, the clinical manifestations include fever, dry cough, feeling weak, diarrhea, etc., which are rather unspecific and indistinguishable from the common colds. The asymptomatic carriers of SARS-CoV-2 may shed viruses and could be very contagious (Nishiura et al. 2020). Therefore, a highly sensitive and specific laboratory method is essential for early diagnosis of SARS-CoV-2 infection, which is critical for appropriate management of suspected COVID-19 patients.

      With abundant sequence information of SARS-CoV-2 strains, many commercial kits for detection of SARS-CoV-2 RNA have been developed (Chan et al. 2020; Chen et al. 2020b; Won et al. 2020). However, unsatisfactory sensitivity of nucleic acid detection kits in clinical application has been reported repeatedly (Li et al. 2020a; Xie et al. 2020). Conflicting positive and negative test results could be obtained from the same patients at different time points along the clinical course (Yang et al. 2020b). In fact, a sequential change of positive-to-negative-to-positive results could not be properly explained but could cause great concern about potential viral reactivation and re-infection in cured COVID-19 patients (Chen et al. 2020a; Ye et al. 2020).

      The molecular diagnosis of COVID-19 by RT-PCR detection of SARS-CoV-2 RNAs has been flawed by the problem of false negative results. As any other PCR-based diagnostic method, many factors such as the quality of test kits and specimens may reduce the sensitivity and specificity of the test. An in-depth investigation is needed to identify the major causes for false negative results. In this study, we tried to gain insights by retrospectively analyzing test results and data from carefully matched patient specimens and sequential specimens from patients with conflicting test results.

      Our analyses demonstrated that clinical specimens with high cellular contents, measured by the RNA levels of a housekeeping gene ribonuclease P/MRP subunit p30 (RPP30), provided a significantly higher positive rate in SARS-CoV-2 detection. In fact, the detectability of SARS-CoV-2 RNAs in respiratory tract specimens was found to be highly associated with cellular content, represented by RPP30 RNA levels. Based on data from these specimens, a set of Ct cutoff values for RPP30 RT-PCR reaction was established for specific tests based on amplification of specific target regions using specific types of specimens. These Ct cutoff values from RPP30 RT-PCR could be used as criteria for identification of false negative results. Our data also suggest that false negative results accounted for most contradicting test results in SARS-CoV-2 RNA detection in clinical use due to poor specimen quality. Thus, the quality of specimens, defined by the cellular content, is a key factor for satisfactory RT-PCR results and could be assessed by an internal reference such as RPP30.

    • A total of 161 confirmed COVID-19 patients admitted into the Second Hospital of Fuyang from January 20 to February 29, 2020 were enrolled in this retrospective single-center study. The diagnosis of COVID-19 for patients was performed according to the Guidelines for the Diagnosis and Treatment of New Coronavirus Pneumonia (version 7) published by the National Health Commission of China. The study was approved by the Ethics Committee of the Second Hospital of Fuyang (Number 2020020004). Written informed consents were obtained from all patients.

      A total of 573 sputum and 579 throat swab specimens were collected from COVID-19 patients. Among them, 254 pairs of matched sputum/throat swab specimens were collected on the same days from the same patients. 109 sputum specimens were collected at different time points from 15 patients with alternating positive–negative–positive results. 72 throat swab specimens from 10 patients were collected in the same way.

    • Laboratory confirmation of the SARS-CoV-2 infection was performed by real-time RT-PCR (Bojie Ltd, Shanghai, China) according to the approval of Chinese Center for Disease Control and Prevention. The fluorescent quantitative RT-PCR tests use two primer pairs and corresponding probes within the ORF1ab and N region of the SARS-CoV-2 genome, respectively (Zou et al. 2020). The oligo DNA sequences for the ORF 1ab were: Forward primer (F)-CCTGTGGGTTTTACACTTAA; Reverse primer (R)-ACGATTGTGCATCAGCTGA; Probe (P)-5′-FAM-CCGTCTGCGGTATGTGGAAAGGTTATGG-BHQ1-3′. For the N region: Forward primer (F)-GGGGAA CTTCTCCTGCTAGAAT; Reverse primer (R)-CAGACATTTTGCTCTCAAGCTG; Probe (P):5′-FAM-TTGCTGCTGCTTGACAGATT-TAMRA-3′. A cellular housekeeping gene ribonuclease P/MRP subunit p30 (RPP30) was used as a marker of the presence of cellular materials and as an internal reference. The sequences for the primer pair and probe were: Forward primer (F)-5′-AGATTTGGACCTGCGAGCG-3′ ' (nt 28–46), Reverse primer (R)-5′-GAGCGGCTGTCTCCACAAGT-3′ (nt 92–73), and the probe (P)-5′-TTCTGACCTGAAGGCTCTGCGCG-3′ (nt 49–71), designed according to the reference sequence NM_006413.5 in the GenBank. A cutoff for the positivity for RPP30 RT-PCR is set at a Ct value = 38.

      Sputum and/or throat-swab specimens were collected from patients and maintained in viral-transport medium prior to laboratory testing. The RNA was extracted with a Nucleic Acid Extraction Kit (Shuoshi Ltd, Taizhou, China), The RT-PCR reactions for all three gene fragments were conducted in the same reaction tube on a SLAN 96P Fluorescence Quantitative PCR Amplification Instrument (Hongshi Ltd, Shanghai, China) by following the manual of the kit (Bojie Ltd, Shanghai, China). As recommended by the Guidelines for Diagnosis and Treatment of the New Coronavirus Pneumonia published by the National Health Commission of China, a test result was considered positive if the Ct values of both target region amplifications of SARS-CoV-2 genome in one test were lower than 38, or the Ct value in one of two target region amplifications was lower than 38 in two consecutive tests.

    • Categorical variables are expressed in frequency or percentage. Nonparametric variables were expressed in median and quartile intervals and the significance was tested by Mann–Whitney U or Kruskal–Wallis test. The correlation between two indicators was analyzed by the Pearson methods. The diagnostic values of selected parameters for differentiating negative and positive of SARS-CoV-2 RNA with samples were assessed by receiver operating characteristic (ROC) and the area under the ROC curve (AUC). A P value < 0.05 is considered statistically significant in all statistical analyses. The SPSS statistical software (Macintosh version 26.0, IBM, Armonk, NY, USA) and R package were used for statistical analysis.

    • SARS-CoV-2 RT-PCR may fail to provide a positive result with specimens from COVID-19 patients. Sputum and throat swabs specimens are commonly used for RNA extraction and RT-PCR detection of SARS-CoV-2 RNA. A retrospective analysis showed that only 39.1% of 573 sputum specimens and 19.2% of 579 throat specimens from COVID-19 patients collected at different time points were consistently tested positive for SARS-CoV-2 RNAs by RT-PCR (Fig. 1A, 1B). Many samples were positive for only the reaction detecting the N region of SARS-CoV-2 RNA. Taking advantage of access to data for a large number of specimens from a cohort of 161 confirmed patients, we systematically analyzed the data to gain insights into the causes for questionable results and find the right solutions.

      Figure 1.  The RT-PCR detection of SARS-CoV-2 RNAs in 1152 samples from patients with confirmed SARS-CoV-2 infection. 573 Sputum (A) or 579 throat swab (B) specimens were collected and subjected to SARS-CoV-2 specific RT-PCR assays targeting the ORF1ab and N regions. +: RT-PCR positive; −: RT-PCR negative. RT-PCR was performed to detect RPP30 RNAs that reflect the presence of cellular RNAs in sputum (C) and throat swab (D) specimens. +/+: positive results for both ORF1ab and N-specific RT-PCR assays; ± : only one of both RT-PCR assays was positive; −/−: both RT-PCR assays were negative. The negative RT-PCR results of SARS-CoV-2 detection correspond to high Ct values for the RT-PCR for RPP30 RNAs. The results were tested for significance by using the Kruskal–Wallis test (C, D). A P value of < 0.05 is considered as significant.

      It is not yet known if viral RNA in released viral particles or in infected epithelial cells or both are detected in these specimens. Thus, we retrospectively examined the presence of cellular materials in patient specimens by detecting the RNA of a cellular housekeeping gene RPP30. RPP30 RNA was frequently detected in sputum and throat swab specimens but at very different levels (Fig. 1C, 1D). In fact, the Ct value of RPP30 RNA ranged from to 18 to 27 for 573 sputum specimens and from 20 to 30 for 579 throat swab specimens (Fig. 1C, 1D). Strikingly, 224 sputum and 111 throat swab specimens positive for SARS-CoV-2 RT-PCR (positive for both ORF1ab and N) have significantly lower Ct values for RPP30 RT-PCR (corresponding to higher levels of RPP30 RNAs) than those with only single positive or double negative results. This fact indicates a strong association between the RPP30 and SARS-CoV-2 RNA levels in patient samples, irrespective of the types of specimens or the target regions of the viral genome for amplification.

    • In order to determine the relationship among amplification of target regions ORF1ab, N region and cellular gene RPP30, data for a total of 254 paired sputum and throat swab specimens were selected and subjected to statistical analyses. In this cohort of specimens, 35.8% of sputum specimens and 16.1% of throat swab specimens were tested positive for SARS-CoV-2 RNA (Fig. 2A, 2B). The correlation between the Ct values of ORF1ab/N-region and RPP30 RT-PCRs was analyzed by using the Pearson method. Consistently, a strong correlation between the Ct values for ORF1ab and N (r = 0.913, P < 0.0001 for sputum, r = 0.926, P < 0.0001 for throat swab), ORF1ab and RPP30 (r = 0.809, P < 0.0001 for sputum, r = 0.805, P < 0.0001 for throat swab), N and RPP30 (r = 0.939, P < 0.0001 for sputum, r = 0.920, P < 0.0001 for throat swab) was found (Fig. 2C2H). Thus, RPP30 may serve as an internal reference and could be a suitable indicator for the quality of specimens. The same conclusion could be reached when the analysis was performed by excluding specimens for which negative results for SARS-CoV-2 RNA detection were obtained (Supplementary Figure S1).

      Figure 2.  The RT-PCR detection of SARS-CoV-2 RNAs in 254 paired sputum and throat swab specimens from patients with confirmed SARS-CoV-2 infection. 254 paired sputum (A) and throat swab (B) specimens were collected and subjected to SARS-CoV-2 specific RT-PCR assays targeting the ORF1ab and N regions. +: RT-PCR positive; −: RT-PCR negative. Pearson correlation coefficients for the levels of detected SARS-CoV-2 RNA levels (based on the assays for ORF1ab and N region) and RPP30 RNAs in patient samples were calculated. For sputum specimens: C ORF1ab and N region; D ORF1ab and RPP30; E N region and RPP30. For throat swab specimens: F ORF1ab and N region; G ORF1ab and RPP30; H N region and RPP30. A P value of < 0.05 is considered as significant.

    • Having discovered strong associations between amplification of target regions and RPP30, we hoped to identify appropriate Ct values for RPP30 which could be used as cutoffs for distinguishing valid test results from invalid ones. Using the receiver operating characteristic (ROC) and area under the ROC curve (AUC) analyses, the values of RPP30 RNA levels for the identification of false negative results of SARS-CoV-2 RNA detection were assessed. As is shown in Fig. 3A3D, the sensitivity and specificity could reach 95.03%–95.26% and 83.72%–98.55% respectively for ORF1ab RT-PCR with sputum (AUC 0.981, cutoff 21.53) and throat swab (AUC 0.973, cutoff 25.53) specimens, as well as for the N region-specific RT-PCR with sputum (AUC 0.981, cutoff 24.47) and throat swab (AUC 0.993, cutoff 27.48) specimens.

      Figure 3.  The suitability of the Ct values of RPP30 specific RT-PCR to discriminate false negative results of RT-PCR detection of SARS-CoV-2 RNAs. The RT-PCR results for SARS-CoV-2 and RPP30 RNAs obtained from 254 paired sputum and throat swab specimens from patients with confirmed SARS-CoV-2 infection were used for analysis. The ROC curve and AUC were calculated for the Ct values of RPP30 specific RT-PCR to predict the false negative results of the ORF1ab and N-specific RT-PCR assays for SARS-CoV-2 RNA detection by using the R package "pROC". The cut offs of the Ct values of RPP30 RT-PCR were set at the sensitivity around 95% for each case: 21.53 for (A) ORF1ab specific RT-PCR with sputum; 24.47 for (B) N specific RT-PCR with sputum; 25.53 for (C) ORF1ab specific RT-PCR with throat swab; and 27.48 for (D) N specific RT-PCR with throat swab. Cr, Criterion (Cutoff value); Se, Sensitivity; Sp, Specificity; A P value of < 0.05 is considered as significant. The Ct values of the RPP30 RT-PCR were used to analyze the positive and negative results of ORF1ab and N-specific RT-PCR assays with 254 paired sputum (E) and throat swab (F) specimens. Pos: positive results; Neg: negative results. The negative RT-PCR results of SARS-CoV-2 detection correspond to high Ct values for RT-PCR for RPP30 RNAs. Red lines: cutoffs for ORF1ab RT-PCR; blue lines: cutoffs for N specific RT-PCR. The results were tested for significance by using the Mann–Whitney test (E, F). A P value of < 0.05 is considered as significant.

      To validate the performance of these cutoff values, these cutoff values were applied to data for 253 specimens from patients with conflicting positive and negative test results and for that from patients with multiple samples and data for 254 pairs of sputum and throat swab specimens from confirmed COVID-19 patients, respectively. The prediction results clearly showed that the majority of false results was correspondent to Ct values over the set cut off values for RPP30 RT-PCR irrespective of types of specimens or target regions of RT-PCR reactions (Fig. 3E, 3F).

      We then tried to determine whether inadequate cellular content was the cause of conflicting RT-PCR results. Analyses of 181 serial samples from 20 patients with conflicting RT-PCR results showed, similar to larger cohort of samples analyzed above, that 47.7% of sputum specimens and 20.8% of throat swab specimens were tested positive in SARS-CoV-2 RNA testing (Fig. 4A, 4B). Again, Pearson analyses revealed strong correlations between the Ct values of RT-PCR assays for ORF1ab and N (r = 0.921, P < 0.0001 for sputum, r = 0.883, P < 0.0001 for throat swab), ORF1ab and RPP30 (r = 0.870, P < 0.0001 for sputum, r = 0.802, P < 0.0001 for throat swab), N and RPP30 (r = 0.930, P < 0.0001 for sputum, r = 0.929, P < 0.0001 for throat swab) (Fig. 4C4H).

      Figure 4.  The RT-PCR detection of SARS-CoV-2 RNAs in 181 sputum and throat swab specimens from 20 patients with conflicting RT-PCR results. 109 paired sputum (A) and 72 throat swab (B) specimens were collected and subjected to SARS-CoV-2 specific RT-PCR assays targeting the ORF1ab and N regions. +: RT-PCR positive; −: RT-PCR negative. Pearson correlation coefficients for the levels of detected SARS-CoV-2 RNA (based on the assays for ORF1ab and N region) and RPP30 RNAs in patient samples were calculated. For sputum specimens: C ORF1ab and N region; D ORF1ab and RPP30; E N region and RPP30. For throat swab specimens: F ORF1ab and N region; G ORF1ab and RPP30; H N region and RPP30. The Ct values of RPP30 RT-PCR were used to analyze the positive and negative results of ORF1ab and N-specific RT-PCR assays with 109 sputum (I) and 72 throat swab (J) specimens. Pos: positive results; Neg: negative results. The negative RT-PCR results of SARS-CoV-2 detection correspond to high Ct values for RT-PCR for RPP30 RNAs. Red lines: cutoffs for ORF1ab RT-PCR; blue lines: cutoffs for N specific RT-PCR. The results were tested for significance by using the Mann–Whitney test (I, J). A P value of < 0.05 is considered as significant.

      We further examined the relationship between cellular content and validity of test results by applying the RPP30 cutoff values established above to data from a cohort of specimens for which contradicting results had been obtained. As is shown in Fig. 4I, 52 positive and 57 negative results were obtained from the ORF1ab RT-PCR reactions with sputum specimens while 84 positive and 25 negative results were generated from the N-specific RT-PCR reactions. Of specimens with negative results, the great majority had RPP30 Ct values above the cutoffs established (Fig. 4I). Similarly, 15 positive and 57 negative results for ORF1ab RT-PCR were obtained using throat swab specimens while 34 positive and 38 negative tests for the N-specific tests were available. Similarly, the great majority of negative results (56 from 57 for ORF1ab RT-PCR and 34 from 38 for N-specific RT-PCR) corresponded to RPP30 Ct values above the established cut off values (Fig. 4J). These data demonstrated that the majority of false negative results could be correctly identified by using the established cutoff Ct values for RPP30.

    • In a recent report, recovered COVID-19 patients were repeatedly found positive in SARS-CoV-2 RNA testing during post-discharge monitoring. Based on this observation, the possibility of latent or chronic SARS-CoV-2 infection has been suggested. Contradicting test results from the same patients are not rare in the diagnosis of and clinical care for COVID-19 patients. In fact, the same were observed in some patients enrolled in this study.

      In order to evaluate the roles of false negative played in contradicting test results for same patients, we analyzed data for a patient from whom sputum (n = 13) and throat swab (n = 10) specimens were collected at different time points during the course of infection. From sputum specimens, 5 positive and 8 negative RT-PCR results were obtained for the ORF1ab region amplification, while 10 positive and 3 negative results for the N region amplification (Fig. 5A). Three positive and 7 negative RT-PCR results were found for the ORF1ab with throat swab specimens while 4 positive and 6 negative results were obtained for the N region (Fig. 5B). Not surprisingly, negative RT-PCR results for SARS-CoV-2 RNAs corresponded to high Ct values for RPP30 RNAs which were above the established cut off values.

      Figure 5.  The longitudinal analysis of RT-PCR results of SARS-CoV-2 and RPP30 RNAs in sputum and throat swab specimens from patients with conflicting RT-PCR results. 13 sputum (A) and 10 throat swab (B) specimens were collected from a single patient at multiple time points after disease onset and subjected to SARS-CoV-2 specific RT-PCR assays targeting the ORF1ab and N region and RPP30 RT-PCR. Green lines: cutoffs = 38 for Ct values, positive results < 38. The Ct values of RPP30 RT-PCR set as cutoffs are indicated by black lines (21.53 in A, 25.53 in B) and yellow lines (24.47 in A and 27.48 in B).

      When the same analyses were expanded to a cohort of 25 patients who received contradicting test results at different time points, the same correspondence between high Ct values for RPP30 and negative test results was found (Tables 1, 2). Apparently, the detectability of SARS-CoV-2 RNA in these patient specimens was strongly correlated with the Ct values of RPP30 RT-PCR reaction. Thus, conflicting results were mainly caused by false negativity resulted from poor quality of patient specimens. Besides, the conclusion of reactivation of or reinfection with SARS-CoV-2 can be drawn only after false negative results have been excluded.

      Patient Test (n) Ct value of RPP30
      ≤ 21.53 21.53–24.47 > 24.47
      SARS-CoV-2 RNA (N or ORF1ab region) +/+ ± −/− +/+ ± −/− +/+ ± −/−
      P1 4 1 1 2
      P2 6 1 3 2
      P3 11 1 3 4 1 2
      P4 5 1 2 2
      P5 8 3 1 2 2
      P6 7 1 3 1 2
      P7 7 4 2 1
      P8 10 2 3 5
      P9 12 2 5 1 2 2
      P10 5 2 1 1 1
      P11 3 2 1
      P12 7 3 2 1 1
      P13 7 4 2 1
      P14 13 5 5 3
      P15 4 1 1 1 1
      Total 109 31 1 21 28 3 3 22

      Table 1.  Correlation between Ct values of RPP30 and detection results of SARS-CoV-2 RNA in sputums

      Patient Test (n) Ct value of RPP30
      ≤ 25.53 25.53–27.48 > 27.48
      SARS-CoV-2 RNA (N or ORF1ab region) +/+ ± −/− +/+ ± −/− +/+ ± −/−
      W1 7 2 3 2
      W2 14 4 1 9
      W3 5 1 1 1 2
      W4 6 1 2 1 2
      W5 6 1 2 3
      W6 9 1 1 1 1 1 4
      W7 7 1 1 1 4
      W8 5 2 1 1 1
      W9 10 2 1 1 6
      W10 3 1 1 1
      Total 72 10 1 4 16 4 1 2 34

      Table 2.  Correlation between Ct values of RPP30 and detection results of SARS-CoV-2 RNA in throat swabs

    • In the present study, we showed that reliable detection of SARS-CoV-2 RNA by RT-PCR assays is clearly associated with the content of cellular materials in patient samples, assessed by the RNA levels of RPP30. A plausible explanation for this finding is that SARS-CoV-2 RNA level may be high in infected epithelial cells and could be more easily detected by RT-PCR assays. This might imply that the detected viral RNA level does not reflect the titer of free viral particles and are not correlated with viral loads. This hypothesis needs to be verified by further examination of the levels of viral RNA in infected host cells and free viral particles though. Nevertheless, the procedures to collect patient specimens need to be performed by trained staffs, ensuring that the specimens contain enough cellular materials.

      In recent reports, recovered COVID-19 patients, defined by negative test results for SARS-CoV-2 RNA in at least two independent tests, were found repeatedly positive for SARS-CoV-2 RNA testing during post-discharge monitoring (Chen et al. 2020a). This observation has triggered great concern about the possibility of reactivation or latent/chronic SARS-CoV-2 infection. In addition, contradicting test results from the same patients are not rare in the diagnosis and clinical care for COVID-19 patients. Our retrospective analysis of data for patient samples showed that the negative test results of SARS-CoV-2 were mainly caused by the poor quality of specimens that did not contain sufficient amount of cellular materials.

      Our study demonstrated that a reliable result of SARS-CoV-2 RNA test needs an appropriate quality control based on the assessment of cellular markers such as RPP30 RNA levels. Specific cutoffs based on RPP30 RNA detection could be established to evaluate the reliability of SARS-CoV-2 RNA test and identify false negative results. These Ct cutoff values of RPP30 RT-PCR can serve as criteria for identification of false negative results. In clinical application, RPP30 may be integrated in the PCR reactions as an internal reference. In this study, Ct values 21.53 and 25.53 are set as criteria for quality control for ORF1ab region amplification with sputum and throat swab specimens respectively (Fig. 6). Similarly, specific Ct values for quality control purpose should be established on the basis of data collected from tests with specific standardized method and procedure.

      Figure 6.  Flow chart of SARS-CoV-2 RNA test and evaluation. Sputum and throat swab samples will be evaluated for their suitability for SARS-CoV-2 RNA test based on Ct values of RPP30 RT-PCR. The samples with Ct values of RPP30 RT-PCR below the specific cutoffs will generate clear positive and negative results, while those with a single positive result need to be retested. For the samples with Ct values of RPP30 RT-PCR above the specific cutoffs, either a single positive or double negative result need to be retested.

      Our results confirmed that the positive rate of SARS-CoV-2 RNA detection is higher when sputum instead of throat swab specimens (Pan et al. 2020; Yang et al. 2020c). Based on this study, this can be is explained by higher cellular contents in sputum specimens compared with that in throat swabs.

      Taken together, a great number of false RT-PCR test results reported are apparently results of inadequate quality of patient specimens and can be excluded by leveraging data for integrated internal reference in the test reactions to assess the content of cellular materials.

    • This work was supported by the Natural Science Foundation of Anhui Province (Grant No. 1608085MH162). We are grateful to Dr. Delia Cosgrove from University of Duisburg-Essen for language editing.

    • ML and ZZ conceptualized and designed the study; YZ, CW, MH, JY and YG performed the experiments; ZL, TH, TL, MX, LZ and GZ collected data and carried out the initial analyses; CW, MH and YG drafted the initial manuscript, YZ, JY, GZ, ML and ZZ reviewed and revised the manuscript. All authors read and approved the final manuscript.

    • The authors declare that they have no conflict of interest.

    • The study was approved by the Ethics Committee of the second hospital of Fuyang (Number 2020020004). Written informed consents were obtained from all patients.

    Figure (6)  Table (2) Reference (22) Relative (20)

    目录

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return