Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Molecular testing for acute respiratory infections (ARIs) has documented value but limited implementation due to questions that typically slow the acceptance of new tests. This study sought to address these questions and achieve implementation. Rhinovirus was added to a nested multiplex PCR (M-PCR), increasing its diagnostic yield. Over one winter, three hospital pediatric departments used the M-PCR to complement their direct fluorescent-antibody assay (DFA) for respiratory syncytial virus (RSV). Clinicians recorded "pretest probability estimates" (using continuous scales for various pathogen groups) for comparison with test results; treatments and test turnaround times were also recorded. Transnasal and throat swabs, with or without nasopharyngeal aspirate (NPA), were M-PCR tested. NPA-containing sample sets found to be RSV positive by DFA were not further tested. Single PCR for human metapneumovirus (hMPV) was performed retrospectively. Of 178 ARI episodes representing 172 patients, NPA was included in 97 sample sets; 54 (56%) were determined to be RSV positive. The other NPA-containing sample sets (n = 43) yielded 27 findings (63%), and the swab-only sets (n = 81) yielded 47 findings (58%); rhinovirus was found most often. Testing for hMPV yielded seven positive results. M-PCR median turnaround times were 4 days in swab-only samples and 5 days with NPA. Antibiotics were prescribed in 50 episodes, at rates similar for RSV and rhinovirus. Pretest probability estimates of a viral cause were lower in episodes caused by rhinovirus than in episodes caused by RSV. The hospitals continued to use M-PCR for NPA-containing samples found to be RSV negative by DFA. Test implementation is more likely with higher diagnostic yield and a protocol that reflects day-to-day clinical and laboratory operations.

Free full text 


Logo of jcmLink to Publisher's site
J Clin Microbiol. 2004 Dec; 42(12): 5596–5603.
PMCID: PMC535307
PMID: 15583287

Practical Implementation of a Multiplex PCR for Acute Respiratory Tract Infections in Children

Abstract

Molecular testing for acute respiratory infections (ARIs) has documented value but limited implementation due to questions that typically slow the acceptance of new tests. This study sought to address these questions and achieve implementation. Rhinovirus was added to a nested multiplex PCR (M-PCR), increasing its diagnostic yield. Over one winter, three hospital pediatric departments used the M-PCR to complement their direct fluorescent-antibody assay (DFA) for respiratory syncytial virus (RSV). Clinicians recorded “pretest probability estimates” (using continuous scales for various pathogen groups) for comparison with test results; treatments and test turnaround times were also recorded. Transnasal and throat swabs, with or without nasopharyngeal aspirate (NPA), were M-PCR tested. NPA-containing sample sets found to be RSV positive by DFA were not further tested. Single PCR for human metapneumovirus (hMPV) was performed retrospectively. Of 178 ARI episodes representing 172 patients, NPA was included in 97 sample sets; 54 (56%) were determined to be RSV positive. The other NPA-containing sample sets (n = 43) yielded 27 findings (63%), and the swab-only sets (n = 81) yielded 47 findings (58%); rhinovirus was found most often. Testing for hMPV yielded seven positive results. M-PCR median turnaround times were 4 days in swab-only samples and 5 days with NPA. Antibiotics were prescribed in 50 episodes, at rates similar for RSV and rhinovirus. Pretest probability estimates of a viral cause were lower in episodes caused by rhinovirus than in episodes caused by RSV. The hospitals continued to use M-PCR for NPA-containing samples found to be RSV negative by DFA. Test implementation is more likely with higher diagnostic yield and a protocol that reflects day-to-day clinical and laboratory operations.

Acute respiratory tract infections (ARIs) in children are a frequent cause for parents to seek medical help, especially in the youngest children. Although the course of these infections is usually benign, hospital admission can be needed, and many clinical laboratories in The Netherlands routinely perform rapid testing for respiratory syncytial virus (RSV) by direct fluorescent-antibody assay (DFA) on nasopharygeal aspirate (NPA) (5). For the ARIs that remain undiagnosed, viral culture methods are used but fill the diagnostic gap only to a limited extent. Studies document the potential advantages of molecular testing in diagnosing ARI, especially if it is caused by rhinovirus, but give little information on its implementation in clinical practice (1, 11, 16, 20, 24). Laboratories considering introduction of molecular diagnosis of ARI face questions such as: which pathogens should be tested for, which methods should be used, should a commercial test be used, how often should the test be performed, and should it be restricted to specified categories of patients? As long as these questions remain, molecular tests for ARI will be introduced only very slowly into clinical practice. We therefore developed a noncommercial nested multiplex PCR (M-PCR), based on available sequence data and literature, to be implemented for both routine clinical use as well as public health requests. We conducted the present study to confirm its clinical usefulness, in cooperation with three hospital pediatric departments. The study was designed to match with day-to-day practices in the pediatric departments as well as in their shared clinical microbiology laboratory. For example, DFA for RSV usually gives a result within hours upon receipt of sample, so we intended our M-PCR to supplement that DFA, as suggested previously (L. Liolios and S. Wesselingh, Authors' Reply to Letter, J. Clin. Microbiol. 40:733-734, 2002). We included rhinovirus in our M-PCR to increase the number of diagnosed episodes of illness. Because rhinovirus is not commonly included in multiplex assays, we recorded clinical symptoms to document its clinical importance and used the prepresentation duration of illness as an indicator of severity (22). We decided to perform M-PCR testing twice weekly, a frequency the laboratory considered “affordable” for a prolonged period, although this choice would lengthen average test turnaround times (TATs) compared to daily testing. Because our M-PCR is based on well-described assays, our study was not designed to generate sensitivity and specificity figures, the classical indices of diagnostic accuracy (17). Instead, it was used to explore pretest probability estimates as a representation of physicians' judgement, borrowing a concept used in the evaluation of diagnostic decision rules (10). As is common in that field, these pretest estimates were recorded and linked with specific test results to indicate clinical usefulness. Thus, while evaluating M-PCR in our specific setting, using obtained numbers of diagnoses and test TATs, we also evaluated whether pretest probability estimates could help demonstrate the usefulness of a molecular test for ARI.

MATERIALS AND METHODS

Pediatric departments, patients, and questionnaires.

All pediatric ARI patients treated at three hospitals between 15 October 2001 and 1 April 2002 were eligible to the study if their attending physician judged that M-PCR could be useful. The three hospitals were Flevo Hospital at Almere, IJsselmeer Hospital at Lelystad, and IJsselmeer Hospital at Emmeloord. Their pediatric departments provide general, not intensive respiratory care for infants. Their shared laboratory for microbiology, based in Amsterdam, provides daily road transport to and from the hospitals, a one-way trip of 35, 65, or 95 km. After written informed consent was obtained from the parents, transnasal and throat swabs with or without NPA were obtained as samples from the children. Decisions regarding requests for routine bacteriology culture and PCR for Bordetella pertussis were left to the physician, as were all other laboratory and X-ray requests. Questionnaires on presenting symptoms, the starting day, risk factors, initial diagnosis, and treatment were completed by the pediatric department staff. In addition, both pediatricians and house staff gave a quantitative estimate of the cause of the illness (10), marking probability scales for the likelihood of various causes (Fig. (Fig.1).1). At the time of discharge, another questionnaire was completed as to the outcome and final diagnosis. The study was approved by the hospitals' ethical committees.

An external file that holds a picture, illustration, etc.
Object name is zjm0120448260001.jpg

Part of a case record form with questions for probability estimates for various causes of the presented complaints (translated from Dutch).

Conventional laboratory methods. (i) DFA.

The NPA samples were processed on all weekdays. They arrived in the laboratory with phosphate-buffered saline (PBS) and were shaken with glass beads for better homogenization. DFA to detect RSV was performed on 10 μl of homogenized sample with 25 μl of fluorescence-labeled anti-RSV antibodies (fluorescein isothiocyanate-labeled antibody MB120 [Imagen; Dako, Glostrup, Denmark]). The slides were read in a fluorescence microscope (Zeiss), and the slide was scored as positive if at least two cells showed specific cytoplasmic fluorescence.

(ii) Virus isolation in tubes and rapid shell vial culture.

If DFA for RSV was negative, both conventional culture and rapid shell vial culture were started and maintained basically as described previously (28). For conventional culture, duplicate aliquots of tertiary monkey kidney cells, human fetal lung fibroblast lung cells and HeLa cells were inoculated with 200 μl of sample fluid at 34°C. If after 4 weeks no cytopathic effect was seen and all staining efforts were negative, the cultures were considered negative. The rapid shell vial culture was performed in duplicate with 200-μl cell suspensions on tertiary monkey kidney and HeLa cells. One series was stained after 2 days, and the other was stained after 5 to 7 days. Direct staining was performed with pools of specific fluorescence-labeled mouse antibodies to influenza A virus, influenza B virus, RSV, and adenoviruses (Imagen; Dako). Indirect staining was performed for parainfluenza type 1, 2 or 3 virus with anti-mouse antibodies (Chemicon Brunschwig, Amsterdam, The Netherlands). Subsequent staining was performed with labeled rabbit anti-mouse antibodies (Imagen; Dako). As controls, virus cultures derived from the Dutch National Institute for Public Health were used (RIVM, Bilthoven, The Netherlands).

Nucleic acid extraction for M-PCR.

Samples from nasal and throat swabs were each suspended in 200 μl of PBS. Total nucleic acids were isolated by isopropanol precipitation as follows. First, 100 μl of PBS eluate was added to 600 μl of lysis buffer (bioMérieux, Boxtel, The Netherlands) plus 1 μl of glycogen (10 mg/ml [Roche Diagnostics, Almere, The Netherlands]). After an incubation of 60 min at 65°C to increase the lysis efficiency, the sample was cooled to room temperature for 2 min. After a short spin (10 s, 14,000 rpm), 1 volume of ice-cold isopropanol (700 μl) was added, followed by mixing. The precipitate was spun down in an Eppendorf centrifuge (type 5417C) for 20 min at 14,000 rpm. The supernatant was removed, and the pellet was washed twice with 70% ethanol. The pellet was dissolved in 50 μl of T10 (10 mM Tris-HCl [pH 8.0] plus 0.4 U of RNasin [Roche Diagnostics]/μl). The nucleic acid was left at 4°C to dissolve overnight and subsequently stored at −80°C until use in the PCR.

M-PCR.

M-PCR was performed twice weekly. Tests for DNA and RNA pathogens were performed separately by using an assay that was based on a previously described method (11). Adjustment to a nested format required outer and inner primers of our design as shown in Table Table1.1. For the DNA pathogens Chlamydia pneumoniae, Mycoplasma pneumoniae, and adenovirus, one nested M-PCR was performed. Both the outer and the inner PCR mixtures contained 20 ng of each of the six appropriate primers, 200 μM deoxynucleoside triphosphate, 2.0 mM MgCl2, 0.5 U of Taq polymerase, 2.5 μl of 10× Taq buffer (Silverstar; Eurogentec, Maastricht, The Netherlands), and water. To the outer PCR mixture, 5 μl of nucleic acid solution was added to obtain a final volume of 25 μl. The PCR program consisted of one step of 94°C for 3 min, followed by 30 cycles of 93°C for 30 s, 55°C for 30 s, and 72°C for 50 s, with a final extension step of 72°C for 7 min. After completion of the outer PCR, 2 μl was transferred to the inner PCR mixture, and the same PCR cycling program was followed. The inner PCR products were separated on a 10% acrylamide gel and stained with ethidium bromide. The length of the inner PCR fragments was indicative of the putative pathogen. Mixtures of culture-positive controls and a buffer sample as a negative control were added in each test run.

TABLE 1.

ARI M-PCR primers and hMPV primers

Detection panel and microorganismTargetDesignationSequence (5′ to 3′)Amplimer length (bp)
Source or reference
OuterInner
DNA panel
    Chlamydia pneumoniaeOmp1 geneC pneu I3TTG GAG CGT AGC CGC TCG TGG A30919
C pneu P3GCT CGA GAC CAT TGT ACT CCA
C pneu K3ATG GGA ATG CGG TTG TGC AAC T223This study
C pneu U3GGC TCC TAC TTG CCA TTC ATG A
    AdenovirusHexon geneAdeno3 out seCCT TTG GCG CAT CCC ATT CT37012
Adeno4 out asGCG CTT GTC ATA GGT GCC CA
Adeno5 inn seCCA CGC GCT AGA CAT GAC TT142This study
Adeno6 inn asGAA GGG CGT GCG CAG GTA CA
    Mycoplasma pneumoniaeP1 gene (three internal repeats)M pn F out seCCC TCG ACC AAG CCA ACC TC34031
M pn R out asTGC GCG TTG TTC TTG TTG GTG
P1-7 inn seGTT TAA CCA CGC AGG ACG GCA A92This study
P1-7 inn asTCA ATC AGC GGT GGG GGT GAG
RNA panel 1
    Rhinovirus5′NCR-VP4NCR 1 out seCGG TAA TTT TGT ACG CCA GTT T5011
NCR 2 out seGAA ACA CGG ACA CCC AAA GTA GT
NCR 3 inn seCAA GCA CTT CTG TTT CCC CGG295This study
NCR 4 inn seCAT TCA GGG GCC GGA GGA
    Influenza B virusNSP gene 8Infl B3 out seGGG ATA TAC GTA ATG TGT TGT489This study
Infl B4 out asGCA CTG CCT GCT GTA CAC TT
Infl B1 inn seATG GCC ATC GGA TCC TCA AC2417
Infl B2 inn asTGT CAG CTA TTA TGG AGC TG
    Parainfluenza virus type 35′ NCR-fusion genePIV 3C out seCTG GGC TTC ATC AGT AGA GA58515
PIV 3D out asGAT CTG TTG GTC ACC ACA AGA
PIV 3B inn seAGA GGT CAA TAC CAA CAA CTA206This study
PIV 3A inn asTAG CAG TAT TGA AGT TGG CA
    Influenza A virusNonstructural protein geneInfl A1 out seAAG GGC TTT CAC CGA AGA GG1717
Infl A2 out asCCC ATT CTC ATT ACT GCT TC
Infl A3 inn seCCA GGA CAT ACT ATT GAG GA112This study
Infl A4 inn asCCC AAG CGA ATC TCT GTA GA
RNA panel 2
    RSVNucleocapsid geneN1A-B out seGAR GTR GCT CCA GAA TAY AGG CAT34320
Osi-2 out asAGC ATC ACT TGC CCT GAA CCA TAG
Osi N4 inn seACT AAG TTA GCA GCA GG197This study
Osi N3 inn asCTG GRA GAA GAT TGT GC
    Parainfluenza virus type 1Hemagglutinin-neur- minidase genePIV 1C out seTGC AGA CGG CAT ATC TCC TCT GGA3079
PIV-1D out asGGT ATG AGA AAT TAC CGG GT
PIV-1E inn seCGT AGG AGA ACC CCT ACT GA173This study
PIV-1F inn asCTA TAT CTG CAC ATC CTT GAG TGA
    Pan-entero virus5′ NCRFox AB out seGGT GYG AAG AGY CTA YTG AGCT20625
Srent2 out asCAC CGG ATG GCC AAT CCA
SRent3 inn seCCC CTG AAT GCG GCT AAT146This study
SRent4 inn asATT GTC ACC ATA AGC AGC CA
hMPV single PCR-hMPVL genehMPV-3s out seAAC ACT GGG GAA AAT GCT CA204This study
hMPV-4a out seATC CGA TAT GAA CCC GTC
hMPV-6 inn seCAT GCC CAC TAT AAA AGG TCA G171-a
hMPV-7na inn asGTC ACC CCA GTC TTT CTT GA
a-, Personal communication of B. van den Hoogen, Institute of Virology, Erasmus University, Rotterdam, The Netherlands. L gene in sequence GenBank AF371337.

For the RNA pathogens (seven viruses [see Table Table1])1]) a combined reverse transcriptase (RT) outer PCR was performed by using the Access kit (Promega, Leiden, The Netherlands) according to the instructions of the manufacturer. The total mixture volume was 25 μl, of which 5 μl consisted of the nucleic acid solution. Thus, the outer Access RT-PCR contained a mixture of 12 primers (degenerate primers for the pan-enterovirus and RSV detection). The amplification program consisted of a first RT step at 48°C for 45 min, followed by a denaturation step of 94°C for 2 min and then 30 cycles of 93° for 30 s, 55°C for 30 s, and 72°C for 50 s, with a final extension step of 72°C for 7 min. After completion of the outer PCR, 2 μl was transferred to two inner PCR mixtures containing the same components as the DNA PCR mixtures, except for the primers. The two inner mixtures were selected to enable optimal discrimination by length separation of the inner PCR products. As shown in Table Table1,1, RNA panel 1 contained the primers (20 ng each) for detecting influenza A and B viruses, pan-rhinovirus, and parainfluenza type 3 virus, whereas RNA panel 2 contained the primers (20 ng each) for detecting pan-enterovirus, RSV, and parainfluenza type 1 virus. The PCR program used for the DNA PCR amplification steps described above was followed. Gel detection and inclusion of positive and negative controls were similar to the DNA PCR.

hMPV PCR.

For retrospective use, a nested PCR was designed by using sequences of the L gene of human metapneumovirus (hMPV) (Table (Table1).1). The outer and inner PCR mixtures and amplification conditions and the gel detection analysis were similar to the RT-PCR approach described above for the M-PCR. Each run contained, as a positive control sample, isolated RNA from cultured hMPV that was kindly provided by A. Osterhaus, Erasmus Medical Center, Rotterdam, The Netherlands.

Comparison of the sensitivity of M-PCR versus specific PCR.

To assess the analytical sensitivity, we compared the M-PCR to each pathogen-specific PCR by performing each test six times on endpoint titrations of control cultures for each pathogen. The specific PCR was done by performing the M-PCR but with only the primers for the pathogen under study, with identical conditions otherwise and with sterile water replacing the other primers. The dilution at which 50% of the PCRs was still positive was calculated by using formulas similar to those used to compute the 50% tissue culture infectious dose. The difference in results between the multiplex setting and the specific PCR were <0.7 log for all pathogens except for influenza B virus (1.3 log) and parainfluenza type 3 (1.3 log), an outcome considered acceptable for this diagnostic amplification system.

Clinical data analysis.

Clinical and laboratory data were entered in an Access database (Microsoft). Continuously recorded probability estimates were grouped into five intervals and, where appropriate, comparisons for the numbers in these intervals were made between specific test outcomes. Test TAT was defined as the day that the result was available minus the day that the sample was taken. The duration of illness prior to presentation to the hospital was figured from the day of presentation back to the day that the illness started. Where appropriate, chi-square tests were performed by using EPI-INFO version 6 (Centers for Disease Control and Prevention, Atlanta, Ga.).

RESULTS

Patients and samples.

During the study period, 188 ARI episodes were considered for our study. Of the sets received at the laboratory, 10 were excluded for one of the following reasons: (i) lack of informed consent (n = 4); (ii) samples were sent, but no questionnaires (n = 2); and (iii) questionnaires were sent, but there was not enough sample for an M-PCR (n = 4). The included 178 episodes represented 172 patients. Patient episode characteristics are summarized by site in Table Table2.2. Patients were seen by four pediatricians at site A, four pediatricians at site B, and two pediatricians at site C. In addition, six junior doctors saw patients at site A, whereas sites B and C each had one junior doctor working at their pediatric ward. Especially the youngest children were preferably sampled with both NPA and swabs. Severe illness was rare; only three patients required referral to other hospitals for intensive respiratory care. Risk factors were reported in 58 episodes; these factors varied from low birth weight to asthma and mental retardation. The largest number of samples was collected at site A, although the number of NPA samples was low compared to site B. The median length of stay of admitted children was shorter at site A compared to site B. Site C contributed the smallest number of samples.

TABLE 2.

Patient episode characteristics

Episode categorySite ASite BSite CAll sites
Patient episodes (all)1055023178
    Patients with a second episode5106
    Age groups
        0-2 mo1819138
        3-5 mo265536
        6-11 mo2014438
        12-23 mo135624
        24-47 mo103417
        48 mo to 16 yr184325
    Transfers for intensive respiratory care2103
    Median length of stay (days) (range)4 (2-9)5 (2-17)5 (1-8)5 (1-17)
Inpatient episodes24 (23)42 (84)20 (87)86 (48)
    NPA and swabs
        No. RSV positive/no. tested for rapid RSVa (%)7/18 (39)26/41 (63)8/14 (57)41/73 (56)
        No. any pathogen positive/no. tested by M-PCRb (%)8/11 (73)8/15 (53)5/6 (83)21/32 (66)
        No. positive in rapid RSV or M-PCR/no. tested (%)15/18 (78)34/41 (83)13/14 (93)62/73 (85)
    Swabs only (no. any pathogen positive/no. tested by M-PCR) (%)3/6 (50)1/1 (100)5/6 (80)9/13 (69)
No. of M-PCR results (positive or negative) available at least 1 day before discharge/no. of all M-PCR tests performed for admitted patients (%)4/17 (23)5/16 (31)5/12 (42)14/45 (31)
Outpatient episodes81 (77)8 (16)3 (13)92 (52)
    NPA and swabs
        No. RSV positive/no. tested for rapid RSV (%)11/18 (61)1/5 (20)1/1 (100)13/24 (54)
        No. any pathogen positive/no. tested by M-PCR (%)4/7 (57)2/4 (50)0/06/11 (55)
        No. positive in rapid RSV or M-PCR/no. tested (%)15/18 (83)3/5 (60)1/1 (100)19/24 (79)
    Swabs only (no. any pathogen positive/no. tested by M-PCR) (%)35/63 (56)2/3 (67)1/2 (50)38/68 (56)
aRapid RSV testing by DFA.
bOnly M-PCR results are counted in Table Table2.2. Retrospectively performed hMPV and specific Bordetella requests were not included. Any pathogen positive, positive for any pathogen.

RSV DFA results and viral culture results.

Table Table22 shows that 97 sample sets (73 inpatients and 24 outpatients) included an NPA. Of these, 54 (41 inpatients and 13 outpatients) were determined to be positive by RSV DFA. Thus, in 56% of the patients sampled by NPA, the first test yielded a positive RSV result. Since admission policies differed among hospitals, less than half of the RSV-positive patients (7 of 18) were admitted at site A, whereas most of the RSV-positive patients were admitted at sites B (26 of 27) and C (8 of 9). Of the 43 NPA samples with a negative or equivocal DFA result, one was insufficient for all remaining tests, so 42 samples were cultured for respiratory viruses, yielding nine positive results (21%): adenovirus (n = 3), rhinovirus (n = 4), influenza virus A (n = 1), and RSV (n = 1).

M-PCR results.

Table Table33 summarizes PCR results of the sample sets with (n = 43) or without (n = 81) NPA. The upper part of Table Table33 shows the results of the M-PCR that became available to the clinicians during our study. The percentage of diagnosed episodes reached 84% or, conversely, the diagnostic deficit was reduced to 16% if NPA was sent to the laboratory, and M-PCR results were added to the DFA results. If only swabs were sent, M-PCR detected a possible pathogen in 58% of the cases. Double infections were common and, with three exceptions, these were all rhinovirus combinations: infection with adenovirus (n = 6), infection with C. pneumoniae (n = 1), infection with M. pneumoniae (n = 4), infection with enterovirus (n = 2), infection with influenza virus A (n = 2), and infection with RSV (n = 3). The three other combinations were influenza virus A and C. pneumoniae, adenovirus and RSV, and influenza virus B and RSV.

TABLE 3.

Amplification test results of 124 patient episodes by type of sample set

AnalysisNo. of sample sets (%)
Sample sets including NPA, negative by DFA for RSV (n = 43)Swab-only sample sets (n = 81)
M-PCR (prospectively)
    Adenovirus2 (5)4 (5)
    Chlamydia pneumoniae01 (1)
    M. pneumoniae1 (2)2 (2)
    Influenza A virus3 (7)7 (9)
    Influenza B virus1 (2)1 (1)
    Parainfluenza 100
    Parainfluenza 31 (2)2 (2)
    Enterovirus01 (1)
    Rhinovirus13 (30)12 (15)
    RSV (PCR)02 (2)
    Double infection6 (14)15 (19)
    Negative16 (37)34 (42)
Bordetella-PCR (if requested)a1 (2)0
hMPV-PCR (retrospectively)b4 (9)3 (4)
Negative after hMPV-, Bordetella-, and M-PCR11 (26)31 (38)
aBordetella-PCR was requested in 51 sample sets.
bhMPV-PCR was retrospectively performed for all 124 sample sets that had been tested by M-PCR.

Of the 66 cases considered to be “bronchiolitis” at presentation, 33 yielded RSV as single pathogen, whereas 9 (7 with NPA plus 2 swab only) yielded a rhinovirus as single pathogen (Table (Table4).4). Four bronchiolitis double infections sampled with NPA all involved rhinovirus: in combination with RSV (n = 3) and C. pneumoniae (n = 1). In bronchiolitis episodes, influenza virus A was found only once. In episodes regarded to be pneumonia on presentation (17 patients, of whom 8 were admitted), rhinovirus was found slightly more frequently than RSV. There were three episodes with rhinovirus alone, one in combination with M. pneumoniae, and one in combination with adenovirus; RSV alone was found twice in such patients, and the RSV-rhinovirus combination was found once. The combination of rhinovirus and M. pneumoniae was found in a 6-year-old child. In three episodes considered to be pneumonia, influenza virus A was detected. Of the three children referred for intensive respiratory care, RSV was detected in one, rhinovirus was detected in another, and no pathogen was detected in the third.

TABLE 4.

Symptoms by sample type

Symptom or syndrome at presentationaOutcome (all tests combined)bNo. of sample sets (%)
NPA included in sample sets (n = 97)Swab-only sample sets (n = 81)
Upper respiratory tract infection (undifferentiated)25 (26)49 (60)
    Pharyngitis2 (2)29 (36)
    Tonsilitis3 (3)9 (11)
    Sinusitis01 (1)
    Otitis media4 (4)7 (9)
Lower respiratory tract infection (undifferentiated)76 (78)58 (72)
    Bronchitis10 (10)32 (40)
    BronchiolitisTotal50 (52)16 (20)
RSV330
Rhinovirus72
Influenza A virus01
hMPV21
Other and double45
Negative47
    PneumoniaTotal6 (6)11 (14)
RSV11
Rhinovirus12
Influenza A virus12
hMPV11
Other and double22
Negative03
None stated7 (7)4 (5)
aClinicians were allowed to indicate the presence of more than one symptom or syndrome.
bThe breakdown by detected pathogen is given only for bronchiolitis and pneumonia. Pathogens were detected both by M-PCR and by conventional viral methods.

hMPV- and Bordetella-PCR and bacteriology results.

The lower part of Table Table33 shows that 7 (5.6%) more diagnoses were retrospectively added by performing the hMPV-PCR on all M-PCR processed samples. Most of the hMPV-infected children had lower respiratory tract infections, and five of the seven children were younger than 6 months, four of whom were admitted for 4 to 8 days. B. pertussis was not a target pathogen in the present study, so only samples with a specific request were tested by PCR for Bordetella. Of 51 such requests, only one was PCR positive for B. pertussis. This case of whooping cough was diagnosed in a 4-week-old baby admitted at ward B who persisted for almost 2 weeks. The infection was not immediately suspected on admission; the probability estimate for viral infection was 90%, and the probability of whooping cough was not stated. Blood cultures (n = 10) and/or lower respiratory tract samples (n = 4) for bacteriology were send in 13 episodes of illness. Blood cultures remained negative. Potential pathogenic bacteria were detected in 3 lower respiratory tract samples. Streptococcus pneumoniae and Haemophilus influenzae were detected in a 10-month-old child known to have previous asthma-like symptoms. Staphylococcus aureus was found in low numbers in a 2-month-old child with Downs' syndrome, and M-PCR detected rhinovirus. At almost 4 months of age, this child had a second episode of illness with a readily recognized RSV bronchiolitis. Finally, Pseudomonas aeruginosa was detected in a 15-year-old with cystic fibrosis; this was a repeated finding.

TATs.

TATs of NPA containing sample sets are graphically represented in Fig. Fig.2.2. The results that were obtained most rapidly are shown; thus, the largest number of positive results was obtained by DFA. Two rapid shell vial results were obtained the same day as the M-PCR result became available, and one conventional culture result (i.e., RSV) was not detected by M-PCR. In the latter sample, a rhinovirus was detected by M-PCR, and in the breakdown columns in Tables Tables44 and and5,5, this sample was designated a “double pathogen.” All other results were obtained only by M-PCR or more rapidly than by viral culture methods. As can be seen in Fig. Fig.2,2, the median TAT for positive M-PCR results was 5 days in the NPA-containing sample sets. Samples in the swab-only group had a median TAT of 4 days, since processing of these samples did not wait for a DFA result. We also calculated the number of admitted patients in whom the M-PCR result (both positive or negative) was available at least 1 day before discharge (Table (Table2),2), finding an average of 31%. The percentage was lowest at site A, which had the lowest admission rate and the shortest length of stay.

An external file that holds a picture, illustration, etc.
Object name is zjm0120448260002.jpg

TATs obtained in NPA-containing sample sets (n = 97) for different laboratory tests. DFA for RSV was performed first and, depending on the result, M-PCR processing followed. Bars represent the numbers of first positive test results and the time (in days) required to produce the result. If a conventionally obtained result was available on the same day as an M-PCR result, the conventional TAT is represented. One adenovirus and one influenza virus A test result were obtained, both with rapid shell vial culture and M-PCR after 2 and 3 days. One RSV result was obtained with conventional culture only after 9 days.

TABLE 5.

Clinician probability estimates for causes of presenting illnesses

Suspected cause of illnessaOutcome (all tests combined)bNo. of samples with clinician pretest probability estimate of:
Not stated<5%6-30%31-69%70-94%≥95%
Viral cause (any)Total439247167
RSV71732
Rhinovirus34153
Influenza A virus2242
hMPV133
Other and double12341414
Negative1371813
Bacterial cause (any)Total2178522340
RSV3331442
Rhinovirus57103
Influenza A virus13321
hMPV133
Other and double315128
Negative8171061
“Atypical” cause24103202380
Pertussis19934113111
Asthma as a co-cause31704026110
aNumbers in rows add up to 178, the total number of patient episodes in the study.
bThe breakdown by detected pathogen is given only for the questions for the probability of a viral and a bacterial cause. Pathogens were detected both by M-PCR and by conventional viral methods.

Probability estimates, test outcomes, and antibiotic treatment.

Clinicians were asked to estimate the likelihood of various causes of the presented illness, as a representation of physicians' judgement (Fig. (Fig.1).1). In the majority of cases, there was a high level of suspicion for a viral cause of the presented symptoms (Table (Table5).5). Low to moderately low probability estimates were given for pertussis, “atypical” agents, and bacterial pathogens. Many physicians did not address the question on the probability of asthma as a co-cause and, of those who did, many indicated their uncertainty by marking the center range of the probability scale. Comparing diagnostic probability estimates with testing results (Table (Table5),5), we noted that doctors were more likely to suspect viral origin in cases of RSV infections (as diagnosed by both DFA and M-PCR) than in cases of rhinovirus infections (M-PCR, single finding). Taking the 95% probability estimate as a threshold in 54 RSV-positive patients, 32 estimates were at or above threshold, whereas only 3 estimates were above threshold in 22 rhinovirus-positive patients (P < 0.01 [chi-square analysis]). Repeating this procedure with inclusion of only the sample sets including NPA or with exclusion of the data of clinicians contributing more than 20 cases yielded similar results, although the numbers were lower (P < 0.05 [chi-square analysis]). Conversely, clinicians were more certain that children did not have a bacterial infection if RSV was detected compared to rhinovirus. Antibiotics were prescribed in 50 episodes of illness. As expected, such prescriptions were strongly related to the clinicians' estimate of bacterial cause. However, even among the 78 episodes in which a bacterial cause was estimated to be very unlikely (Table (Table5),5), antibiotics were prescribed in 10. Among the patients sampled via NPA, those with reported risk factors were more likely to receive an antibiotic prescription than those without risk factors (P < 0.01 [chi-square analysis]). RSV was detected in 16 and rhinovirus as a single pathogen was detected in 7 of the antibiotic-prescribed episodes. Thus, rhinovirus-infected patients were not more likely to have antibiotics prescribed than RSV-infected patients.

Duration of illness prior to presentation with RSV or rhinovirus infection.

Calculation of the duration of illness prior to presentation was possible in 152 of the 178 episodes, and the duration ranged from 0 to 122 days. In cases with the longest duration, we assume that parents and/or clinicians did not always consider only the current pathogen episode when indicating the starting date of the illness. However, taking 2 days as a threshold, 11 of 22 rhinovirus episodes had a prepresentation illness of ≤2 days, whereas only 8 of 45 RSV episodes had such a short prepresentation duration of illness (P < 0.01 [chi-square analysis]).

DISCUSSION

Our study in three pediatric departments was intended to enable their clinicians and microbiologists to decide whether or not to establish M-PCR as a test that is routinely available within the existing collaboration of the hospitals and shared laboratory. We focused on the number of results, test TATs, and the clinicians' pretest probability estimates in relation to test outcomes as indicators of clinical usefulness. Our noncommercial M-PCR was based on a previously described assay (11). We added rhinovirus to the pathogen set, expecting and finding a substantial increase of diagnosed episodes of illness. Primers were redesigned or supplemented with new primers to obtain a nested multiplex test format. Decreased analytical sensitivity of the multiplex PCR compared to single-pathogen PCR tests did not prove to be a problem; in our hands, differences were small and did not outweigh the advantages in both ease and decreased reagent costs. The M-PCR obtained far more diagnoses than conventional viral culture, at reasonable test TATs. Our finding that clinicians recorded lower pretest probabilities of viral causation in rhinovirus infections, compared to RSV, underscored the usefulness of M-PCR as an additional diagnostic tool.

While designing the present study, we decided to perform M-PCR on NPA only if DFA for RSV was negative. DFA usually gives a reliable result within hours upon receipt, and the associated costs are modest, making it unlikely that molecular methods will replace DFA for RSV detection in the next few years. Figure Figure22 illustrates that in our setting, with the laboratory distant from the hospitals and offering once-daily transport, less than half of the DFA results are available on the day of sampling. Performing a test for RSV in cases of bronchiolitis is considered standard in The Netherlands (5), but the typical bronchiolitis can be managed without it (23). Due to the sequential testing in our study, M-PCR results in the NPA-containing sample sets were delayed compared to the swab-only samples. Most M-PCR results were not received in time to affect decisions during hospital stays. Still, clinicians appreciated that the results could be reported to the parents at the next outpatient visit.

Our hypothesis was that the M-PCR test results would be more appreciated if clinicians were uncertain about the diagnosis, in other words, when the estimated pretest probability was low. We therefore recorded clinicians' diagnostic probability estimates before any microbiological test was done, thus introducing physicians' judgement into evaluating a new diagnostic procedure in clinical microbiology. Although used in other fields, to our knowledge this approach has not been used previously in diagnostic studies in infectious disease, perhaps due to certain limitations. For instance, clinicians may hesitate to estimate pretest probabilities in an individual case (3). However, sufficient numbers of observations made by a sizeable group of clinicians should allow inferences. The fact that clinicians frequently recorded very high levels of pretest probability of a viral cause in RSV infections (Table (Table5)5) but not in rhinovirus infections suggests that M-PCR indeed adds useful diagnostic information, particularly regarding that pathogen. The relative diagnostic uncertainty in rhinovirus infections could result in more antibiotic prescriptions, but this was not seen in our data set.

Rhinovirus was the single most frequently detected virus in the present study after RSV (Table (Table3).3). Appreciation of this virus as a potential pathogen is vital in evaluating the usefulness of M-PCR as an additional test. As shown in Table Table4,4, rhinovirus came second to RSV in episodes considered bronchiolitis at presentation and, in cases considered to be pneumonia, rhinovirus was slightly more common than RSV. Distinguishing pneumonia clinically may be difficult in children (30). These findings are in line with reports that rhinovirus does cause a number of lower respiratory tract infections (21). In hematologic cancer patients requiring bronchoalveolar lavage, in bronchopulmonary dysplasia patients, and in adults and children with exacerbated asthma, rhinovirus proved to be a serious pathogen (4, 6, 8, 14, 24, 29). Similar to a previous report, we found that more children with infected with rhinovirus had been ill no longer than 2 days before presentation compared to the RSV-infected children (P < 0.01 [chi-square analysis]), indicating more serious disease (22). We conclude that it is worthwhile to test for rhinovirus and that the few manufacturers of multiplex amplification tests for ARI should include rhinovirus in their assays.

Influenza A virus was also commonly found, but mainly during the high-incidence season in The Netherlands. Few of these children required admission. M-PCR did not add much speed because in NPA samples influenza viruses are readily detected with conventional rapid methods (2). M-PCR performed on swabs, however, made outbreaks caused by influenza easier to investigate. Our collected set of samples was used to determine the frequency of hMPV (27). Of the 124 samples tested, 7 (5.6%) were positive for hMPV, a percentage that is comparable to the findings of other reports (26, 27). Especially the youngest children were affected; they had lower respiratory tract symptoms, and all recovered uneventfully. Retrospective testing for hMPV thus reduced the diagnostic deficit to 11% (11 of 97) in the NPA-containing sample sets and to 38% (31 of 81) in the swab-only sample sets.

We recognize that there must be some selection bias in our data set, given the relatively low number of samples from sites B and C compared to site A (Table (Table2).2). A partial explanation may lie in the different numbers of junior doctors. In addition, pediatricians at locations B and C had more space to admit children presenting with RSV bronchiolitis. At location A such children were often sent home with equipment and instructions for the parents; these children were told to return the next day to the pediatric department to be seen by the clinician. Variation in resource utilization in hospitalized children in the United States has been studied by Willson et al., who found that the severity of illness did not explain the variation (32).

Costs have been considered throughout the planning and performing of the present study, and future economic assessments of molecular tests are warranted. However, we did not perform a formal economic assessment, mainly because molecular methods to diagnose ARI are still being improved and thus have no widely accepted standard. At present, introducing a new in-house molecular test is largely a matter of affordability. As for future assessment, ARI in children usually has a benign course, so outcome measures need to be chosen with this in mind. Improved care may reduce length of stay and save hospital costs, as found in a study of rapid viral culture methods (2); however, having seen differences in admission and discharge policies among our sites, we doubt that length of stay will be significantly influenced just by rapid diagnostic methods. Improved antibiotic stewardship and avoidance of resistance development are important possible effects of molecular testing, but economic evaluation of resistance is complicated (18), and the availability of M-PCR results may not automatically reduce the number of antibiotic prescriptions. As we noted above, patients may have an antibiotic prescribed even if the clinician is fairly certain that the illness is caused by a virus. To reduce such prescriptions, a combination of individual M-PCR test results with repeated feedback of aggregated results is probably required. Finally, we must stress the appreciation of the test results by the children's parents. Diagnostic certainty or “knowing for the sake of knowing” should not be ignored, in our opinion, and may be addressed with “willingness to pay” questionnaires (13). Within the present study, we attempted to determine the parents' “willingness to pay” for M-PCR but failed to collect sufficient data. We think that especially parents of infants at risk for developing asthma may value diagnostic information on an episode of wheezing.

At our study sites, pediatricians and laboratory staff decided to continue M-PCR testing of NPA samples. Swab-only samples, however, were discontinued since there was no consensus among the hospitals on the indication of these samples as routine requests. After approval by the hospitals' administrators, M-PCR testing was thus implemented. We hope that laboratories already capable of noncommercial molecular tests will be encouraged by the number of diagnoses we achieved and proceed to offer molecular tests for ARI at hospitals comparable to ours. Of course, newer molecular methods should be used as soon as they are available and affordable, with cheap and accurate point-of-care diagnosis being the ultimate goal. Future studies should confirm that both individual and aggregated feedback of molecular ARI test results indeed contribute to more appropriate antibiotic use.

Acknowledgments

We thank Patrick M. M. Bossuyt and Henri A. Verbrugh for critical reading of the manuscript and Lucy D. Phillips for editorial review.

REFERENCES

1. Andeweg, A. C., T. M. Bestebroer, M. Huybreghs, T. G. Kimman, and J. C. De Jong. 1999. Improved detection of rhinoviruses in clinical samples by using a newly developed nested reverse transcription-PCR assay. J. Clin. Microbiol. 37:524-530. [Europe PMC free article] [Abstract] [Google Scholar]
2. Barenfanger, J., C. Drake, N. Leon, T. Mueller, and T. Troutt. 2000. Clinical and financial benefits of rapid detection of respiratory viruses: an outcomes study. J. Clin. Microbiol. 38:2824-2828. [Europe PMC free article] [Abstract] [Google Scholar]
3. Barriga, P., and M. Smieja. 2001. Likelihood ratios for microbiology. J. Clin. Microbiol. 39:2366.. [Europe PMC free article] [Abstract] [Google Scholar]
4. Boivin, G., A. D. Osterhaus, A. Gaudreau, H. C. Jackson, J. Groen, and P. Ward. 2002. Role of picornaviruses in flu-like illnesses of adults enrolled in an oseltamivir treatment study who had no evidence of influenza virus infection. J. Clin. Microbiol. 40:330-334. [Europe PMC free article] [Abstract] [Google Scholar]
5. Brand, P. L., A. A. Vaessen-Verberne, et al. 2000. Differences in management of bronchiolitis between hospitals in The Netherlands. Eur. J. Pediatr. 159:343-347. [Abstract] [Google Scholar]
6. Chidekel, A. S., C. L. Rosen, and A. R. Bazzy. 1997. Rhinovirus infection associated with serious lower respiratory illness in patients with bronchopulmonary dysplasia. Pediatr. Infect. Dis. J. 16:43-47. [Abstract] [Google Scholar]
7. Claas, E. C., M. J. Sprenger, G. E. Kleter, R. van Beek, W. G. Quint, and N. Masurel. 1992. Type-specific identification of influenza viruses A, B, and C by the polymerase chain reaction. J. Virol. Methods 39:1-13. [Europe PMC free article] [Abstract] [Google Scholar]
8. Corne, J. M., C. Marshall, S. Smith, J. Schreiber, G. Sanderson, S. T. Holgate, and S. L. Johnston. 2002. Frequency, severity, and duration of rhinovirus infections in asthmatic and non-asthmatic individuals: a longitudinal cohort study. Lancet 359:831-834. [Abstract] [Google Scholar]
9. Fan, J., and K. J. Henrickson. 1996. Rapid diagnosis of human parainfluenza virus type 1 infection by quantitative reverse transcription-PCR-enzyme hybridization assay. J. Clin. Microbiol. 34:1914-1917. [Europe PMC free article] [Abstract] [Google Scholar]
10. Glas, A. S., B. A. Pijnenburg, J. G. Lijmer, K. Bogaard, R. M. de Roos, J. N. Keeman, R. M. Butzelaar, and P. M. Bossuyt. 2002. Comparison of diagnostic decision rules and structured data collection in assessment of acute ankle injury. Can. Med. Assoc. J. 166:727-733. [Europe PMC free article] [Abstract] [Google Scholar]
11. Grondahl, B., W. Puppe, A. Hoppe, I. Kuhne, J. A. Weigl, and H. J. Schmitt. 1999. Rapid identification of nine microorganisms causing acute respiratory tract infections by single-tube multiplex reverse transcription-PCR: feasibility study. J. Clin. Microbiol. 37:1-7. [Europe PMC free article] [Abstract] [Google Scholar]
12. Hierholzer, J. C., P. E. Halonen, P. O. Dahlen, P. G. Bingham, and M. M. McDonough. 1993. Detection of adenovirus in clinical specimens by polymerase chain reaction and liquid-phase hybridization quantitated by time-resolved fluorometry. J. Clin. Microbiol. 31:1886-1891. [Europe PMC free article] [Abstract] [Google Scholar]
13. Hirth, R. A., B. S. Bloom, M. E. Chernew, and A. M. Fendrick. 1999. Willingness to pay for diagnostic certainty: comparing patients, physicians, and managed care executives. J. Gen. Intern. Med. 14:193-195. [Europe PMC free article] [Abstract] [Google Scholar]
14. Johnston, S. L., P. K. Pattemore, G. Sanderson, S. Smith, F. Lampe, L. Josephs, P. Symington, S. O'Toole, S. H. Myint, and D. A. Tyrrell. 1995. Community study of role of viral infections in exacerbations of asthma in 9- to 11-year-old children. BMJ 310:1225-1229. [Europe PMC free article] [Abstract] [Google Scholar]
15. Karron, R. A., K. L. O'Brien, J. L. Froehlich, and V. A. Brown. 1993. Molecular epidemiology of a parainfluenza type 3 virus outbreak on a pediatric ward. J. Infect. Dis. 167:1441-1445. [Abstract] [Google Scholar]
16. Kehl, S. C., K. J. Henrickson, W. Hua, and J. Fan. 2001. Evaluation of the Hexaplex assay for detection of respiratory viruses in children. J. Clin. Microbiol. 39:1696-1701. [Europe PMC free article] [Abstract] [Google Scholar]
17. McAdam, A. J. 2000. Discrepant analysis: how can we test a test? J. Clin. Microbiol. 38:2027-2029. [Europe PMC free article] [Abstract] [Google Scholar]
18. McGowan, J. E. J. 2001. Economic impact of antimicrobial resistance. Emerg. Infect. Dis. 7:286-292. [Europe PMC free article] [Abstract] [Google Scholar]
19. Meijer, A., J. A. van der Vliet, L. M. Schouls, A. de Vries, P. J. M. Roholl, and J. M. Ossewaarde. 1998. Detection of microorganisms in vessel wall specimens of the abdominal aorta: development of a PCR assay in the absence of a gold standard. Res. Microbiol. 149:577-583. [Abstract] [Google Scholar]
20. Osiowy, C. 1998. Direct detection of respiratory syncytial virus, parainfluenza virus, and adenovirus in clinical respiratory specimens by a multiplex reverse transcription-PCR assay. J. Clin. Microbiol. 36:3149-3154. [Europe PMC free article] [Abstract] [Google Scholar]
21. Papadopoulos, N. G., P. J. Bates, P. G. Bardin, A. Papi, S. H. Leir, D. J. Fraenkel, J. Meyer, P. M. Lackie, G. Sanderson, S. T. Holgate, and S. L. Johnston. 2000. Rhinoviruses infect the lower airways. J. Infect. Dis. 181:1875-1884. [Abstract] [Google Scholar]
22. Papadopoulos, N. G., M. Moustaki, M. Tsolia, A. Bossios, E. Astra, A. Prezerakou, D. Gourgiotis, and D. Kafetzis. 2002. Association of rhinovirus infection with increased disease severity in acute bronchiolitis. Am. J. Respir. Crit. Care Med. 165:1285-1289. [Abstract] [Google Scholar]
23. Perlstein, P. H., U. R. Kotagal, C. Bolling, R. Steele, P. J. Schoettker, H. D. Atherton, and M. K. Farrell. 1999. Evaluation of an evidence-based guideline for bronchiolitis. Pediatrics 104:1334-1341. [Abstract] [Google Scholar]
24. Rakes, G. P., E. Arruda, J. M. Ingram, G. E. Hoover, J. C. Zambrano, F. G. Hayden, T. A. Platts-Mills, and P. W. Heymann. 1999. Rhinovirus and respiratory syncytial virus in wheezing children requiring emergency care. IgE and eosinophil analyses. Am. J. Respir. Crit. Care Med. 159:785-790. [Abstract] [Google Scholar]
25. Read, S. J., and J. B. Kurtz. 1999. Laboratory diagnosis of common viral infections of the central nervous system by using a single multiplex PCR screening assay. J. Clin. Microbiol. 37:1352-1355. [Europe PMC free article] [Abstract] [Google Scholar]
26. Stockton, J., I. Stephenson, D. Fleming, and M. Zambon. 2002. Human metapneumovirus as a cause of community-acquired respiratory illness. Emerg. Infect. Dis. 8:897-901. [Europe PMC free article] [Abstract] [Google Scholar]
27. van den Hoogen, B. G., J. C. De Jong, J. Groen, T. Kuiken, R. de Groot, R. A. Fouchier, and A. D. Osterhaus. 2001. A newly discovered human pneumovirus isolated from young children with respiratory tract disease. Nat. Med. 7:719-724. [Europe PMC free article] [Abstract] [Google Scholar]
28. Van Doornum, G. J., and J. C. De Jong. 1998. Rapid shell vial culture technique for detection of enteroviruses and adenoviruses in fecal specimens: comparison with conventional virus isolation method. J. Clin. Microbiol. 36:2865-2868. [Europe PMC free article] [Abstract] [Google Scholar]
29. van Elden, L. J., M. G. van Kraaij, M. Nijhuis, K. A. Hendriksen, A. W. Dekker, M. Rozenberg-Arska, and A. M. van Loon. 2001. Polymerase chain reaction is more sensitive than viral culture and antigen testing for the detection of respiratory viruses in adults with hematological cancer and pneumonia. Clin. Infect. Dis. 34:177-183. [Europe PMC free article] [Abstract] [Google Scholar]
30. van Woensel, J. B., W. M. van Aalderen, and J. L. Kimpen. 2003. Viral lower respiratory tract infection in infants and young children. BMJ 327:36-40. [Europe PMC free article] [Abstract] [Google Scholar]
31. Waring, A. L., T. A. Halse, C. K. Csiza, C. J. Carlyn, M. K. Arruda, and R. J. Limberger. 2001. Development of a genomics-based PCR assay for detection of Mycoplasma pneumoniae in a large outbreak in New York State. J. Clin. Microbiol. 39:1385-1390. [Europe PMC free article] [Abstract] [Google Scholar]
32. Willson, D. F., S. D. Horn, J. O. Hendley, R. Smout, and J. Gassaway. 2001. Effect of practice variation on resource utilization in infants hospitalized for viral lower respiratory illness. Pediatrics 108:851-855. [Abstract] [Google Scholar]

Articles from Journal of Clinical Microbiology are provided here courtesy of American Society for Microbiology (ASM)

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/43017010
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/43017010

Article citations


Go to all (42) article citations

Data 


Data behind the article

This data has been text mined from the article, or deposited into data resources.