Europe PMC

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Background: Global outbreaks caused by emerging or re-emerging arthropod-borne viruses (arboviruses) are becoming increasingly more common. These pathogens include the mosquito-borne viruses belonging to the Flavivirus and Alphavirus genera. These viruses often cause non-specific or asymptomatic infection, which can confound viral prevalence studies. In addition, many acute phase diagnostic tests rely on the detection of viral components such as RNA or antigen. Standard serological tests are often not reliable for diagnosis after seroconversion and convalescence due to cross-reactivity among flaviviruses. Methods: In order to contribute to development efforts for mosquito-borne serodiagnostics, we incubated 137 human sera on individual custom peptide arrays that consisted of over 866 unique peptides in quadruplicate. Our bioinformatics workflow to analyze these data incorporated machine learning, statistics, and B-cell epitope prediction. Results: Here we report the results of our peptide array data analysis, which revealed sets of peptides that have diagnostic potential for detecting past exposure to a subset of the tested human pathogens including Zika virus. These peptides were then confirmed using the well-established ELISA method. Conclusions: These array data, and the resulting peptides can be useful in diverse efforts including the development of new pan-flavivirus antibodies, more accurate epitope mapping, and vaccine development against these viral pathogens.

Free full text 


Logo of f1000resF1000Research
Version 3. F1000Res. 2019; 8: 1875.
PMCID: PMC7065662
Other versions
PMID: 32201571

Peptide arrays incubated with three collections of human sera from patients infected with mosquito-borne viruses

Maria del Pilar Martinez Viedma, Formal Analysis, Investigation, Methodology, Validation, Writing – Original Draft Preparation, Writing – Review & Editing,1 Nurgun Kose, Data Curation, Investigation, Supervision,2 Leda Parham, Data Curation, Investigation, Supervision,3 Angel Balmaseda, Investigation, Supervision,4 Guillermina Kuan, Investigation, Supervision,5 Ivette Lorenzana, Data Curation, Investigation, Supervision, Writing – Original Draft Preparation,3 Eva Harris, Data Curation, Investigation, Supervision, Writing – Original Draft Preparation, Writing – Review & Editing,6 James E. Crowe, Jr., Data Curation, Investigation, Supervision, Writing – Original Draft Preparation, Writing – Review & Editing,7,8 and Brett E. Pickett, Conceptualization, Data Curation, Formal Analysis, Funding Acquisition, Project Administration, Software, Supervision, Visualization, Writing – Original Draft Preparation, Writing – Review & Editinga,1,9

Associated Data

Data Citations
Data Availability Statement

Version Changes

Revised. Amendments from Version 2

This version of the manuscript includes updated text that clarifies the materials and methods that were used, as well as additional topics in the Discussion section. We have also added a new figure of a heat map for the Zika-specific peptides across all arrays.

Peer Review Summary

Review dateReviewer name(s)Version reviewedReview status
2020 Mar 10Felix F. LoefflerVersion 3Version 3Version 3Approved
2020 Feb 18Salvatore De-SimoneVersion 2Approved
2020 Feb 13Felix F. LoefflerVersion 1Approved with Reservations
2019 Nov 14Salvatore De-Simone and David William ProvanceVersion 1Not Approved

Abstract

Background: Global outbreaks caused by emerging or re-emerging arthropod-borne viruses (arboviruses) are becoming increasingly more common. These pathogens include the mosquito-borne viruses belonging to the Flavivirus and Alphavirus genera. These viruses often cause non-specific or asymptomatic infection, which can confound viral prevalence studies. In addition, many acute phase diagnostic tests rely on the detection of viral components such as RNA or antigen. Standard serological tests are often not reliable for diagnosis after seroconversion and convalescence due to cross-reactivity among flaviviruses.

Methods: In order to contribute to development efforts for mosquito-borne serodiagnostics, we incubated 137 human sera on individual custom peptide arrays that consisted of over 866 unique peptides in quadruplicate. Our bioinformatics workflow to analyze these data incorporated machine learning, statistics, and B-cell epitope prediction.

Results: Here we report the results of our peptide array data analysis, which revealed sets of peptides that have diagnostic potential for detecting past exposure to a subset of the tested human pathogens including Zika virus. These peptides were then confirmed using the well-established ELISA method.

Conclusions: These array data, and the resulting peptides can be useful in diverse efforts including the development of new pan-flavivirus antibodies, more accurate epitope mapping, and vaccine development against these viral pathogens.

Keywords: peptide arrays, mosquito-borne viruses, Zika virus, serodiagnostic, bioinformatics, B-cell epitopes

Introduction

Zika virus (ZIKV) is an arbovirus within the Flavivirus genus and the Flaviviridae family. In addition to ZIKV, many other mosquito-borne viruses exist that negatively affect public health, including dengue virus (DENV) and chikungunya virus (CHIKV), among others. ZIKV is primarily transmitted by the bite of infected Aedes spp. mosquitoes, with limited instances of sexual transmission also being reported 14. The recent worldwide epidemic has demonstrated that ZIKV is a neuropathic virus that is associated with fetal microcephaly and other congenital defects in infected pregnant women, and Guillain-Barré syndrome in adults 5. Due to the number of ZIKV infections in recent years and the continued threat of ZIKV re-emerging around the world, there is still an urgent need for rapid and accurate surveillance assays in order to rapidly identify new outbreaks. Distinguishing between infection with multiple co-circulating arboviruses that have similar clinical signs and symptoms makes accurate prevalence calculations and diagnosis extremely difficult—especially after convalescence 610.

The sequence similarity at the amino acid level in many flavivirus immunogenic protein regions contributes to the observed cross-reactivity in serological assays, which is especially high in the E protein and also present in the NS1 protein 11. Although reports showing antibodies against other viral proteins are detectable and show acceptable specificity 12, the E and NS1 proteins are considered some of the primary targets of the humoral anti-flavivirus immune response in humans 1315, even with the known amounts of cross-reactivity with other mosquito-borne flaviviruses.

Recent efforts to generate whole-genome sequences for these pathogens enable the application of bioinformatics tools to mine the data for trends and patterns that can be clinically applicable 1620. The meta-CATS (metadata-driven Comparative Analysis Tool for Sequences) algorithm is a statistical workflow that rapidly identifies sequence variations that significantly correlate with the associated metadata for two or more groups of sequences 21. This algorithm has been included in an analytical workflow to identify residues within 15-mer surface-exposed linear peptide regions that have high predicted specificity and sensitivity values for many Flavivirus species 22. The peptides predicted by this prior in silico analysis are evaluated in the current study for their ability to detect antibodies against a variety of mosquito-borne viruses. Quantifying the reactivity of this set of peptides using high-throughput custom peptide arrays enables the efficient and simultaneous testing of the set of peptides against a variety of serum samples with higher efficiency than what is possible with manual enzyme-linked immunosorbent assay (ELISA) technology alone 23.

The aim of current study is to evaluate the previously-predicted 15-mer viral peptides for their ability to act as differentiating B-cell epitopes, through high-throughput peptide arrays using relevant sera. We have recently completed an analysis of 137 serum samples using custom peptide arrays (each containing 866 experimental viral peptides) to identify 15-mer linear peptides that could be useful as serodiagnostic reagents to detect prior infection with mosquito-borne viruses. Specifically, we tested peptides representing different co-circulating mosquito-borne viruses, including: ZIKV, DENV 1–3, CHIKV and West Nile virus (WNV). Applying machine learning, a weighting scheme, and B-cell epitope prediction algorithms to these data enabled us to identify pools of 8–10 peptides that are predicted to be immunodominant across human sera from previously infected individuals in Central and South America. In addition, we have separately evaluated these peptides using an ELISA method with a set of well-characterized sera. These data could be used by the scientific community to develop improved serological diagnostic methods for detecting past infection with one or more of these viral pathogens.

Methods

Peptide preparation and microarray printing

A subset of the previously predicted diagnostic peptides 22, representing multiple mosquito-borne virus species and subtypes, were synthesized at the Center for Protein and Nucleic Acid Research at The Scripps Research Institute (TSRI) 23, 24. This selected collection of peptides consisted of surface-exposed 15-mers with sequences that represented the consensus amino acid sequence among strains belonging to each of our six target taxa including: CHIKV, DENV1, DENV2, DENV3, WNV, and ZIKV. Peptides on the array that represented mosquito-borne virus taxa for which there were no serum samples were ignored in downstream quantification and computation. As such, a total of 25, 51, 28, 34, or 70 peptides in the E protein as well as 15, 19, 15, 23, or 70 peptides in the NS1 protein (all derived from DENV1, DENV2, DENV3, WNV, or ZIKV sequences, respectively) were evaluated in these experiments. A set of 25 peptides spanning portions of the CHIKV E2 protein that had previously been reported as relevant for detecting anti-CHIKV antibodies were also included 25. Synthesized peptides were suspended in 12.5 μL DMSO and 12.5 μL of ultra-pure water. Immediately prior to printing, suspended peptides were diluted 1:4 in a custom protein printing buffer [saline sodium citrate (SSC): 300 mM sodium citrate, pH 8.0, containing 1 M sodium chloride and supplemented with 0.1% Polyvinyl Alcohol (PVA) and 0.05% Tween 20], in a 384-well non-binding polystyrene assay plate. Two positive control peptides, hemagglutinin A (HA) (YPYDVPDYA) and FLAG tag (DYKDDDDK), together with a dye that permanently fluoresces at 488 nm (Alexa Fluor 488) were included in the print to guide proper grid placement and peptide alignment, as well as to serve as printing controls as well as controls to quantify the maximum fluorescence for the assays.

Quadruplicate sets of all peptides were printed onto N-hydroxysuccinimide ester (NHS-ester) coated NEXTERION Slide H (Applied Microarrays) slides at an approximate density of 1 ng/spot, using a Microgrid II (DigilabGlobal) microarray printing robot equipped with solid steel (SMP4, TeleChem) microarray pins. Humidity was maintained at 50% during the printing process. Immediately prior to interrogating the arrays, slides were blocked for 1 h with ethanolamine buffer to quench any unreacted NHS-ester on the slide. All slides were used within 2 months of printing and were stored at -20°C 23.

Serum sources

Spent diagnostic serum samples were provided by collaborators working under three separate clinical studies in Honduras, the United States, and Nicaragua. These sera were collected from a total of 137 consented human patients under IRB supervision and were characterized as positive for antibodies against at least one of: ZIKV, DENV1, DENV2, DENV3, WNV, and/or CHIKV.

A total of 32 deidentified plasma samples from patients suspected of Zika, chikungunya or dengue in Honduras were obtained at the discretion of health care providers at the Hospital Escuela Universitario from patients (ages 6–73 years old). These acute-phase samples were sent to the Centro de Investigaciones Geneticas at the Universidad Nacional Autonoma de Honduras in Tegucigalpa, Honduras for ZIKV, CHIKV and/or DENV molecular testing. Of these patients, 23 had infection with DENV and nine had infection with ZIKV confirmed by RT-qPCR during the acute phase. Convalescent samples were collected from these patients 10–30 days post-onset of symptoms between June 1 to November 30, 2016.

A total of 73 de-identified human serum samples were obtained from the Vanderbilt Vaccine Center Biorepository. Sera from individuals with previous history of natural infection with DENV, WNV, CHIKV, or ZIKV (confirmed by serology for convalescent samples or RT-qPCR for acute-phase samples) while traveling in the Caribbean, Central or South America, or West Africa were included on arrays. For WNV, sera were from individuals with confirmed previous history of natural infection contracted during an outbreak in 2012 in Dallas, TX. The samples were collected in the convalescent phase, months to years after post-onset of symptoms.

A total of 32 de-identified human sera were collected from the Pediatric Dengue Cohort Study (PDCS) in Managua, Nicaragua 26, 27. Early convalescent-phase samples were collected 15–17 days post-onset of symptoms from 9 Zika cases that were confirmed as positive for ZIKV infection by real-time RT-qPCR between January and July, 2016. Late convalescent samples were obtained from 21 DENV-positive cohort participants after RT-qPCR confirmed DENV1 (n=7), DENV2 (n=8), or DENV3 (n=6) infection and 2 DENV-negative subjects, all in 2004–2011, prior to the introduction of ZIKV to Nicaragua. Samples were analyzed by inhibition ELISA 28, 29 and neutralization assay 30, 31. The PDCS was approved by the IRBs of the University of California, Berkeley, and Nicaraguan Ministry of Health. Parents or legal guardians of all subjects provided written informed consent; subjects 6 years old and older provided assent.

High-throughput screening and quantification of characterized patient sera

Once the peptide microarrays were printed, aliquots from a subset of samples were used to optimize the screening and detection processes. Specifically, dilutions ranging from 1:50 to 1:1000 were evaluated to determine the optimal dilution level for subsequent screening. A 1:200 dilution was selected to achieve an optimal balance between the available aliquot volumes and assay sensitivity.

The 137 characterized sera were separately subjected to high-throughput screening using the synthesized peptide arrays. Sera were tested for IgG reactivity using the custom peptide array at TSRI. For immunolabeling, the incubation area around the printed grids was circumscribed using a peroxidase anti-peroxidase (PAP) hydrophobic marker pen (Research Products International Corp) and the subsequent steps were performed in a humidified chamber at room temperature on a rotator. Control anti-HA (mAb 12CA5, Scripps Research, mouse IgG, RRID:AB_514505) and anti-FLAG monoclonal antibodies (Invitrogen, MA1-142-A488, RRID:AB_2610653) were assayed at a concentration of 10 μg/ml while 10 μl of human sera were diluted 1:200 in PBS buffer containing Tween (PBS-T) and incubated for 1 h followed by three washes in PBS buffer. The arrays were then incubated for 1 h with goat anti-human IgG tagged with Alexa Fluor® 488 (Invitrogen, cat. #: A-11013, RRID: AB_2534080) as a secondary antibody for anti-FLAG and anti-HA bound to control peptides, and Alexa Fluor® 633-conjugated goat anti-human IgG (Invitrogen, cat. #: A-21091, RRID: AB_2535747) as a secondary antibody for serum antibodies bound to viral peptides. Arrays were washed three times in PBS-T, two times in PBS, and another two times in deionized water and centrifuged to dry at 200 × g for 5 mins.

The fluorescence of the processed slides was quantified using a ProScanArray HT (Perkin Elmer) microarray scanner at 488 nm and 635 nm, with laser power set at 5 or 10, PMT gain set at 50 and 50. Captured images were saved as high-resolution TIF files. Imagene® 6.1 microarray analysis software (BioDiscovery; ImageJ could be used as an open-access alternative) was used to calculate the fluorescence intensity of the area within the printed diameter of each peptide as well as the fluorescence of the same diameter directly outside of the area occupied by each peptide. The mean and median fluorescence signal and background pixel intensities, as well as other data for each antigen, spot were calculated, digitized, and exported as individual rows in a comma-delimited file for subsequent analysis.

Data processing to identify immunodominant epitopes

A custom script 32 was written to implement a previously described array processing workflow 24 with a minor change to use the median foreground and background values instead of mean values to minimize outlier effects (available on GitHub). Negative background values were interpreted as zeroes. Briefly, background correction was calculated by subtracting the median background from the median foreground measurements for each spot on each array. Normalization was performed by dividing the background-corrected values for each spot on each slide by the non-control spot having the largest fluorescence value on each slide as has been described previously 24. The quadruplicate spots for each peptide on each array were then summarized into a single value by calculating the median value of the quadruplicate spots for each peptide to further reduce the effects of any outliers. The normalized relative fluorescence intensity values for all peptides and all samples were output as a separate file together with summarized quantitative values indicating how well each peptide was recognized by each of the polyclonal serum samples.

A separate script was used to transform all relative fluorescence intensity values for each peptide into Z-scores, and separate tables were constructed to contain the summarized Z-score values for all peptides (as columns) representing each of the viral taxa and all samples (as rows) that were tested with the peptide array. A random forest algorithm ( randomForest version 4.6-12 package in R) was applied to each of these tables in order to identify the peptides that were best able to differentiate between each of the viral taxa. In this case, the number of trees generated in the random forest for each species was 100,000, and the number of variables randomly sampled as candidates at each split was equal to the square root of the number of columns present in each table.

The values representing the mean decrease in Gini index were calculated separately for samples obtained from each of the three collections as well as all possible combinations of two or more collections. These data were then used to identify the top 30 peptides according to their usefulness in identifying the correct virus taxon. The BepiPred algorithm was then used to predict the number of residues that are frequently present in B-cell epitopes, and would therefore contribute to increased affinity and binding by antibodies in downstream assays 33. The peptides were then assigned a cumulative rank based on the epitope prediction and Gini values, and the 10 highest-ranking peptides across the E and NS1 proteins for each viral taxon, as well as 8 peptides in the E2 region for CHIKV, were categorized as the most likely to have high immunodominance and therefore be recognized by antibodies in sera collected from previously infected patients in the western hemisphere. Statistical comparisons of quantitative differences between the Gini and normalized fluorescence values for sets of peptides were performed using Student’s t-test.

Peptide validation using ELISA

Each peptide was synthesized (LifeTein, LLC) and 2 ng of peptide was diluted in 50 μL of ddH2O. Natural human IgG protein (abcam, cat. # ab91102), complement component C1q from human serum (sigma, cat. #: C1740), and labelled secondary antibody (ThermoFisher, cat. #: A18817, RRID: AB_2535594) were used as additional controls. Pools of two peptides were used to coat duplicate wells on a 96-well Immulon 4HBX plate (ThermoFisher, cat. # 3855) and incubated at 4°C overnight. Next, 100 μL of blocking buffer (PBS+5% BSA) was added to each well and incubated for 2 hours at room temperature prior to three washing steps with washing buffer (PBS + 0.05% Tween 20). Human serum was diluted 1:25 in blocking buffer and 50 μL of this solution was added to each well prior to incubation for 2 hours at room temperature. Each plate was then washed four times with washing buffer and 50 μL of HRP-conjugated anti-human IgG antibody (ThermoFisher, cat. #: A18817, RRID: AB_2535594; 0.1 mg/mL diluted 1:20,000) was added to each well, followed by incubation at room temperature for 2 hours. Each plate was then washed four additional times before incubating at room temperature for 30 minutes with 75 μL of TMB substrate (abcam, cat. # ab171523). Then, 75 μL of stop solution (abcam, cat. # ab171529) was added to each well and a BioTek-synergy HT plate reader was used to quantify the fluorescence in each well at 450nm within 15 minutes.

ELISA data processing

A normalization process was implemented that adjusted fluorescence values in each well based on the control wells included on each ELISA plate 34, which enabled the downstream comparison between plates. Briefly, the average background value from all negative control wells (i.e. no bound peptide) was calculated and subtracted from each set of duplicate wells on the plate. The normalized value was calculated by dividing the background-corrected value for each set of duplicate wells by the background-corrected average of the positive control wells (i.e. bound secondary antibody). Wells with normalized values of greater than 2.5, between 1.5 and 2.5, or less than 1.5 were categorized as putative positive, borderline, or negative, respectively, for the target viruses. A downstream quality control method was also implemented to ignore results from ELISA plates that displayed high levels of background, inconsistent signal from multiple control wells, or samples observed to have at least two wells for each taxon with higher than expected signal.

Human subject approval

All samples evaluated on the peptide arrays and ELISA plates were acquired from patients under informed consent and approved by the Ethical or Institutional Review Board at each participating institution, including: Universidad Nacional Autonoma de Honduras (IRB 00003070), Vanderbilt University (IRB 8675), University of California, Berkeley (Committee for Protection of Human Subjects 2010-09-2245), and the Comite Institutional de Revision Etica (NIC-MINSA/CNDR CIRE-09/03/07-008.ver19).

Results

Data records

Overall, we screened 137 unique serum samples for their reactivity against a panel of viral peptides ( Figure 1 and Underlying data 35). These samples, together with the clinical diagnosis, were collected from patients with known past exposure to at least one of the viruses targeted by our peptides ( Table 1). Also contained within the Underlying data are files describing the metadata of peptides included on the array and each experimental sample 35.

Figure 1.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0000.jpg
Bioinformatics and laboratory workflow diagram.

A graphical depiction of the processes for predicting, screening, processing, and validating peptide array experiments.

Table 1.

Number of serum samples screened with peptide arrays.
VirusNumber of
Samples
CHIKV5
CHIKV, DENV32
DENV10
DENV17
DENV225
DENV312
WNV12
ZIKV21
ZIKV, DENV9
DENV-Negative2
Unknown2
Total137

The data from each array is contained in a single tab-delimited text file and contains the quantitative data captured from a single serum sample on a single peptide array 35. A subset of the fields in each file include: location of each peptide spot on the array, peptide identifier, raw mean and median foreground fluorescence at both 488 and 635 nm, raw mean and median background fluorescence at 488 and 635 nm, and other data collected from the raw image.

A subset of Z-scores, which corresponded to peptides predicted to be relevant for ZIKV, were visualized for all samples ( Figure 2). A complete matrix containing the transformed Z-score values for each peptide was formatted for input into a random forest (RF) machine learning algorithm to assist with ranking peptides according to virus taxon. To do so, a column was added to the matrix assigning each sample to the virus taxon that was known to have infected the patient (e.g. “Zika” or “Non-Zika”). Z-score values in columns containing the predicted peptides from each taxon were then captured and input into the RF algorithm.

Figure 2.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0001.jpg
Heatmap of calculated z-score values for ZIKV-specific peptides across all sera.

The z-score normalized values (i.e. normal distribution with a mean of 0 and a standard deviation of 1) for all candidate peptides predicted to be specific to ZIKV, together with the known serological history of each patient were visualized in a heatmap with hierarchical clustering.

The benefit of the RF algorithm is that it is capable of ranking the importance of features, which are peptides in this case, based on a known classification. The ranking is based on the mean decrease in Gini index, which is a value that quantifies node impurity. In other words, the higher the Gini index value, the more important the feature is in correctly identifying the virus taxon.

In order to account for geographical, genetic, and population-based factors, we computed the mean decrease in Gini index for individual collections (e.g. Nicaragua or Honduras), all relevant pairs of collections (e.g. Nicaragua and Honduras, Honduras and United States), and the combination of all collections from our sera providers. These calculations were accompanied by a class-error rate that quantifies the number of samples characterized as being positive for ZIKV that were predicted to be ZIKV samples.

This class-error rate information for each individual or combination of collections was then used to weight the peptide rankings results. Briefly, this involved multiplying the average rank for each peptide in each comparison by the average weight and dividing it by the sum of weight. This process works to increase the rank of peptides that have consistently high Gini values. We used these rankings to identify the top 25 species-specific peptides for each virus taxon. This process was repeated for non-ZIKV samples, including WNV, DENV1-3, and CHIKV.

In addition to the class-error rate, we visualized the random forest output using a receiver operating characteristic (ROC) curve to graph the relationship between true-positive rate and false-positive rate. The area under the curve (AUC) can be calculated with higher values indicating better accuracy. We performed this analysis for the collections from Nicaragua, Honduras, the United States, and the combination of all three collections ( Figure 3).

Figure 3.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0002.jpg
Receiver operating characteristic curve for random forest results.

Individual curves were calculated for A) the combination all of three collections of sera, B) the Nicaragua collection of sera, C) the United States collection of sera, and D) the Honduras collection of sera.

In order to conserve resources for the peptide array and decrease the number of peptides that would be incorporated into the future ELISA assay, we used the existing BepiPred 2.0 algorithm to predict which of our 15-mer peptides contain the highest number of amino acids that are most often recognized by antibodies 36. These B-cell epitope predictions were then used to reduce the 25 best peptides identified from machine learning, to the 10 best peptides that are predicted to not only be species-specific, but that are most likely to contain species-specific epitopes. In the case of ZIKV, we also reviewed the spot size and shape in the peptide array images to ensure that there were no irregularities that could negatively bias our results. The BepiPred 2.0 results enabled us to predict which peptides would be most seroreactive for each selected taxon. The mean maximum score from the BepiPred 2.0 analysis was calculated to be 0.58 (range: 0.55 – 0.63). These scores are associated with a specificity greater than 81%.

Computational validation

Given the serological cross-reactivity that has been reported among many of our targeted mosquito-borne viruses 37, we recognized the need to validate the results of our high-throughput screen. To do so, we not only ensured that those generating the peptide array data were “blinded” to the phenotype of each sample, but we also computationally evaluated two distinct but complementary comparative and quantitative metrics that are described below.

First, we compared two serum samples from pediatric patients that had not been infected with DENV prior to sample collection. The data from the DENV-specific peptides in these samples were then compared to those from a representative DENV-positive sample to verify the differences in signal between known positive and known negative samples. This comparison would also provide a better understanding of the contribution of cross-reactivity, which has been reported previously 37, on our platform ( Table 2). This comparison showed that the DENV-negative samples had less than four percent of the normalized fluorescence values, well below the 10 percent that was observed in the DENV-positive sample. Transforming these raw data into Z-scores further increases the observed differences in fluorescence values and, provides additional support to the unbiased nature of the data produced in these experiments.

Table 2.

Comparison of normalized reactivity percentages among representative well-characterized serum samples as an indicator of peptide specificity.
DENV-Negative * DENV-Negative ** DENV1-Positive ***
DENVNon-DENVDENVNon-DENVDENVNon-DENV
Min0.055%0.000%0.196%0.392%0.000%0.000%
Max1.496%7.181%3.509%10.201%10.671%32.004%
Median0.383%0.550%1.032%1.854%1.455%1.576%
Mean0.505%1.005%1.242%2.186%1.837%3.576%

* Sample H22.

** Sample H23.

*** Sample H1.

We next wanted to assess the technical rigor of our approach by performing a statistical analysis of the observed experimental variation in the peptide array experiments. In this case, data was available for six of our target viruses for which sera was evaluated on the arrays. We specifically wanted to quantify the reactivity of the best-performing peptides for each sample against in a panel of comparisons ( Table 3). The results from this analysis identified noticeable differences in the signals for ZIKV and WNV ( Figure 4). However, we observed that the quantified values for the other four virus taxa were lower than the values for all samples combined and did not meet statistical significance when comparing known positive and negative samples ( Figure 5). These results show that incorporating Gini scores and immune epitope predictions into our computational pipeline contributed to our ability to identify sets of peptides that were capable of distinguishing between past infection with a subset of our target viruses.

Table 3.

Predicted immunodominant diagnostic epitopes identified from peptide array data reported in this study.
ZIKVCHIKVWNVDENV1DENV2DENV3
EEWCCRECTMPPLSFSRKISHSCTHPFHHDESCGHRGPATRTTTEIESEKNETWKLARASNIWLKLREKQDVFCDDLPLPWTSGATTETP
NSFVVDGDTLKECPLEKFHSRPQHGGKELPTRMFLKVRESNTTECIMWKQISNELNHILLKEIKVTPQSSITEAEQKNGSWKLEKASLIE
VREDYSLECDPAVIGSNAATAEEIEVHMPPATVSDLSTKAACPTMYWIESEKNETWKLARKQDVFCDSKLMSAAIIIGVLEQGKRTLTPQ
AQMAVDMQTLTPVGRNVYKATRPYLAHCPDLVHREWFMDLNLPWSIPFSTQDEKGVTQNGREKQDVFCDSKLMSADGQGKAHNGRLITAN
FVVDGDTLKECPLKHTDSRKISHSCTHPFHFVHGPTTVESHGNYSKCVTKLEGKIVQYENTPHSGEEHAVGNDTGPLPWTSGATTETPTW
GEAYLDKQSDTQYVCNCKVDQCHAAVTNHKEWFMDLNLPWSSAGSFSTQDEKGVTQNGRLDTGKHGKEIKVTPQSFSTEDGQGKAHNGRL
GPSLRSTTASGRVIEIGREKFHSRPQHGGKDLNLPWSSAGSTVWRKQISNELNHILLENDHSGEEHAVGNDTGKHIGIGDNALKINWYKK
MEIRPRKEPESNLVRSMGEEPNYQEEWVTHKAACPTMGEAHNDKRCKIPFSTQDEKGVTQGIMQAGKRSLRPQPTPWTSGATTETPTWNR
TRGPSLRSTTASGRVEDFGFGLTSTRMFLKTDAPCKIPFSTQDEKHGKEIKVTPQSSITECKIPFSTEDGQGKAH
KNDTWRLKRAHLIEMHGPTTVESHGNYSTQDEKGVTQNGRLITANGNDTGKHGKEIKVTPTSGATTETPTWNRKE

Figure 4.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0003.jpg
Mean of normalized ratio values across multiple viral taxa.

A bar chart depicting the mean values of the best-performing peptides for samples that were characterized as: positive for the specified taxon, negative for the specified taxon, positive or negative for the specified taxon, and all samples across all viral taxa.

Figure 5.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0004.jpg
Quantitating statistical significance between normalized ratio values.

A bar chart showing the -log10 p-value for the best-performing sets of peptides for each virus species. Comparisons include: samples that were positive for the virus vs. those that were negative for the virus (+ vs -), samples that were positive for the virus vs. all samples quantified for the virus), and samples that were positive vs. all quantified samples (+ vs. All). Values greater than 1.30 indicate p < 0.05.

It is also important to recognize that each peptide was printed at non-adjacent sites on each array in quadruplicate to minimize experimental bias due to the location of any given spot on the array. Incorporating technical replicates was an important component of the experimental design. Such an approach enables improved replication of the results and also increases the scientific rigor of the resulting dataset upstream of any data processing workflows.

Experimental validation

The number of samples that were evaluated for prior exposure to each virus was insufficient to allow the use of in silico cross-validation techniques that are generally applied to the classifier predictions. We therefore designed custom 96-well ELISA plates to validate the ability of the peptides ( Figure 6). The highest predicted reactivity to accurately detect prior infection by each of the target viruses.

Figure 6.

An external file that holds a picture, illustration, etc.
Object name is f1000research-8-24949-g0005.jpg
Layout of custom ELISA plate to screen sera for reactivity against predicted peptides.

Testing of duplicate pairs of each peptide for each of the target virus taxa. Each column contains pairs of peptides that were predicted to be effective at differentiating each virus based on the bioinformatics processing of the peptide array data. (row A for ZIKV; row B for CHKV; row C for WNV; row D for DENV-1; row E for DENV-2; row F for DENV-3; row G for DENV-4; row H for YFV). Negative control wells, which were not coated with peptides are in column 12 and in wells with no label. Wells containing other control material are in column 11 (green) and include: C1q, naïve human immunoglobulin G, or only secondary antibody.

These custom ELISA plates were incubated with 26 human convalescent sera that had been previously characterized as positive for at least one of our target virus taxa using complementary methods, including plaque reduction neutralization test (PRNT) from convalescent serum, IgM antibody capture enzyme-linked immunosorbent assay (MAC-ELISA) from post-acute phase serum, and/or quantitative real-time PCR (qRT-PCR) from blood collected during acute infection. These samples were obtained from public sources including: BEI Resources (5 samples), the World Reference Center for Emerging Viruses and Arboviruses (7 samples), or the United States Centers for Disease Control and Prevention (16 samples).

After processing and correcting the raw ELISA data, we found that the well-characterized samples showing a normalized absorbance ratio greater than 1.5 correlated with cases of previously confirmed Zika infection ( Table 5Table 30). Consequently, we compiled the normalized absorbance ratio data and categorized any peptide pool found to have a normalized ratio value greater than 1.5 was classified as a “borderline” result, while those having a value greater than 2.5 was classified as a putative “positive” result. In order to increase specificity, any sample with at least two wells of the ELISA plate having normalized ratios greater than 1.5 were labeled as putative “positive” for prior infection with the target virus.

Given the p-values associated with the peptide array results, we decided to especially focus on samples that were positive for ZIKV. As such, instances where excessive signal was detected for all viruses were processed in a way that still identified samples having at least 2x stronger signal for ZIKV peptides than for DENV peptides in the same sample were labeled with a “Z” to differentiate them from other categories.

The summarized results of the ELISA data revealed a fair amount of concordance with the “gold standard” methods and displayed overall sensitivity and specificity of 61.5% and 50%, respectively ( Table 4). Interestingly, these values fluctuated depending on the collection that was analyzed and were affected by small sample size from two of the collections.

Table 4.

ELISA data compared with sample characterization data and metadata.
Control
Sample
Name
ZIKV (P-ositive,
N-egative,
B-orderline,
Z-ika
adjustment)
ZIKV Conclusion
(INCLUDE 'Z')
ZIKV Conclusion
(EXCLUDE 'Z')
Interpretation
ZIKV
PRNT new
guidance
interpretation
PRNT 4-fold
difference
interpretation
MAC-
ELISA
P/N
ZIKV
PRNT
ZIKA
PRNT
DENV 1
PRNT
DENV 2
PRNT
DENV 3
PRNT
DENV 4
Original
Clinical
PCR
result
Original
Clinical IgM
result
Original
Clinical PRNT
interpretation
Time
from clin
sample
to conv
sample
Specificity
(Include 'Z')
Sensitivity
(Include 'Z')
Specificity
(All)
Sensitivity
(All)
NR50226D2#N/AFPTN----------< 20271< 2042----Primary DENV2--000.250.615
NR50231D#N/AFPFP----------9129335068----Secondary
DENV
--
NR50896ZK#N/AFNFNPositive--------------------ZIKV89 days
NR50900ZK#N/AFNFNPositive--------------------ZIKV100 days
NR50902ZK#N/A----Positive--------------------ZIKV170 days
UTMB10#N/A----Positive----3.83675852425743------97 daysNaN1
UTMB11#N/A----Positive----2.82354247<307648------135 days
UTMB133#N/ATPFNPositive----------------Positive------
UTMB134#N/ATPFNPositive----------------Positive------
UTMB2#N/ATPTPPositive----4.0131062765187624381230------45 DPO
UTMB8#N/A----Positive----1.27658NDNDNDND------113 DPO
UTMB9#N/A----Positive----1.39438376412453425------156 DPO
P23-A#N/A----Presumptive
Positive
flavivirusflavivirus40.992560102405120----Pos---- ~ 6–8
weeks
0.50.625
P23-B#N/AFNFNPresumptive
positive
flavivirusflavivirus12.03256025605120----Pos---- ~ 6–8
weeks
P23-C#N/ATPTPPresumptive
positive
flaviviruszika9.4412808020----Pos---- ~ 6–8
weeks
P23-D#N/A----Presumptive
positive
flavivirusdengue7.911280>204802560----Pos---- ~ 6–8
weeks
P23-E#N/AFNFNPresumptive
positive
flavivirusflavivirus8.21128012801280----NegNeg/Pos
seroconversion
flavivirus4 mos
P23-F#N/A----Presumptive
positive
flaviviruszika9.79128010<10----PosIgM Positiveflavivirus15 weeks
P23-G1#N/AFPTNNegativeNegativeNegative--------------------
P23-H#N/A----Presumptive
positive
flaviviruszika25.7832010<10----PosIgM Positiveflavivirus9 weeks
P23-I#N/ATPTPPresumptive
Positive
flavivirusflavivirus4.6640512010240----Pos---- ~ 6–8
weeks
P23-J1#N/ATNTNNegativeNegativeNegative--------------------
P23-K#N/AFNFNPresumptive
Positive
flavivirusflavivirus44.66128012801280----Pos---- ~ 6–8
weeks
P23-L#N/ATPFNPresumptive
Positive
flavivirusflavivirus55.2212801280640----Pos---- ~ 6–8
weeks
P23-M#N/ATPFNPresumptive
Positive
flaviviruszika14.16102408040----Pos---- ~ 6–8
weeks
P23-N#N/ATPFNPresumptive
Positive
flavivirusflavivirus60.86256051201280----Pos---- ~ 6–8
weeks

Table 5.

Normalized ELISA results for NR50226D2.
123456789101112
A1.6541.0381.0383.0380.69250.192
B0.4621.3461.0382.0770.346
C0.9622.1541.3461.1150.923
D2.3461.0772.2310.8850.538122.500
E2.3851.0770.3460.6920.423
F1.1150.5001.1921.15414.308
G0.6922.1921.5770.7692.5381.000
H2.0383.2312.0770.6150.808

Table 6.

Normalized ELISA results for NR50231D.
123456789101112
A0.1611.2521.6710.7761.69913.531
B1.3081.83910.95814.2030.664
C1.1961.3360.1891.5031.699
D1.1401.3920.8601.1120.77685.737
E1.8110.7200.7480.6641.112
F0.7481.5310.9721.1401.755
G0.6361.5311.6151.6712.5941.000
H1.3644.6642.0350.2170.049

Table 7.

Normalized ELISA results for NR50896ZK.
123456789101112
A0.4000.5600.2400.480-0.24075.600
B-0.8401.2800.1201.240-0.320
C-0.1201.4800.6000.2400.400
D1.5600.8802.760-0.080-0.640122.907
E2.4400.6000.8800.1201.080
F0.520-0.0800.0400.08023.960
G0.4801.6401.5600.4000.3601.000
H1.6402.3202.4800.0400.080

Table 8.

Normalized ELISA results for NR50900ZK.
123456789101112
A0.265-0.3060.020-0.9591.00035.204
B1.0001.245-0.306-0.224-1.449
C25.1630.102-1.204-0.3060.429
D1.000-0.796-0.388-1.776-1.204254.796
E1.816-0.7961.327-0.0610.673
F0.2650.2650.1020.51011.694
G0.5920.9182.2240.5103.6941.000
H4.75528.3474.102-0.2240.347

Table 9.

Normalized ELISA results for NR50902ZK.
123456789101112
A1.4800.200-0.600-0.4402.44086.707
B-0.9201.640-0.120-1.240-3.160
C39.7200.520-1.080-0.4400.520
D3.400-0.4401.320-3.320-0.760526.173
E2.280-1.4002.4400.8402.760
F-0.920-0.9200.8400.84018.280
G0.2002.4400.360-0.2805.1601.000
H3.56049.1602.9200.0400.200

Table 10.

Normalized ELISA results for P23-A.
123456789101112
A2.8623.6552.8282.1383.58618.000
B4.1725.3792.9663.793-0.310
C3.3105.8975.5524.8286.379
D8.3796.8973.3452.3793.37953.080
E4.5523.6555.1034.5862.966
F3.6555.1035.0345.6552.724
G4.5174.0007.1034.8281.1031.000
H3.2072.4833.828-0.241-0.276

Table 11.

Normalized ELISA results for P23-B.
123456789101112
A-1.235-3.431-4.137-2.098-15.510-1.340
B-2.647-4.529-3.980-3.9021.000
C-1.471-6.529-3.039-3.784-4.059
D-6.725-5.863-30.647-3.588-1.275-64.634
E-4.412-4.843-3.667-5.510-0.137
F-3.902-4.451-4.020-4.647-4.098
G-4.490-5.157-5.824-1.6670.8821.000
H-1.353-5.157-2.9610.3331.392

Table 12.

Normalized ELISA results for P23-C.
123456789101112
A-3.6320.8601.8422.2636.404-0.450
B-3.211-0.3331.4911.421-0.825
C-5.9475.4213.5263.8077.316
D6.4743.2461.211-3.561-1.10594.708
E1.5610.0882.4741.070-1.947
F-1.3161.5614.6494.6499.702
G0.6491.6326.3331.912-1.1751.000
H-0.684-0.7543.246-1.8770.789

Table 13.

Normalized ELISA results for P23-D.
123456789101112
A1.2167.0544.7844.45910.83818.622
B1.3241.973-0.4054.459-1.054
C-3.6499.6495.3247.1627.703
D19.1626.5143.919-5.054-2.784171.559
E8.459-1.2701.757-0.622-2.459
F5.0002.7305.5414.892-3.541
G2.1895.00011.3782.514-1.3781.000
H-6.5681.5411.865-6.459-1.378

Table 14.

Normalized ELISA results for P23-E.
123456789101112
A-0.051-0.333-0.7950.000-1.487-21.829
B-0.231-0.7180.179-0.9230.026
C0.641-0.872-0.538-1.385-1.718
D-1.641-0.6671.3851.4360.051-53.145
E-0.7950.1031.0510.923-0.487
F-0.205-0.487-1.051-1.231-0.077
G-0.282-0.897-1.359-0.1540.1031.000
H-0.2050.026-0.4100.6410.872

Table 15.

Normalized ELISA results for P23-F.
123456789101112
A0.918-0.061-3.735-1.694-4.061-10.728
B1.082-1.6121.245-3.7352.959
C3.204-2.265-1.857-3.653-4.633
D-1.612-0.3883.6942.143-1.694-144.007
E-2.673-0.633-7.5711.980-3.163
F1.8160.510-2.265-4.6331.163
G1.408-1.367-2.9181.0821.4901.000
H2.878-1.5311.2453.5313.612

Table 16.

Normalized ELISA results for P23-G.
123456789101112
A-0.679-1.272-3.198-1.123-5.568-5.930
B-1.469-3.494-1.222-3.593-0.037
C1.000-6.160-5.519-3.148-5.617
D-5.914-20.1361.7410.457-0.185-114.111
E-12.580-3.0490.111-0.037-46.753
F-1.370-1.864-4.185-4.037-63.543
G-2.259-3.198-5.519-0.8770.3091.000
H-1.0251.444-18.9015.7413.222

Table 17.

Normalized ELISA results for P23-H.
123456789101112
A-1.00043.00036.00068.00069.000116.667
B21.00054.00015.00060.000-5.000
C-54.00088.00035.00067.00073.000
D105.00033.00026.000-14.000-38.0002154.000
E24.000-8.0006.0001.000-5.000
F22.00012.00046.00052.000-24.000
G20.00025.00099.00022.000-23.0001.000
H57.000100.00041.000-24.000-15.000

Table 18.

Normalized ELISA results for P23-I.
123456789101112
A-3.000-1.0000.4550.2734.4557.273
B-1.5450.182-2.7271.909-3.273
C-3.4551.455-3.0912.7275.091
D2.545-0.727-7.273-7.8185.818118.909
E2.455-3.273-4.364-3.727-4.091
F-1.6360.636-1.1820.909-5.909
G-1.091-1.2732.273-0.8181.3641.000
H0.273-3.3640.091-5.455-15.545

Table 19.

Normalized ELISA results for P23-J.
123456789101112
A-2.067-18.733-21.400-23.400-31.00016.422
B-20.067-25.933-18.600-28.0670.067
C-1.533-30.333-19.400-28.467-42.733
D-44.333-26.8674.6007.400-17.667-243.578
E-38.067-12.067-9.267-13.933-7.800
F-23.000-26.200-17.133-27.133-4.067
G-23.933-21.400-35.800-17.800-1.6671.000
H-21.133-19.267-22.8673.4008.067

Table 20.

Normalized ELISA results for P23-K.
123456789101112
A-1.900-2.0000.5000.900-0.100-0.133
B-3.2000.000-2.1002.600-1.900
C-3.5003.400-0.3003.4005.600
D2.700-2.800-7.300-1.0007.900171.533
E1.100-3.100-2.700-2.400-2.500
F-0.5002.1001.2003.4000.200
G3.0001.6006.5002.0000.7001.000
H-0.4001.6003.500-1.000-2.600

Table 21.

Normalized ELISA results for P23-L.
123456789101112
A-2.6471.5881.7061.4717.3535.118
B3.4711.471-0.0591.706-1.000
C-6.7653.2351.7067.11811.000
D1.941-0.294-8.294-12.1764.765152.647
E4.647-7.353-3.941-3.941-2.294
F2.0593.2352.0594.647-5.941
G1.7063.7066.2940.882-0.1761.000
H5.5880.0592.529-3.118-1.941

Table 22.

Normalized ELISA results for P23-M.
123456789101112
A-0.667-1.500-2.250-0.667-3.750-20.278
B0.000-1.333-0.250-2.4170.167
C-1.250-3.500-2.000-3.000-2.167
D-3.333-0.6671.333-0.250-2.583-169.667
E-2.750-2.0000.250-0.5000.083
F0.2500.167-2.500-1.667-4.917
G-0.167-2.000-1.6670.3330.0831.000
H4.3331.5002.6674.3335.000

Table 23.

Normalized ELISA results for P23-N.
123456789101112
A7.5268.1589.9478.57917.42164.895
B7.7379.73710.68411.7375.842
C6.36812.1588.68412.89513.632
D14.0537.73710.7893.6326.579193.105
E9.4216.3687.1058.1589.105
F7.9478.78911.31613.0007.105
G11.0009.63214.4749.6327.9471.000
H3.0004.0533.737-0.263-0.579

Table 24.

Normalized ELISA results for UTMB2.
123456789101112
A1.6401.0000.7870.7332.17346.351
B1.2670.3071.2131.907-0.067
C-1.5071.2671.4800.6800.573
D0.893-0.4935.320-0.3330.200160.307
E3.507-0.7075.3201.5872.813
F0.307-0.2800.4670.41313.480
G0.2001.6931.2670.147-0.4401.000
H0.6274.7871.000-0.227-1.560

Table 25.

Normalized ELISA results for UTMB8.
123456789101112
A4.1552.8591.1131.4512.35290.296
B3.6483.8733.0283.6480.606
C1.7892.2961.7893.9861.620
D4.1551.50716.155-0.4081.451157.901
E5.0000.6060.8311.5631.563
F2.0701.7322.9151.6761.901
G2.1833.8732.4080.8875.0001.000
H3.1412.8591.5631.2250.437

Table 26.

Normalized ELISA results for UTMB9.
123456789101112
A-25.667-24.333-36.333-19.000-20.333-566.111
B22.333-111.000-19.000-16.33322.333
C2.333-51.000-37.667-29.667-4.333
D-52.333-33.667-159.000-16.333-15.000-3714.556
E-57.667-19.000-27.000-23.000-21.667
F-33.667-35.000-48.333-132.333-39.000
G-21.667-61.667-21.667-133.667-33.6671.000
H-9.667-292.333-316.3336.333-19.000

Table 27.

Normalized ELISA results for UTMB10.
123456789101112
A14.06713.80017.2673.6677.400321.089
B2.0676.33312.73315.133-6.733
C6.86710.3338.7333.6672.333
D15.1339.5335.800-3.800-3.800697.800
E14.6003.667-9.933-0.067-0.867
F6.3331.80013.53347.1331.267
G5.5335.8004.73328.46714.6001.000
H2.86714.0670.2000.2002.867

Table 28.

Normalized ELISA results for UTMB11.
123456789101112
A6.4357.8267.4784.2173.91341.101
B2.21745.6966.1747.391-0.478
C0.9573.3915.7833.7393.304
D6.3913.00010.8261.3911.652121.507
E6.8701.9131.9133.7391.348
F0.1741.1745.3042.6520.913
G3.3485.1743.9571.4789.1301.000
H3.3917.8707.304-1.3910.174

Table 29.

Normalized ELISA results for UTMB133.
123456789101112
A4.2683.4791.6761.2824.54930.690
B3.1412.634-0.127-1.535-0.915
C-0.127-0.3520.718-1.8173.535
D-0.0702.3525.620-3.3941.394153.094
E9.845-1.7613.1410.042-0.972
F2.0142.4653.9863.366-0.577
G3.8734.0994.3240.7188.0421.000
H3.2549.620-0.915-3.056-3.338

Table 30.

Normalized ELISA results for UTMB134.
123456789101112
A-2.250-1.500-1.850-1.125-2.150-10.992
B-1.750-2.050-0.550-1.3750.075
C-1.350-2.5500.350-0.950-0.750
D-2.575-1.025-3.025-0.2750.050-68.275
E-3.075-1.200-0.650-1.225-0.650
F-1.000-0.625-0.825-0.775-3.400
G-2.175-1.875-1.425-0.500-1.9001.000
H-1.300-2.150-1.3000.0000.050

Discussion

The array data reported in this manuscript were used to identify high-scoring peptides that could be used as serodiagnostic reagents in an ELISA format to distinguish between prior infection and seroconversion to a panel of mosquito-borne viruses. Our workflow incorporated both computational and laboratory components to improve identification of regions that were uniquely recognized by virus-specific antibodies to each virus and could therefore be useful as serodiagnostic peptides. Sabalza et al. described a protocol to identify ZIKV specific diagnostic epitopes through peptide microarrays; however, they only used one human serum sample, did not use any bioinformatics analysis, and the identified peptides sequences were not provided 38.

The integration of Gini values calculated by the random forest machine learning algorithm with the BepiPred B-cell epitope prediction algorithm, enabled us to identify the best peptides for each taxon. This approach improved our selected peptides to those that had increased affinity and binding to antibodies 33. We purposely chose peptides in both the E and NS1 proteins (E2 protein of CHIKV) to improve our ability to detect epitopes within viral antigens that are known to circulate in the bloodstream 11. However, it would be of broad interest to quantify how the specificity and sensitivity of our assay would be affected by including additional peptides that span the viral nonstructural protein regions.

We observed that a few of our selected peptides displayed high reactivity and Gini values, while other selected peptides had lower measured values. We attribute a subset of these unexpected differences to the imposed requirement of being located within a predicted B-cell epitope. Is also possible that the heavy + light chain secondary antibodies used for the array could also bind IgM and had an affect the quantified reactivity. Reactivity is an essential measurement for individual samples, while Gini values are useful to rank peptides based on their ability to identify peptides that differentiate one taxon from the others. As such, Gini values are better able to identify linear epitopes that differentiate taxa and that are sufficiently immunodominant across patient populations. We are therefore confident in the results from taxa where the Gini values were significantly different between selected peptides when compared to the remaining peptides. By providing the raw data in a publicly-accessible resource, we expect these data to be subject to re-analysis and meta-analysis using alternative methods.

We also noticed cases where the comparisons of our selected peptides yielded non-significant p-values in various comparisons, especially among dengue viruses. The most likely explanation for this observation is the high degree of cross-reactivity that occurs between linear epitopes derived from these viruses. While other existing serological assays are capable of distinguishing between these highly related taxa, they primarily rely on recognition of conformational epitopes by IgG antibodies circulating in the bloodstream. It is, therefore, possible that linear peptides in the selected proteins may be inadequately suited to differentiate between these taxa. Given the incomplete histories and serology that was performed in a subset of our tested samples, additional work is needed to determine whether incomplete metadata contributed to this finding. It is also possible that quantifying the reactivity of peptides containing the range of amino acid variation that exists in natural strains could improve the overall reactivity of our peptide reagents. Additional laboratory experiments are being performed to calculate the specificity and sensitivity for our sets of peptides in a larger number of human serum samples from various clinical cohorts.

With these publicly accessible peptide array data, it could also be possible to perform the opposite analysis in a way that would search for regions that were recognized with reduced specificity and could therefore be useful to identify peptides that could indicate past infection by at least one of these viruses. Similarly, these data could be mined to identify linear peptides that could be used as antigens to generate an antibody response to such epitopes towards the development of additional “universal” monoclonal antibodies.

The ELISA data indicate that this method could be a more resource- and time-efficient approach to PRNT. Although results against alternative characterization methods vary widely, additional criteria have been added to PRNT results to account for the high degree of cross-reactivity between ZIKV and DENV 39. The observed sensitivity and specificity values could potentially be improved through additional experimentation and optimization. Screening additional well-characterized samples with our ELISA method could shed additional light into a more accurate gauge of ZIKV seroprevalence and could guide public health decisions.

These data help to quantify the human humoral response to multiple mosquito-borne viruses and could be useful to identify, map, and/or design native or synthetic antigens that provide increased protection against natural infection by these viruses. Our data could also be relevant to the design of a mosquito-borne virus vaccine. However, care must be taken in designing such experiments to ensure that antibody-dependent enhancement does not increase the risk of adverse events following administration of the vaccine.

Data availability

Underlying data

Figshare: Peptide Arrays of Three Collections of Human Sera from Patients Infected with Mosquito-Borne Viruses. https://doi.org/10.6084/m9.figshare.c.4298600.v2 35.

This project contains the following underlying data:

  • 1 Metadata file for: Describing the characteristics about each patient from which serum was collected.

  • 1 Metadata file for: Information on Peptide names, sequences, and identifiers included on Array.

  • 1 Metadata file for: Metadata for Experimental Samples.

  • 151 Data files containing quantitative data for the peptide arrays.

Data are available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).

Software availability

The custom script used to parse the data files can be found at GitHub: https://github.com/bpickett/PeptideArray/tree/v0.9.

Archived source code at time of publication: https://doi.org/10.5281/zenodo.3518356 32.

License: GNU General Public License v3.0.

Acknowledgements

We gratefully acknowledge the Microarray and NGS Core facility at The Scripps Research Institute, especially Shelby Willis, Ryan McBride, Dr. Phillip Ordoukhanian, and Dr. Steven Head for their excellent technical assistance with preparing and developing the peptide arrays. We also thank Dr. Scott Weaver and Dionna Scharton of the World Reference Center for Emerging Viruses and Arboviruses (NIH AI120942) for their assistance with providing control samples.

Notes

[version 3; peer review: 2 approved]

Funding Statement

This project has been funded in whole or part with federal funds from the United States Agency for International Development (USAID) Combating Zika and Future Threats, a Grand Challenge for Development; under grant number AID-OAA-F-16-00102. The Pediatric Dengue Cohort Study from which the Nicaraguan samples were obtained was supported by NIH grants P01 AI106695 (EH), U19AI118610 (EH), R01AI099631 (AB), and Pediatric Dengue Vaccine Initiative grant VE-1 funded by the Bill and Melinda Gates Foundation (EH).

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

1. D'Ortenzio E, Matheron S, Yazdanpanah Y, et al. : Evidence of Sexual Transmission of Zika Virus. N Engl J Med. 2016;374(22):2195–8. 10.1056/NEJMc1604449 [Abstract] [CrossRef] [Google Scholar]
2. Moreira J, Lamas CC, Siqueira A: Sexual Transmission of Zika Virus: Implications for Clinical Care and Public Health Policy. Clin Infect Dis. 2016;63(1):141–2. 10.1093/cid/ciw211 [Abstract] [CrossRef] [Google Scholar]
3. McDonald EM, Duggal NK, Brault AC: Pathogenesis and sexual transmission of Spondweni and Zika viruses. PLoS Negl Trop Dis. 2017;11(10):e0005990. 10.1371/journal.pntd.0005990 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
4. Musso D, Richard V, Teissier A, et al. : Detection of Zika virus RNA in semen of asymptomatic blood donors. Clin Microbiol Infect. 2017;23(12):1001.e1–1001.e3. 10.1016/j.cmi.2017.07.006 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
5. White MK, Wollebo HS, David Beckham J, et al. : Zika virus: An emergent neuropathological agent. Ann Neurol. 2016;80(4):479–89. 10.1002/ana.24748 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
6. Hayes EB: Zika virus outside Africa. Emerg Infect Dis. 2009;15(9):1347–50. 10.3201/eid1509.090442 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
7. Lanciotti RS, Kosoy OL, Laven JJ, et al. : Genetic and serologic properties of Zika virus associated with an epidemic, Yap State, Micronesia, 2007. Emerg Infect Dis. 2008;14(8):1232–9. 10.3201/eid1408.080287 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
8. Beltramello M, Williams KL, Simmons CP, et al. : The human immune response to Dengue virus is dominated by highly cross-reactive antibodies endowed with neutralizing and enhancing activity. Cell Host Microbe. 2010;8(3):271–83. 10.1016/j.chom.2010.08.007 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
9. Deng YQ, Dai JX, Ji GH, et al. : A broadly flavivirus cross-neutralizing monoclonal antibody that recognizes a novel epitope within the fusion loop of E protein. PLoS One. 2011;6(1):e16059. 10.1371/journal.pone.0016059 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
10. Stiasny K, Kiermayr S, Holzmann H, et al. : Cryptic properties of a cluster of dominant flavivirus cross-reactive antigenic sites. J Virol. 2006;80(19):9557–68. 10.1128/JVI.00080-06 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
11. Stettler K, Beltramello M, Espinosa DA, et al. : Specificity, cross-reactivity, and function of antibodies elicited by Zika virus infection. Science. 2016;353(6301):823–826. 10.1126/science.aaf8505 [Abstract] [CrossRef] [Google Scholar]
12. Mishra N, Caciula A, Price A, et al. : Diagnosis of Zika Virus Infection by Peptide Array and Enzyme-Linked Immunosorbent Assay. mBio. 2018;9(2):pii: e00095–18. 10.1128/mBio.00095-18 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
13. Diamond MS, Pierson TC, Fremont DH: The structural immunology of antibody protection against West Nile virus. Immunol Rev. 2008;225:212–25. 10.1111/j.1600-065X.2008.00676.x [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
14. Chung KM, Thompson BS, Fremont DH, et al. : Antibody recognition of cell surface-associated NS1 triggers Fc-gamma receptor-mediated phagocytosis and clearance of West Nile Virus-infected cells. J Virol. 2007;81(17):9551–5. 10.1128/JVI.00879-07 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
15. Stave JW, Lindpaintner K: Antibody and antigen contact residues define epitope and paratope size and structure. J Immunol. 2013;191(3):1428–35. 10.4049/jimmunol.1203198 [Abstract] [CrossRef] [Google Scholar]
16. Lequime S, Richard V, Cao-Lormeau VM, et al. : Full-genome dengue virus sequencing in mosquito saliva shows lack of convergent positive selection during transmission by Aedes aegypti. Virus Evol. 2017;3(2):vex031. 10.1093/ve/vex031 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
17. Calvet G, Aguiar RS, Melo ASO, et al. : Detection and sequencing of Zika virus from amniotic fluid of fetuses with microcephaly in Brazil: a case study. Lancet Infect Dis. 2016;16(6):653–660. 10.1016/S1473-3099(16)00095-5 [Abstract] [CrossRef] [Google Scholar]
18. Faria NR, da Costa AC, Lourenço J, et al. : Genomic and epidemiological characterisation of a dengue virus outbreak among blood donors in Brazil. Sci Rep. 2017;7(1):15216. 10.1038/s41598-017-15152-8 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
19. Metsky HC, Matranga CB, Wohl S, et al. : Zika virus evolution and spread in the Americas. Nature. 2017;546(7658):411–415. 10.1038/nature22402 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
20. Tan Y, Pickett BE, Shrivastava S, et al. : Differing epidemiological dynamics of Chikungunya virus in the Americas during the 2014-2015 epidemic. PLoS Negl Trop Dis. 2018;12(7):e0006670. 10.1371/journal.pntd.0006670 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
21. Pickett BE, Liu M, Sadat EL, et al. : Metadata-driven comparative analysis tool for sequences (meta-CATS): an automated process for identifying significant sequence variations that correlate with virus attributes. Virology. 2013;447(1–2):45–51. 10.1016/j.virol.2013.08.021 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
22. Lee AJ, Bhattacharya R, Scheuermann RH, et al. : Identification of diagnostic peptide regions that distinguish Zika virus from related mosquito-borne Flaviviruses. PLoS One. 2017;12(5):e0178199. 10.1371/journal.pone.0178199 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
23. Ruwona TB, Mcbride R, Chappel R, et al. : Optimization of peptide arrays for studying antibodies to hepatitis C virus continuous epitopes. J Immunol Methods. 2014;402(1–2):35–42. 10.1016/j.jim.2013.11.005 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
24. McBride R, Head SR, Ordoukhanian P, et al. : Low-Cost Peptide Microarrays for Mapping Continuous Antibody Epitopes. Methods Mol Biol. 2016;1352:67–83. 10.1007/978-1-4939-3037-1_6 [Abstract] [CrossRef] [Google Scholar]
25. Kam YW, Lum FM, Teo TH, et al. : Early neutralizing IgG response to Chikungunya virus in infected patients targets a dominant linear epitope on the E2 glycoprotein. EMBO Mol Med. 2012;4(4):330–43. 10.1002/emmm.201200213 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
26. Kuan G, Gordon A, Avilés W, et al. : The Nicaraguan pediatric dengue cohort study: study design, methods, use of information technology, and extension to other infectious diseases. Am J Epidemiol. 2009;170(1):120–9. 10.1093/aje/kwp092 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
27. Zambrana JV, Bustos Carrillo F, Burger-Calderon R, et al. : Seroprevalence, risk factor, and spatial analyses of Zika virus infection after the 2016 epidemic in Managua, Nicaragua. Proc Natl Acad Sci U S A. 2018;115(37):9294–9299. 10.1073/pnas.1804672115 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
28. Balmaseda A, Hammond SN, Tellez Y, et al. : High seroprevalence of antibodies against dengue virus in a prospective study of schoolchildren in Managua, Nicaragua. Trop Med Int Health. 2006;11(6):935–42. 10.1111/j.1365-3156.2006.01641.x [Abstract] [CrossRef] [Google Scholar]
29. Katzelnick LC, Gresh L, Halloran ME, et al. : Antibody-dependent enhancement of severe dengue disease in humans. Science. 2017;358(6365):929–932. 10.1126/science.aan6836 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
30. Mattia K, Puffer BA, Williams KL, et al. : Dengue reporter virus particles for measuring neutralizing antibodies against each of the four dengue serotypes. PLoS One. 2011;6(11):e27252. 10.1371/journal.pone.0027252 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
31. Montoya M, Gresh L, Mercado JC, et al. : Symptomatic versus inapparent outcome in repeat dengue virus infections is influenced by the time interval between infections and study year. PLoS Negl Trop Dis. 2013;7(8):e2357. 10.1371/journal.pntd.0002357 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
32. bpickett: bpickett/PeptideArray v0.9 (Version v0.9). Zenodo. 2019. 10.5281/zenodo.3518356 [CrossRef] [Google Scholar]
33. Larsen JE, Lund O, Nielsen M: Improved method for predicting linear B-cell epitopes. Immunome Res. 2006;2:2. 10.1186/1745-7580-2-2 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
34. Ramanakumar AV, Thomann P, Candeias JM, et al. : Use of the normalized absorbance ratio as an internal standardization approach to minimize measurement error in enzyme-linked immunosorbent assays for diagnosis of human papillomavirus infection. J Clin Microbiol. 2010;48(3):791–6. 10.1128/JCM.00844-09 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
35. Pickett BE, Crowe JE, Harris E, et al. : Peptide Arrays of Three Collections of Human Sera from Patients Infected with Mosquito-Borne Viruses. figshare.Collection.2019.
36. Jespersen MC, Peters B, Nielsen M, et al. : BepiPred-2.0: improving sequence-based B-cell epitope prediction using conformational epitopes. Nucleic Acids Res. 2017;45(W1):W24–W29. 10.1093/nar/gkx346 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
37. Mansfield KL, Horton DL, Johnson N, et al. : Flavivirus-induced antibody cross-reactivity. J Gen Virol. 2011;92(Pt 12):2821–9. 10.1099/vir.0.031641-0 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
38. 2, Sabalza M Barber CA Abrams WR et al. : Zika Virus Specific Diagnostic Epitope Discovery. J Vis Exp. 2017; (130):e56784. 10.3791/56784 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]
39. Rabe IB, Staples JE, Villanueva J, et al. : Interim Guidance for Interpretation of Zika Virus Antibody Test Results. MMWR Morb Mortal Wkly Rep. 2016;65(21):543–6. 10.15585/mmwr.mm6521e1 [Abstract] [CrossRef] [Google Scholar]

Approved

1Department of Biomolecular Systems, Max Planck Institute of Colloids and Interfaces, Potsdam, Germany
Competing interests: No competing interests were disclosed.
Review date: 2020 Mar 10. Status: Approved. 10.5256/f1000research.24949.r60676

All of my previously raised questions and concerns have been sufficiently addressed. I believe that the manuscript can be accepted for indexing.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Approved

1Oswaldo Cruz Foundation, Rio de Janeiro, Brazil
Competing interests: No competing interests were disclosed.
Review date: 2020 Feb 18. Status: Approved. 10.5256/f1000research.24759.r60141

The authors justified and revised the work accordingly.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Approved with Reservations

1Department of Biomolecular Systems, Max Planck Institute of Colloids and Interfaces, Potsdam, Germany
Competing interests: No competing interests were disclosed.
Review date: 2020 Feb 13. Status: Approved with Reservations. 10.5256/f1000research.23090.r59099

In this manuscript entitled “Peptide arrays of three collections of human sera from patients infected with mosquito-borne viruses” by Pickett et al., the authors report the screening of patient sera using peptide microarrays for antibody interactions. The goal is to identify disease specific biomarkers, since “serological tests are often not reliable for diagnosis after seroconversion and convalescence due to cross-reactivity among flaviviruses”.

Overall, the approach is sound and has very good potential and the authors did an impressive job in bioinformatic prediction and analysis. Yet, the results show that there is room for technological and methodological improvement.

I believe that the data presentation can be improved. Thus, I suggest the following minor changes:

  1. The title “Peptide arrays of … human sera…” is in my opinion misleading. “Human sera are analyzed/screened on/with peptide arrays” or “Arrays are incubated with human sera”.

  2. It is somewhat difficult to understand the peptide selection, because there is just a reference to another publication. A brief 2-3 sentences description on the peptide selection process would help.

  3. To judge the quality of the microarray data, it would be highly beneficial to have some kind of heat map of all array results together (raw and/or normalized median peptide staining intensity per patient). I found it somewhat unconventional to deposit a tsv result file on github. Only providing raw data makes a quick review and validation rather difficult. For an example, see Figure 2 in Weber, L.K., et al. (2017), Eng. Life Sci., 17: 1078-1087 1. Furthermore, I could not find a link between the raw data files and the corresponding peptide sequence. This needs more explanation and the authors should provide an additional file with the sequences of each position on the array.

  4. In my opinion, the patient sample presentation has to be improved. The authors state that they only have incomplete patient history (“Given the incomplete histories and serology …additional work is needed to determine whether incomplete metadata contributed to this finding.”). Yet, in the section “Serum sources”, the authors give some ranges on patient age and days after onset of symptoms. In my opinion, a full patient information table (e.g. in supporting information) is essential (even though data might be missing), showing patient age, sex, known previous arbovirus infections (primary vs. secondary infection), days after onset of symptoms, etc. of all patients. From my experience, there can be a large difference in antibody response in patients 10 days vs. 30 days after onset of symptoms, so these patients should be categorized and analyzed as different groups. I believe that patient stratification is one of the keys to more statistically significant data.

The following general comments might be helpful to discuss the statistical significance of the results:

  1. I do not fully agree with this general assumption: “Although reports showing antibodies against other viral proteins are detectable 12, the E and NS1 proteins are the primary targets of the humoral anti-flavivirus immune response in humans 13–15.” Although discussed before (citation 11), this approach ignores for example the highly specific serum biomarker from the NS2B protein in Zika. This approach might miss other similarly important peptide biomarkers. In addition, adding peptides from the nonstructural proteins might help to boost the overall sensitivity of the assay (yet, losing some specificity).

  2. By choosing consensus sequences, the authors limited the peptide selection, which is valid and – with current array technology – necessary. However, this probably limits the sensitivity of the microarray results and the subsequent ELISA. Depending on the selected protein regions and patient origins (-> virus genotypes), there might be several important genotypic variants, which the authors would have neglected.

In addition, the array protocol seems not optimal and there are some inconsistencies in the methods section. Some general remarks, questions, corrections and suggestions regarding the array processing:

  1. The raw data states that the scanner Innopsys Innoscan 1100AL and the Mapix software were used. Yet, the in the manuscript, it is stated: “…using a ProScanArray HT (Perkin Elmer) microarray scanner at 488 nm and 600 nm, and images were saved as high-resolution TIF files. Imagene® 6.1 microarray analysis software…”. Please correct. The scanner wavelengths were supposedly 488 nm and 600 nm. In the raw data files, it says 488 nm and 635 nm. Please correct. If possible, please also give the laser powers and gain (PMT) settings for the scans (according to the raw data: wavelengths 635, 488: "LaserPower=10.0, 5.0", "PMTGain=50, 50").

  2. For the microarray experiments, the authors claim to have used the Alexa 488 labeled secondary antibody: Invitrogen, cat. #: A-11013, RRID: AB_2534080. This is an (H+L) chain specific antibody, so it will also bind to IgM antibodies (please include this information!)! The use of the Ab labeled with Alexa 488 is a bit odd, since the original data files state that the scanning of the main interaction was performed at 635 nm. Yet, the data of the 488 nm channel is not included in the raw data and, according to the protocol, it seems to me that this dye is only used for controls (see section “Peptide preparation and microarray printing”). Are you sure that you used this specific secondary antibody? If so, I would highly recommend changing to a 635 nm channel compatible secondary antibody, since the 488 nm channel gives much higher background and generally very strong autofluorescence.

  3. In contrast, for the ELISAs, the authors apparently used a different secondary antibody, which is Fc specific, so it should only bind to IgG. Thus, the microarray data cannot be directly compared to the ELISA data.

  4. The final steps of the array washing and drying protocol are in my opinion not optimal: “… another two times in deionized water and centrifuged to dry at 200 × g for 5 mins.” The pH of distilled water should be checked. Since deionized water is only weakly buffered (very low salt concentration), deionized water may have a low pH (especially observed in ddH2O). By washing the arrays with it, the lower pH may destroy interactions of weakly (or pH sensitive) binding antibodies. Instead, to remove salt residues from the array surface, you might want to use 1 mM Tris buffer in the future.

  5. In addition, for future experiments, centrifuging arrays for drying is not optimal, since drying effects may cause artifacts (coffee ring drying effects, etc.). Instead, using a jet of air to quickly remove droplets from the surface causes much less artifacts.

Overall, the manuscript is well written and the bioinformatics seems sound. Yet, the authors can take some more care in presenting the data and should correct and/or explain the inconsistencies in the methods section (scanner, wavelengths, antibodies).

Future analyses should focus on patient stratification and possibly more homogenous samples (different cohorts may be difficult to compare). This may significantly improve statistical outcome.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

1. : Antibody fingerprints in lyme disease deciphered with high density peptide arrays. Engineering in Life Sciences.2017;17(10) : 10.1002/elsc.201700062 1078-1087 10.1002/elsc.201700062 [Europe PMC free article] [Abstract] [CrossRef] [Google Scholar]

Not Approved

Salvatore De-Simone, Referee1 and David William Provance, Co-referee1
1Oswaldo Cruz Foundation, Rio de Janeiro, Brazil
Competing interests: No competing interests were disclosed.
Review date: 2019 Nov 14. Status: Not Approved. 10.5256/f1000research.23090.r56293

The authors have focused on an important biomedical problem – How to identify the virus responsible for an infection through serological diagnostic tests when many of the potential pathogens display a high level of sequence similarity? While the approach presented represents an excellent start to achieve their goals, a number of issues need to be addressed. They have correctly focused on short poly-amino acid sequences but need to go further and define the epitome of each virus. As an epitope defines the exact sequence of amino acids bound to the cleft of an immunoglobulin, it is the most precise restriction possible for differentiating similar pathogens. This would allow an in silico evaluation of the potential for cross-reactivity that could be confirmed by immunoassays. Furthermore, a peptide of 15 amino acids could limit reactivity with IgM, which is an important component to defining seroconversion. Another important point is that the panel of patient sera was fairly small. It is also unclear if each patient sample was screened for each of the pathogens in questions or only the suspected infection. It is very common for patients from endemic regions to suffer multiple infections without registering them. A small panel size also makes it difficult to perform Receiver Operating Characteristics analyses, which are absent from the study. In addition, a limited combination of peptides was tested rather than a checkerboard. This is all the more important as peptides often show the lowest sensitivity. Methodologically, another important point to be clarified is regarding the cut off value used in peptide immunoassays or the value used by the software to delimit the signal intensity of a positive test from a negative one.

We confirm that we have read this submission and believe that we have an appropriate level of expertise to state that we do not consider it to be of an acceptable scientific standard, for reasons outlined above.


Articles from F1000Research are provided here courtesy of F1000 Research Ltd

Citations & impact 


Impact metrics

Jump to Citations

Citations of article over time

Alternative metrics

Altmetric item for https://www.altmetric.com/details/69923132
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/69923132
Altmetric item for https://www.altmetric.com/details/76795564
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/76795564

Article citations


Go to all (7) article citations

Data 


Data behind the article

This data has been text mined from the article, or deposited into data resources.

Similar Articles 


To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.


Funding 


Funders who supported this work.

Bill and Melinda Gates Foundation (1)

NIAID NIH HHS (4)

National Institutes of Health (3)

United States Agency for International Development (1)