Next Article in Journal
A Novel Fluorescent Probe for Selective Detection of Hydrazine and Its Application in Imaging
Next Article in Special Issue
On-Chip Glucose Detection Based on Glucose Oxidase Immobilized on a Platinum-Modified, Gold Microband Electrode
Previous Article in Journal
Paper and Other Fibrous Materials—A Complete Platform for Biosensing Applications
Previous Article in Special Issue
Applications of Microwave Energy in Medicine
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of the Diagnostic Accuracy of a New Biosensors-Based Rapid Diagnostic Test for the Point-Of-Care Diagnosis of Previous and Recent Dengue Infections in Malaysia

1
Centre for Communicable Diseases Research, Institute for Public Health, National Institutes of Health, Ministry of Health, Persiaran Setia Murni, Setia Alam, Shah Alam 40170, Selangor, Malaysia
2
Department of Medical Microbiology, Faculty of Medicine, University of Malaya, Jalan Profesor Diraja Ungku Aziz, Kuala Lumpur 50603, Malaysia
3
Faculty of Medical & Health Sciences, UCSI University, Jalan Menara Gading, Cheras, Kuala Lumpur 56000, Malaysia
*
Authors to whom correspondence should be addressed.
Submission received: 22 February 2021 / Revised: 3 April 2021 / Accepted: 6 April 2021 / Published: 22 April 2021
(This article belongs to the Special Issue Biosensors: Precision Medicine)

Abstract

:
Dengue is a major threat to public health globally. While point-of-care diagnosis of acute/recent dengue is available to reduce its mortality, a lack of rapid and accurate testing for the detection of previous dengue remains a hurdle in expanding dengue seroepidemiological surveys to inform its prevention, especially vaccination, to reduce dengue morbidity. This study evaluated ViroTrack Dengue Serostate, a biosensors-based semi-quantitative anti-dengue IgG (immunoglobulin G) immuno-magnetic agglutination assay for the diagnosis of previous and recent dengue in a single test. Blood samples were obtained from 484 healthy participants recruited randomly from two communities in Petaling district, Selangor, Malaysia. The reference tests were Panbio Dengue IgG indirect and capture enzyme-linked immunosorbent assays, in-house hemagglutination inhibition assay, and focus reduction neutralization test. Dengue Serostate had a sensitivity and specificity of 91.1% (95%CI 87.8–93.8) and 91.1% (95%CI 83.8–95.8) for the diagnosis of previous dengue, and 90.2% (95%CI 76.9–97.3) and 93.2% (95%CI 90.5–95.4) for the diagnosis of recent dengue, respectively. Its positive predictive value of 97.5% (95%CI 95.3–98.8) would prevent most dengue-naïve individuals from being vaccinated. ViroTrack Dengue Serostate’s good point-of-care diagnostic accuracy can ease the conduct of dengue serosurveys to inform dengue vaccination strategy and facilitate pre-vaccination screening to ensure safety.

1. Introduction

Dengue is a mosquito-borne infectious disease caused by the dengue virus (DENV) with four serotypes (DENV-1 to DENV-4) from the genus Flavivirus [1,2]. It has become a public health threat affecting more than 100 countries globally [3,4,5]. Every year, approximately 390 million dengue infections occur worldwide, most of which happen in tropical and subtropical regions [2,6]. The Global Burden of Disease Study 2013 estimated that in that year alone, dengue illness cost the world US$ 8.9 billion to treat [4], and was responsible for 566,000 years lived with disability and 576,900 years of life lost [7].
While dengue deaths can be prevented with the early detection and appropriate treatment of dengue cases, the prevention and control of dengue transmission requires a more coordinated effort in disease surveillance and integrated vector management [1,2]. In addition, due to the presence of asymptomatic infection and its nonspecific clinical manifestations, more accurate estimation of the true burden of dengue is required to inform the effectiveness of current preventive measures, as well as the future implementation of a dengue vaccination program [2,8,9].
The estimation of the true burden of dengue can only be achieved with the help of diagnostic tests; in particular, serology tests for the detection of anti-dengue antibodies [10,11,12]. The development of laboratory diagnostics in the past decades has made this possible, but they are costly and time-consuming [13]. The arrival of rapid diagnostic tests (RDTs) has made point-of-care diagnosis possible, but all dengue RDTs developed to date, even serology tests, catered only for the diagnosis of acute or recent dengue infection [13,14,15,16,17]. These tests are mainly paper-based tests with a fixed detection threshold, making their serology components unsuitable to determine the status of previous dengue infection due mainly to decreasing IgG (immunoglobulin G) levels post-infection below their detection threshold [14,18], although they are able to diagnose recent dengue. In addition, RDTs are not as accurate as laboratory-based diagnostics [14,15,16].
The breakthrough in the development of a biosensors-based dengue RDT with quantitative read-out and objective interpretation makes it possible to strike a balance between rapidity and accuracy of dengue diagnosis [19,20]. A rapid yet accurate biosensors-based dengue serology RDT capable of detecting not just recent but also previous dengue infection has the potential to improve dengue surveillance through seroepidemiological survey and inform dengue vaccination strategies [9,11,12,21]. This article aimed to evaluate the diagnostic accuracy of a new biosensors-based RDT for the diagnosis of previous and recent dengue infections.

2. Materials and Methods

2.1. Study Design

This is a prospective cross-sectional diagnostic test accuracy evaluation study. Publication of this study complies with the highest requirement in the Standards for the Reporting of Diagnostic Accuracy Studies (STARD) guidelines [22].

2.2. Participants

The study was carried out in a highly urbanized district called Petaling in the state of Selangor, where dengue incidence was among the highest in Malaysia [23]. Two communities were selected randomly from a list of all communities covered by the District Health Office for dengue vector control activities, with one community each from those with the highest and the lowest reported dengue cases from the years 2013 to 2017. A total of 500 participants were required based on the single proportion sample size formula to achieve <10% margin of error for the expected dengue seroprevalence in these communities with type I error of 5% [24]. These participants were recruited from 250 households selected randomly from both communities proportionate to their population size, with an expectation of 4 people in each household and a 50% overall attrition rate [25]. All residents aged ≥ nine months who lived in the selected household address in the past six months were included in the study. People with current febrile illness, history of other flaviviral infection or vaccination, or risk factors of complications from blood taking were excluded.
The recruitment of participants lasted from 18 August to 26 October 2018. All consented participants were interviewed by trained field researchers using a structured questionnaire to capture socio-demographic characteristics. Both capillary and venous blood specimens were sampled from each participant. Capillary blood was meant for the evaluated index test that was conducted on-site. It was drawn from the prick site using a capillary tube and immediately transferred to a vial containing buffer solution. Venous blood specimens were collected in plain tubes, chilled, and transferred at the end of each workday to a virology laboratory in the University of Malaya, Kuala Lumpur, Malaysia, where they were centrifuged, aliquoted, and stored at −80 °C until reference tests were conducted in batches.

2.3. Index Test

ViroTrack Dengue Serostate (BluSense Diagnostics, Copenhagen, Denmark) was the evaluated index test. It is a biosensor composed of a polymer centrifugal microfluidic cartridge embedded with dry reagent and a portable opto-magnetic reader—BluBox (Figure 1) [26]. It comes with a vial of buffer solution used to dilute the test sample (blood/plasma/serum). The reader is CE marked and in use for other tests. The ViroTrack Dengue Serostate is a semi-quantitative anti-dengue immunoglobulin G (IgG) assay based on the immuno-magnetic agglutination (IMA) principle. The scientific principle of this assay and the design of the microfluidic are described in detail elsewhere [19,27,28,29]. Briefly here, 10 mcl capillary blood is diluted in the buffer solution. After mixing well, 10 mcl of the diluted sample is pipetted into the loading chamber of the cartridge. The cartridge is then inserted into the BluBox, in which the sample is centrifuged, metered, and mixed with nanoparticles (MNPs) coated with DENV antigen. This antigen captures any anti-dengue IgG present in the test sample and forms sandwich agglutination after magnetic incubation. Using an oscillating magnetic field, the MNPs are forced to rotate, which then modulate the intensity of a passing laser beam. The difference between the modulated light wave and the applied field is directly proportional to the concentration of anti-dengue IgG in the test sample. It is measured by a photodetector with Blu-ray optical pickup and given in a relative unit (BluSense IMA unit), which the BluBox interprets according to set thresholds, i.e., presence of previous dengue infection if ≥8 units and recent dengue infection if ≥140 units [20]. The duration from cartridge insertion to result is around 8 min. Index test was run on-site by trained field researchers immediately after capillary blood collection. As such, they were blinded to the participants’ previous and recent dengue status as defined by the reference tests below.

2.4. Reference Standard

The reference standard for previous dengue diagnosis comprised of three different reference tests for the detection of anti-dengue antibodies, namely (1) commercially available Panbio Dengue IgG indirect enzyme-linked immunosorbent assay (ELISA) (Abbott, Chicago, IL, USA), (2) in-house hemagglutination inhibition (HI) assay, and (3) in-house focus reduction neutralization test (FRNT) adapted from the plaque reduction neutralization test (PRNT). HI remains the gold standard for the titration and subtyping of antibodies due to its high accuracy and its ability to determine the exact titer of virus-neutralizing antibodies [30]. Meanwhile, the serotype-specific PRNT/FRNT is considered the gold standard for the differential serodiagnosis of dengue virus [31]. However, there is a chance that HI might not detect the antibodies against other viral components aside from the hemagglutinating protein, despite being cross-reactive with other flaviviral infections. Similarly, a certain degree of cross-reactivity exists between the four serotypes in PRNT/FRNT. As such, IgG ELISA with sensitivity that is comparable to HI, but significantly more specific than HI, was also selected to be part of the composite reference standard [32].
Previous dengue diagnosis was defined as positive when a sample was tested negative to only one out of three reference tests above, which were in turn defined as follows: (1) for IgG indirect ELISA (<9, 9–11, and >11 Panbio units were positive, equivocal, and negative, respectively), (2) for HI (titer of <1:10 and ≥1:10 were negative and positive, respectively). For FRNT, the titer reported was reciprocal of the highest serum dilution capable of 95% plaque reduction compared to the serum-free control (FRNT95). Titer of <1:10 and ≥1:10 for FRNT95 against a specific DENV serotype were defined as negative and positive tests to that serotype, respectively. Finally, FRNT95 positive was defined as a positive test to any of the individual serotype-specific FRNT95.
On the other hand, recent dengue status was defined as positive when a sample was tested positive to Panbio Dengue IgG capture ELISA (Abbott, Chicago, IL, USA), where <18, 18–22, and >22 Panbio units were positive, equivocal, and negative, respectively.
All serum specimens extracted from the venous blood samples of all participants were tested on all the above reference tests from 6 December 2018 to 19 April 2019 by trained laboratory researchers blinded to the results of the index test. Commercial tests were conducted and interpreted according to the manufacturer’s instructions [33,34,35], while in-house tests were performed and interpreted as described previously [30,31,32,36,37,38,39,40,41]. (Supplement 1).

2.5. Analysis

Descriptive analysis was used to describe socio-demographic characteristics of the participants and the dengue status of their samples according to the reference standards and by individual reference tests. Diagnostic accuracy and their 95% confidence intervals (95%CI) were derived from 2 × 2 tables comparing the results of the index test and the dengue status as defined by the reference standards and by individual reference tests, where samples were divided into true positives (TP), false positives (FP), true negatives (TN), and false negatives (FN). Accuracy estimates computed were (1) sensitivity (SN) = TP/(TP + FN); (2) specificity (SP) = TN/(TN + FP); (3) positive predictive value (PPV) = TP/(TP + FP); and (4) negative predictive value (NPV) = TN/(TN + FN) [42]. Finally, the correlation of ViroTrack relative unit and the Panbio units for both indirect and capture ELISAs was visualized using scatterplot and tested using Spearman’s rho (ρ), which was defined as very strong (≥0.8), moderately strong (0.6–0.8), fair (0.3–0.5), and poor (<0.3) [43]. A p of <0.05 was accepted as statistical significance of this correlation. All statistical analyses were performed using STATA version 12 (StataCorp, College Station, TX, USA). Any sample with inconclusive or missing results of any test was excluded from the final analysis.

2.6. Ethical Statement

This study adhered to the revised 2013 Declaration of Helsinki [44]. Ethics approval was obtained from the Medical Research and Ethics Committee, Ministry of Health Malaysia (NMRR-17-853-34393) and the University Malaya Medical Center Medical Research Ethics Committee (MRECID.NO: 2017426-5171). All participants provided written informed consent and, where applicable, minor assent.

3. Results

3.1. Description of the Study Participants

Out of the 533 eligible participants identified, 515 (96.6%) consented to participate in this study, and the results for 484 (90.8%) were included in the final analysis. Among the latter, 358 tested as positive on ViroTrack and 126 were negative. Reference standard was available for all of them (Figure 2).
The age of these 484 participants ranged from 1.0 to 83.7 years, and averaged at 32.0 (s.d. 18.4) years. There were 250 (51.7%) male participants. The majority were of Malay ethnicity (373, 77.1%), followed by Indian descent (52, 10.7%,) and Chinese descent (31, 6.4%), while 8 (1.7%) people were natives of East Malaysia and 20 (4.1%) were foreigners (data not shown).
Out of the 484 participants, 363 (75.0%) tested positive with IgG indirect ELISA and 356 (73.6%) with HI. Around 54.8–61.6% of participants tested positive with FRNT95 against a specific DENV serotype, which made up to 414 (85.5%) positive tests against any DENV serotype on FRNT95. Based on the abovementioned reference standards, a total of 383 (79.1%) participants were infected with dengue previously, while 41 (8.5%) were infected with dengue recently (Table 1).

3.2. Diagnostic Accuracy of ViroTrack Dengue Serostate

ViroTrack Dengue Serostate’s SN was 91.1% (95%CI 87.8–93.8), and its SP was 91.1% (95%CI 83.8–95.8) for the diagnosis of previous dengue infection. The PPV and NPV were 97.5% (95%CI 95.3–98.8) and 73.0% (95%CI 64.4–80.5), respectively (Table 2).
For the diagnosis of recent dengue, the SN and SP of ViroTrack Dengue Serostate were 90.2% (95%CI 76.9–97.3) and 93.2% (95%CI 90.5–95.4), respectively. Its PPV was 55.2% (95%CI 42.6–67.4), while its NPV was 99.0% (95%CI 97.6–99.7) (Table 2).
When compared to the individual reference tests used to construct the reference standard for previous dengue, ViroTrack accuracy varied (Table 3). When IgG indirect ELISA alone was used as a standard, ViroTrack had 95.3% (95%CI 92.6–97.3) SN, 90.1% (95%CI 83.3–94.8) SP, 96.7% (95%CI 94.2–98.3) PPV, and 86.5% (95%CI 79.3–91.9) NPV. When compared to HI only, the SN, SP, PPV, and NPV of ViroTrack were 91.6% (95%CI 88.2–94.2), 75.0% (95%CI 66.6–82.2), 91.1% (95%CI 87.6–93.8), and 76.2% (95%CI 67.8–83.3), respectively. Lastly, its SN and SP when compared to FRNT95 alone were 75.6% (95%CI 71.2–79.7) and 35.7% (95%CI 24.6–48.1), respectively; while the PPV and NPV were 87.4% (95%CI 83.5–90.7) and 19.8% (95%CI 13.3–27.9), respectively.

3.3. Correlation of ViroTrack Dengue Serostate and Panbio Dengue IgG ELISA

The correlation between ViroTrack Dengue Serostate and both Panbio Dengue IgG indirect and capture ELISAs is visualized in Figure 3. The BluSense IMA unit was positively correlated to the Panbio unit for both ELISAs, where the curve appeared to be logarithmic for indirect ELISA and exponential for capture ELISA. The Spearman’s ρ for the BluSense IMA unit and the Panbio unit was 0.8728 (p < 0.0001) for indirect ELISA and 0.9238 (p < 0.0001) for capture ELISA, indicating a very strong correlation between ViroTrack Dengue Serostate and both ELISAs that was statistically significant.

4. Discussion

This study found that ViroTrack Dengue Serostate performed well for the diagnosis of previous and recent dengue infections when compared to the reference standards, with SN and SP for both diagnoses above 90%. The PPV for the diagnosis of previous dengue and the NPV for the diagnosis of recent dengue were close to 100% (Table 2). When compared to each individual laboratory test used in the definition of the reference standard for previous dengue, its accuracy point estimates were above 75% for all tests, except for FRNT95 (Table 2).
The main reason for ViroTrack’s low SP and, correspondingly, PPV, as compared to FRNT95, was due to the cross-reactivity of our FRNT [10,38]. PRNT/FRNT is performed in-house with varied assay methodology. Its titers can be affected by many factors such as difference in cell line, viral passage, etc. [38,45]. In our case, while around 60% of the samples had a titer of ≥1:10 for FRNT95 against a specific DENV serotype, as many as 85.5% tested positive for any one of the serotypes, much higher than that of HI and IgG indirect ELISA. The FRNT positive rate would be even higher at 93.2% for any serotype (data not shown) if the cut-off of 90% plaque reduction were used. With a higher positive rate, it was possible that our FRNT95 misclassified some negative tests as positive. Although ViroTrack was able to correctly classify these samples as negative, these supposedly TN results were deemed as FN in the 2 × 2 table. The increase in FN and decrease in TN then falsely decreased the SN, SP, and NPV of ViroTrack when compared to FRNT95 alone [46]. This decrease was more notable for NPV as TN was used as the denominator, while FN was the numerator in its calculation. However, PPV stayed totally unaffected and reflected the true value.
While FRNT95 alone was an imperfect gold standard, IgG ELISA and HI also have their fair share of cross-reactivity when used alone [1]. We overcame this shortcoming with the use of a composite reference standard [46]. By defining previous dengue positive as those tested negative to only one out of three different reference tests, we reduced the number of falsely classified dengue-naïve cases and increased the specificity of the reference standard. Here, our reference standard defined 79.1% of our participants as previously infected with DENV, which was in line with the seropositive rates found among urban dwellers in Malaysia [24,47]. As such, our reference standard provided an accurate and realistic representation of the dengue immunological profile of our participants.
ViroTrack has a huge potential for application. First of all, paper-based dengue serology RDTs with a fixed positivity threshold are built exclusively for the diagnosis of acute/recent dengue, as it is not profitable for the manufacturers to design another one specifically for serological surveillance [13,14,15,16,17,48]. On the other hand, conducting dengue seroprevalence study using laboratory-based serology tests has higher specimen requirements and is logistically tedious [49]. ViroTrack, which is semi-quantitative, can fill this gap in disease surveillance, as the same IgG test can produce one numerical output that can be interpreted according to different positivity thresholds for the diagnosis of previous and recent dengue infections, effectively reducing its development costs. Secondly, its combination with previously validated ViroTrack Dengue Acute would be helpful not only in increasing the latter’s SN in diagnosing acute/recent dengue, but would also concurrently provide ongoing dengue seroprevalence data [20].
Finally, and more importantly, ViroTrack Dengue Serostate can be used as a component of a dengue vaccination strategy. Currently, the only licensed dengue vaccine, Dengvaxia, was developed by Sanofi Pasteur. Although moderately efficacious for seropositive individuals, this vaccine put dengue-naïve subjects at a greater risk of hospitalization for severe dengue due to its lower efficacy among them [8,9]. As such, an individual pre-vaccination screening was recommended prior to the use of Dengvaxia. Otherwise, vaccination without individual screening can also be considered in places where dengue seroprevalence is ≥80% among the population below 9 years old [9]. The application of ViroTrack in the latter case was as discussed above. For individual pre-vaccination screening, ViroTrack Dengue Serostate is user-friendly, portable, and rapid, making it useful to be administered at point-of-care immediately before vaccination. However, more importantly, its high PPV in determining previous dengue status means very few dengue-naïve children will be vaccinated, and therefore even fewer will be hospitalized for severe dengue in the future.
To the best of our knowledge, this is the first study that evaluates the diagnostic accuracy of a biosensors-based RDT, ViroTrack, for the diagnosis of previous and recent dengue. As mentioned above, all the commercial dengue RDTs available currently were intended for the diagnosis of acute/recent dengue. As such, the majority of the evaluation studies conducted on them were solely for that purpose. To date, only two discontinued paper-based dengue IgG RDTs were evaluated for the diagnosis of previous dengue. Their SP was similar at 83.3%, but their SN were only 43.2% and 6.8% [48]. For acute/recent dengue diagnosis, the accuracy of paper-based dengue IgG RDT varied from 38.8 to 90.1% for SN, and 92.5–100.0% for SP [20]. However, these results are not directly comparable to the results of our study due to heterogeneity in the study design and sample population. Further studies that evaluate different RDTs head-to-head are required for direct comparison [20].
The strength of our study lies in its sound methodology. It was conducted among community dwellers in an urban setting in Malaysia using a cross-sectional prospective design and a random sampling. Coupled with a good response rate, the selection bias in this study was negligible. Measurement bias was eliminated by the blinding of the performers of index tests and reference tests, and by ensuring all participants received the same index test and reference tests [46,50]. Finally, this study was reported according to the STARD guidelines for greater transparency and accountability [22]. The limitation of our study was mainly the cross-reactivity of FRNT95. However, the bias that arose from the imperfect gold standard was rectified with the use of a composite reference standard. Lastly, as this article was the first evaluation study published for ViroTrack Dengue Serostate, although its diagnostic accuracy for the diagnosis of previous and recent dengue infection is applicable to our population, it might differ in other populations. More evaluation studies are recommended among different populations prior to its application on them, especially as a pre-vaccination screening tool.

5. Conclusions

ViroTrack Dengue Serostate, a semi-quantitative biosensors-based dengue IgG RDT, was accurate in diagnosing previous and recent dengue infections in Malaysia with a single test. Its potential applications are (1) community-based dengue seroepidemiological surveillance to estimate the burden of dengue to guide dengue prevention and control measures, including vaccination programs; (2) individual pre-vaccination screening immediately prior to dengue vaccination; and (3) combination with its previously evaluated sibling to improve the accuracy in diagnosing acute/recent dengue. Further evaluation among the intended populations is recommended prior to any of its applications above.

Supplementary Materials

The following is available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/bios11050129/s1, Supplement 1: Protocols of Reference Tests.

Author Contributions

Conceptualization, Z.L.C.; methodology, Z.L.C. and S.D.S.; funding acquisition, Z.L.C., project administration, Z.L.C., H.J.S., A.A.I., T.M., and S.C.; data curation and formal analysis, Z.L.C., H.J.S., and S.D.S.; writing—original draft preparation, Z.L.C. and H.J.S.; writing—review and editing, A.A.I., T.M., S.C., and S.D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded with the Malaysia Global Entrepreneurship Movement (GEM) ColossusINNO2017 award won by BluSense Diagnostics, Denmark.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Medical Research and Ethics Committee, Ministry of Health Malaysia (NMRR-17-853-34393) and the University Malaya Medical Center Medical Research Ethics Committee (MRECID.NO: 2017426-5171).

Informed Consent Statement

Informed consent (and, where applicable, additional minor assent) was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to agreement of confidentiality.

Acknowledgments

The authors would like to thank the Director General of Health Malaysia for the approval to publish this article. We greatly appreciate the Association of Environmental Health Officers, Malaysia (EHOM) for its contribution to the study. We also thank Marco Donolato for providing additional information on ViroTrack Dengue Serostate.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Dengue: Guidelines for Diagnosis, Treatment, Prevention and Control—New Edition; WHO: Geneva, Switzerland, 2009. [Google Scholar]
  2. World Health Organization. Global Strategy for Dengue Prevention and Control 2012–2020; WHO: Geneva, Switzerland, 2012. [Google Scholar]
  3. Brady, O.J.; Gething, P.W.; Bhatt, S.; Messina, J.P.; Brownstein, J.S.; Hoen, A.G.; Moyes, C.L.; Farlow, A.W.; Scott, T.W.; Hay, S.I. Refining the Global Spatial Limits of Dengue Virus Transmission by Evidence-Based Consensus. PLoS Negl. Trop. Dis. 2012, 6, e1760. [Google Scholar] [CrossRef] [PubMed]
  4. Shepard, D.S.; Undurraga, E.A.; Halasa, Y.A.; Stanaway, J.D. The global economic burden of dengue: A systematic analysis. Lancet Infect. Dis. 2016, 16, 935–941. [Google Scholar] [CrossRef]
  5. Guo, C.; Zhou, Z.; Wen, Z.; Liu, Y.; Zeng, C.; Xiao, D.; Ou, M.; Han, Y.; Huang, S.; Liu, D.; et al. Global Epidemiology of Dengue Outbreaks in 1990-2015: A Systematic Review and Meta-Analysis. Front. Cell Infect. Microbiol. 2017, 7, 317. [Google Scholar] [CrossRef]
  6. Bhatt, S.; Gething, P.W.; Brady, O.J.; Messina, J.P.; Farlow, A.W.; Moyes, C.L.; Drake, J.M.; Brownstein, J.S.; Hoen, A.G.; Sankoh, O.; et al. The global distribution and burden of dengue. Nature 2013, 496, 504–507. [Google Scholar] [CrossRef] [PubMed]
  7. Stanaway, J.D.; Shepard, D.S.; Undurraga, E.A.; Halasa, Y.A.; Coffeng, L.E.; Brady, O.J.; Hay, S.I.; Bedi, N.; Bensenor, I.M.; Castañeda-Orjuela, C.A.; et al. The global burden of dengue: An analysis from the Global Burden of Disease Study 2013. Lancet Infect. Dis. 2016, 16, 712–723. [Google Scholar] [CrossRef] [Green Version]
  8. Khetarpal, N.; Khanna, I. Dengue Fever: Causes, Complications, and Vaccine Strategies. J. Immunol. Res. 2016, 2016, 6803098. [Google Scholar] [CrossRef] [Green Version]
  9. Halstead, S.B.; Dans, L.F. Dengue infection and advances in dengue vaccines for children. Lancet Child. Adolesc. Health 2019, 3, 734–741. [Google Scholar] [CrossRef]
  10. Imai, N.; Dorigatti, I.; Cauchemez, S.; Ferguson, N.M. Estimating dengue transmission intensity from sero-prevalence surveys in multiple countries. PLoS Negl. Trop. Dis. 2015, 9, e0003719. [Google Scholar] [CrossRef] [Green Version]
  11. Fritzell, C.; Rousset, D.; Adde, A.; Kazanji, M.; Van Kerkhove, M.D.; Flamand, C. Current challenges and implications for dengue, chikungunya and Zika seroprevalence studies worldwide: A scoping review. PLoS Negl. Trop. Dis. 2018, 12, e0006533. [Google Scholar] [CrossRef] [Green Version]
  12. Lim, J.K.; Carabali, M.; Lee, J.S.; Lee, K.S.; Namkung, S.; Lim, S.K.; Ridde, V.; Fernandes, J.; Lell, B.; Matendechero, S.H.; et al. Evaluating dengue burden in Africa in passive fever surveillance and seroprevalence studies: Protocol of field studies of the Dengue Vaccine Initiative. BMJ Open 2018, 8, e017673. [Google Scholar] [CrossRef] [PubMed]
  13. Peeling, R.W.; Artsob, H.; Pelegrino, J.L.; Buchy, P.; Cardosa, M.J.; Devi, S.; Enria, D.A.; Farrar, J.; Gubler, D.J.; Guzman, M.G.; et al. Evaluation of diagnostic tests: Dengue. Nat. Rev. Microbiol. 2010, 8, S30–S38. [Google Scholar] [CrossRef]
  14. Miller, E.; Sikes, H.D. Addressing Barriers to the Development and Adoption of Rapid Diagnostic Tests in Global Health. Nanobiomedicine 2015, 2, 6. [Google Scholar] [CrossRef]
  15. Blacksell, S.D. Commercial Dengue Rapid Diagnostic Tests for Point-of-Care Application: Recent Evaluations and Future Needs? J. Biomed. Biotechnol. 2012, 2012, 151967. [Google Scholar] [CrossRef] [Green Version]
  16. Pang, J.; Chia, P.Y.; Lye, D.C.; Leo, Y.S. Progress and Challenges towards Point-of-Care Diagnostic Development for Dengue. J. Clin. Microbiol. 2017, 55, 3339–3349. [Google Scholar] [CrossRef] [PubMed]
  17. Vaughn, D.W.; Nisalak, A.; Kalayanarooj, S.; Solomon, T.; Dung, N.M.; Cuzzubbo, A.; Devine, P.L. Evaluation of a rapid immunochromatographic test for diagnosis of dengue virus infection. J. Clin. Microbiol. 1998, 36, 234–238. [Google Scholar] [CrossRef] [Green Version]
  18. Luo, S.; Cui, W.; Li, C.; Ling, F.; Fu, T.; Liu, Q.; Ren, J.; Sun, J. Seroprevalence of dengue IgG antibodies in symptomatic and asymptomatic individuals three years after an outbreak in Zhejiang Province, China. BMC Infect. Dis. 2018, 18, 92. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Antunes, P.; Watterson, D.; Parmvi, M.; Burger, R.; Boisen, A.; Young, P.; Cooper, M.A.; Hansen, M.F.; Ranzoni, A.; Donolato, M. Quantification of NS1 dengue biomarker in serum via optomagnetic nanocluster detection. Sci. Rep. 2015, 5, 16145. [Google Scholar] [CrossRef] [Green Version]
  20. Chong, Z.L.; Sekaran, S.D.; Soe, H.J.; Peramalah, D.; Rampal, S.; Ng, C.W. Diagnostic accuracy and utility of three dengue diagnostic tests for the diagnosis of acute dengue infection in Malaysia. BMC Infect. Dis. 2020, 20, 210. [Google Scholar] [CrossRef] [PubMed]
  21. Imai, N.; Ferguson, N.M. Targeting vaccinations for the licensed dengue vaccine: Considerations for serosurvey design. PLoS ONE 2018, 13. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Bossuyt, P.M.; Reitsma, J.B.; Bruns, D.E.; Gatsonis, C.A.; Glasziou, P.P.; Irwig, L.; Lijmer, J.G.; Moher, D.; Rennie, D.; de Vet, H.C.; et al. STARD 2015: An Updated List of Essential Items for Reporting Diagnostic Accuracy Studies. Clin. Chem. 2015, 61, 1446–1452. [Google Scholar] [CrossRef] [Green Version]
  23. Idengue. Official Portal: Idengue for Community (Version 3.0). Available online: https://idengue.mysa.gov.my/index.php (accessed on 7 January 2021).
  24. Chew, C.H.; Woon, Y.L.; Amin, F.; Adnan, T.H.; Abdul Wahab, A.H.; Ahmad, Z.E.; Bujang, M.A.; Abdul Hamid, A.M.; Jamal, R.; Chen, W.S.; et al. Rural-urban comparisons of dengue seroprevalence in Malaysia. BMC Public Health 2016, 16, 824. [Google Scholar] [CrossRef] [Green Version]
  25. ESRI. Malaysia Average Household Size. Available online: http://www.arcgis.com/home/item.html?id=69f2d666483f4bf79e3e7b9c42a12d39 (accessed on 4 November 2016).
  26. Diagnostics, B. BluSense Diagnostics: Products. Available online: https://blusense-diagnostics.com/products/ (accessed on 3 April 2021).
  27. Liao, T.; Wang, X.; Donolato, M.; Harris, E.; Cruz, M.M.; Balmaseda, A.; Wang, R.Y.L. Evaluation of ViroTrack Sero Zika IgG/IgM, a New Rapid and Quantitative Zika Serological Diagnostic Assay. Diagnostics 2020, 10, 372. [Google Scholar] [CrossRef]
  28. Diagnostics, B. BluSense Diagnostics: Technology. Available online: https://blusense-diagnostics.com/technology/ (accessed on 3 April 2021).
  29. Donolato, M.; Antunes, P.; de la Torre, T.Z.; Hwu, E.T.; Chen, C.H.; Burger, R.; Rizzi, G.; Bosco, F.G.; Strømme, M.; Boisen, A.; et al. Quantification of rolling circle amplified DNA using magnetic nanobeads and a Blu-ray optical pick-up unit. Biosens. Bioelectron. 2015, 67, 649–655. [Google Scholar] [CrossRef] [PubMed]
  30. Comin, A.; Toft, N.; Stegeman, A.; Klinkenberg, D.; Marangon, S. Serological diagnosis of avian influenza in poultry: Is the haemagglutination inhibition test really the ‘gold standard’? Influenza Other Respir. Viruses 2012, 7, 257–264. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  31. Maeda, A.; Maeda, J. Review of diagnostic plaque reduction neutralization tests for flavivirus infection. Vet. J. 2013, 195, 33–40. [Google Scholar] [CrossRef]
  32. Lukman, N.; Salim, G.; Kosasih, H.; Susanto, N.H.; Parwati, I.; Fitri, S.; Alisjahbana, B.; Widjaja, S.; Williams, M. Comparison of the Hemagglutination Inhibition Test and IgG ELISA in Categorizing Primary and Secondary Dengue Infections Based on the Plaque Reduction Neutralization Test. Biomed. Res. Int. 2016, 2016, 5253842. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Vazquez, S.; Hafner, G.; Ruiz, D.; Calzada, N.; Guzman, M.G. Evaluation of immunoglobulin M and G capture enzyme-linked immunosorbent assay Panbio kits for diagnostic dengue infections. J. Clin. Virol. Off. Publ. Pan Am. Soc. Clin. Virol. 2007, 39, 194–198. [Google Scholar] [CrossRef] [PubMed]
  34. Blacksell, S.D.; Jarman, R.G.; Gibbons, R.V.; Tanganuchitcharnchai, A.; Mammen, M.P., Jr.; Nisalak, A.; Kalayanarooj, S.; Bailey, M.S.; Premaratna, R.; de Silva, H.J.; et al. Comparison of seven commercial antigen and antibody enzyme-linked immunosorbent assays for detection of acute dengue infection. Clin. Vaccine Immunol. 2012, 19, 804–810. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Schüttoff, T.; Adam, A.; Reiche, S.; Jassoy, C. Enhancing the concordance of two commercial dengue IgG ELISAs by exchange of the calibrator sample. J. Clin. Virol. 2019, 118, 1–5. [Google Scholar] [CrossRef]
  36. Clarke, D.H.; Casals, J. Techniques for hemagglutination and hemagglutination-inhibition with arthropod-borne viruses. Am. J. Trop. Med. Hyg. 1958, 7, 561–573. [Google Scholar] [CrossRef] [Green Version]
  37. Wang, S.M.; Sekaran, S.D. Early diagnosis of Dengue infection using a commercial Dengue Duo rapid test kit for the detection of NS1, IGM, and IGG. Am. J. Trop. Med. Hyg. 2010, 83, 690–695. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. WHO. Guidelines for Plaque Reduction Neutralization Testing of Human Antibodies to Dengue Viruses; World Health Organization: Geneva, Switzerland, 2007. [Google Scholar]
  39. Ngwe Tun, M.M.; Muta, Y.; Inoue, S.; Morita, K. Persistence of Neutralizing Antibody Against Dengue Virus 2 After 70 Years from Infection in Nagasaki. Biores. Open Access 2016, 5, 188–191. [Google Scholar] [CrossRef] [Green Version]
  40. Endy, T.P.; Nisalak, A.; Chunsuttitwat, S.; Vaughn, D.W.; Green, S.; Ennis, F.A.; Rothman, A.L.; Libraty, D.H. Relationship of preexisting dengue virus (DV) neutralizing antibody levels to viremia and severity of disease in a prospective cohort study of DV infection in Thailand. J. Infect. Dis. 2004, 189, 990–1000. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Ngwe Tun, M.M.; Thant, K.Z.; Inoue, S.; Kurosawa, Y.; Lwin, Y.Y.; Lin, S.; Aye, K.T.; Thet Khin, P.; Myint, T.; Htwe, K.; et al. Serological characterization of dengue virus infections observed among dengue hemorrhagic fever/dengue shock syndrome cases in upper Myanmar. J. Med. Virol. 2013, 85, 1258–1266. [Google Scholar] [CrossRef] [Green Version]
  42. Šimundić, A.-M. Measures of Diagnostic Accuracy: Basic Definitions. EJIFCC 2009, 19, 203–211. [Google Scholar] [PubMed]
  43. Chan, Y.H. Biostatistics 104: Correlational analysis. Singap. Med. J. 2003, 44, 614–619. [Google Scholar]
  44. WMA. Declaration of Helsinki—Ethical Principles for Medical Research Involving Human Subjects. Available online: http://www.wma.net/en/30publications/10policies/b3/ (accessed on 8 November 2016).
  45. Raafat, N.; Blacksell, S.D.; Maude, R.J. A review of dengue diagnostics and implications for surveillance and control. Trans. R Soc. Trop. Med. Hyg. 2019, 113, 653–660. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Kohn, M.A.; Carpenter, C.R.; Newman, T.B. Understanding the Direction of Bias in Studies of Diagnostic Test Accuracy. Acad. Emerg. Med. 2013, 20. [Google Scholar] [CrossRef]
  47. Mohd-Zaki, A.H.; Brett, J.; Ismail, E.; L’Azou, M. Epidemiology of dengue disease in Malaysia (2000-2012): A systematic literature review. PLoS Negl. Trop. Dis. 2014, 8, e3159. [Google Scholar] [CrossRef] [PubMed]
  48. Campbell, C.A.; George, A.; Salas, R.A.; Williams, S.A.; Doon, R.; Chadee, D.D. Seroprevalence of dengue in Trinidad using rapid test kits: A cord blood survey. Acta Trop. 2007, 101, 153–158. [Google Scholar] [CrossRef]
  49. Imai, N.; Dorigatti, I.; Cauchemez, S.; Ferguson, N.M. Estimating Dengue Transmission Intensity from Case-Notification Data from Multiple Countries. PLoS Negl. Trop. Dis. 2016, 10, e0004833. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Whiting, P.F.; Rutjes, A.W.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; Leeflang, M.M.; Sterne, J.A.; Bossuyt, P.M.M. Quadas-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 2011, 155, 529–536. [Google Scholar] [CrossRef] [PubMed]
Figure 1. ViroTrack and BluBox.
Figure 1. ViroTrack and BluBox.
Biosensors 11 00129 g001
Figure 2. STARD flow diagram for the evaluation of ViroTrack Dengue Serostate.
Figure 2. STARD flow diagram for the evaluation of ViroTrack Dengue Serostate.
Biosensors 11 00129 g002
Figure 3. Correlation between the ViroTrack Dengue Serostate’s BluSense IMA Unit and Panbio Unit of (a) Panbio Dengue IgG indirect ELISA and (b) Panbio Dengue IgG capture ELISA.
Figure 3. Correlation between the ViroTrack Dengue Serostate’s BluSense IMA Unit and Panbio Unit of (a) Panbio Dengue IgG indirect ELISA and (b) Panbio Dengue IgG capture ELISA.
Biosensors 11 00129 g003
Table 1. Characterization of the 484 study participants.
Table 1. Characterization of the 484 study participants.
Sample Characteristicsn (%)
PositiveEquivocalNegative
(I)
Previous dengue status *
(a)
IgG indirect ELISA only
(b)
Hemagglutination inhibition only
(c)
FRNT95 only
(i)
FRNT95 against DENV-1 only
(ii)
FRNT95 against DENV-2 only
(iii)
FRNT95 against DENV-3 only
(iv)
FRNT95 against DENV-4 only
383 (79.1)-101 (20.9)
363 (75.0)11 (2.3)110 (22.7)
356 (73.6)-128 (26.4)
414 (85.5)-70 (14.5)
298 (61.6)-186 (38.4)
299 (61.8)-185 (38.2)
296 (61.2)-188 (38.8)
265 (54.8)-219 (45.2)
(II)
Recent dengue status **
41 (8.47)12 (2.48)431 (89.05)
(IgG capture ELISA only)
* Previous dengue status was defined as positive when a sample tested negative to only one out of three reference tests, which were in turn defined as follows: (a) for IgG indirect ELISA (<9, 9–11, and >11 Panbio units were positive, equivocal, and negative, respectively), (b) for hemagglutination inhibition (titer of <1:10 and ≥1:10 were negative and positive, respectively). For FRNT, the titer reported was reciprocal of the highest serum dilution capable of 95% plaque reduction compared to serum-free control (FRNT95). Titer of <1:10 and ≥1:10 for FRNT95 against a specific DENV serotype were defined as negative and positive tests for that particular serotype, respectively. Finally, a positive test to FRNT95 was defined as a positive test to any of the individual serotype-specific FRNT95. ** Recent dengue status was defined as positive when a sample tested positive to Panbio Dengue IgG capture ELISA, where <18, 18–22, and >22 Panbio units were positive, equivocal, and negative, respectively).
Table 2. Accuracy of ViroTrack Dengue Serostate for the Diagnosis of Previous and Recent Dengue.
Table 2. Accuracy of ViroTrack Dengue Serostate for the Diagnosis of Previous and Recent Dengue.
Estimate, % (95%CI)Previous DengueRecent Dengue
Sensitivity349/383
91.1 (87.8–93.8)
37/41
90.2 (76.9–97.3)
Specificity92/101
91.1 (83.8–95.8)
413/443
93.2 (90.5–95.4)
Positive Predictive Value349/358
97.5 (95.3–98.8)
37/67
55.2 (42.6–67.4)
Negative Predictive Value92/126
73.0 (64.4–80.5)
413/417
99.0 (97.6–99.7)
Note: The italic numbers before the estimates and their 95%CI are the numbers used to derive them.
Table 3. Accuracy of ViroTrack Dengue Serostate as compared to individual reference tests used in the reference standard of previous dengue diagnosis.
Table 3. Accuracy of ViroTrack Dengue Serostate as compared to individual reference tests used in the reference standard of previous dengue diagnosis.
Estimate, % (95%CI)IgG Indirect
ELISA Only
Hemagglutination Inhibition OnlyFRNT95 Only
Sensitivity346/363
95.3 (92.6–97.3)
326/356
91.6 (88.2–94.2)
313/414
75.6 (71.2–79.7)
Specificity109/121
90.1 (83.3–94.8)
96/128
75.0 (66.6–82.2)
25/70
35.7 (24.6–48.1)
Positive
Predictive Value
346/358
96.7 (94.2–98.3)
326/358
91.1 (87.6–93.8)
313/358
87.4 (83.5–90.7)
Negative
Predictive Value
109/126
86.5 (79.3–91.9)
96/126
76.2 (67.8–83.3)
25/126
19.8 (13.3–27.9)
Note: The italic numbers before the estimates and their 95%CI are the numbers used to derive them.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chong, Z.L.; Soe, H.J.; Ismail, A.A.; Mahboob, T.; Chandramathi, S.; Sekaran, S.D. Evaluation of the Diagnostic Accuracy of a New Biosensors-Based Rapid Diagnostic Test for the Point-Of-Care Diagnosis of Previous and Recent Dengue Infections in Malaysia. Biosensors 2021, 11, 129. https://0-doi-org.brum.beds.ac.uk/10.3390/bios11050129

AMA Style

Chong ZL, Soe HJ, Ismail AA, Mahboob T, Chandramathi S, Sekaran SD. Evaluation of the Diagnostic Accuracy of a New Biosensors-Based Rapid Diagnostic Test for the Point-Of-Care Diagnosis of Previous and Recent Dengue Infections in Malaysia. Biosensors. 2021; 11(5):129. https://0-doi-org.brum.beds.ac.uk/10.3390/bios11050129

Chicago/Turabian Style

Chong, Zhuo Lin, Hui Jen Soe, Amni Adilah Ismail, Tooba Mahboob, Samudi Chandramathi, and Shamala Devi Sekaran. 2021. "Evaluation of the Diagnostic Accuracy of a New Biosensors-Based Rapid Diagnostic Test for the Point-Of-Care Diagnosis of Previous and Recent Dengue Infections in Malaysia" Biosensors 11, no. 5: 129. https://0-doi-org.brum.beds.ac.uk/10.3390/bios11050129

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop