Performance Evaluation of the ABX Micros CRP:
Transcription
Performance Evaluation of the ABX Micros CRP:
ISLH Laboratory Hematology 7:69-74 © 2001 Carden Jennings Publishing Co., Ltd. Official Publication Performance Evaluation of the ABX Micros CRP: The First Instrument Reporting a Complete Blood Count, 3-Part Leukocyte Differential, and C-Reactive Protein Quantitation BRUCE H. DAVIS, NANCY C. BIGELOW Maine Medical Center Research Institute, Scarborough, Maine significant carryover. Correlation of CRP with the Roche COBAS Integra was excellent with a slope of approximately 0.98, no significant bias, and an r 2 value of >0.99. No interference was seen in the analysis of any of the samples from patients with clinical conditions associated with interfering substances. Samples held at either 25°C or 4°C were stable for 48 hours. The CRP sensitivity was greater than the manufacturer’s claim of 0.2 mg/dL. The ABX Micros CRP demonstrated performance suitable for clinical practice. The ease of use, small sample volume (18µL), and rapid turnaround time (<5 minutes for CBC and CRP) are features that will make this instrument useful in point-ofcare testing areas including both adult and pediatric intensive care units and in office laboratories, particularly those of pediatricians, rheumatologists, and infectious disease specialists. Lab. Hematol. 2001;7:69-74. ABSTRACT ABX Diagnostics has developed the ABX Micros CRP analyzer, the first instrument to provide both a complete blood count (CBC) with a 3-part differential and a quantitative C-reactive protein (CRP) determination. The CRP measurement is based on a whole-blood immunoturbidimetric method using latex beads coated with antiCRP–specific–monoclonal antibody. The evaluation reported here of the linearity, sensitivity, precision, carryover, and clinical performance of the ABX Micros CRP was performed prior to release of the instrument in the United States. Precision of CRP analysis was assessed by replicate determinations of K3EDTA-anticoagulated whole-blood samples with CRP values in the range of <0.4 mg/dL to 10 mg/dL. Linearity was evaluated by assaying pooled normal samples spiked with CRP control material. The stability of CRP was studied in blood samples held at both room temperature and refrigerated conditions over a 72-hour period. Correlation studies were performed by analyzing 100 blood samples on the ABX Micros CRP and comparing the results with those obtained using the Roche COBAS Integra CRP assay, which is based on latex nephelometry. Within-run and between-run precision of both CBC and CRP values had a coefficient of variation (CV) of <10%. Excellent linearity was observed and there was no KEY WORDS: Inflammation · Hematology instrumentation · Point-of-care testing · Laboratory automation · Acute phase reactant INTRODUCTION One of the recent trends in laboratory medicine is the merging of testing in the traditionally separate disciplines of hematology and chemistry. This merger has created the unfortunate term, chematology, and has been driven by the desire to save money. One expensive, still experimental, approach to achieving that goal has been to put hematology and chemistry instruments on the robotic track, forcing Correspondence and reprint requests: Bruce H. Davis, MD, Maine Medical Center Research Institute, 81 Research Drive Scarborough, ME 04074 (e-mail: davisb@mmc.org). Received December 1, 2000; accepted December 4, 2000 69 70 B.H. Davis and N.C. Bigelow data generated with this system correlates with that of the FDA-approved Roche COBAS Integra CRP assay, which is based on latex nephelometry. MATERIALS AND METHODS Stability Five samples from healthy patients were divided into 2 aliquots each, 1 of which was placed at room temperature and the other at 4°C. At baseline (immediately after blood collection) and at 24, 48, and 72 hours post-collection, each aliquot was carefully mixed and tested in duplicate using the ABX Micros CRP. Results are shown in Table 2 and are expressed as percentage deviation from the baseline measurement. FIGURE 1. MICROS CRP instrument from ABX DIAGNOSTICS (Montpellier, France) provides a CBC with a 3part leukocyte differential and C-reactive protein values on whole-blood samples. technical specialists to become cross-trained generalists and on-site computer and mechanical repair experts. An alternative approach is to focus on the point-of-care arena and create specialized instruments that are focused on specific clinical needs. One such arena is the outpatient or specialized inpatient setting in which patients with suspected or documented inflammatory diseases such as infections and rheumatoid diseases are evaluated. ABX Diagnostics (Montpellier, France) has developed an instrument that provides both a complete blood count (CBC) with a 3-part leukocyte differential and a quantitative C-reactive protein (CRP) measurement, a combination of testing that is tailored to this setting. The ABX Micros CRP (Figure 1) is a fully automated hematology analyzer identical to the ADVIA 60 (Bayer Diagnostics, Tarrytown, NY), an FDA-approved hematology analyzer that measures various CBC parameters, including 3part differential leukocyte counts, hematocrit, hemoglobin, mean corpuscular volume, mean corpuscular hemoglobin, mean corpuscular hemoglobin concentration, red blood cell counts and distribution width, platelet count, and a mean platelet volume and distribution width. ABX has modified the Micros to create the ABX Micros CRP by integrating another assay using turbidimetric measurements with monoclonal antibody–coated latex beads to measure CRP in whole blood. CRP is an acute-phase reactant that provides diagnostic information similar to the classic erythrocyte sedimentation rate (ESR) and is an indicator of tissue injury or disease activity in inflammatory processes [1-7]. The purpose of this study was to evaluate the performance characteristics of the ABX Micros CRP and to demonstrate the extent to which Precision A blood sample from a healthy subject was used to estimate the within-run precision for the normal range using replicate testing (>10 times). Serial analyses of low-control (LC) and high-control (HC) specimens (ABX Diagnostics) were performed to determine between-run and between-day precision. All normal and abnormal blood specimens were analyzed in duplicate using paired-precision analysis to assess day-to-day intra-assay precision. Linearity ABO- and Rh-matched blood samples with high and low CRP levels were mixed in the following proportions and assayed in duplicate: 100%:0%, 90%:10%, 80%:20%, 65%:35%, 50%:50%, 35%:65%, 20%:80%, 5%:95%, 0%:100%. In addition, known amounts of CRP control material were added to 0.5 mL aliquots of a normal blood sample in increments of 0.2 mg and run in duplicate. Carryover The ABX Micros CRP carryover was evaluated by assaying the LC specimens in triplicate (LC1-3), followed by triplicate testing of the HC specimens (HC1-3), then rerunning the LC in triplicate again (LC4-6). It is assumed that carryover TABLE 1. Carryover for the ABX Micros CRP Assay* Sample Number 1 Number 2 Number 3 Mean ± SD UL/CI Carryover (%)† Low Control High Control Low Control 0.57 0.60 0.59 0.59 ± 0.01 0.603955 0.13 4.46 4.68 4.65 4.60 ± 0.10 0.61 0.57 0.59 0.59 ± 0.02 *SD indicates standard deviation; UL, upper limit of 95% confidence interval; CI, confidence interval. †(0.61 – 0.603955) ÷ 4.60 100. Performance Evaluation of the ABX Micros CRP 71 by medical chart review using the presence of infection or other inflammatory disease as the clinical indicator. Investigation of Clinical Conditions Associated With Interfering Substances Samples were obtained from patients with conditions known to be associated with hyperbilirubinemia, hyperhemoglobinemia, hypergammaglobulinemia, and hyperlipidemia, and evaluated with the ABX Micros CRP; the results were evaluated using paired precision and clinical correlation. This evaluation is not meant to be an exhaustive study, but does provide information about the testing of patients with clinical conditions associated with substances known to interfere with other CRP methods. Statistical Analysis Linearity and procedural correlation data were analyzed using linear regression analysis, and comparative data on patient and control specimens were evaluated using analysis of variance methods when appropriate. All statistical procedures were performed using Statistica for Windows (StatSoft, Tulsa, OK) and Excel (Microsoft, Redmond, WA). RESULTS FIGURE 2. Linearity of C-reactive protein (CRP) measurements on ABX Micros CRP. has not occurred if the LC4 value lies within the 95% confidence interval (CI) defined by the LC1-3 replicates. If the LC4 value was greater than the upper limit of the 95% CI (UL), then the following formula was used to calculate carryover: (LC4 – UL/CI) ÷ (HC1-3 ÷ 3), where LC4 is the first low control replicate following the high control testing, UL/CI is the upper limit of the 95% CI, and HC1-3 ÷ 3 is the average of the triplicate high control values. Procedural Correlation Twenty-five samples from healthy patients and 75 samples from patients with diseases in which CRP levels are likely to be elevated were assayed in duplicate with the ABX Micros CRP. These values were compared with the value obtained with the Roche COBAS Integra CRP assay according to institution-approved guidelines and Institutional Review Board (IRB) approval. All samples were stored at room temperature and tested within 12 hours of collection, except for the stability evaluation phase of the study (described above). When samples were assayed on multiple instruments, not more than 1 hour elapsed between the beginning of testing with the first instrument and the beginning of testing with the second. Sensitivity and specificity for clinical utility was determined Assay Precision A blood specimen from a healthy subject was assayed 10 times in succession and the mean level of CRP was found to be 0.39 ± 0.02 mg/dL, with a coefficient of variation (CV) of 6.0%. The within-run precision derived from paired duplicate analyses of CRP on all patient samples and healthy donors was a mean CV of 17.6% ± 37.3% (range 0% to 200%, N = 100). When those samples that had CRP levels below the linearity limit determined by this study (0.05 mg/dL) were excluded, low imprecision was demonstrated with a mean CV of 6.5% ± 11.7% (range 0% to 72.7%, n = 86). The between-run precision estimates were obtained by assaying the LC and HC specimens 4 times at approximately 2-hour intervals every day for 17 days. CVs ranged from 1.4% to 11.6% (mean, 4.1% ± 2.8%) for the LC with an overall mean of 0.56 ± 0.03 mg/dL, and 0.5% to 3.1% (mean, 1.8% ± 0.7%) for the HC with an overall mean of 4.25 ± 0.14 mg/dL. Between-day precision studies for the LC and HC specimens produced CVs of 5.4% and 3.3%, respectively. Assay Linearity The linearity of the ABX Micros CRP was initially assessed using duplicate assays of dilutions of ABO- and Rh-matched blood samples with high and low CRP levels mixed in various proportions and showed a loss of linearity in undiluted specimens with CRP levels between 7 mg/dL and 10 mg/dL (Figure 2). Specimens with CRP values above 10 mg/dL were diluted prior to analysis according to the product manual and showed good linearity. Linearity between the normal range 72 B.H. Davis and N.C. Bigelow for the samples with the lowest CRP levels, with increases of 5% to 10% at 48 hours in samples stored at both ambient and low temperatures, in contrast to decreases of 1% to 3% for those with elevated CRP levels (Table 2). At 72 hours post-collection, deviations from baseline were more apparent, but were still less than 11% for both normal and abnormal samples irrespective of storage temperature. FIGURE 3. Intermethod correlation between ABX Micros CRP and Roche Integra CRP (latex) of 100 samples. CRP indicates C-reactive protein. and approximately 7 mg/dL were studied further by adding increasing volumes of 5 µL to 230 µL of a sample with a high CRP level (21.3 mg/dL) to 0.5 mL aliquots of a normal specimen and showed excellent linearity (Figure 2). Procedural Correlation Samples were collected from 25 healthy subjects and from 75 subjects with known disease (44% female), of which 42 were older than 4 years (mean age, 35.3 years) and 58 were younger than 1 year. Samples were assayed in duplicate using the ABX Micros CRP and Roche COBAS Integra. The correlation coefficient between the 2 methods was 0.975 for all samples tested (Figure 3), with the ABX Micros CRP method exhibiting a greater deviation from regression in the 7 to 10 mg/dL range, in which whole-blood samples were not diluted, in accordance with the manufacturer’s original instructions. When only the 25 normal samples were tested, the 2 methods were almost perfectly correlated (r 2 = 0.996, Figure 4). Investigation of Potentially Interfering Substances During the course of the evaluation, 2 samples were found to have potentially interfering substances for a CRP assay. One sample with hyperhemoglobinemia secondary to an active malaria infestation gave clinically relevant duplicate values of 6.61 mg/dL and 6.92 mg/dL. A second sample was from a patient with hyperlipidemia (cholesterol, >1000 mg/dL) and a hypergammaglobulinemia (>3 g/dL), but no clinical evidence of active inflammation. The ABX Micros CRP gave appropriately normal CRP values for the sample with both hyperlipidemia and hypergammaglobulinemia (0.18 mg/dL and 0.19 mg/dL). Both samples demonstrated a CV with paired precision comparable to samples without these potentially compounding substances. These findings show that although users should be aware of the potential for interfering substances to cause erroneous results, the presence of hyperlipidemia, hypergammaglobulinemia, and hyperhemoglobinemia are not absolute contraindications for using the ABX Micros CRP. DISCUSSION The data presented in this study demonstrate that withinrun, between-run, and between-day precision for the ABX Micros CRP assay is quite acceptable, with the best precision Sample Carryover As shown in Table 1, the CRP value for the first LC sample following triplicate testing of the 3 HC samples was slightly above the upper limit of the 95% CI for the 3 low level controls initially tested (0.610 versus 0.604) resulting in a carryover estimate of 0.13%. Sample Stability Five normal and 5 abnormal blood specimens were tested immediately after collection and following storage at both ambient (approximately 25°C) and low temperatures (approximately 5°C) at 24, 48, and 72 hours. As expected, the percentage deviation from baseline was somewhat greater FIGURE 4. Intermethod correlation between ABX Micros CRP and Roche Integra CRP (latex) of 25 healthy donor samples show excellent agreement. CRP indicates C-reactive protein. Performance Evaluation of the ABX Micros CRP TABLE 2. Stability of Normal and Abnormal Samples Assayed on ABX Micros CRP (n = 10)* Time (h) Variable Normal sample RT Mean Deviation Percentage deviation Abnormal sample RT Mean Deviation Percentage deviation Normal sample at 5°C Mean Deviation Percentage deviation Abnormal sample at 5°C Mean Deviation Percentage deviation 0 24 48 72 0.131 0.138 0.007 5.3 0.139 0.008 6.1 0.142 0.011 8.4 4.054 3.981 0.073 –1.8 4.002 0.052 –1.3 3.730 0.324 –8.0 0.131 0.144 0.013 9.9 0.139 0.008 6.1 0.117 0.014 –10.7 4.054 3.935 0.119 –2.9 3.995 0.059 –1.5 3.816 0.238 –5.9 *Mean CRP values expressed as mg/dL. Deviation is the deviation of the sample mean from baseline. Percentage deviation is the mean deviation expressed as a percentage. RT indicates room temperature. obtained for the low control (0.56 mg/dL) tested 4 times per day for 17 days (CV 1.4 to 11.6%). This CRP assay is linear for anticoagulated blood without dilution up to a CRP value of 7 mg/dL. Although the ABX Micros CRP was originally designed for CRP concentrations up to 10 mg/dL in undiluted blood, this study demonstrated a slight loss of linearity in the range of 7 to 10 mg/dL. Thus, our findings indicate that samples with CRP values > 7 mg/dL on initial analysis with the ABX Micros CRP should be diluted and reanalyzed to obtain accurate results. When this protocol was followed, we observed results from the ABX Micros CRP assay to be highly correlated with those of the Roche COBAS Integra CRP. Carryover was found to be negligible and samples stored for up to 48 hours at either room temperature or under refrigeration were shown to be stable for the ABX Micros CRP assay. Finally, we observed no interference in the CRP measurements in a limited sampling of patients with rheumatoid factor, hyperhemoglobinemia, hyperlipidemia, or hypergammaglobulinemia, conditions associated with interference problems with other CRP methods [8]. Thus our findings support the claim that the ABX Micros CRP provides reproducible, linear measurement of CRP in the range of 0.05 to 7.0 mg/dL using undiluted, EDTAanticoagulated whole-blood samples and >7.0 mg/dL using diluted samples. Furthermore, the ease of operation, small sample volume requirement, and reporting of both CBC and CRP results in less than 5 minutes are features that make this a suitable instrument for point-of-care testing. 73 An elevated CRP level is indicative of inflammatory disease activity and is preferred to the ESR as a disease marker. But the simpler nature of the ESR procedure means it is more available and that results are reported out more frequently than the immunologic CRP method. If it is available, the CRP assay is typically run in batches, and results are reported once daily (or even less frequently), precluding its use in realtime patient management. Yet it is clear that the CRP has clinical utility in the management of neonatal sepsis [9-14], suspected appendicitis in the acute care setting [1,2,15], and more recently, in cardiac injury and stroke [16-20]. Such clinical conditions typically involve patients in either intensive care settings or emergency care, where the use of point-of-care testing has been found to improve patient care and reduce health care costs. It is clear that instruments such as the ABX Micros CRP should provide a solution to a real clinical need. The CRP measurement with the ABX Micros CRP was shown to have a lower limit of linearity down to 0.05 mg/dL, which is not sufficient to be defined as a high-sensitivity CRP method as employed in many of the studies demonstrating CRP as a risk factor in cardiovascular diseases. However, the ABX Micros CRP appears to be sufficiently sensitive to identify not only the elevated CRP values that occur in neonatal sepsis, but also those in patients with subtler abnormalities that have been found in studies using high-sensitivity CRP methods which define prognostic risk at threshold values in the range of 0.2 to 0.4 mg/dL [16-18,20]. Therefore, aside from the intended use of the ABX Micros CRP in the physician office setting of rheumatologist, pediatrician, or internist, this instrument may find utility in point-of-care settings such as neonatal intensive care units, emergency care units, or outpatient cardiac care settings. The clinical use of the CRP is generally well defined as a marker in the patient with infection or sepsis, although its use may be challenged by newer diagnostic tests of responses to infections, such as procalcitonin, interleukin-6, and neutrophil CD64 measurements [11,21-27]. But at least for now, the advantage of combining CBC and CRP determinations on a single instrument platform, such as the ABX Micros CRP, should be a valuable diagnostic tool for reliable point-of-care testing of individuals with proven or suspected inflammatory diseases. The combination of CBC parameters with other laboratory determinations may be a new trend in laboratory hematology. ACKNOWLEDGMENTS This work was supported by ABX Diagnostics, Irvine, CA, and was performed as part of the clinical evaluation for the FDA 510(k) submission of the ABX Micros CRP. Dr. Davis and Ms. Bigelow are paid consultants to ABX Diagnostics, Montpellier, France. This work was presented in part at the annual ISLH meeting in Banff, Canada, in April 2000 and the American 74 B.H. Davis and N.C. Bigelow Society of Hematology meeting in San Francisco, California, in December 2000. REFERENCES 1. Clyne B, Olshaker J. The C-reactive protein. J Emerg Med. 1999;17:1019-1025. 2. Gronroos J, Gronroos P. Leucocyte count and C-reactive protein in the diagnosis of acute appendicitis. Br J Surg. 1999;86:501-504. 3. Yeun J. Clinical utility of C-reactive protein measurements. Semin Dial. 2000;13:56-57. 4. Szalai A, Agrawal A, Greenhough T, Volanakis J. C-reactive protein: structural biology and host defense function. Clin Chem Lab Med. 1999;37:265-270. 5. Rodriguez-Sanjuan J, Martin-Parra J, Seco I, Garcia-Castrillo L, Naranjo A. C-reactive protein and leukocyte count in the diagnosis of acute appendicitis in children. Dis Colon Rectum. 1999;42: 1325-1329. 6. Posen R, de LR. C-reactive protein levels in the extremely premature infant: case studies and literature review. J Perinatol. 18:138-141. 7. Povoa P, Almeida E, Moreira P, et al. C-reactive protein as an indicator of sepsis. Intensive Care Med. 1998;24:1052-1056. 8. Lelong M, Renard M, Giraudeaux V. Solid immunoassay and immunonephelemetric methods for serum C reactive protein (CRP) determination: discrepancy in CRP value for a patient presenting a monoclonal immunoglobulin G. Clin Chim Acta. 1999;288:147-152. 9. Benitz W, Han M, Madan A, Ramachandra P. Serial serum C-reactive protein levels in the diagnosis of neonatal infection [abstract]. Pediatrics. 1998;102:965. 10. Bomela H, Ballot D, Cory B, Cooper P. Use of C-reactive protein to guide duration of empiric antibiotic therapy in suspected early neonatal sepsis. Pediatr Infect Dis J. 2000;19:531-535. 11. Carlet J. Rapid diagnostic methods in the detection of sepsis. Infect Dis Clin North Am. 1999;13:483-494. 12. Chiu C, Lin T, Bullard M. Identification of febrile neonates unlikely to have bacterial infections. Pediatr Infect Dis J. 1997;16:59-63. 13. Gerdes J, Polin R. Early diagnosis and treatment of neonatal sepsis. Indian J Pediatr. 1998;65:63-78. 14. Kaftan H, Kinney J. Early onset neonatal bacterial infections. Semin Perinatol. 1998;22:15-24. 15. Asfar S, Safar H, Khoursheed M, Dashti H, al-Bader A. Would measurement of C-reactive protein reduce the rate of negative exploration for acute appendicitis? J R Coll Surg Edinb. 2000;45:21-24. 16. Ford E, Giles W. Serum C-reactive protein and self-reported stroke: findings from the Third National Health and Nutrition Examination Survey. Arterioscler Thromb Vasc Biol. 2000;20:1052-1056. 17. Ridker P, Hennekens C, Buring J, Rifai N. C-reactive protein and other markers of inflammation in the prediction of cardiovascular disease in women. N Engl J Med. 2000;342:836-843. 18. Tommasi S, Carluccio E, Bentivoglio M, et al. C-reactive protein as a marker for cardiac ischemic events in the year after a first, uncomplicated myocardial infarction. Am J Cardiol. 1999;83: 1595-1599. 19. Gaspardone A, Crea F, Versaci F, et al. Predictive value of C-reactive protein after successful coronary-artery stenting in patients with stable angina. Am J Cardiol. 1998;82:515-518. 20. Anderson J, Carlquist J, Muhlestein J, Horne B, Elmer S. Evaluation of C-reactive protein, an inflammatory marker, and infectious serology as risk factors for coronary artery disease and myocardial infarction. J Am Coll Cardiol. 1998;32:35-41. 21. Hatherill M, Tibby S, Sykes K, Turner C, Murdoch I. Diagnostic markers of infection: comparison of procalcitonin with C reactive protein and leucocyte count. Arch Dis Child. 1999;81:417-421. 22. Hedlund J, Hansson L. Procalcitonin and C-reactive protein levels in community-acquired pneumonia: correlation with etiology and prognosis. Infection. 2000;28:68-73. 23. Somech R, Zakuth V, Assia A, Jurgenson U, Spirer Z. Procalcitonin correlates with C-reactive protein as an acute-phase reactant in pediatric patients. Isr Med Assoc J. 2000;2:147-150. 24. Toikka P, Irjala K, Juven T, et al. Serum procalcitonin, C-reactive protein and interleukin-6 for distinguishing bacterial and viral pneumonia in children. Pediatr Infect Dis J. 2000;19:598-602. 25. Karzai W, Reinhart K. Sepsis: definitions and diagnosis. Int J Clin Pract Suppl. 1998;95:44-48. 26. Davis BH, Bigelow NC, Curnutte JT, Ornvold K. Neutrophil CD64 expression: potential diagnostic indicator of acute inflammation and therapeutic monitor of interferon-γ therapy. Lab Hematol. 19951:3-12. 27. Fjaertoft G, Hakansson L, Ewald U, Foucard T, Venge P. Neutrophils from term and preterm newborn infants express the high affinity Fcgamma-receptor I (CD64) during bacterial infections. Pediatr Res. 1999;45:871-876.