Analyze Diet
Veterinary clinical pathology2019; 48(4); 668-676; doi: 10.1111/vcp.12811

Intra- and inter-rater agreement for the detection of band neutrophils and toxic change in horses.

Abstract: The detection of band neutrophils and toxic change via microscopic blood smear review is vitally important, as their presence indicates systemic inflammation. However, in-clinic evaluation of WBC morphology is often limited. Objective: We aimed to determine the agreement between expert raters in the detection of bands and toxic change. Methods: Three board-certified clinical pathologists each evaluated 109 blood smears from horses with acute disease, and 19 control smears from healthy horses. The pathologists determined if bands were present, and if so, the percentage of bands present. They also determined if toxic change was present, and if so, the grade of toxic change. Intra-rater agreement was evaluated using 12 duplicate blood smears. Agreement on the presence of bands between pathologists and an in-clinic hematology analyzer was evaluated. Results: Intra-rater agreement was substantial to almost perfect. Agreement between pathologists for the detection of bands was moderate, but when pathologists agreed bands were present, there was excellent agreement on the percentage of bands and mature neutrophils. Agreement between pathologists for the detection of high-grade, clinically relevant toxic change was fair. When pathologists agreed high-grade toxic change was present, there was fair agreement on Döhle bodies and cytoplasmic basophilia and poor agreement on cytoplasmic vacuolation. Agreement between individual pathologists and the in-clinic hematology analyzer for the indication of bands was fair to moderate. Conclusions: Consistent identification of bands and toxic change is challenging, even for highly trained personnel. It is, thus,not surprising that in-clinic blood smear evaluation of WBC morphology by non-experts could be inadequate.
Publication Date: 2019-12-10 PubMed ID: 31823397DOI: 10.1111/vcp.12811Google Scholar: Lookup
The Equine Research Bank provides access to a large database of publicly available scientific literature. Inclusion in the Research Bank does not imply endorsement of study methods or findings by Mad Barn.
  • Journal Article

Summary

This research summary has been generated with artificial intelligence and may contain errors and omissions. Refer to the original study to confirm details provided. Submit correction.

The research focuses on the accuracy of expert assessment in identifying band neutrophils and toxic change in horses’ blood smear tests. It evaluates the consistency of the evaluations made by three experienced pathologists, and how well their assessments match those done by a clinical hematology analyzer.

Research Methodology

  • The study involved three board-certified clinical pathologists who examined a total of 128 blood smear tests. Out of these, 109 came from horses with acute disease, while 19 were controls from healthy horses.
  • The pathologists sought to identify if band neutrophils were present, and if they were, the proportion involved. They also attempted to detect any toxic changes, along with determining their grade.
  • Intra-rater agreement, which gauges the consistency of evaluations made by the same individual on two or more occasions, was evaluated using 12 duplicate blood smears.
  • The study also sought to assess the agreement between individual pathologists and an in-clinic hematology analyzer, mainly focusing on the indication of band neutrophils.

Results of the Study

  • The intra-rater agreement was found to range from substantial to almost perfect, signifying high consistency in the individual assessments of the pathologists.
  • However, the agreement between the different pathologists in the detection of band neutrophils was moderate. But when they agreed that band neutrophils were present, their agreement on the percentage was excellent.
  • The agreement for the detection of high-grade toxic change (clinically significant change) was fair. Further, if they agreed on its presence, their agreement was fair on Döhle bodies and cytoplasmic basophilia (specific types of toxic changes), but poor on cytoplasmic vacuolation (another form of toxic change).
  • When comparing individual pathologists’ evaluations with the in-clinic hematology analyzer, the agreement was fair to moderate.

Conclusion from the Study

  • Even for highly trained personnel, consistently identifying band neutrophils and toxic change is challenging. This difficulty could explain why non-expert in-clinic blood smear evaluations might be inadequate.

Cite This Article

APA
Fernandez NJ, Gilroy CV, Wagg CR, Kwong GPS, Roy MF. (2019). Intra- and inter-rater agreement for the detection of band neutrophils and toxic change in horses. Vet Clin Pathol, 48(4), 668-676. https://doi.org/10.1111/vcp.12811

Publication

ISSN: 1939-165X
NlmUniqueID: 9880575
Country: United States
Language: English
Volume: 48
Issue: 4
Pages: 668-676

Researcher Affiliations

Fernandez, Nicole J
  • Western College of Veterinary Medicine, University of Saskatchewan, Saskatoon, SK, Canada.
Gilroy, Cornelia V
  • Atlantic Veterinary College, University of Prince Edward Island, Charlottetown, PE, Canada.
Wagg, Catherine R
  • University of Calgary, Faculty of Veterinary Medicine, Calgary, AB, Canada.
Kwong, Grace P S
  • University of Calgary, Faculty of Veterinary Medicine, Calgary, AB, Canada.
Roy, Marie-France
  • University of Calgary, Faculty of Veterinary Medicine, Calgary, AB, Canada.

MeSH Terms

  • Animals
  • Automation
  • Hematologic Tests / veterinary
  • Horse Diseases / blood
  • Horses
  • Inflammation / blood
  • Inflammation / veterinary
  • Leukocyte Count / veterinary
  • Leukopoiesis
  • Neutrophils / cytology
  • Observer Variation
  • Retrospective Studies

Grant Funding

  • 1-419529-1142-60104-8000-9999 / University of Saskatchewan

References

This article includes 34 references
  1. Lambert JL, Fernandez NJ, Roy M-F. Association of presence of band cells and toxic neutrophils with systemic inflammatory response syndrome and outcome in horses with acute disease.. J Vet Intern Med 2016;30:1284-1292.
  2. Burton AG, Harris LA, Owens SD, Jandrey KE. Degenerative left shift as a prognostic tool in cats.. J Vet Intern Med 2014;28:912-917.
  3. Burton AG, Harris LA, Owens SD, Jandrey KE. The prognostic utility of degenerative left shifts in dogs.. J Vet Intern Med 2013;27:1517-1522.
  4. Segev G, Klement E, Aroch I. Toxic neutrophils in cats: clinical and clinicopathologic features, and disease prevalence and outcome-a retrospective case control study.. J Vet Intern Med 2006;20:20-31.
  5. Tvedten HW, Andersson V, Lilliehöök IE. Feline differential leukocyte count with ProCyte Dx: frequency and severity of a neutrophil-lymphocyte error and how to avoid it.. J Vet Intern Med 2017;31:1708-1716.
  6. Rishniw M, Pion PD. Evaluation of performance of veterinary in-clinic hematology analyzers.. Vet Clin Pathol 2016;45:604-614.
  7. Goldmann F, Bauer N, Moritz A. Evaluation of the IDEXX ProCyte Dx analyzer for dogs and cats compared to the Siemens ADVIA 2120 and manual differential.. Comp Clin Pathol 2014;23:283-296.
  8. Lanaux TM, Rozanski EA, Simoni RS. Interpretation of canine and feline blood smears by emergency room personnel.. Vet Clin Pathol 2011;40:18-23.
  9. Smits SM, Leyte A. Clinical performance evaluation of the CellaVision Image Capture System in the white blood cell differential on peripheral blood smears.. J Clin Pathol 2014;67:168-172.
  10. Gulati G, Song J, Dulau Florea A, Gong J. Purpose and criteria for blood smear scan, blood smear examination, and blood smear review.. Ann Lab Med 2013;33:1-7.
  11. Lee L, Mansoor A, Wood B, Nelson H, Higa D, Naugler C. Performance of CellaVision DM96 in leukocyte classification.. J Pathol Inform 2013;4:14-21.
  12. Giordano A, Rossi G, Pieralisi C, Paltrinieri S. Evaluation of equine hemograms using the ADVIA 120 as compared with an impedance counter and manual differential count.. Vet Clin Pathol 2008;37:21-30.
  13. McHugh ML. Interrater reliability: the kappa statistic.. Biochem Med (Zagreb) 2012;22:276-282.
  14. Cicchetti DV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.. Psychol Assess 1994;6:284-290.
  15. R Core Team. A Language and Environment for Statistical Computing.. Vienna, Austria: R Foundation for Statistical Computing. 2018.
  16. Quatto P, Ripamonti E. Raters: a modification of Fleiss' Kappa in case of nominal and ordinal variables.. R Package, Version 2.0. 1. 2014 2015.
  17. Lo Martire R. rel: Reliability Coefficients.. R package version 1.3.1. 2017 .
  18. Hothorn T, Hornik K, Van De Wiel MA, Zeileis A. Implementing a class of permutation pests: the coin package.. J Statist Softw 2008;28:1-23.
  19. Agresti A. Categorical Data Analysis.. Hoboken, NJ: John Wiley & Sons, Inc.; 2002.
  20. Allison RW, Meinkoth JH. Hematology without the numbers: in-clinic blood film evaluation.. Vet Clin North Am: Small Anim Pract 2007;37:245-266.
  21. Flatland B, Freeman KP, Vap LM, Harr KE. ASVCP guidelines: quality assurance for point-of-care testing in veterinary medicine.. Vet Clin Pathol 2013;42:405-423.
  22. Weiser MG, Vap LM, Thrall MA. Perspectives and advances in in-clinic laboratory diagnostic capabilities: hematology and clinical chemistry.. Vet Clin North Am: Small Anim Pract 2007;37:221-236.
  23. Metzger FL Jr, Rebar A. Three-minute peripheral blood film evaluation: preparing the film.. Vet Med 2004;99:1020-1025.
  24. Kujan O, Khattab A, Oliver RJ, Roberts SA, Thakker N, Sloan P. Why oral histopathology suffers inter-observer variability on grading oral epithelial dysplasia: an attempt to understand the sources of variation.. Oral Oncol 2007;43:224-231.
  25. Lai JKC, Robertson PL, Goh C, Szer J. Intraobserver and interobserver variability of the bone marrow burden (BMB) score for the assessment of disease severity in Gaucher disease. Possible impact of reporting experience.. Blood Cells Mol Dis 2018;68:121-125.
  26. Kolben TM, Bergauer F, Moeckel J. Short interval between two Pap smears: effect on the result of the second smear? A prospective randomized trial.. Arch Gynecol Obstet 2017;295:1427-1433.
  27. Lidbury JA, Rodrigues Hoffmann A, Ivanek R. Interobserver agreement using histological scoring of the canine liver.. J Vet Intern Med 2017;31:778-783.
  28. Santoro P. Manual methods vs automated hematology analyzers in veterinary hematology.. Vet Clin Pathol 2018;47:178-178.
  29. Novis DA, Walsh M, Wilkinson D, St Louis M, Ben-Ezra J. Laboratory productivity and the rate of manual peripheral blood smear review: a College of American Pathologists Q-Probes study of 95,141 complete blood count determinations performed in 263 institutions.. Arch Pathol Lab Med 2006;130:596-601.
  30. Paltrinieri S, Talon E. Analytic variability in the enumeration of neutrophil subpopulations in canine blood.. Vet Clin Pathol 2017;46:551-557.
  31. Giraldi M, Paltrinieri S, Zatelli A. Evaluation of the analytical variability of dipstick protein pads in canine urine.. Vet Clin Pathol 2018;47:246-251.
  32. Fernandez NJ, Hecker KG, Gilroy CV, Warren AL, Léguillette R. Reliability of 400-cell and 5-field leukocyte differential counts for equine bronchoalveolar lavage fluid.. Vet Clin Pathol 2013;42:92-98.
  33. Tvedten HW, Lilliehöök IE. Canine differential leukocyte counting with the CellaVision DM96Vision, Sysmex XT-2000iV, and Advia 2120 hematology analyzers and a manual method.. Vet Clin Pathol 2011;40:324-339.
  34. Lilliehöök I, Tvedten H. Validation of the Sysmex XT-2000iV hematology system for dogs, cats, and horses. II. Differential leukocyte counts.. Vet Clin Pathol 2009;38:175-182.

Citations

This article has been cited 3 times.
  1. Perez-Ecija A, Buzon-Cuevas A, Aguilera-Aguilera R, Gonzalez-De Cara CA, Mendoza FJ. Blood Storage Conditions Affect Hematological Analysis in Samples From Healthy Donkeys and Donkeys With Experimentally-Induced Endotoxemia. Front Vet Sci 2020;7:640.
    doi: 10.3389/fvets.2020.00640pubmed: 33134340google scholar: lookup
  2. O Toole DS, Williams TL, Hare CHZ. The Value of Neutrophil Cell Population Data Parameters as Markers of Systemic Inflammation in Dogs and Cats. Vet Clin Pathol 2025 Jun;54(2):78-86.
    doi: 10.1111/vcp.70029pubmed: 40476643google scholar: lookup
  3. Sun P, Jeffery U. Decreased antithrombin activity and inflammation in cats. J Feline Med Surg 2021 Jun;23(6):498-506.
    doi: 10.1177/1098612X20960400pubmed: 33025836google scholar: lookup