A comparison of four systems for scoring recovery quality after general anaesthesia in horses.

This research aims to evaluate the reliability of four contemporary systems used to score the quality of recovery in horses after general anesthesia – a critical factor in veterinary practice. The study found that all four systems were equally reliable, with minimal variation between different observers’ scores, paving the way for choosing a universally acceptable scoring system based on other criteria, like simplicity, therefore facilitating multicentre studies of recovery post-anaesthesia in horses.

Methodology

• The basis of the study is the assessment made by final year veterinary students over a period of five days, which involved reviewing pre-recorded horse recoveries from anesthesia.
• On the first day, each student ranked these recoveries from best to worst, forming a baseline.
• Over the following four days, the same recoveries were scored using four different recovery quality scoring systems (RQSSs) – three currently in use and one previously published – applied in random sequence.
• The scores obtained were ranked and plotted against the initial ranking of each student to measure the level of agreement, using a statistical method known as the generalizability theory.

Additional Validation

• For additional verification, the same recovery instances were also ranked by a group of 12 experienced equine anaesthetists.
• Using the Spearman Rank Correlation coefficient, a high level of agreement was established between the rankings made by both experienced and inexperienced evaluators.

Results

• All four RQSSs were found to be equally reliable across all evaluations by 117 students.
• The study revealed minimum (<4%) variability in the ranking of different observers using each RQSS.
• Significant variation (80%) stemmed from differences between individual horses, not the scoring system.
• The general correlation between the initial (day 1) ranking and the rankings in each RQSS system was strong.
• There was a nearly perfect correlation (r = 0.983) between the rankings established by the students and those given by the experienced anaesthetists, indicating the reliability of the scoring results obtained by less experienced evaluators.

Conclusions

• All four RQSSs proved to be equally reliable, hence any of them could be chosen for use.
• Since all RQSSs showed similar reliability, the basis for selection of a universally acceptable system can be factors outside reliability, such as ease of use.
• These findings are significant in facilitating multicentre studies related to post-anaesthesia recovery in horses, as they ensure a common, reliable scoring system could be employed.