Intra- and interobserver agreement in the interpretation of navicular bones on radiographs and computed tomography scans

Authors
Groth, A.M.; May, S.A.; Weaver, M.P.; Weller, R.
Date
February 2009
Journal
Equine Veterinary Journal
Volume
41
Number
2
Pages
124-129

Reasons for performing study: Criteria for the radiographic evaluation of navicular bones in horses have been published to standardise classification of radiographic signs. However, intra- and interobserver agreement have not been established.

Objective: To determine intra- and interobserver agreement in the evaluation of radiographic and computed tomographic (CT) navicular changes. It was hypothesised that: 1) intraobserver agreement would be better than interobserver agreement; 2) agreement would be better for CT than for radiography; and 3) pathological changes would be recognised with greater certainty with CT.

Methods: Radiographs and CT scans of 60 cadaver navicular bones were evaluated by 3 observers using published criteria. A subset of 30 studies was evaluated twice by one observer. Agreement was tested using the kappa statistic. Certainty about pathological changes was evaluated by giving the observers the option to choose 'not sure'.

Results: Agreement varied from poor to almost perfect for radiographic evaluation and from poor to substantial for CT evaluation. For radiographic evaluation mean interobserver agreement was fair, as it was for CT evaluation. For radiographic evaluation mean intraobserver agreement was moderate as it was for CT evaluation. Pathological changes were evaluated with greater certainty on CT scans compared to radiographs; however, this was not associated with improved agreement.

Conclusions: Variations in classification of navicular lesions in radiographic and CT studies were considerable between and within observers and challenge the use of such studies for diagnostic and prognostic purposes.

Potential relevance: The results of this study allowed the identification of evaluation criteria with sufficient precision to be useful for navicular bone evaluation