Physician consensus on preventability and predictability of readmissions based on standard case scenarios

Abstract

Background: Policy makers struggle with unplanned readmissions as a quality indicator since integrating preventability in such indicators is difficult. Most studies on the preventability of readmissions questioned physicians whether they consider a given readmission to be preventable, from which conclusions on factors predicting preventable readmissions were derived. There is no literature on the interobserver agreement of physician judgement. Aim: To assess the degree of agreement among physicians regarding predictability and preventability of medical readmissions. Design: An online survey based on eight real-life case scenarios was distributed to European physicians. Methods: Physicians were requested to rate from the first four (index admission) scenarios whether they expected these patients to be readmitted within 30 days (the predictability). The remaining four cases, describing a readmission, were used to assess the preventability. The main outcome was the degree of agreement among physicians determined using the intra class correlation coefficient (ICC). Results: 526 European medical physicians completed the survey. Most physicians had internal medicine as primary specialism. The median years of clinical experience was 11. ICC for predictability of readmission was 0.67 (moderate to good) and ICC for preventability of readmission was 0.13 (poor). Conclusion: There was moderate to good agreement among physicians on the predictability of readmissions while agreement on preventability was poor. This study indicates that assessing preventability of readmissions based solely on the judgement of physicians is far from perfect. Current literature on the preventability of readmissions and conclusions derived on the basis of physician opinion should be interpreted with caution.