I am wondering if anyone can suggest a way forward with an analysis I am perplexed with.
CTAS is a 5-point ordinal (some could argue categorical) scale used in many emergency departments for establishing the priority by which patients should be assessed.The scale delineates 5 levels of acuity: level 1 (resuscitation), level 2 (emergent), level 3 (urgent), level 4 (less urgent) and level 5 (nonurgent).
We implemented an electronic algorithm (eCTAS) to help triage nurses assign this score. We want to see if there was a reduction in variability in CTAS scores after the implementation of eCTAS in 35 hospitals across the province. So I am interested in both within hospital variance and between hospital variance for 15 different presenting complaints (chest pain, fever, etc).
I think I need something that can assess the variance across the CTAS distribution for a given complaint, while accounting for clustering (hospital), pre and post eCTAS implementation. I am stuck wondering what statistic I could use for this.