Introduction
In the realm of child social care and therapeutic interventions, it is crucial to effectively monitor and measure progress. Tools that provide reliable feedback are invaluable for practitioners, allowing them to tailor their approaches and ensure the best possible outcomes for children, young people, and their families. Among these tools, the Outcome Rating Scale (ORS) and the Child Outcome Rating Scale (CORS) stand out as practical and insightful measures. This article delves into the ORS and CORS, exploring their purpose, application, suitability, and significance as essential instruments in child social care outcomes measurement.
What are the Outcome Rating Scale (ORS) and Child Outcome Rating Scale (CORS)?
The Outcome Rating Scale (ORS) and its child-friendly adaptation, the Child Outcome Rating Scale (CORS), are brief, session-by-session feedback tools designed to capture the client’s perspective on the effectiveness of therapeutic services. These scales are not just questionnaires; they are instruments that facilitate a collaborative approach to care, ensuring that the voices of children, young people, and their caregivers are central to the therapeutic process.
The Outcome Rating Scale (ORS)
The ORS is a four-item measure that assesses key areas of well-being known to be responsive to therapeutic intervention. These domains include:
- Personal Well-being: Reflecting individual distress and overall mental health.
- Interpersonal Well-being: Gauging satisfaction and health in intimate relationships.
- Social Role Functioning: Assessing fulfillment and well-being in work, school, and broader social relationships outside the family.
- Overall Well-being: A holistic measure of general life satisfaction and functioning.
Each of these areas is represented by a 10-centimeter visual analogue scale. Respondents are asked to place a mark on each line, indicating their perception of their current state, with the left end representing a low estimate and the right end a high estimate. The language of the ORS is designed to be accessible to individuals with a 13-year-old reading level, making it suitable for adolescents and adults.
The Child Outcome Rating Scale (CORS)
Recognizing the need for a tool tailored to younger children, the Child Outcome Rating Scale (CORS) was developed for children aged 6–12. The CORS maintains the same format as the ORS but utilizes child-friendly language and incorporates smiley and frowning faces to enhance understanding and engagement for younger respondents. This adaptation ensures that even younger children can effectively express their experiences and contribute to the feedback process.
Young Child Outcome Rating Scale (YCORS)
For children aged 5 and under, the Young Child Outcome Rating Scale (YCORS) provides another avenue for engaging young children in the assessment of their well-being. While less structured in the traditional scale format, YCORS serves as a valuable tool to gather insights into the perspectives of the youngest clients.
Utilizing the ORS and CORS for Effective Child Social Care
The ORS and CORS are not merely assessment tools; they are catalysts for enhancing the therapeutic process and ensuring client-centered care. Their straightforward administration and scoring, coupled with their focus on client feedback, make them invaluable for practitioners in various settings.
Suitability and Administration
The ORS is appropriate for children and young people aged 13-18 years, as well as adults. The CORS is designed for children aged 6-12 years. Crucially, parents and caregivers can also complete the ORS or CORS to provide their perspectives on the child or young person’s well-being. This multi-perspective approach offers a more comprehensive understanding of the child’s situation.
Administering the ORS, CORS, and YCORS is designed to be simple and integrated into routine practice. These tools facilitate:
- Collaborative Practice: By actively involving children and families in evaluating progress.
- Person-Centered Care: By prioritizing the client’s perspective and experience.
- Feedback-Informed Treatment: By using collected data to adjust and refine interventions.
To maximize the benefits of these measures, practitioners are encouraged to consult available guides and resources that offer practical advice on their implementation in child and adolescent mental health settings.
Adapting to Remote Work
The adaptability of the ORS and CORS extends to remote service delivery. During periods requiring remote interactions, guidance is available to facilitate the use of these measures effectively, ensuring continuity of feedback-informed practice even when face-to-face meetings are not possible. This adaptability underscores the enduring value of these tools in evolving service delivery models.
Scoring and Interpretation of the Child Social Care Outcomes Measurement Tool
Scoring the ORS and CORS is designed to be straightforward and immediate, ideally conducted in collaboration with the child, young person, or caregiver. For paper versions, a ruler is used to measure the mark placed on each 10cm visual analogue scale. Each centimeter corresponds to a score of 1, with a maximum score of 10 per scale. The scores from the four scales are summed to obtain an overall score, with a maximum possible total score of 40.
These total scores can then be tracked over time, either through graphs or electronic databases, allowing for the monitoring of progress and trends in well-being.
Clinical Cut-Off Scores
Clinical cut-off scores provide important benchmarks for interpreting ORS and CORS scores. These cut-offs help identify individuals who may be experiencing clinically significant levels of distress or dysfunction.
- ORS Cut-offs:
- For 13–17 year olds: 28
- For 18 years and over: 25
- CORS Cut-offs:
- Child self-report: 28 or 32 (two different cut-offs have been cited in research)
- Caregiver report on child: 28
These cut-off scores serve as guidelines and should be used in conjunction with clinical judgment and other relevant information to inform decision-making.
Psychometric Properties: Validity and Reliability
The ORS and CORS are not only practical but also psychometrically sound instruments. Robust research supports their reliability and validity, essential qualities for any measurement tool used in social care and mental health.
- Internal Consistency: Studies have demonstrated high internal consistency for the ORS, indicating that the items within the scale are measuring similar constructs. Coefficient alpha estimates have been reported as high as .93 and .97.
- Test-Retest Reliability: Research indicates moderate to high test-retest reliability, suggesting that the ORS provides consistent scores over time when the underlying condition is stable.
- Concurrent Validity: The ORS shows good concurrent validity, correlating well with other established measures of outcomes, such as the Outcome Questionnaire-45.2 (OQ-45.2).
- Construct Validity: Studies support the construct validity of the ORS, demonstrating its ability to differentiate between clinical and non-clinical populations and aligning with theoretical constructs of outcome measurement.
These psychometric properties reinforce the ORS and CORS as credible and dependable tools for measuring child social care outcomes.
Accessibility and Resources
The ORS and CORS are designed to be accessible and widely available to practitioners.
Translations
Recognizing the diverse needs of global communities, the ORS and CORS have been translated into numerous languages. These translations ensure that the tools can be used effectively across different cultural and linguistic contexts. Translations can be accessed through the developer’s website.
Useful Resources and Licensing
Beyond the scales themselves, a wealth of resources is available to support practitioners in their use of the ORS and CORS. Manuals, guidelines, and supporting materials offer detailed instructions on administration, scoring, and interpretation.
For individual practitioners, a license to use the ORS, CORS, and YCORS in paper format is available free of charge. For group practices, agencies, and larger organizations, licensing information and options are available on the developer’s website. It is important to note that all use of these measures is subject to the developer’s licensing conditions, ensuring appropriate and ethical application. For use within health and social care systems in the UK, licenses can be obtained through NHS Digital.
Conclusion
The Outcome Rating Scale (ORS) and Child Outcome Rating Scale (CORS) represent invaluable tools for professionals dedicated to enhancing child social care outcomes. Their simplicity, focus on client feedback, and strong psychometric properties make them essential components of feedback-informed practice. By integrating these Child Social Care Outcomes Measurement Tools into routine care, practitioners can ensure they are truly hearing and responding to the voices of children, young people, and their families, ultimately leading to more effective and meaningful support.
References
1 Duncan, B. L., Sparks, J., Miller, S. D., Bohanske, R., & Claud, D. (2006). Giving youth a voice: A preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. Journal of Brief Therapy, 5, 66- 82.
2 Miller, S. (2012). ORS/CORS Reliable Change Chart. https://scottdmiller.com/wp-content/uploads/2016/09/ORS-Reliable-Change-Chart-Color.pdf
3 Duncan, B. & Sparks, J. (2017). The Partners for Change Outcome Management System. In: Lebow, J., Chambers, A., Breunlin, D. (eds) Encyclopedia of Couple and Family Therapy. Springer, Cham.
4 Duncan, B. (2017). The Ominous Clinical Cutoff and Data Accuracy. https://blog.betteroutcomesnow.com/2017/09/15/the-ominous-clinical-cutoff-and-data-accuracy
Anker, M.G., Duncan, B.L., & Sparks, J.A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 692-704.
Duncan, B. L., Sparks, J., Miller, S. D., Bohanske, R., & Claud, D. (2006). Giving youth a voice: A preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. Journal of Brief Therapy, 5, 66- 82.
Miller, S. D., Duncan, B. L., Brown, J., Sorrel, R., & Chalk, B. (2006). Using outcome to inform and improve treatment outcomes. Journal of Brief Therapy, 5, 5-22.
Bringhurst, D. L., Watson, C. W., Miller, S. D., Duncan, B. L., (2006). The reliability and validity of the Outcome Rating Scale: a replication study of a brief clinical measure. Journal of Brief Therapy, 5, 23–30.
Duncan, B. L., Miller, S. D., Sparks, J., Claud, D., Reynolds, L., Brown, J., Johnson, L., (2003). The Session Rating Scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 3–12.
Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91-100.
Reese, R. J., Norsworthy, L., & Rowlands, S. (2009a). Does a continuous feedback Version 17/01/12 27 system improve psychotherapy outcomes? Psychotherapy, 46, 418-431.
Reese, R. J., Usher, E., Bowman, D., Norsworthy, L., Halstead, J., Rowlands, S., & Chisholm, R. R. (2009b). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and education in Professional Psychology, 3(3), 157-168.
Casey, P., Patalay, P., Deighton, J., Miller, S. D., & Wolpert, M. (2019). The Child Outcome Rating Scale: validating a four-item measure of psychosocial functioning in community and clinic samples of children aged 10–15. European Child & Adolescent Psychiatry, 29(8), 1089–1102.
