Volume 24, Issue 1 p. 54-65

Original Article

The development and testing of PSYCHLOPS Kids: a new child-centred outcome measure

Emma Godfrey,

Emma Godfrey

Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK

Department of Physiotherapy, School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Molly Aubrey,

Molly Aubrey

Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK

Department of Physiotherapy, School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Susan Crockford,

Susan Crockford

Roundabout Dramatherapy (Registered Charity 297491), Croydon, UK

Search for more papers by this author

Deborah Haythorne,

Deborah Haythorne

Roundabout Dramatherapy (Registered Charity 297491), Croydon, UK

Search for more papers by this author

Maria Kordowicz,

Maria Kordowicz

School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Mark Ashworth,

Corresponding Author

Mark Ashworth

[email protected]

School of Population Health and Environmental Sciences, King's College London, London, UK

Correspondence

Mark Ashworth, School of Population Health and Environmental Sciences, King's College London, Guy's Campus, Addison House, London, SE1 1UL, UK. Email: [email protected]

Search for more papers by this author

Emma Godfrey,

Emma Godfrey

Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK

Department of Physiotherapy, School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Molly Aubrey,

Molly Aubrey

Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK

Department of Physiotherapy, School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Susan Crockford,

Susan Crockford

Roundabout Dramatherapy (Registered Charity 297491), Croydon, UK

Search for more papers by this author

Deborah Haythorne,

Deborah Haythorne

Roundabout Dramatherapy (Registered Charity 297491), Croydon, UK

Search for more papers by this author

Maria Kordowicz,

Maria Kordowicz

School of Population Health and Environmental Sciences, King's College London, London, UK

Search for more papers by this author

Mark Ashworth,

Corresponding Author

Mark Ashworth

[email protected]

School of Population Health and Environmental Sciences, King's College London, London, UK

Correspondence

Mark Ashworth, School of Population Health and Environmental Sciences, King's College London, Guy's Campus, Addison House, London, SE1 1UL, UK. Email: [email protected]

Search for more papers by this author

First published: 24 March 2018

https://doi.org/10.1111/camh.12271

Citations: 13

Share a link

Email
Facebook
Twitter
LinkedIn
Reddit
Wechat

Abstract

Background

There are currently no client generated measures able to capture a child's perspective of the value of generic therapeutic mental health interventions. We have developed a new measure called ‘PSYCHLOPS Kids’. It measures areas of individual importance to the respondent and contains both quantitative and qualitative elements. We aimed to pilot this new outcome measure and determine its psychometric properties.

Methods

PSYCHLOPS Kids was adapted from the adult PSYCHLOPS questionnaire, a validated and reliable client-generated measure used in primary care mental health. Development of PSYCHLOPS Kids involved an expert group, pilot testing with dramatherapists followed by psychometric testing with children receiving dramatherapy aged 7–13 years.

Results

One hundred and thirty-two children completed pre- and postintervention questionnaires. Mean initial PSYCHLOPS Kids scores (scale of 0–12) were 4.98 (SD: 3.42); mean post-therapy, 3.24 (SD: 3.03); mean effect size of change, 0.51. The Strengths and Difficulties Questionnaire (SDQ) was used as a comparator instrument completed by parent/carers of 32 children; mean effect size, 0.39. The effect size difference between both instruments was not significant (t = 1.05; p = .30); the PSYCHLOPS Kids Problem domain effect size (mean, 0.68) was significantly greater than for the SDQ (t = 2.06; p = .04). Concurrent validity was demonstrated by strong predictive power of change scores for the self-assessment of change item in PSYCHLOPS Kids; therapist-assessment of change was not a significant predictor of change scores. PSYCHLOPS Kids and SDQ change scores were not significantly correlated.

Conclusions

PSYCHLOPS Kids is the first client generated mental health outcome measure focussing on problems for generic use in children. It has demonstrated moderate responsiveness to change and satisfactory testing for measured aspects of validity and reliability. PSYCHLOPS Kids now requires further validity, reliability and qualitative testing.

References

Ashworth, M., Robinson, S., Evans, C., Shepherd, M., Conolly, A., & Rowlands, G. (2007). What does an idiographic measure (PSYCHLOPS) tell us about the spectrum of psychological issues and scores on a nomothetic measure (CORE-OM)? Primary Care and Community Psychiatry, 12, 7–16.
Web of Science®Google Scholar
Ashworth, M., Robinson, S., Godfrey, E., Shepherd, M., Evans, C., Seed, P., … & Tylee, A. (2005). Measuring mental health outcomes in primary care: The psychometric properties of a new patient-generated outcome measure, PSYCHLOPS (Psychological Outcome Profiles). Primary Care Mental Health, 3, 261–270.
Google Scholar
Ashworth, M., Shepherd, M., Christey, J., Matthews, V., Wright, K., Parmentier, H., … & Godfrey, E. (2004). A client-centred psychometric instrument: The development of ‘PSYCHLOPS’ (‘Psychological Outcome Profiles’). Counselling and Psychotherapy Research, 4, 27–33.
10.1080/14733140412331383913
Google Scholar
Cohen, J. (1977). Statistical power analysis for the behavioural sciences. New York: Academic Press.
Google Scholar
Dallos, R., & Vetere, A. (2005). Researching psychotherapy and counselling. London: Open University Press.
Google Scholar
Elliott, R., Wagner, J., Sales, C.M.D., Rodgers, B., Alves, P., & Café, M.J. (2016). Psychometrics of the Personal Questionnaire: A client-generated outcome measure. Psychological Assessment, 28, 263–278.
10.1037/pas0000174
PubMedWeb of Science®Google Scholar
Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor-Clark, J. (2003). Practice based evidence: Benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology and Psychotherapy, 10, 374–388.
10.1002/cpp.384
Web of Science®Google Scholar
Godfrey, E., & Haythorne, D. (2013). Benefits of dramatherapy for Autism Spectrum Disorder: A qualitative analysis of feedback from parents and teachers of clients attending Roundabout dramatherapy sessions in schools. Dramatherapy, 35, 20–28.
10.1080/02630672.2013.773131
Google Scholar
Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire (SDQ). Journal of the American Academy of Child and Adolescent Psychiatry, 40, 1337–1345.
10.1097/00004583-200111000-00015
CASPubMedWeb of Science®Google Scholar
Gowers, S.G., Harrington, R.C., Whitton, A., Lelliott, P., Beevor, A., Wing, J., & Jezzard, R. (1999). Brief scale for measuring the outcomes of emotional and behavioural disorders in children. Health of the Nation Outcome Scales for children and Adolescents (HoNOSCA). British Journal of Psychiatry, 174, 413–416.
10.1192/bjp.174.5.413
CASPubMedWeb of Science®Google Scholar
Green, A. (2016). Making the case for using personalised outcome measures to track progress in psychotherapy. European Journal of Psychotherapy and Counselling, 18, 39–57.
10.1080/13642537.2015.1130075
Web of Science®Google Scholar
Harty, M., & Horwitz, L. (1976). Therapeutic outcome as rated by patients, therapists, and judges. Archives of General Psychiatry, 33, 957–961.
10.1001/archpsyc.1976.01770080075007
CASPubMedWeb of Science®Google Scholar
Hedinsson, H., Kristjansdottir, H., Olason, D., & Sigurdsson, J.F. (2013). A validation and replication study of the patient-generated measure ‘PSYCHLOPS’ (Psychological Outcome Profiles) on an Icelandic clinical population. European Journal of Psychological Assessment, 29, 89–95.
10.1027/1015-5759/a000136
Web of Science®Google Scholar
Higginson, I.J., & Carr, A.C. (2001). Using quality of life measures in the clinical setting. British Medical Journal, 322, 1297–1300.
10.1136/bmj.322.7297.1297
CASPubMedWeb of Science®Google Scholar
Kazis, L., Anderson, J., & Meenan, R. (1989). Effect sizes for interpreting changes in health status. Medical Care, 27, S178–S189.
10.1097/00005650-198903001-00015
CASPubMedWeb of Science®Google Scholar
Kelly, V. (2010). Social constructions of PSYCHLOPS (Psychological Outcome Profiles) in the context of CBT for psychosis. Doctoral thesis. Available from: http://www.psychlops.org.uk/sites/default/files/socialconstructionsofpsychlops.pdf [last accessed 15 December 2017].
Google Scholar
King, G.A., McDougall, J., Palisano, R., Gritzan, J., & Tucker, M. (2009). Goal attainment scaling. Its use in evaluating pediatric therapy programs. Journal Physical and Occupational Therapy in Pediatrics, 19, 31–52.
Google Scholar
Kirk, K., & Dutton, C. (2006). “Nobody nowhere” to “somebody somewhere”: Researching the effectiveness of psychodrama with young people with Asperger's syndrome. British Journal of Psychodrama and Sociodrama, 21, 31–53.
Google Scholar
Lacasse, Y., Wong, E., & Guyatt, G. (1999). Individualising questionnaires. In: C.R.B. Joyce, C.A. O'Boyle & H. McGee (Eds.), Individual quality of life. Approaches to conceptualisation and assessment (pp. 87–103). Amsterdam, the Netherlands: Harwood Academic.
Google Scholar
Macdonald, J., & Mellor-Clark, J. (2015). Correcting psychotherapists’ blindsidedness: Formal feedback as a means of overcoming the natural limitations of therapists. Clinical Psychology and Psychotherapy, 22, 249–257.
10.1002/cpp.1887
PubMedWeb of Science®Google Scholar
Mellor-Clark, S., Mellor-Clark, J., & Macdonald, J. (2014). Tracking responses to items in measures as a means of increasing therapeutic engagement in clients: A complementary clinical approach to tracking outcomes. Clinical Psychology and Psychotherapy, 22, 698–707.
PubMedWeb of Science®Google Scholar
National Institute of Mental Health in England (2008). Mental health outcomes compendium (p. 65). London: Author.
Google Scholar
Rahman, A., Hamdani, U.S., & Awan, N.R. (2016). Effect of a multicomponent behavioral intervention in adults impaired by psychological distress in a conflict-affected area of Pakistan: A randomized clinical trial. Journal of the American Medical Association, 316, 2609–2617.
10.1001/jama.2016.17165
PubMedWeb of Science®Google Scholar
Sales, C., Neves, I., Alves, P., & Ashworth, M. (2017). Capturing and missing the patient's story through outcome measures: A thematic comparison of patient-generated items in PSYCHLOPS with CORE-OM and PHQ-9. Health Expectations, 1–5. https://doi.org/10.1111/hex.12652.
PubMedWeb of Science®Google Scholar
Twigg, E., Barkham, M., Bewick, B.M., Mulhern, B., Connell, J., & Cooper, M. (2009). The Young Person's CORE: Development of a brief outcome measure for young people. Counselling and Psychotherapy Research, 9, 160–168.
10.1080/14733140902979722
Google Scholar
Weber, A.M., & Haen, C. (2005). Clinical applications of drama therapy in child and adolescent treatment. New York and Hove: Brunner-Routledge, Taylor & Francis Group.
Google Scholar
Wolpert, M., Ford, T., Trustam, E., Law, D., Deighton, J., Flannery, H., & Fugard, A. (2012). Patient-reported outcomes in child and adolescent mental health services (CAMHS): Use of idiographic and standardized measures. Journal of Mental Health, 21, 165–173.
10.3109/09638237.2012.664304
PubMedWeb of Science®Google Scholar

Citing Literature

Volume24, Issue1

February 2019

Pages 54-65

The development and testing of PSYCHLOPS Kids: a new child-centred outcome measure

Abstract

Background

Methods

Results

Conclusions

References

Citing Literature

References

Information

RESOURCES

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

The development and testing of PSYCHLOPS Kids: a new child-centred outcome measure

Abstract

Background

Methods

Results

Conclusions

References

Citing Literature

References

Related

Information

RESOURCES