Screening Efficiency of the Child Behavior Checklist and Strengths and Difficulties Questionnaire: A Systematic Review
Erin M. Warnick,
Michael B. Bracken,
Stanislav Kasl,
Erin M. Warnick
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Child Study Center, Yale University, USA.
Search for more papers by this authorMichael B. Bracken
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Center for Perinatal, Pediatric and Environmental Epidemiology, Yale University, USA
Search for more papers by this authorStanislav Kasl
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Search for more papers by this authorErin M. Warnick,
Michael B. Bracken,
Stanislav Kasl,
Erin M. Warnick
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Child Study Center, Yale University, USA.
Search for more papers by this authorMichael B. Bracken
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Center for Perinatal, Pediatric and Environmental Epidemiology, Yale University, USA
Search for more papers by this authorStanislav Kasl
Department of Epidemiology and Public Health, Yale University, USA. E-mail: [email protected]
Search for more papers by this authorAbstract
Objective: Assess the screening efficiency of the caretaker-report CBCL and SDQ in community and clinical samples using published data.
Methods: PyschInfo, Medline, and EMBASE were systematically searched to identify studies with appropriate efficiency data. Estimates of sensitivity and specificity were extracted from identified studies and used to generate summary likelihood ratio estimates on which the scales were compared. Summary estimates of sensitivity and specificity were calculated with respect to a ‘true’ diagnosis to compare scales.
Results: A total of 29 and 3 studies met inclusion criteria for CBCL and SDQ respectively. Summary estimates of the likelihood ratios for domains assessed by CBCL ranged from 3.86 (2.23, 6.69) to 4.87 (2.90, 8.18); and for SDQ from 5.02 (1.61, 15.63) to 8.32 (2.72, 25.48). Heterogeneity was low. For total problems, the SDQ caretaker-report was found to be most specific (0.93, 95% CI 0.92, 0.94) and the CBCL caretaker-report to be most sensitive (0.66, 95%CI 0.60, 0.73).
Conclusions: This meta-analysis supports continued use of the CBCL and SDQ via caretaker-report in clinical and community samples. Additional research is required to determine if there is a true difference in efficiency between the two scales.
References
- Achenbach, T. M. (1991). Manual for Child Behavior Checklist/4–18 and 1991 Profile. Burlington, VT: University of Vermont, Department of Psychiatry.
- Achenbach T. M., & Rescorla, L. (2001). Manual for the ASEBA School-Age Forms & Profiles: An Integrated System of Multi-informant Assessment. Burlington, VT: University of Vermont, Research Center for Children, Youth & Families.
- Aschenbrand, S. G., Angelosante, A. G., & Kendall, P. C. (2005). Discriminant validity and clinical utility of the CBCL with anxiety-disordered youth. Journal of Clinical Child and Adolescent Psychology, 34, 735–746.
- Bird H. R., Canino, G., Gould, M. S., Ribera, J., Rubio-Stipec, M., Woodbury, M. A., Huertas-Goldman, S., & Sesman, M. (1987). Use of the Child Behavior Checklist as a screening instrument for epidemiological research in child psychiatry: Results of a pilot study. Journal of the American Academy of Child & Adolescent Psychiatry, 26, 207–213.
- Bird, H. R., Gould, M. S., Rubio-Stipec, M., Staghezza, B. M., & Canino, G. (1991). Screening for childhood psychopathology in the community using the Child Behavior Checklist. Journal of the American Academy of Child & Adolescent Psychiatry, 30, 116–123.
- Canning, E. H., & Kelleher, K. (1994). Performance of screening tools for mental health problems in chronically ill children. Archives of Pediatrics & Adolescent Medicine, 148, 272–278.
- Chen, W. J., Faraone, S. V., Biederman, J., & Tsuang, M. T. (1994). Diagnostic accuracy of the Child Behavior Checklist scales for attention-deficit hyperactivity disorder: A receiver-operating characteristic analysis. Journal of Consulting & Clinical Psychology, 62, 1017–1025.
- Cochrane Methods Group on Systematic Review of Screening and Diagnostic Tests (1996). Recommended Methods. Vol. 2005: The Cochrane Collaboration.
- Costello, E. J., & Benjamin, R. (1989). Epidemiology and child diagnosis. In: C. G. Last, & M. Hersen, (Eds), Handbook of child psychiatric diagnosis Wiley series on personality processes. Oxford,England: John Wiley & Sons.
- Costello, E. J., Edelbrock, C. S., & Costello, A. J. (1985). Validity of the NIMH Diagnostic Interview Schedule for Children: A comparison between psychiatric and pediatric referrals. Journal of Abnormal Child Psychology, 579–595.
- Deeks, J., Higgins, J., & Altman, D. (2005). Analysing and presenting results. In: J. Higgins & S. Green (Eds), Cochrane Handbook for Systematic Reviews of Interventions 4.2.5. Chichester, UK: John Wiley & Sons, Ltd.
- Deeks, J. J. (2001). Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. British Medical Journal, 323, 157–62.
- Derks, E. M., Hudziak, J. J., Dolan, C. V., Ferdinand, R. F., & Boomsma, D. I. (2006). The relations between DISC-IV DSM diagnoses of ADHD and multi-informant CBCL-AP syndrome scores. Comprehensive Psychiatry, 47, 116–122.
- Dickey, W. C., & Blumberg, S. J. (2004). Revisiting the Factor Structure of the Strengths and Difficulties Questionnaire: United States, 2001. Journal of the American Academy of Child & Adolescent Psychiatry, 43, 1159–1167.
- Doyle, A., Ostrander, R., Skare, S., Crosby, R. D., & August, G. J. (1997). Convergent and criterion-related validity of the Behavior Assessment System for Children-Parent Rating Scale. Journal of Clinical Child Psychology, 26, 276–284.
- Egger, H. L., Erkanli, A., Keeler, G., Potts, E., Walter, B. K., & Angold, A. (2006). Test-Retest Reliability of the Preschool Age Psychiatric Assessment (PAPA). Journal of the American Academy of Child & Adolescent Psychiatry, 45, 538–549.
- Eiraldi, R. B., Power, T. J., Karustis, J. L., & Goldstein, S. G. (2000). Assessing ADHD and comorbid disorders in children: The Child Behavior Checklist and the Devereux Scales of Mental Disorders. Journal of Clinical Child Psychology, 29, 3–16.
- Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology & Psychiatry & Allied Disciplines, 38, 581–586.
- Goodman, R. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337–1345.
- Gould, M. S., Bird, H., & Staghezza-Jaramillo, B. (1993). Correspondence between statistically derived behavior problem syndromes and child psychiatric diagnoses in a community sample. Journal of Abnormal Child Psychology, 21, 287–313.
- Harris, E. S., Canning, R. D., & Kelleher, K. J. (1996). A comparison of measures of adjustment, symptoms, and impairment among children with chronic medical conditions. Journal of the American Academy of Child & Adolescent Psychiatry, 35, 1025–32.
- Hawes, D. J., & Dadds, M. R. (2004). Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Australian & New Zealand Journal of Psychiatry, 38, 644–651.
- Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560.
- Hudziak, J. J., Copeland, W., Stanger, C., & Wadsworth, M. (2004). Screening for DSM-IV externalizing disorders with the Child Behavior Checklist: A receiver-operating characteristic analysis. Journal of Child Psychology & Psychiatry, 45, 1299–1307.
- Jensen, A. L., & Weisz, J. R. (2002). Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents. Journal of Consulting & Clinical Psychology, 70, 158–168.
- Jensen, P. S., Salzberg, A. D., Richters, J. E., & Watanabe, H. K. (1993). Scales, diagnoses, and child psychopathology: I. CBCL and DISC relationships. Journal of the American Academy of Child & Adolescent Psychiatry, 32, 397–406.
- Jensen, P. S., & Watanabe, H. (1999). Sherlock Holmes and child psychopathology assessment approaches: The case of the false-positive. Journal of the American Academy of Child & Adolescent Psychiatry, 38, 138–146.
- Jensen, P. S., Watanabe, H. K., Richters, J. E., Roper, M., Hibbs, E. D., Salzberg, A. D., & Liu, S. (1996). Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. Journal of Abnormal Child Psychology, 24, 151–168.
- Kasius, M. C., Ferdinand, R. F., Van den Berg, H., & Verhulst, F. C. (1997). Associations between different diagnostic approaches for child and adolescent psychopathology. Journal of Child Psychology & Psychiatry, 38, 625–632.
- Kazdin, A. E., & Heidish, I. E. (1984). Convergence of clinically derived diagnoses and parent checklists among inpatient children. Journal of Abnormal Child Psychology, 12, 421–435.
- Kim, J. W., Park, K. H., Cheon, K. A., Kim, B. N., Cho, S. C., & Hong, K. E. (2005). The child behavior checklist together with the ADHD rating scale can diagnose ADHD in Korean community-based samples. Canadian Journal of Psychiatry - Revue Canadienne de Psychiatrie, 50, 802–805.
- Krol, N. P., De Bruyn, E. E., Coolen, J. C., & Van Aarle E. J. (2006). From CBCL to DSM:A Comparison of Two Methods to Screen for DSM-IV Diagnoses Using CBCL Data. Journal of Clinical Child and Adolescent Psychology, 35, 127–135.
- Lampert, T., Polanczyk, G., Tramontina, S., Mardini, V., & Rohde, L. (2004). Diagnostic performance of the CBCL-Attention Problem Scale as a screening measure in a sample of Brazilian children with ADHD. Journal of Attention Disorders, 8, 63–71.
- Lengua, L. J., Sadowski, C. A., Friedrich, W. N., & Fisher, J. (2001). Rationally and empirically derived dimensions of children's symptomatology: Expert ratings and confirmatory factor analyses of the CBCL. Journal of Consulting & Clinical Psychology, 69, 683–698.
- Lewczyk, C. M., Garland, A. F., Hurlburt, M. S., Gearity, J., & Hough, R. L. (2003). Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 349–356.
- Mullick, M. S. I., & Goodman, R. (2001). Questionnaire screening for mental health problems in Bangladeshi children: A preliminary study. Social Psychiatry & Psychiatric Epidemiology, 36, 94–99.
- Nolan, T. M., Bond, L., Adler, R., Littlefield, L., Birleson, P., Marriage, K., Mawdsley, A., Salo, R., & Tonge, B. J. (1996). Child Behaviour Checklist classification of behaviour disorder. Journal of Paediatrics & Child Health, 32, 405–11.
- Noterdaeme, M., & Amorosa, H. (1999). Evaluation of emotional and behavioral problems in language impaired children using the Child Behavior Checklist. European Child & Adolescent Psychiatry, 8, 71–77.
- Pickles, A. (1998). Psychiatric epidemiology. Statistical Methods in Medical Research, 7, 235–251.
- Schmeck, K., Poustka, F., Dopfner, M., Pluck, J., Berner, W., Lehmkuhl, G., Fegert. J. M., Lenz, K., Huss, M., & Lehmkuhl, U. (2001). Discriminant validity of the Child Behavior Checklist CBCL-4/18 in German samples. European Child & Adolescent Psychiatry, 10, 240–247.
- Steingard, R., Biederman, J., Doyle, A., & Sprich-Buckminster, S. (1992). Psychiatric comorbidity in attention deficit disorder: Impact on the interpretation of Child Behavior Checklist results. Journal of the American Academy of Child & Adolescent Psychiatry, 31, 449–454.
- The Cochrane Collaboration (2002). The Cochrane Collaboration open learning material. Vol 2005: The Cochrane Collaboration.
- The Cochrane Collaboration (2004). RevMan. 4.2.7 edition: Cochrane Collaboration.
- Tripp, G., Schaughency, E. A., & Clarke, B. (2006). Parent and Teacher Rating Scales in the Evaluation of Attention-deficit Hyperactivity Disorder: Contribution to Diagnosis and Differential Diagnosis in Clinically Referred Children. Journal of Developmental & Behavioral Pediatrics, 27, 209–218.
-
Verhulst, F. C.,
Berden, G. F., & Sanders-Woudstra, J. A. (1985). Mental health in Dutch children: II. The prevalence of psychiatric disorder and relationship between measures.
Acta Psychiatrica Scandinavica, 345, 1–45.
10.1111/j.1600-0447.1985.tb10513.x Google Scholar
- Verhulst, F. C., Van Der Ende, J., Ferdinand, R. F., & Kasius, M. C. (1997). The prevalence of DSM-III-R diagnoses in a national sample of Dutch adolescents. Archives of General Psychiatry, 54, 329–336.
-
Warner, J. (2004). Clinicians’ guide to evaluating diagnostic and screening tests in psychiatry.
Advances in Psychiatric Treatment, 10, 446–454.
10.1192/apt.10.6.446 Google Scholar
- Wassenberg, R., Max, J. E., Koele, S. L., & Firme, K. (2004). Classifying psychiatric disorders after traumatic brain injury and orthopaedic injury in children: Adequacy of K-SADS versus CBCL. Brain Injury, 18, 377–390.
- Weissman, M. M., Pilowsky, D. J., Wickramaratne, P. J., Talati, A., Wisniewski, S. R., Fava, M., Hughes, C. W., Garber, J., Malloy, E., King, C. A., Cerda, G., Sood, A., Alpert, J. E., Trivedi, M. H., & Rush, A. (2006). Remissions in Maternal Depression and Child Psychopathology: A STAR*D-Child Report. Journal of the American Medical Association, 295, 1389–1398.
- Youth in Mind (2005). SDQ: Information for researchers and professionals about the Strengths & Difficulties Questionnaires. http://www.sdqinfo.com Acessed 16th March 2005.
-
Zhou, X. H.,
Obuchowski, N. A., & McClish, D. K. (2002). Statistical Methods in Diagnostic Medicine. New York, NY: John Wiley & Sons.
10.1002/9780470317082 Google Scholar
Citing Literature
September 2008
Pages 140-147
