Evaluation Findings - SAMHSA Store - Substance Abuse and Mental ...

In addition, at the request of SAMHSA, the
national evaluation developed the
Continuous Quality Improvement (CQI)
Progress Reports, to document program
performance at the community and national
levels, and to assist communities in
furthering program goals of continuous
quality improvement. The first reports were
produced in 2006. Program performance
addressed in these reports includes (a)
system-level outcomes, (b) child and family
outcomes, (c) satisfaction with services, (d)
family and youth involvement, and (e)
cultural and linguistic competence. These
indicators, which capture performance in
areas such as service access, school
performance, suicide attempts, youth arrests,
caregiver employment, satisfaction with
services, and provider cultural and linguistic
competence, align with SAMHSA’s
National Outcome Measures (otherwise
known as NOMs). The indicators assessed
through the CQI process and an aggregate
CQI report that uses longitudinal outcomes
data collected as part of the national
evaluation of grant communities initially
funded in 2002–2004 are included in
Appendix C.
About This Report
This report to Congress summarizes
information about the systems of care
developed through the CMHI, including the
following: the characteristics of children,
youth, and families served by systems of
care; the outcomes attained for children,
youth, and families; their service use and
service experience; how well communities
have implemented system of care principles;
the cost savings and economic benefits; how
well communities have implemented
evidence-based practices, how culturally and
linguistically competent the services are,
how well systems of care integrate data and
technology, and the sustainability of systems
of care.
The report presents the combined evaluation
findings from the 81 communities initially
funded in FY 1999 through FY 2006. The
findings are from three phases of the
evaluation: communities:
Phase III: Initially funded in FY 1999–FY
2000 (22 sites)
Phase IV: Initially funded in FY 2002–FY
2004 (29 sites)
Phase V: Initially funded in FY 2005–FY
2006 (30 sites)
All findings presented in the report are
based upon all available data for the
combined phases. In some instances, data
were not available from all three phases, and
instruments sometimes changed from one
phase to another. In each outcome area, the
report indicates whether data were derived
from the entire sample of 81 communities or
from a subgroup of communities; the
instruments used to derive data also are
noted throughout the report. Descriptive data
were collected from 28,423 children
enrolled in these CMHI grant communities.
Longitudinal data were collected from 9,952
caregivers and 6,392 youth aged 11 years
and older. The longitudinal data were
collected every 6 months for up to 36
months following intake into services.
Sources of data used for the report include
the following:
Descriptive data (e.g., demographic
information, diagnosis, child and family
history, functional characteristics, and
referral sources) obtained at the time
The Comprehensive Community Mental Health Services for Children and Their Families Program Evaluation Findings
2006–2008 Annual Report to Congress ● Page 7