A Framework for Evaluating Systems Initiatives

Fourteen years ago, a favorable political environment and gubernatorial leadership in North Carolinaled to Smart Start, a statewide initiative that provided substantial new funding for early childhoodsystems building. Smart Start’s challenge was to use those resources effectively. In response, the statedeveloped an infrastructure that included governance structures, evaluation and research components,and technical assistance to communities based on best practices. That infrastructure, also supportedby the private sector, created a continued favorable political environment for growth and development,as it provided policymakers and leaders with confidence that systems development was both deliberateand accountable.The Center was founded on the notion that North Carolina’s deep experience and lessons learnedcould be usefully applied in other states where systems work was in an earlier stage of development.Center staff members use technical assistance, coaching, site visits, research, conferences, and otherresources to support states and share lessons. They tend to concentrate on states’ infrastructure andcapacity needs, where lessons are particularly transferable (e.g., sharing how different states havestructured their governance structures or creative ways in which to use federal or state funding streamsto support systems work).The Annie E. Casey Foundation’s Casey Strategic Consulting Group is another example of an initiativefocused on infrastructure to support human service system reform. Founded in 2001, the StrategicConsulting Group works directly and on-site with state agencies to strengthen their infrastructure forsystems, focusing on, for example, agency management, internal operations, and frontline practices.The Group has adapted private sector management consulting practices for public sector purposes,and uses a team-based approach combined with strategic analysis and rigorous research to assesssystem performance, identify gaps, and develop solutions. The Group also brings to its work theCasey Foundation’s resources in the form of funding (consulting services are free for clients selected),deep expertise on systems reform, and a respected reputation in the public sector. 21 The StrategicConsulting Group selects partners with favorable political contexts—those that show readiness for“non-incremental” change within major human service systems.5ScaleSystems initiatives focused on scale ensure that a comprehensive and quality system is available to asmany of its intended beneficiaries as possible.ActivitiesInitiatives may attempt to scale up a system by increasing system services and the numbers ofbeneficiaries served; ensuring program integrity and service quality is high enough to be consequential;and making sure systems are sustainable. 22Initiatives attempting to scale up a system usually require a high level of funding. This funding cancome from both public and private investments, but more often than not the lion’s share must comefrom public sources, especially if the goal is to scale up the system statewide.21Annie E. Casey Foundation. Casey strategic consulting. Download on June 30, 2007 from http://www.aecf.org/MajorInitiatives/CaseyStrategicConsulting.aspx.22Coburn, C. (2003). Rethinking scale: Moving beyond the numbers to deep and lasting change [Electronic version]. Educational Researcher,32 (6), 3-12.14A Framework for Evaluating Systems Initiatives