STRATEGIC PLAN - ASPE - U.S. Department of Health and Human ...

Appendix a: program evaluation effortsHHS Program Evaluation EffortsEvaluations play an integral role in carrying out theHHS mission. Evaluation assesses the efficiency, effectiveness,and responsiveness of the Department’sprograms or strategies through the analysis of data orinformation collected scientifically. It also ensures theeffective use of resulting information in strategic planning,program or policy decisionmaking, and programimprovement.HHS evaluation planning activities are coordinatedwith Departmentwide planning initiatives. HHS evaluationactivities support the Department’s strategicplanning and performance management activitiesin several ways. Completed evaluation studies helpprograms determine the means and strategies they willuse to achieve HHS strategic goals and objectives. Programevaluations also may identify data that programscan use to measure performance. A sample of currentevaluations is listed in Table A-1. Also listed are futureevaluations that will inform strategic planning. HHSdivisions use findings from their evaluations to supportthe Government Performance and Results Act (GPRA)of 1993 (Public Law 103-62) annual performance reportingto the U.S. Congress and program budget justificationsof various HHS programs. Evaluation findingsprovide important sources of information and evidenceabout the success of policies and programs.Typically, HHS evaluation priorities include congressionallymandated program evaluations, evaluations ofSecretarial program or policy initiatives, assessmentsof new programs, evaluations of programs that arecandidates for reauthorization, and reviews of programperformance that support management decisionmakingand accountability.The U.S. Congress requests that HHS coordinate all ofits Research, Demonstration, and Evaluation (RD&E)programs to ensure that the results of these projects addressHHS program goals and objectives. HHS reportsto the Congress annually on RD&E activities. The AssistantSecretary for Planning and Evaluation (ASPE) andthe Assistant Secretary for Resources and Technology(ASRT) work together with HHS divisions to providethe Congress with a special annual research, demonstration,and evaluation budget plan that coincideswith the preparation of the President’s fiscal year budget.The plan outlines HHS RD&E priorities as relatedto the Department’s strategic goals and objectives.Evaluation OversightHHS divisions and ASPE execute annual evaluationplans that involve developing evaluation contractsand disseminating and applying evaluation results. Alldivisions and their subunits (centers, institutes, andbureaus) coordinate with each other on research andevaluation project planning and release of final reportsthat relate to work of other HHS divisions. Althoughthere is some oversight responsibility and executioncapability in the Office of the Director or Administratorfor each division, the various subunits conduct much ofthe day-to-day evaluation activity.The Office of Inspector General (OIG) performs independentevaluations, also called inspections. The OIGmission includes providing HHS, the U.S. Congress, andthe public with evaluations that focus on preventingfraud, waste, or abuse; promoting economy, efficiency,and effectiveness in Departmental programs; andpresenting practical recommendations for improvingprogram operations. XLIQuality Assurance and ImprovementMost evaluation projects are developed at the programor office level. A committee of division- or office-levelpolicy and planning staff members generally conductsthe initial quality review. Before a project is approved, asecond committee reviews it for technical quality withexpertise in evaluation methodology. Technical reviewcommittees follow a set of criteria for quality evaluationpractice established by each division. ASPE, forexample, has a formalized peer review process in whichexperienced evaluators on staff review, discuss, andapprove all proposed research projects before they aresubmitted for funding. Some HHS divisions have externalevaluation review committees composed of evaluationexperts from universities and research centers.HHS uses a variety of program evaluation techniquesto review the effectiveness of programs and to ensurethat programs are on target so that HHS can meet itsstrategic goals. Comprehensive, independent evaluationsare an important component of the HHS strategyto improve overall program effectiveness and to ensurethat the goals identified in the Strategic Plan accuratelyrepresent HHS’s progress in achieving its goals. Theseevaluations are an important component in evaluatingwhether or not programs are effective, well designed,and well managed.HHS Strategic Plan FY 2007-2012139