Towards a Metrics Implementation Plan - UCAR Finance ...

its particular goal. We advise the MDTs to pay particular attention to the five “GeneralMetrics for the CCSP,” 6 which are Process, Input, Output, Outcome, and Impact Metrics.• After developing the draft metrics, each MDT will oversee a formal review of the draftmetrics by other stakeholders familiar with activities relevant to its strategic plan goal. Thereview committee(s) for each MDT should be directly charged with watching for the pitfallsoutlined under “caveats” in the UCAR Metrics Committee Report and under “Characteristicsof Good Metrics” in the NRC document. We advise the MDTs to consider includingstakeholders from outside UCAR in this process, possibly including representatives fromUCAR member universities or other entities closely affiliated with UCAR.• Once the stakeholders have reviewed the draft metrics, each MDT will submit them to theMIC for review and comment. Included with this submission should be the intended audiencefor each draft metric and preliminary information on the difficulty and cost, among otherfactors, of computing each metric.• Once the draft metrics are reviewed and accepted by the MIC, the MDTs should complete afirst pass computation of all approved metrics and submit the results to the MIC with detailedplans for implementing each metric for the long term. (Note that computation of somemetrics may require resources beyond those available to the MDTs. In this case the MIC willallocate the resources necessary to complete this computation.) Included with this submissionshould be information on the frequency with which the metric should be calculated,estimated resources and costs of maintaining the metric over the long term, and insights intothe ways in which the metric may have to change in future to remain useful.Step 6: MIP Internal ReviewOnce each of the MDTs completes their work, the MIC will compile the seven MDT productsinto a coordinated and integrated MIP. The MDTs may need to revise their products based oninput from the MIC.Step 7: UCAR/NCAR/UOP Management Adoption of MIPUCAR/NCAR/UOPOnce the MIC completed the integrated MIP, the committee will submit the document toUCAR/NCAR/UOP management for review and comment. UCAR management may providefeedback requiring sufficient revision and thus some iteration of prior steps in the MIPdevelopment process. Once the MIP has been completed to the satisfaction of UCARmanagement, it will be accepted as an internal document and sent for more formal externalreview.6 NRC document, Executive Summary, pages 6–714