Center for Evaluation and Implementation Resources

Veterans Health Administration, Decatur PA

Investigators

Abstract

Justification (include hypothesis): The Foundations for Evidence-Based Policymaking Act of 2018 mandated implementation of federal evidence-building activities. Since enactment, there has been a growing demand for training in best practices and guide materials to conduct evaluations of VA programs consistent with VA Evidence Act requirements. The Center for Evaluation and Implementation Resources (CEIR) will focus on the use of program evaluation best practices in everyday VA care settings, positioning CEIR to serve as the QUERI Evaluation Coordinating Center in support of VA field-based needs related to the Evidence Act. Gaps Addressed (Knowledge and Practices): CEIR will develop VA training opportunities in program evaluation skills and best practices to facilitate the development of internal operational program evaluation capacity, promote and coordinate rapid evaluation mechanisms, provide consultation on project methods and key resources, and collaborate with PEPReC to meet the needs of VHA leaders and workgroups. Innovativeness: CEIR promotes innovation by consolidating services to expand VA capacities related to program evaluation and implementation science. By coordinating services related to these areas within one center, program evaluation and practice dissemination can be standardized, assessed, and coordinated and opportunities for improvement more easily identified. Through these efforts, VA will develop more rapid, flexible evaluation capacity and broader staff competency in rapid program evaluations and rapid implementation of new programs into standard clinical care. Specific Aims: Aim 1) Expand VA’s capacity to conduct rapid program evaluations designed to address areas of operational priority by coordinating the application, review, selection, and reporting processes for rapid evaluation mechanisms (i.e., QUERI Rapid Response Teams, HSRD Researchers and Evaluators in Residence); Aim 2) Develop trainings which allow for the development VA competence in program evaluation and implementation science best practices; Aim 3) Provide consultation on national strategic decisions intended to support activities consistent with Evidence Act goals; Aim 4) Effectively coordinate with QUERI leadership and PEPReC to support the time-sensitive evaluation needs of VA and VHA leaders and workgroups. Project Methods: CEIR's activities will be informed by best-practice resources such as the QUERI Implementation Roadmap, the QUERI Program Evaluation Guide, and legislation such as the Evidence Act. For Aim 1, an Operations Core lead will oversee the management of ORD rapid evaluation mechanisms (i.e., submissions, review and selection, allocation of awards, and reporting) and the creation of REDCap databases for submission tracking. A Learning Core lead will manage the development of evaluation and implementation science trainings and resources for Aim 2 such as TMS trainings, slide decks, evaluation and implementation guides, and community of practice calls to support skill development. Aim 3 will be accomplished by a team lead by a Partnership Core lead with experience in VHA operations, evaluation, and clinical research and will include targeted assessment and outreach efforts to ensure that consultation services are available to all interested VA personnel. Aim 4 will be supported by work efforts that span the CEIR cores and are facilitated by regular workgroup meetings with QUERI and PEPReC leadership. Description of Primary Outcomes/Endpoints: CEIR's impacts will be demonstrated through the growth and expansion of the number of projects supported via ORD rapid evaluation mechanisms; through the growth of program evaluation learning communities and expanded learning opportunities for skill development (e.g., Program Evaluation Boot Camp, "Implementation 101" slide set, Qualitative Methods Learning Collaborative); through the development and adoption of standardized approaches to structure, carry out, and apply the results of evaluations within VA; and through the development and consolidation of best-practice resources related to program evaluation and implementation.