Preface / Ray C. Rist -- Introduction / Markus Palenberg and Arne Paulson -- The results paradox in Norwegian development assistance / Ida Lindkvist and Per Øyvind Bastøe -- Behind the scenes of the French evidence-based policy movement : rise and fall of an RCT-driven model of evidence / Agathe Devaux-Spatarakis -- Influencing the supply of and demand for results information in government. Can outsiders help? A case study from Ireland / Richard Boyle -- Evaluation one step removed : the government/not for profit performance nexus / David Gilchrist and Peter Wilkins -- The role of an intermediary organization in a large evaluation : the case of the Norwegian health care reform / Olaf Rieper -- Evaluation plans in the EU cohesion policy : redefining the relation between the demand for and the supply of evaluation / Francesco Mazzeo Rinaldi -- Assessing the contribution of research to improved policy and practice : an evaluation of CIFOR's climate change research / Brian Belcher, John Young and Daniel Suryadarma -- Mind the gaps : integrating human rights and sustainable development goals into evaluation practice / Pearl Eliadis -- Mending the theory gap in evaluation : moving toward theory knitting / Sebastian Lemire, Christina Christie and Steffen Bohni Nielsen -- Realistic commissioning of impact evaluations : getting what you ask for? / John Mayne -- Realpolitik of demand and supply regarding results information / R. Pablo Guerrero.
Zugriffsoptionen:
Die folgenden Links führen aus den jeweiligen lokalen Bibliotheken zum Volltext:
Research and policy processes in many fields, such as sustainability and health, are increasingly relying on transdisciplinary cooperation among a multitude of governmental, nongovernmental, and private actors from local to global levels. In the absence of hierarchical chains of command, multistakeholder governance may accommodate conflicting or diverse interests and facilitate collective action, but its effectiveness depends on its capacity to integrate systems, transformation, and target knowledge. Approaches to foster such governance are nascent and quickly evolving, and methodological standards to facilitate comparison and learning from best practice are needed. However, there is currently no evaluation approach that (i) comprehensively assesses the capacity for knowledge integration in multistakeholder governance, (ii) draws on the best available knowledge that is being developed in various fields, and (iii) combines a systematic and transferable methodological design with pragmatic feasibility. We brought together 20 experts from institutions in nine countries, all working on evaluation approaches for collaborative science–policy initiatives. In a synthesis process that included a 2-day workshop and follow-up work among a core group of participants, we developed a tool for evaluating knowledge integration capacity in multistakeholder governance (EVOLvINC). Its 23 indicators incorporate previously defined criteria and components of transdisciplinary evaluations into a single, comprehensive framework that operationalizes the capacity for integrating systems, target, and transformation knowledge during an initiative's (a) design and planning processes at the policy formulation stage, (b) organization and working processes at the implementation stage, and (c) sharing and learning processes at the evaluation stage of the policy cycle. EVOLvINC is (i) implemented through a questionnaire, (ii) builds on established indicators where possible, (iii) offers a consistent and transparent semiquantitative scoring and aggregation algorithm, and (iv) uses spider diagrams for visualizing results. The tool builds on experience and expertise from both the northern and southern hemispheres and was empirically validated with seven science–policy initiatives in six African and Asian countries. As a generalized framework, EVOLvINC thus enables a structured reflection on the capacity of multistakeholder governance processes to foster knowledge integration. Its emphasis on dialog and exploration allows adaptation to contextual specificities, highlights relative strengths and weaknesses, and suggests avenues for shaping multistakeholder governance toward mutual learning, capacity building, and strengthened networks. The validation suggests that the adaptive capacity of multistakeholder governance could be best enhanced by considering systems characteristics at the policy formulation stage and fostering adaptive and generic learning at the evaluation stage of the policy cycle. ; ISSN:1708-3087
This article is based upon work from COST Action (TD 1404, Network for Evaluation of One Health, NEOH), supported by COST (European Cooperation on Science and Technology), and the State Secretariat for Education, Research and Innovation via the Swiss National Science Foundation (grant IZCNZ0-174587). ; Research and policy processes in many fields, such as sustainability and health, are increasingly relying on transdisciplinary cooperation among a multitude of governmental, nongovernmental, and private actors from local to global levels. In the absence of hierarchical chains of command, multistakeholder governance may accommodate conflicting or diverse interests and facilitate collective action, but its effectiveness depends on its capacity to integrate systems, transformation, and target knowledge. Approaches to foster such governance are nascent and quickly evolving, and methodological standards to facilitate comparison and learning from best practice are needed. However, there is currently no evaluation approach that (i) comprehensively assesses the capacity for knowledge integration in multistakeholder governance, (ii) draws on the best available knowledge that is being developed in various fields, and (iii) combines a systematic and transferable methodological design with pragmatic feasibility. We brought together 20 experts from institutions in nine countries, all working on evaluation approaches for collaborative science– policy initiatives. In a synthesis process that included a 2-day workshop and follow-up work among a core group of participants, we developed a tool for evaluating knowledge integration capacity in multistakeholder governance (EVOLvINC). Its 23 indicators incorporate previously defined criteria and components of transdisciplinary evaluations into a single, comprehensive framework that operationalizes the capacity for integrating systems, target, and transformation knowledge during an initiative's (a) design and planning processes at the policy formulation stage, (b) organization and working processes at the implementation stage, and (c) sharing and learning processes at the evaluation stage of the policy cycle. EVOLvINC is (i) implemented through a questionnaire, (ii) builds on established indicators where possible, (iii) offers a consistent and transparent semiquantitative scoring and aggregation algorithm, and (iv) uses spider diagrams for visualizing results. The tool builds on experience and expertise from both the northern and southern hemispheres and was empirically validated with seven science–policy initiatives in six African and Asian countries. As a generalized framework, EVOLvINC thus enables a structured reflection on the capacity of multistakeholder governance processes to foster knowledge integration. Its emphasis on dialog and exploration allows adaptation to contextual specificities, highlights relative strengths and weaknesses, and suggests avenues for shaping multistakeholder governance toward mutual learning, capacity building, and strengthened networks. The validation suggests that the adaptive capacity of multistakeholder governance could be best enhanced by considering systems characteristics at the policy formulation stage and fostering adaptive and generic learning at the evaluation stage of the policy cycle. ; publishersversion ; published
