Review of International Research for Development Indicators
International research for development aims to generate useful knowledge to address complex social problems. Such contributions are difficult and expensive to measure directly. Research effectiveness is typically indicated by the number of publications or citations in peer-reviewed journals. Many evaluating bodies – including funders –rely on traditional indicators that are inadequate to capture the diverse societal contributions of research for development. Therefore, we need appropriate indicators and indicator systems that effectively aggregate useful data to track progress and promote good practice.
Guiding question: What are the principles for designing indicators for assessing progress and effectiveness in use-inspired research?
Purpose: To guide the development and use of progress indicators in research-for-development, transdisciplinary and other use-inspired research.
Method: We reviewed the quality of a sample of bilateral project-level output, outcome, and impact indicators, as well as a standard indicator system. The objective was to assess the extent to which the indicators were specific, measurable, achievable, relevant, and time-bound, and how well the indicator system aligned thematically with the bilateral project indicators so that reporting could be streamlined.
Result: Not all indicators of research outputs, outcomes and impacts that are currently used are specific, measurable, achievable, relevant, and/or time-bound, which makes them difficult to apply. Furthermore, indicator systems that use standard indicators do not always function to aggregate data at the project level consistently, with several common errors. We offer recommendations for improved indicator design.
Read the full peer-reviewed publication:
Belcher, B. M., Claus, R., Davel, R. & Place, F. (2024). Indicators for Monitoring and Evaluating Research-for-Development: A critical review of a system in use. Environmental and Sustainability Indicators, 100526.
Read the full reports:
CGIAR Standard Indicators Review Report
CGIAR Non-Pooled Indicators Review Report