Fantasy indicators are masking the real problems in achieving the SDGs. It is time for some difficult conversations with the indicator industrial complex.
The Sustainable Development Goals (SDGs) present an enticing vision for global progress, promising unified action across multiple spheres such as social equity, environmental sustainability, and economic growth. The SDG headlines of eliminating poverty, gender equality and so on are laudable aims but too often operationalised only as slogans. If you really want to understand how the SDGs operate then it is necessary to focus attention on the 247 indicators. Increasingly in-depth analysis reveals significant flaws in the measurement assumptions embodied in these indicators, particularly through controversial indicators like SDG 6.5.1 which purports to assess the implementation of Integrated Water Resources Management (IWRM). As part of the GCRF Water Security and Sustainable Development Hub, we explored SDG 6.5.1 reporting in Colombia, Ethiopia, India, Malaysia and the UK. Our detailed research is published in a paper in a hard-hitting special edition of Water Alternatives.
The illusion of progress through measurement
At a superficial level, the SDGs serve as a global agenda, constructed through the consensus of 193 UN member states. However, as discussed in the paper by Mdee et al., the reliance on indicators such as 6.5.1 may create an illusion of action that distracts from real systemic issues. Rather than operating as effective tools for transforming governance and addressing complex social realities, these indicators often reduce multidimensional problems to simplistic numerical scores on a 0-100 scale.
This reductive quantification can obscure the political and institutional dynamics that underlie water governance and broader societal challenges. By advocating for measurable outcomes, the SDG framework risks prioritising achieving simplified and illegitimate universal numerical targets at the expense of nuanced and localised action.
The challenges of quantification
Construction of indicators like SDG 6.5.1 takes complex and contested conceptual approaches and actively pretends that they can be boiled down to a set of scores that are both universal and global. This ignores the intricacies of local governance, resulting in what has been termed "rendering technical," where the messy realities of stakeholder incentives and power relationships are assumed away and hidden behind easily digestible (but fantastical) figures. In the case of SDG 6.5.1, the collection of data for reporting becomes cumbersome and shifts focus away from meaningful implementation, creating an environment ripe for "SDG-washing" where superficial compliance replaces genuine engagement and reform.
Moreover, the aggregation of data into composite indicators masks the subjective nature of component data—including biases in survey design, completion, and interpretation. Each headline score hides background complexity and thus provides a poor representation of the actual conditions on the ground. Moreover, it suppresses local debate on wider water politics.
Hidden power dynamics and governance challenges
Our analysis of the SDG indicators also raises critical questions about power dynamics in data production. As our paper points out, the current approach tends to empower a small elite of "statistical entrepreneurs" while sidelining local insights and expertise. This situation creates a paradox where indicators claim to facilitate transparency and accountability while simultaneously fostering a context where those in power can deflect responsibility through numerical success.
We also reveal that despite a rhetorical commitment from all countries to the achievement of the SDGs, that countries such as the UK behave as though the SDGs do not really apply to them. Our study revealed that in relation to integrated water resources management, the UK appeared to view their compliance as a mere formality. UK reporting data rates the UK as performing with an almost perfect level of IWRM implementation. It is hard to square this circle with the now very hot political issues of watercourse contamination and aging infrastructure in the UK. Hence the SDG 6.5.1 indicator appears to reinforce a colonial narrative that ‘developing countries’ are to look to mimic the ‘developed’.
A call for meaningful analysis rather than fantasy metrics
Addressing the failings of the current SDG measurement framework necessitates a paradigm shift. Instead of relying solely on fantasy metrics, there is a pressing need for qualitative analyses that capture the complexities of governance and responsive engagement at local levels. This approach would allow for a more nuanced understanding of the challenges involved in implementing significant initiatives like IWRM.
The critique of SDG 6.5.1 illustrates the essentiality of rethinking indicators as tools of governance rather than fantasy metrics, which provide the fuel for international institutions to claim their own legitimacy. Engaging with the socio-political realities that influence resource management decisions will necessitate a more profound understanding of the nuanced contexts in which these decisions are made, rather than distracting precious local capability into the production of fantasy metrics.
Written by Anna Mdee