MEASURING SUCCESS

Metrics and baselines will be established for each shared outcome.  With these metrics, progress at a statewide level can be documented and evaluated. ​

METRICS AND BASELINES

The following tables indicate draft metrics and proposed data collection methods for each SWEAP Outcome. It is envisioned that a task force of water educators, data collection experts, and stakeholders will help finalize data collection methods through the development of data collection protocols for each metric.

In order to assist with evaluating the effectiveness of strategies and actions in accomplishing SWEAP outcomes, the state will implement a statewide public awareness survey in 2020 or 2021. The envisioned survey effort will collect baseline data on water issues and follow up with periodic surveys to measure progress. In addition to a statewide survey effort, the SWEAP team will work with partners to develop and implement assessments to evaluate the effectiveness of local and regional education activities using the data collection protocols.

Examples of how metrics can be included in a survey format already exist. Please reference the 2020 Rocky Mountain PBS Water Week  survey for one such example or email [email protected] with questions on how to utilize these draft metrics.

Please note that any data collection and reporting efforts should follow the SWEAP Guiding Principles.

Awareness Outcomes and Metrics

SWEAP Outcome	Metric (DRAFT)	Proposed Data Collection Method
​​Outcome 1: The proportion of Coloradans in each river basin who can identify how water supports their quality of life, as well as the threats to and potential solutions for a sustainable water supply, increases.​	From a list of threats/pressures: % of respondents rating how much pressure (“A great deal”, “A lot”, “A moderate amount”, “A little”, “None at all”) each applies to Colorado’s water (Basin-specific) ​ % of respondents who can identify a solution to what they identify as the top threat (or “pressure”) to Colorado’s water (Basin-specific)	Survey

Knowledge & Skills Outcomes and Metrics

SWEAP Outcome	Metric (DRAFT)	Proposed Data Collection Method
​​Outcome 2: The proportion of Coloradans in each river basin who can articulate at least three “Critical Water Concepts” increases.	% of respondents who are “Very Confident” or “Confident” in explaining a Critical Water Concept to someone else (by Concept and Basin-specific)	Survey
Outcome 3: The proportion of Coloradans in each river basin who report confidence in having the knowledge necessary to take an active role in water stewardship in their community increases.	​% of respondents who are “Very Confident” or “Confident” in having the knowledge necessary to take an active role in water stewardship in their community (Basin-specific)	Survey
Outcome 4: The proportion of Coloradans in each river basin who report confidence in having the skills necessary to take an active role in water stewardship in their community increases.	​% of respondents who are “Very Confident” or “Confident” in having the skills necessary to take an active role in water stewardship in their community (Basin-specific)	Survey

Behavior Change Outcomes and Metrics

SWEAP Outcome	Metric (DRAFT)	Proposed Data Collection Method
​​Outcome 5: Participation in community discourse and decision processes about water at the state, regional and local levels increases.	Number of non-member participants who attend meetings involving discourse and/or decision-making about water on a rare, occasional or frequent basis (State, Regional, Local levels)	Analysis of sign-in sheets/participant logs
Outcome 6: Voters have access to factual information that addresses potential impacts to sustainable water resources in relevant issue areas.	List of most trusted sources of information as reported in poll	Public polling of voters registered in Colorado
Outcome 7: The proportion of Coloradans in each river basin that are demonstrating sustainable water behaviors increases.​	% of respondents who report frequent (i.e. “Always”, “Usually”) use of sustainable water behaviors (Basin and behavior-specific)	Survey

Systems Change Outcomes and Metrics

SWEAP Outcome	Metric (DRAFT)	Proposed Data Collection Method
​​Outcome 8: Where relevant, local and state policies and practices are supportive of advancing statewide water literacy.	Scorecard-style / rating approach with supporting narrative (State and Local levels)	Scorecard-style / rating approach based on task force analysis of 1) Standardized review of Colorado Academics Standards (state level) and 2) Statewide survey of Colorado PK-12 Schools and Districts  (local level)
Outcome 9: Where relevant, local and state policies, regulations, and practices demonstrate a consideration of impacts on sustainable water resources.	Scorecard-style / rating approach (State and Local levels)	Expert panel
Outcome 10: Water decision-making bodies are increasingly representative of the demographic make-up of the area they serve.​	Index comparing make-up of water decision-making bodies with the area they serve. (e.g., % composition of water decision making bodies in each demographic category compared to % of census respondents in each demographic category within the decision-making body's geographic area).	Self-report & Self-identify Survey: Comparison of board demographics vs service area demographics

THE DASHBOARD

​The cumulative impact of SWEAP can be defined by a few key indicators of success, which will be built on specific metrics for each outcome during the implementation phase.

Key indicators will be summarized in the SWEAP “dashboard” to help reflect progress toward achieving the collective SWEAP Outcomes.