EVALUATION TOOLKIT (Format Option 1)
SUMMARY
To be developed
METRICS AND PROPOSED METHODS
Additional description and links coming soon.
The following Figures summarize the metrics and proposed methods.
The following Figures summarize the metrics and proposed methods.
|
Awareness Outcomes and Metrics
|
SWEAP Outcome |
Metric (DRAFT) |
Proposed Data Collection Method (click on links for details and supplemental methods) |
Outcome 1: The proportion of Coloradans in each river basin who can identify how water supports their quality of life, as well as the threats to and potential solutions for a sustainable water supply, increases. |
From a list of threats/pressures: % of respondents rating how much pressure (“A great deal”, “A lot”, “A moderate amount”, “A little”, “None at all”) each applies to Colorado’s water (Basin-specific) % of respondents who can identify a solution to what they identify as the top threat (or “pressure”) to Colorado’s water (Basin-specific) |
Survey |
|
Knowledge & Skills Outcomes and Metrics
|
SWEAP Outcome |
Metric (DRAFT) |
Proposed Data Collection Method (click on links for details and supplemental methods) |
Outcome 2: The proportion of Coloradans in each river basin who can articulate at least three “Critical Water Concepts” increases. |
% of respondents who are “Very Confident” or “Confident” in explaining a Critical Water Concept to someone else (by Concept and Basin-specific) |
Survey |
Outcome 3: The proportion of Coloradans in each river basin who report confidence in having the knowledge necessary to take an active role in water stewardship in their community increases. |
% of respondents who are “Very Confident” or “Confident” in having the knowledge necessary to take an active role in water stewardship in their community (Basin-specific) |
Survey |
Outcome 4: The proportion of Coloradans in each river basin who report confidence in having the skills necessary to take an active role in water stewardship in their community increases. |
% of respondents who are “Very Confident” or “Confident” in having the skills necessary to take an active role in water stewardship in their community (Basin-specific) |
Survey |
|
Behavior Change Outcomes and Metrics
|
SWEAP Outcome |
Metric (DRAFT) |
Proposed Data Collection Method (click on links for details and supplemental methods) |
Outcome 5: Participation in community discourse and decision processes about water at the state, regional and local levels increases. |
Number of non-member participants who attend meetings involving discourse and/or decision-making about water on a rare, occasional or frequent basis (State, Regional, Local levels) |
Analysis of sign-in sheets/participant logs |
Outcome 6: Voters have access to factual information that addresses potential impacts to sustainable water resources in relevant issue areas. |
List of most trusted sources of information as reported in poll |
Public polling of voters registered in Colorado |
Outcome 7: The proportion of Coloradans in each river basin that are demonstrating sustainable water behaviors increases. |
% of respondents who report frequent (i.e. “Always”, “Usually”) use of sustainable water behaviors (Basin and behavior-specific) |
Survey |
|
Systems Change Outcomes and Metrics
|
SWEAP Outcome |
Metric (DRAFT) |
Proposed Data Collection Method (click on links for details and supplemental methods) |
Outcome 8: Where relevant, local and state policies and practices are supportive of advancing statewide water literacy. |
Scorecard-style / rating approach with supporting narrative (State and Local levels) |
Scorecard-style / rating approach based on task force analysis of 1) Standardized review of Colorado Academics Standards (state level) and 2) Statewide survey of Colorado PK-12 Schools and Districts (local level) |
Outcome 9: Where relevant, local and state policies, regulations, and practices demonstrate a consideration of impacts on sustainable water resources. |
Scorecard-style / rating approach (State and Local levels) |
Expert panel |
Outcome 10: Water decision-making bodies are increasingly representative of the demographic make-up of the area they serve. |
Index comparing make-up of water decision-making bodies with the area they serve. (e.g., % composition of water decision making bodies in each demographic category compared to % of census respondents in each demographic category within the decision-making body's geographic area). |
Self-report & Self-identify Survey: Comparison of board demographics vs service area demographics |
EVALUATION TOOLKIT (Format Option 2)
SUMMARY
To be developed
METRICS AND PROPOSED METHODS
Additional description and links coming soon.
The following Figures summarize the metrics and proposed methods.
The following Figures summarize the metrics and proposed methods.
Click to view the PDF.
|
Figure 1 includes a summary of the metrics and primary data collection methods for SWEAP Outcomes at a statewide scale.
|
Click to view the PDF.
|
Figure 2 indicates existing data sources as of March 2022 for each of the SWEAP Outcomes.
(Updated 3/10/2022) |
DETAILS OF METRICS AND PROPOSED METHODS
The following section provides more detailed data collection methods for each outcome, including primary data collection method, supplemental data collection method(s), and focus audience or topic.
Click to view the PDF.
|
Figure 3 SWEAP Outcomes 1, 3, 4, 7: describes primary and supplemental data collection methods, along with focus audiences/topics for SWEAP Outcomes 1, 3, 4, 7: Awareness, Knowledge & Skills, and Behavior Outcomes suitable for a survey.
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 4 SWEAP Outcome 2: describes primary and supplemental data collection methods, along with focus audiences/topics for SWEAP Outcome 2 related to understanding Critical Water Concepts.
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 5 SWEAP Outcome 5: describes primary and supplemental data collection methods, along with focus audiences/topics for SWEAP Outcome 5 related to participation in water-related community discourse and decision processes.
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 6 SWEAP Outcome 6: describes primary and supplemental data collection methods, along with focus audiences/topics for SWEAP Outcome 6 related to voter access to information.
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 7 SWEAP Outcome 8: describes primary and supplemental data collection methods, along with focus audience/topics for SWEAP Outcome 8 related to policies supporting water literacy.
(Updated 3/10/2022) |
|
Figure 8 SWEAP Outcome 9: describes primary and supplemental data collection methods, along with focus audience/topics for SWEAP Outcome 9 related to policies, regulations, and practices.
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 9 SWEAP Outcome 10: describes primary and supplemental data collection methods, along with focus audience/topics for SWEAP Outcome 10 related to representation in water decision-making bodies.
(Updated 3/10/2022) |
Click to view the PDF.
EVALUATION RESOURCES
- Checklist of survey considerations (link)
- Baseline Survey Questions by Context (link)
- Example survey with recommended survey questions (link)
- 2021 Colorado Water Awareness, Knowledge and Behaviors Survey (link)
- Water Education Status and Opportunities Survey for Colorado's PK-12 Districts and Schools (SWEAP Outcome 8) (link)
- Example Program Self-Check for inclusion of Critical Water Concepts (link)
- Example Post-Program Evaluation Survey (link)
- Links to more resources (link)
Click to view the PDF.
|
Figure 10 contains an overview of survey questions for SWEAP Outcome 1, 2, 3, 4, and 7
(Updated 3/10/2022) |
Click to view the PDF.
|
Figure 11 includes examples of survey advertising from the Colorado Water Awareness, Knowledge, and Behaviors Survey and the Water Education Status and Opportunities Survey for Colorado's PK-12 Districts and Schools.
(Updated 3/10/2022) |
