1
2	Focus Today Importance of evaluation Types of evaluation Planning for evaluation
3	“Sustaining” Implies “continuation” Summative Includes “improving” Formative Should be part of “planning” Design Must allow for “ending”
4	Elements of “Quality” Measures Ranges - to excellence Success Perspectives Stakeholders Public policy Objectivity Timeframes
5	“Literacy Programs”as Systems Outcomes and impacts Processes and practices Inputs and resources
6	Reasons for Evaluation Accountability Marketing Informed decision-making Continuous improvement
7	Pivotal Questions 1. Is it effective? Do what it claims to do? Problem solved or change achieved? Compared to what?
8	Pivotal Questions 2. Is it efficient? Best use of resources? Compared to what?
9	Measures of Success Satisfaction with overall effectiveness and efficiency Quality of processes and practices Adequacy of resources: money, time, people
10	Evaluation Process 1. Description (logic model) Intended outcomes Activities Resources 2. Research plan Data required Data sources Tools 3. Analysis Success Quality Lessons Learned
11	Types of Evaluation Quality Audit (standards based) Impact Analysis Return on Investment Analysis
12	Quality Audit (Which Standards?)
13	Impact Analysis (Immediate, long-term)
14	ROI Analysis Program Providers / Users
15	Planning for Evaluation Start when the program starts Establish benchmarks Allocate resources Keep it simple
16	Research Wisdom Strive for balance Include “costs” Be ethical / defensible Share your findings
17	For more information: www.FuturEd.com Consumer’s Guide to ROTI http://www11.hrdc-drhc.gc.ca/pls/edd/hrdc.main Lessons Learned in Adult Literacy
18	Over to You: Workshop Plans Round tables: Goals and barriers for program evaluation Indicators of program success Discussion of ROI Advice for CAMA / next steps?
19	FuturEd …helping change learning systems for the future 101 - 1001 West Broadway, pod 190 Vancouver, BC V6H 4E4 phone: 250-539-2139 e-mail: kbarker@FuturEd.com website: www.FuturEd.com