Developing a program evaluation system
Abstract
This effective practice summarizes the Project STAR toolkit, "A User's Guide to Evaluation for National Service Programs." The toolkit offers a step-by-step guide to developing an easy-to-use and effective program evaluation system, or it can be used to improve on the components of an existing evaluation system. A link to the toolkit is provided.Issue
National Service programs striving for increased accountability to stakeholders face the challenge of developing a program evaluation system, often from the ground up and with limited resources, knowledge, and experience in evaluation.Action
The Project STAR Toolkit titled "A User's Guide to Evaluation for National Service Programs," offers a step-by-step guide to develop an easy-to-use and effective program evaluation system, including how to develop objectives, evaluation plans, and instruments; how to collect, aggregate and analyze data; and how to report program results to stakeholders.
The User's Guide was developed for Corporation programs before 2003 and focuses on empowerment evaluation. The Corporation is now requiring Corporation programs to conduct performance measurement. However, many of the concepts are the same and the information in this User's Guide may still be helpful for many programs.
The User's Guide leads National Service programs through the steps to conduct a self-assessment of program outcomes. The User's Guide provides all National Service programs with information on how to put together customized materials for measuring program results. It can be used to develop a complete evaluation system from scratch or to improve upon the components of an existing evaluation system.
The User's Guide is designed to assist programs in meeting key evaluation needs through a series of guides related to Corporation for National and Community Service priority areas. These include: Education, Public Safety, Human Needs, and the Environment.
Each guide focuses on evaluation tasks specific to a priority area and leads the program through a series of practical steps designed to accomplish that task. Each guide is self-contained and programs can select only the guides they need. If questions arise while working on a guide, the program can call the toll-free assistance line at 1-800-548-3656.
The User's Guide has the following files:
Title Page (pdf)
Table of Contents (80k) (pdf)
Chapter One (157k)(pdf) "Objectives - The Building Codes"
Chapter Two(97k)(pdf) "Evaluation Plans - The Blueprints"
Chapter Three (245k)(pdf) "Instrument Development - The Hammers and Saws"
Chapter Four (206k)(pdf) "Data Collection - Gathering the Raw Materials"
Chapter Five (102k)(pdf) "Data Analysis - The Construction Phase"
Chapter Six (136k)(pdf) "Reporting Your Results - The Open House"
Chapter Seven (553k)(pdf) "Education Programs"
Chapter Eight (525k)(pdf) "Public Safety Programs"
Chapter Nine (532k)(pdf) "Environmental Programs"
Chapter Ten (491k)(pdf) "Other Human Needs"Writing Outcome Objectives (1,307k)(pdf)
Evaluation Plans (825k)(pdf)
Instrument Development (441k)(pdf)
Data Collection (401k)(pdf)
Data Analysis (673k)(pdf)
Reporting (263k)(pdf)
Context
National Service programs are under increased pressure to demonstrate program results to stakeholders.
Project STAR is the evaluation training and technical assistance provider for the Corporation for National and Community Service. They are tasked with helping programs assess the impact of their services. Project STAR is a project of Aguirre International, which provides high quality social issues research, and evaluation and technical assistance for government, business, and nonprofit sectors.
Evidence
Many National Service programs have successfully used the User's Guide to develop their program evaluation system and/or to improve upon existing evaluation materials, according to Project STAR.Posted On
September 3, 2002For More Information