|
Program and Project Evaluation
Introduction to Evaluation
Planning the Evaluation
Collecting Information
Analyzing and Interpreting
Reporting |
Home >>
Program and Project Evaluation Introduction to Evaluation
What is Evaluation?
The process of determining the worth or merit of an activity,
program, person, or product.
Joint Committee on Standards for Educational Evaluation
Applying this definition to the educational arena, evaluation provides the
opportunity to reflect on the goals and objectives of a program/project and determine its level of
success at meeting the stated outcomes. Program/project evaluation, therefore, is the process of
systematically collecting information to make improvements or inform decision-making.
Formative Evaluation provides information
for improvement by identifying aspects of the program/project that are successful and areas in need
of improvement. The study generally focuses on the content and design of the program/project, with
results useful to program staff.
Summative Evaluation provides an overall
perspective of the program/project. The study usually focuses on the value or worth of the
program/project and is designed for accountability or continuation purposes.
Due to the diverse nature of Syracuse Universitys programs and projects,
no standard evaluation plan will meet all their needs. It is necessary, therefore, to develop an
evaluation plan that fits the specific needs of the program/project. Reasons for conducting an
evaluation vary among programs and may even change over time for a specific program/project. For
example, the evaluation focus for a program in its developmental and early implementation stages
will differ from the needs after the program becomes relatively well established.
This Evaluation Toolkit
is targeted for educational programs and projects at Syracuse University. It explains the various
stages of evaluation from planning and development to information collection, analysis, and
reporting. A range of evaluation methodologies and approaches are provided to help in designing
specific evaluation plans. Keep in mind that evaluation studies are basically a process of asking
questions and then developing an approach to find useful answers.
The following table summarizes the steps involved in designing an
evaluation plan. Each of these steps is discussed in detail throughout the toolkit.
The Evaluation Process
| |
| |
Steps in the process |
Decision making |
| |
|
|
| 1. |
Specify, select, refine, or modify project goals and
evaluation objectives. |
What is the general focus of the evaluation?
- What is to be evaluated?
- Why what are the purposes?
- Who is the evaluation for?
|
| 2. |
Establish standards/criteria (performance measures) where
appropriate |
What benchmarks or measures will be used to evaluate the
success of the project? |
| 3. |
Plan appropriate evaluation design |
- What are the key questions that need answering?
- What is
feasible in terms of budget, time, available resources and expertise?
|
| 4. |
Select and/or develop data gathering methods |
What information will be gathered?
- From whom?
- By whom?
- How will the information be gathered?
|
| 5. |
Collect relevant data |
| 6. |
Process, summarize, analyze relevant data |
How will the information be analyzed and interpreted?
(Criteria for judging will relate to Step 2.) |
| 7. |
Contrast data with evaluation standards/criteria |
|
8. |
Report and feedback results |
How will the results be communicated?
|
|
[Adapted from Payne, D. A. (1994). Designing
Educational Project and Program Evaluations: A Practical Overview Based on Research and
Experience. Boston: Kluwer Academic Publishers. (page 13).] |
|
|
.GIF)
