Programme evaluation models pdf

Purposes can range from a mechanical compliance with a funders reporting requirements, to the genuine desire by program managers and stakeholder to learn are we making a difference. It concludes by propos ing a comprehensive and eclectic process that can be used to evaluate a field of study, which is perhaps the most difficult curricular element that evaluators face. This approach focuses on the degree to which the objectives of a program, product, or process have been achieved. Models of program evaluation many evaluation models were developed in the 1970s and 1980s. This was a problem with evaluations in the past when program evaluation methods were chosen largely on the basis of achieving complete scientific accuracy, reliability and. Basic guide to program evaluation including many additional. For many years evaluation experts focused on simply measuring program outcomes patton, 2011. At the end of the process, a specific programme logic model and associated implementation plan should be written for every public health programme. Basic guide to program evaluation university of new mexico.

Evaluating educational programs yael fisher achva academic college, telaviv 69121, israel abstract. Evaluation measures the extent to which programs, processes, or tools achieve the. The breadth of an evaluation will always be limited by the resources available, but note that a welldesigned, simple evaluation can be as powerful as a more complex and costly one. The aim is to determine the relevanc e and fulfillment of objectives, development efficiency. This article provides a quick overview of 4 evaluation models youll find most useful. The model described and recommended in this manual is based on the projectprogramme cycle, which depicts the management of an intervention through a sequence of inter. One purpose of conducting a theorybased evaluation is to test the model hypothesized to explain the program and. Program evaluation models and related theories amee guide. Using programme theory to evaluate 33 the remainder of the article presents and discusses examples of programme theory evaluations that address each of these issues through the type of logic model developed and how it was used for the evaluation.

Programme operations, unicef, new york, revised may 2003, pp. Stufflebeams ipp evaluation model defining evaluation. Exploratory evaluation study designs can help you at the beginning of your program to. Application of context input process and product model in. There are several types of evaluations that can be. Example of logic models use in evaluation planning. References to program evaluation methods frequently include the phrase qualitative and quantitative methods, as if the mention of one method demands the inclusion of the other. A logic model can also help maintain focus and accountability, reveal assumptions, guide and focus work, and supportcontinuous improvement. You can think of evaluation designs in three main categories. Glynn sharpe nipissing university 100 college drive box 5002, north bay, ontario. Evaluation of training and development is the most essential aspect of training programme.

Outcomeeffectiveness evaluation measures program effects in the target. Know what a logic model is, and how it can be useful to your daily program operations identify the key components of a logic model. Any attempt to obtain information feedback on the effects of training programme. Evaluation models for evaluating educational programs. Curriculum evaluation is shaped with the questions of an evaluation specialist, and the philosophy taken as a basis has an immediate effect on the evaluation doll. Bdi logic models can also improve the evaluation of community programs and initiatives.

Projectprogramme monitoring and evaluation guide 2. These approaches, in varying degrees, are unique and cover most program evaluation efforts. All human service programs are designed to make a difference in the lives of people or to. Evaluation is the systematic process of delineating, obtaining, reporting, and applying descriptive and. The cipp model is a social systems model applied to program evaluation. A logic model shows a series of linkages thatare expected to accomplish the program goals. Types of evaluation centers for disease control and. Educational program evaluation using cipp model neliti. At different points in your program cycle, you may need to use different types of evaluation designs. Program evaluation models and related theories 3 in this guide, we first briefly define program evaluation, discuss reasons for conducting educational program evaluation, and outline some theoretical bases for evaluation models.

Two of the approaches, reflecting the political realities of evaluation, are often used illegitimately to falsely characterize a program s value and are labeled pseudo. Formative evaluation ensures that a program or program activity is feasible, appropriate, and acceptable before it is fully implemented. Models are linear, programs are complex, interactive models are static, programs may change over time. Also, beyond covering both creditable and noncreditable approaches, some authors of evaluation approaches say that the term model. Program evaluation can include any or a variety of at least 35 different types of evaluation, such as for needs assessments, accreditation, costbenefit analysis, effectiveness, efficiency, formative, summative, goal. Using these types of evaluation can help your program deliver better results and have a greater impact, all while reducing costs. Educators can be more confident when choosing an appropriate evaluation model if they first consider the models theoretical basis against their program s complexity and their own evaluation needs. If you have the pills, then you can take the pills, if you take the pills, then headache will go away. Making evaluation an integral part of your program means evaluation is a part of everything you do. How to evaluate the programme world health organization. Educational evaluation models were not developed with education theories in mind. Logic models can be useful planning tools during this phase. Years of experience helped us develop our program implementation model. Program theory and logic models evaluation resources from wilder research.

Logic models for program design, implementation, and evaluation. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model. The assessment of the evaluation model metaevaluation is a critical step in evaluation, as it is at the basis of a successful program project evaluation. This approach often generated extensive data from which very carefully. Logic model a planning and evaluation tool page 6 of 11 larger, more complex programs can utilize a nested model to better manage program details. Use program theory and logic models, but be flexible, and open to.

Using programme theory to evaluate complicated and. Program evaluation some myths about program evaluation. Types of evaluation once youve determined which program activities in your logic model should be evaluated, you can begin to identify the types of evaluation you can conduct. Rr11 overview of the framework cdc pdf provides 3page key points from framework. Typically, program evaluations are used to measure progress in achieving obje prove program implementation, provide accountability information to stakeholders. The evaluation context is used to give a rational reason a selected program or curriculum to be. Logic models for program design, implementation, and. Evaluation planning ll 73737373 using your logic model to plan for evaluation t hinking through program evaluation questions in terms of the logic model components you have developed can provide the framework for your evaluation plan. You can use it to objectively analyze the impact of training, to work out how well your team members learned, and to improve their learning in the future. What is evaluation use the program theory or logic model to come up with evaluation questions does the program have a positive outcome. Once youve determined which program activities in your logic model should be. The research regarding programs and project evaluation models developed. This paper reveals a new evaluation model, which enables educational program and project managers to evaluate their programs with a. Methodology a threepart search was undertaken to explore how these issues had been ad.

The relationships among program components are usually represented in a logic model by arrows that show. It would simply mean the act of judging whether or not the activity to be evaluated is worthwhile in terms of set criteria. Understanding different types of program evaluation brad. A generic programme logic model ministry of health.

An evaluation framework for community health programs can be used by communitybased organizations and community health workers to enhance their understanding of evaluation and to build their capacity to more actively and aggressively participate in evaluation efforts of their programs. Gfe, in program evaluation, is a model in which the official or stated program goals and objectives are withheld or screened from the evaluator. Although methodological diversity in evaluation is widely accepted, and even recommended by. A program evaluation is conducted every three to five years for our longterm community development programs, and every year to two years for our grantfunded projects, to measure change over time. Using programme theory to evaluate complicated and complex. The mission of the office of migrant education is to provide excellent leadership, technical assistance, and financial support to improve the educational opportunities and academic success. Program evaluation methods treasury board of canada. Understanding different types of program evaluation program evaluations are conducted for a variety of reasons. Many people believe evaluation is a useless activity that generates lots of boring data with useless conclusions. Major types of program evaluation evaluating program processes, goals, outcomes. It helps identify what is necessary to achieve desired outcomes in a planning mode and serves to. Cipp evaluation model developed by stufflebeam and shinkfield in 1985.

Choose a program evaluation model that allows you to. Dms 53855 programdevelopment evaluation model fact sheet1. In 1980 when tom first began teaching a graduate level class in program evaluation, he asked the students to give him their perspective on why there is so much resistance to program evaluation of human service. Taba 1962 and varis 1996 particularly emphasize the interaction between the components of a curriculum. Using programme theory to evaluate 31 this distinction seemed to provide a particularly useful orienting framework for evaluation patton, 2003 and has obvious implications for programme theory evaluation. Program theory and logic models 1 wilder research, august 2009 wilder research. There are many models of evaluation that can be used to evaluate a program. Curriculum evaluation should be cyclic, but not linear. An evaluation framework for community health programs. Chapter 12 curriculum evaluation sage publications. Programme managers training course for ntds targeted for control or elimination by preventive chemotherapy interventions module 6. An evaluation is a purposeful, systematic, and careful collection and analysis of information used for the purpose of documenting the effectiveness and impact of programs, establishing. Logic models reveal the relationships among program resources, activities, outputs, and short, mid, and longterm outcomes. Table 2 considerations in developing credible evaluations.

In this article, well explore kirkpatricks model and how to apply it. Programme evaluation and strategic reporting a logic model presents programme information and progress towards goals in ways that inform programme stakeholders and advocate for a particular programme approach. Modification of programme elements summative evaluation at its conclusion. There are several types of evaluations that can be conducted. The aim is to determine the relevanc e and fulfillment of objectives, development efficiency, effectiveness, impact and sustainability. Program evaluation models and related theories unc school of. Project and programme evaluations guidelines 1 evaluation. Qualitative research methods in program evaluation.

Developing and implementing such an evaluation system has many benefits including helping you to. Evaluation literally means the assessment of value or worth. Context evaluation input evaluation process evaluation product evaluation these components are or can be viewed as separate forms of evaluation, but they can also be viewed as steps or stages in a comprehensive evaluation. Training evaluation ensures that whether candidates are able to. Evaluation models have not always supported such a range of needs. Evaluation models 11 program evaluation defined in characterizing and assessing evaluation approaches, the various kinds of activities conducted in the name of program evaluation. This logic model workshop toolkit is designed to help practitioners learn the overall purpose of a logic model, the different elements of a logic model, and. The systematic and objective assessment of an ongoing or completed project or programme, its design, implementation and results. The evaluation results may contribute to the modification or formation of the curriculum for example, results of formative evaluation may help in 1. It links the intervention programme activities to programme goals and objectives. Jan 20, 2016 learning evaluation models you will find useful there are dozens of learning evaluation models currently in practice.

There are many types of logic model which can be used in planning programmes and implementing activities. We recognize this as a simple systems model the connection of interdependent parts that together make up the whole\it is a\. Additional resources developing evaluation questions. Educators can be more confident when choosing an appropriate evaluation model if they first consider the model s theoretical basis against their programs complexity and their own evaluation needs. The evaluation of simple interventions is intended to either develop or test the recipe that others can then follow. Effective program evaluation is a carefully planned and systematic approach to. We then focus on several commonly used program evaluation models in the context of those theoretical bases. Evaluation models and approaches the monograph uses the term evaluation approach rather than evaluation model because the former is broad enough to cover illicit as well as laudatory practices. Evaluation models values in studying alternative program evaluation approaches are to discover their strengths and weaknesses, decide. Kirkpatricks fourlevel training evaluation model can help you to answer questions like these. Generally all good training and development programmes start with identification of training and development needs and ends with evaluation of training gopal, 2009. Logic models and program evaluation edward monaghan, ome preeti choudhary, ome.

The task is complicated by the many specific evaluation issues that may require attention, by the numerous methods that could be used to gather and examine information given the resources and time available, and by the need to ensure that all relevant issues are examined. These models establish the evaluation purposes, strategies, activities, and the people that participate in the assessment process, as well as method choices, and roles and responsibilities of. The major question guiding this kind of evaluation is, is the program. Models of curriculum evaluation university of kwazulunatal. On the two extremes, their design models, process, methods, and types of information may indeed differ. Evaluation models and approaches the following models and approaches are frequently mentioned in the evaluation literature. Evaluating and improving criminal justice training final report september 2007 submitted to national institute of justice prepared by kelly bradley edward connors institute for law and justice. Project programme monitoring and evaluation guide 2. Evaluation modelsabstract western michigan university. The guide describes a generic programme logic model and checklist that are designed to guide people through the steps of developing a thorough public health programme. You design your program with evaluation in mind, collect data on an ongoing basis, and use these data to continuously improve your program. Figure 4 model of the effect of an excise tax 101 table 1 basic program evaluation issues 4 table 2 considerations in developing credible evaluations 22 table 3 example of descriptive statistics 84 table 4 further descriptive data 87 table 5 example of descriptive statistics 89. Theories that inform educational program evaluation models 4.