Evaluation in Instructional Design

10/31/07


According to Scriven evaluation is the process of determining the merit, worth, and value of things, and evaluations are the products of that process. There are four steps: select the criteria, set performance standards, collect and compare performance data, and make a value judgment. Evaluation can be formative or summative. Formative evaluation is performed while something is being created, hence formative. It is used to improve the effectiveness of what is being designed. Summative evaluation is the rest of the evaluation.

The CIPP model of evaluation is widely used today. Context evaluation is the first component. This stage is often called needs analysis and it helps in making planning decisions. The second component is input evaluation. The third stage is process evaluation which corresponds to formative evaluation. The final stage is product evaluation which corresponds to summative evaluation. The evaluator plays a key role in all stages.

It seems that everything in evaluation comes in fours. The Kirkpatrick model has four levels. The first is reaction which measures learners' attitudes toward their learning experience. It is assumed that if learners don't like the instruction, they won't learn. The second level is learning. In this level, achievement test are given to evaluate degree of knowledge gained, performance test to evaluate degree of skill mastery gained, and questionnaires for to measure attitudes. Behavior or transfer of training is the third level. This levels checks whether the skills and knowledge gained are being used in the real world. Level 4 is results. Level 4 outcomes include any outcomes that affect the performance of an organization.

I feel evaluation is necessary to design instruction.