Saturday, September 19, 2009

Assignment 2 - Case Study

As with any evaluation, a number of key factors determine which approach would best suit a program such as the time, personnel and funding available. Assuming that these are substantial, my pick here would be to utilize a combination of an outcome-based or goal- oriented summative approach as well as a process-based formative evaluation. Using both these approaches would provide the most comprehensive and, hence, the most beneficial evaluation.

Firstly, a Michael Scriven’s outcome-based approach is appropriate in order to evaluate the effectiveness of the program in addressing the children’s needs as determined by their Individual Program Plans (IPP). Once clear parameters defining these needs are provided, the evaluation can then focus on determining which of them were effectively fulfilled by the ECS program, as well as to identify any shortcomings. Indicators of the program’s effectiveness could include the children’s improvement in skill, behaviours, independence, quality of life, and other areas identified in the IPP. In order to assess the level of change, a pre-test and post-test would be required.

The formative process-based approach would compliment this initial evaluation by examining the services rendered to the participants of the ECS program. As both the center-based programs and in-home programs form an integral link to the overall effectiveness of the program, evaluating them closely would certainly be worthwhile.
Focus areas of this approach could include examining how these services are provided in terms of the average number and duration of home visits or centre-based participation, the personnel involved during each session, how the participants’ levels of functioning are assessed, the process involved in determining the children’s needs for the IPP, the level of stress (if any) exhibited by the participants during the transportation to and from the centres, the level of involvement or interaction required from the children during different activities, the methods used and the reaction towards them as apparent in the actions of the participant, etc. Data collection in both approaches would involve a battery of questionnaires, observations as well as interviews with all involved participants including parents, care providers and specialists.

Once all information is gathered, the evaluators could then look for correlations between process and outcomes and hence be better equiped to draw conclusions regarding the overall effectiveness of the program. Accordingly, the combined approach evaluation has the potential to provide a very comprehensive and sound base for decision-making regarding the future direction of the program.

1 comment:

  1. Zosia

    I am happy to see someone go after a big budget production such as the one you propose. The combination of both summative and formative would give you a through breakdown of the program where it is succeeding and where it needs improvement. My only question to you is would there be any negative issues around conducting both types of evaluations?

    ReplyDelete