For this program I suggest a primarily goals-based evaluation focus (as defined by McNamara, 2002) within the framework of a case study evaluation model (as defined by Stufflebeam, 2001). I see goal specification as conspicuously absent from the information provided in the program document. It talks at some length about incidence of, and risk factors for, gestational diabetes mellitus (GDM).
However, there are no statements regarding targeted outcomes of the program. Is the goal of the program decreased incidence of GDM, increased education about risk factors, better overall health, establishment of a social support network?
However, there are no statements regarding targeted outcomes of the program. Is the goal of the program decreased incidence of GDM, increased education about risk factors, better overall health, establishment of a social support network?
Somewhat tangential to goals-based evaluation is the question of participation level. A very high percentage of inquiring women participated (69%), but a very low percentage of the estimated population inquired (11%). Were there resources in place to accommodate 69% participation at the population level? That could potentially be 300 women (plus buddies) looking for child care, bathing suits, food, exercise space, and so on. The participation aspect starts to move the evaluation towards process-based, but I believe it ties into the goal of servicing the target community.
The main goal of a case study model (Stufflebeam, 2001) is to “delineate and illuminate” (p. 34) a program rather than directing or assessing its worth. It's strengths include incorporation of various stakeholders and multiple methodologies. Perhaps most importantly in this application, a case study is a natural fit for a focused program evaluation. Its primary limitation is a direct offshoot of that strength. It is not well suited for a whole-program evaluation. As that is not a requirement in this situation, the strengths of this model greatly outweigh its limitations.
References
McNamara, C., 2002. A Basic Guide to Program Evaluation. Retrieved from the Grantsmanship Center website: http://www.tgci.com/sites/default/files/pdf/A%20Basic%20Guide%20to%20Program%20Evaluation_0.pdf
Stufflebeam, D. L., 2001. Evaluation Models [Monograph]. New Directions for Evaluation, 89, 7-98. doi:10.1002/ev.3
The main goal of a case study model (Stufflebeam, 2001) is to “delineate and illuminate” (p. 34) a program rather than directing or assessing its worth. It's strengths include incorporation of various stakeholders and multiple methodologies. Perhaps most importantly in this application, a case study is a natural fit for a focused program evaluation. Its primary limitation is a direct offshoot of that strength. It is not well suited for a whole-program evaluation. As that is not a requirement in this situation, the strengths of this model greatly outweigh its limitations.
References
McNamara, C., 2002. A Basic Guide to Program Evaluation. Retrieved from the Grantsmanship Center website: http://www.tgci.com/sites/default/files/pdf/A%20Basic%20Guide%20to%20Program%20Evaluation_0.pdf
Stufflebeam, D. L., 2001. Evaluation Models [Monograph]. New Directions for Evaluation, 89, 7-98. doi:10.1002/ev.3
Jeff
ReplyDeleteYou make a good case for using a goals -based approach and on top of that point our a need to find out what the goals of the program actually are. Using a case study in combination allows for an integration of a wide variety of content.
Jay