EDD8508: Program Planning and Evaluation for Adult Education

Michael Quinn Patton's utilization-focused evaluation (UFE) framework receives particular emphasis in EDD8508 because it directly addresses what is arguably the most common failure mode in program evaluation practice — not a failure of methodology but a failure of use: evaluations that are competently designed and executed from a methodological standpoint but whose findings are never actually used by anyone to make any decisions about the program being evaluated, either because the evaluation was not designed with specific users and uses in mind from the outset, or because the findings, however methodologically sound, do not address the questions that actual decision-makers actually need answered. This problem is not hypothetical or occasional — decades of evaluation research and practice have documented that unused evaluation findings are closer to the norm than the exception across many sectors, and adult education is particularly vulnerable to this pattern for several interconnected reasons. First, adult education programs are frequently required to conduct evaluation as a condition of funding (federal grants under WIOA Title II, state funding streams, foundation grants all typically require evaluation or accountability reporting), which means evaluation is often experienced by program staff as a compliance requirement rather than a genuine learning tool — something done to satisfy external requirements rather than to inform internal improvement decisions. Evaluations designed primarily for compliance often collect the data required by the funder (enrollment numbers, completion rates, standardized test score gains) without addressing the questions that program staff and administrators actually struggle with in their daily work: why are certain learners dropping out at specific points in the program, what is actually happening instructionally in classrooms that differs from the program design, what support services are making a difference and which are not, what do employers actually think about the preparation graduates receive. Second, adult education programs frequently lack the organizational infrastructure — dedicated evaluation staff, data analysis capacity, protected time for reflection on findings — to absorb and act on evaluation findings even when relevant findings are produced. Patton's utilization-focused framework addresses these problems by fundamentally reorienting the evaluation design process: rather than beginning with methodology (what is the most rigorous way to evaluate this program?), UFE begins with intended users and intended uses (who will use the findings, for what decisions, in what timeframe?), and then designs the evaluation — including its methodology, its data collection approach, its timing, and the format in which findings are communicated — specifically to serve those identified uses. This means the evaluation may not be the most methodologically elegant design possible in the abstract, but it produces findings that actual decision-makers actually use to make actual improvements — which Patton argues is the fundamental purpose of evaluation and the standard against which evaluation quality should ultimately be judged. For adult education administrators who must justify limited evaluation resources and demonstrate that evaluation contributes to program improvement rather than merely consuming scarce staff time, UFE provides both a practical framework and a compelling rationale for investing in evaluation as a genuine improvement tool rather than treating it solely as a compliance burden.