Change is inevitable and sometimes a shifting terrain can leave uncertainty about where we are headed. Often times this change is outside of our control. For example an educational program may have to deal with the uncertainty of a promised curriculum review or new dean. A non-profit continues to work towards its mission even if there is funding uncertainty because of an unexpected change in funding models. Government ministries must carry-on working after each election even if that means a new elected government shifts priorities.
Traditional forms of assessment are better suited for closed-systems like projects with set timelines and parameters. It can be difficult to build an assessment framework in a situation that is constantly in flux. Typically evaluators might ask did you reach your final destination? Well how do you evaluate something that is venturing into the unknown?
Patton (2017) argues that our principles act as rudders that guide our choices and principles-focused evaluation (PFE) can examine whether our principles are meaningful and clear, if they are actually being followed, and whether they are leading to desired results. The strength of PFE lies in how it can work within uncertainty while still providing formative, accountability, knowledge-generating, summative, and developmental evaluation. This makes it ideal for complex and dynamic situations.
Patton defines and categorizes principles and provides examples of how each can be evaluated. Instead of SMART (smart, measurable, achievable, realistic, and timely) goals this type of evaluation use the GUIDE (guiding, useful, inspiring, developmental, evaluable) criteria for clarifying effective principles. The book provides pracitcal examples of the application of GUIDE framework and implementing PFE. For example Patton walks the reader through a case study of Minnesota Youth Homeless agencies that differed in approaches but shared common principles that were used to create an evidence-based framework.
As the world becomes more connects and complex this approach to assessment might become more common. Beyond local changes there are a number of growing global uncertainties. Climate change for example could be a significant source of uncertainty across all aspects of life.
As of this writing I have begun my first assessment project using PFE and will update my blog with future reflections on my experiences.
Patton, M. Q., & EBSCOhost. (2017). Principles-focused evaluation: The guide. New York: Guilford Press.
