Beyond the Bar: Alternative Methods for Visualizing Change Between Two Data Points
September 14, 2022
Learning to visualize data through charts and graphs is an effective way to communicate key insights to stakeholders quickly. When evaluators and applied researchers design data visualizations that illustrate the change between two data points, most default to the clustered (or grouped) bar graph. But there are so many choices out there! In this talk, several alternative methods for visualizing change between two points in time that go beyond the bar will be presented. This discussion will dig into this assumption, examining what we mean by each of these concepts, and exploring how the application of an intersectional feminist lens can in fact nuance and enhance our understanding of rigor in evaluation.
Strategic Evaluation and Learning for Organizations
September 21, 2022
Google Data Studio for Evaluators and a 'no-code' Data Science Toolbox for Evaluators
September 28, 2022
Google Data Studio (GDS) is a free, flexible, and robust system for creating dashboards and interactive reports. GDS seamlessly connects with existing spreadsheets, making it an ideal tool for evaluators and community agencies seeking to maximize the value of their data. This workshop demonstrates how to use GDS to convert a collection of static agency reports into a single, interactive report that can easily be updated, extended, and shared. We also offer resources and suggested strategies to promote efficient skill development.
Most Significant Change Stories of Impact: A 2-in-1 Program Monitoring and Outcome Evaluation Method
October 5, 2022
GIS and Remote Sensing Analytics
October 12, 2022
A Quality Approach to the In-Depth Interview Method
October 26, 2022
As the most frequently used qualitative research method, the in-depth interview enables researchers to explore complex issues and gain a contextually rich understanding of participants鈥 lived experiences. However, the complexities associated with conducting qualitative research 鈥 and, specifically, in-depth interviews 鈥 present unique challenges to researchers who strive to develop qualitative research designs that result in meaningful contextual data while incorporating quality measures that maximize the ultimate usefulness of their research.
This session presents an approach that brings greater rigor to the in-depth interview method without stifling the creative approaches and interpretations utilized by skilled qualitative researchers. This approach is the Total Quality Framework (TQF) which is a comprehensive and principled yet flexible way to conceptualize, implement, and interpret qualitative research. This session discusses the TQF, focusing on the Credibility component having to do with data gathering. The discussion includes practical examples of how to apply the Credibility component of the TQF to the in-depth interview method.
The Aesthetic Perspectives Framework, Art for Change, and Indigenous Nation (Re)building
November 2, 2022
Indigenous nation (re)building occurs as an Indigenous nation strengthens its own foundational capacity for governance and self-determined community development. Much can be done to spur Indigenous nation rebuilding, from executive leadership training to inter-nation visits, community-wide strategic planning, work on constitutional reform, and more. But the actual results of these efforts鈥攚hich can manifest in improved social, economic, health, and environmental outcomes鈥攇enerally arise slowly and only over the longer term. How is it possible to know whether an Indigenous nation is moving along the nation building pathway? How can champions identify what is working and amplify those efforts?
Evaluation as a Reflective Practice: Practical Implications for the Field
November 16, 2022
Using a Medicine Wheel Logic Model
November 30, 2022
A medicine wheel logic model provides an approach for evaluation work that is rooted in Indigenous cultural frameworks. From the initial focus on identity to the final recommendations and intergenerational nature of each stage, this model challenges mainstream ideas and offers an alternative perspective that is much needed in this field.
What Implications Do the Growing Discourses on Equity, Decolonizing Development, and Localization Have for the Practice of Evaluation in the International Context
December 7, 2022
The focus on equity, especially racial and gender equity in the US have received supercharged attention, especially with the growth of the Black Lives Matter and Me Too Movement, and the protests that followed the murder of George Floyd. At the same time, primarily in the international development context, there is burgeoning discourse on the importance of decolonizing development and the need for localization. These three movements/discourses seem to converge around the importance of dismantling old power structures that are at the root of long-standing social and economic inequities.
The Synergy of Evaluation and Story
January 18, 2023
Ensuring Credibility and Usability of your Qualitative Findings
January 25, 2023
Appropriately utilizing qualitative methodologies including data collection and analysis strategies, could yield rich results when conducting a program evaluation. As an evaluator, in order to ensure that stakeholders believe what you found (i.e., credibility) and that they use what you found (i.e., usability), you need to be transparent 鈥 showing your intent, decisions and actions in relation to the evaluation process. However, as a qualitative methodologist working with an evaluation team (with limited involvement in the design and implementation of the evaluation), how do you ensure credibility of the findings? Also, how do you ensure the usability of the findings when working with limited time and resources? In this presentation, I will share my experience as a methodology expert in the world of program evaluation and address the above questions.
Considering your Professional Ethics and Values in your Data Work
February 8, 2023
Bringing Lived Experience to Evaluation
February 15, 2023
In policy, there is an increasing recognition of the importance of involving people with lived experience to ensure policy and services reflect their needs and support their goals. In mental health and disability, there is a commitment to nothing about us without us. For evaluation to operate in this way, we need to rethink the conception of evaluator as 'independent objective outsider', instead, engaging people with lived experience to inform all stages from design through reporting. But how do we do this well in practice?
This session will outline a practical framework any evaluator can use for engaging lived experience evaluators and lived experience advisory groups - including recruitment channels and processes, position descriptions and terms of reference, induction, training and support, options for roles and responsibilities, considerations of collaboration modes to suit different communication needs and tasks, managing power dynamics, and timelines.
Evaluating Agricultural and Agribusiness Transformation Through Private Sector Involvement in Driving Community Value Chains in Sub-Saharan Africa
February 22, 2023
Business advisory support services are essential in creating sustainable and vibrant agricultural landscape and agro-processing industries in Africa. One commodity 鈥淐assava鈥 which has had poor image since its cultivation in Africa has metamorphosed into one of the most popular emerging industrial crop as a result of scientific research into its utilization. The presentation will present the outcome of the research result, challenges, transformational interventions, the outcome and evaluation of the impact vis a vis the expectations and lessons learned.
What's a Girl Gonna Do: Understanding Evaluation Theory from a Postcolonial Lens
March 1, 2023
Distilling Evaluation Practice into 43 Essential Tasks
April 5, 2023
The framework of delineates 43 evaluation tasks across seven broad domains of evaluation activity: Management; Engagement; Planning and Design; Data Collection and Analysis; Interpretation; Communication, Dissemination, and Use of Results; and Quality Review. In this session, we will (1) provide an overview of the task framework鈥檚 content; (3) describe the multifaced development and validation process, including challenges; and (3) discuss how it is being used to plan evaluation capacity development activities and resources by EvaluATE, the ATE program鈥檚 evaluation resource hub.
Teaching Evaluation Through Role Play
April 12, 2023
In a PhD-level Foundations of Evaluation course, students are anticipated to gain an in-depth understanding of the origins and history of evaluation as well as its evolution toward an independent discipline. They should also develop a basic understanding of a wide array of evaluation theory and practice perspectives. In a changing world, deep understanding of the foundational theories vitally grounds evaluation professionals, helping them to be more responsive and inclusive. Targeting these objectives was the purpose of a mock debate between students posing as evaluation theorists. The cognitive complexity represented in the debate transcript shows that students can articulate theorist approaches and, when challenged by their classmates, occasionally compare, contrast, and evaluate different approaches.