Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2512.20713

How to Do STEM Outreach Evaluation -- Recommendations Based on a Review of Self Evaluation Tools in Canadian STEM Outreach Programs

Garrett Richards·Svetlana Barkanova
View original source ↗Read source document ↗Export metadata ↓

Abstract

STEM (Science, Technology, Engineering, and Mathematics) outreach programs in Canada, especially those oriented towards youth, play a critical role in supporting the nation's future workforce, innovation capacity, and equity across social groups in STEM fields. They constitute a large, multi-layered ecosystem connecting universities, national laboratories, non profit organizations, and grassroots community groups. Despite the growing importance of these programs, and the frequency that they undergo self-evaluation, little systematic information exists on best practices or common approaches to evaluating the effectiveness of STEM outreach initiatives. To address this gap, we integrated literature review with email inquiries about self evaluation tools sent to Canadian STEM outreach programs funded by NSERC (Natural Sciences and Engineering Research Council of Canada) PromoScience grants. We contacted 200 programs and heard back from about 100 of them, for a response rate of 50%. Of those respondents, 68 shared information about a formal self-evaluation tool appropriate for general STEM outreach. The results led us to develop a toolbox of self-evaluation methods, master question banks and starting-point templates for student/participant and teacher/chaperone surveys, and a synthesized list of recommendations for evaluation process, design, and implementation. Our approach provides a broad treatment of how to do STEM outreach evaluation, supplementing the relevant literature, where large-N studies and Canadian studies are relatively rare. We acknowledge that some of the most effective practices in STEM outreach evaluation require resources or capacity (e.g. longitudinal approaches), which may be limited for many outreach practitioners, but others seem to have a high ratio of benefit to cost (e.g. adding qualitative questions to an otherwise quantitative survey).

Explore related subjects

physics.ed-phphysics.soc-ph

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Garrett Richards, Svetlana Barkanova. 2025-12-23. How to Do STEM Outreach Evaluation -- Recommendations Based on a Review of Self Evaluation Tools in Canadian STEM Outreach Programs. https://arxiv.org/abs/2512.20713

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Addressing misconceptions in university physics: A review and experiences from quantum physics educators

Students often begin physics courses with misconceptions rooted in everyday experience and intuition, which can be resistant to change. While research has identified strategies for addressing misconceptions across physics, it remains unclear whether different domains, like classical and quantum physics, require different approaches. Quantum concepts can pose different representational and mathematical demands, while both domains require instructors to elicit and develop students' reasoning. To support discussion of these instructional challenges, we organize selected literature on addressing misconceptions in physics education and summarize instructors' accounts. The overview groups 122 distinct works into four categories, with further subcategories. A preliminary framework developed from existing review literature informed the interview guide. We interviewed 12 instructors from the University of Waterloo's Institute for Quantum Computing and the Perimeter Institute, who have collectively taught over 100 quantum courses. The accounts describe difficulties involving instructional representations, prerequisite knowledge, and the interpretation of students' reasoning, alongside reported diagnostic and instructional responses. We draw these accounts and the literature together as questions for instructional planning. The report does not resolve the intended classical--quantum comparison or establish comparative instructional effectiveness.

physics.ed-ph↗
arXiv2026

Johann Bernoulli's analysis of elastic collisions (a teaching sequence to introduce the dynamic law thereby inspired)

In order to explain an elastic collision, Johann Bernoulli considered two bodies connected by a spring. Motion is defined as a succession of states of rest. Then, considering the spring to be a lever with a body at each extremity, the laws of equilibrium imply that `motion' is described by the time variation of the (common) quantity of motion of the bodies; the dynamic law is thus deduced. This inspires a teaching sequence to introduce the dynamic law (in one dimension) in introductory physics course; we call it ``bernoullian sequence''.

physics.ed-ph↗
arXiv2026

Design and Initial Evaluation of a Photovoltaics-focused Course-based Undergraduate Research Experience in Physics

Traditional physics laboratory courses often focus on experiments with well-known results, limiting students' engagement in authentic scientific practices. Course-based undergraduate research experiences (CUREs), where students engage in real research with unknown outcomes, have been shown to support positive student outcomes, such as increased self-efficacy, persistence, and engagement in scientific practices. However, discipline-specific studies of CUREs in physics remain limited. We describe the development, structure, and initial implementation of a photovoltaics-focused CURE in a second-year undergraduate physics laboratory course at the University of Colorado Boulder. To examine how students experienced the course, we analyzed end-of-semester reflection assignments using the five CURE components (i.e., scientific practices, discovery, relevance, collaboration, and iteration), as well as established dimensions of research authenticity, as analytic frameworks. Students described experiences associated with all five CURE components, with collaboration, relevance, and scientific practices appearing most prominently in their reflections. Students also associated authentic research with meaningful scientific contribution, engagement in authentic scientific practices, and navigating the uncertainty and setbacks inherent in research, although fewer explicitly identified themselves as researchers or scientists. A subset of students additionally connected the course to their immediate thinking about future academic and professional pathways. This work contributes both a discipline-specific model for implementing CUREs in experimental physics laboratory courses and provides insight into how students interpret and experience authentic research within this course context.

physics.ed-ph↗