Asee peer logo

Applying the Five Dimensions of Effectiveness Framework to Evaluate the Effectiveness of a Research Practice Partnership Aimed at Increasing Equity in Computer Science Education

Download Paper |

Conference

2023 ASEE Annual Conference & Exposition

Location

Baltimore , Maryland

Publication Date

June 25, 2023

Start Date

June 25, 2023

End Date

June 28, 2023

Conference Session

Framework Studies

Tagged Division

Educational Research and Methods Division (ERM)

Tagged Topic

Diversity

Page Count

15

DOI

10.18260/1-2--42281

Permanent URL

https://peer.asee.org/42281

Download Count

175

Request a correction

Paper Authors

biography

Monica McGill CSEdResearch.org Orcid 16x16 orcid.org/0000-0002-3096-9619

visit author page

Monica McGill is President & CEO of CSEdResearch.org and a Temporary Research Specialist at Knox College. Her area of scholarship is K-12 computer science and cybersecurity education research with a current focus on diversity and improving the quality of research.

visit author page

biography

Angelica Thompson CSEdResearch.org

visit author page

Dr. Thompson has a Ph.D. in Educational Psychology and Research. She has extensive experience working as an internal researcher and program evaluator for a large-scale K–12 school district. As the Senior Education Researcher at CSEdResearch.org, she works to ensure equity and access in the field of CS, with a focus on advancing the academic and economic outcomes of underrepresented youth.

visit author page

author page

Darius Ellis James

Download Paper |

Abstract

Problem: RPP are a relatively new, promising strategy of creating a collaboration between researchers and practitioners for better alignment. Henrick and colleagues’ (2017) Five Dimensions of Effectiveness is one of the few frameworks for evaluating RPP effectiveness. However, researchers need a framework for understanding how to not only evaluate RPP effectiveness, but to also evaluate equitable practices within an RPP. Research Question: Our research question is: What types of equitable-practice codes can be derived from the Five Dimensions to assess the effectiveness of an RPP aimed at increasing equity in computer science education? Methodology: We developed research questions for each of the Five Dimensions, identified indicators of success for each dimension, and developed equity-focused codes for each indicator. We then created a corresponding semi-structured interview protocol. This study is preregistered at the Center for Open Science. Data Procedures: We conducted semi-structured interviews with the members (n=8) of a newly formed RPP, viewed recordings of all meetings between the organizations, and collected post-meeting surveys and analyzed the data using the newly created codebook. Results: Findings show that the codebook may be a useful tool for evaluating equitable practices within the RPP. We also used this process to provide iterative feedback to the RPP allowing the team to engage in continuous improvement methods and in-the-moment changes to increase inclusive collaboration and broadening participation. Implications: An equity-focused codebook can be used to analyze equitable practices within RPPs, provide ongoing feedback, and ensure all partners have an equal voice in the process.

McGill, M., & Thompson, A., & James, D. E. (2023, June), Applying the Five Dimensions of Effectiveness Framework to Evaluate the Effectiveness of a Research Practice Partnership Aimed at Increasing Equity in Computer Science Education Paper presented at 2023 ASEE Annual Conference & Exposition, Baltimore , Maryland. 10.18260/1-2--42281

ASEE holds the copyright on this document. It may be read by the public free of charge. Authors may archive their work on personal websites or in institutional repositories with the following citation: © 2023 American Society for Engineering Education. Other scholars may excerpt or quote from these materials with the same citation. When excerpting or quoting from Conference Proceedings, authors should, in addition to noting the ASEE copyright, list all the original authors and their institutions and name the host city of the conference. - Last updated April 1, 2015