Board 436: Work in Progress: Testing and Examining the Impact of a Set of STEM-Oriented Creative Video Projects on STEM Students’ Psychosocial, Persistence, and Scholastic Outcomes

Marcus Antonius Ynalvez; Claudia San Miguel; Ruby Ynalvez; Deepak Ganta; Runchang Lin; Marcela Moran; Leonela Preciado; Mayra Alejandra Garza; Rene Rangel; Veronica Judith Prado

Download Paper | Permalink

Conference: 2024 ASEE Annual Conference & Exposition
Location: Portland, Oregon
Publication Date: June 23, 2024
Start Date: June 23, 2024
End Date: July 12, 2024
Conference Session: NSF Grantees Poster Session
Tagged Topic: NSF Grantees Poster Session
Permanent URL: https://strategy.asee.org/47027

Request a correction

Paper Authors

biography

Marcus Antonius Ynalvez Texas A&M International University

visit author page

Marcus Antonius Ynalvez is a professor of sociology at Texas A&M International University. His areas of interest are the sociology of science, science education and training, and advanced quantitative methodologies.

visit author page

author page

Claudia San Miguel Texas A&M International University

biography

Ruby Ynalvez Texas A&M International University

visit author page

Dr. Ruby Ynalvez is a professor of biology at Texas A&M International University in Laredo, Texas, USA. She is a Co-PI in this U.S. National Science Foundation-funded project.

visit author page

biography

Deepak Ganta Texas A&M International University

visit author page

Dr. Deepak Ganta is an Associate Professor of Engineering at Texas A&M International University. His research interests include Nanotechnology, Machine Learning, Sensors, and Engineering Education.

visit author page

biography

Runchang Lin Texas A&M International University

visit author page

Dr. Runchang Lin received Ph.D. in Mathematics and M.A. in Statistics from Wayne State University, Detroit, MI, and M.S. in Computational Mathematics and B.S. in Mathematics from Tongji University, Shanghai, China. He is a Professor of Mathematics at Texas A&M International University, Laredo, TX. Dr. Lin’s research interest is in Numerical Analysis and Applied Mathematics. He has published more than 30 articles in numerical analysis and education in peer reviewed journals.

visit author page

author page

Marcela Moran Texas A&M International University

biography

Leonela Preciado Texas A&M International University

visit author page

MBA
Program Manager for "Building Capacity: An Undergraduate STEM-Enrichment Program in TX" Award #1953679.

visit author page

author page

Abstract

We present preliminary results from a scientific research study conducted at Texas A&M International University (TAMIU); a Hispanic-Serving Institution located along the U.S-Mexico border. Our study focuses on generating knowledge about learning strategies that improve and enhance undergraduate STEM education. As such, our study has both a programmatic and a research component. Through our project's programmatic component, we aim at increasing the quantity and improving the quality of retained and graduated TAMIU STEM-students. We do this by engaging 3 consecutive cohorts (one cohort per year) of students in a 4-semester pre-/early-college (i.e., pre-college summer; and freshman fall/spring/summer semesters) curriculum-based STEM-enrichment program called USTEM. Through USTEM, we implement high-impact and proven STEM-enrichment activities, practices, and strategies published in the STEM-education literature. Through our project’s research component, we examine how a set of creative video projects (CVPs) that we designed influences students’ psychosocial, scholastic, and persistence outcomes.

Casted as a longitudinal RCT-type experiment in generalized randomized block design (GRBD; with cohorts as complete blocks and students serving as replications within complete blocks), we randomly assign half of each cohort to participate in USTEM without CVPs (USTEM1); the other half of each cohort to participate in USTEM with CVPs (USTEM2). USTEM2 participants produced four CVPs in the form of: 1) a biography of a STEM scientist, 2) a position statement on a STEM controversy, 3) a tutorial on a STEM technique, and 4) a methodological critique of a STEM peer-reviewed research article. Outcomes were measured every end-of-semester.

The longitudinal data set generated allows us to compare and evaluate the efficacy of USTEM1 versus USTEM2, and to parametrically characterize trends across semesters; and to assess and evaluate USTEM as a STEM-enrichment program methodically and statistically. We performinferential analyses using SAS 9.4 (e.g., PROC MIXED) and SPSS 29 Premium Version (Generalized Linear Models). In consideration of the level of measurement and the empirical distribution of outcomes, and our objectives, the analytical techniques we use are in the form of analysis of variance, generalized linear models using normal (for scores) and logistic (for binary outcomes; e.g., graduated or not) link functions, and longitudinal analysis with trend analysis.

The intellectual merit of our research derives from our use of: 1) RCT-design, blocking and replication techniques, and GRBD-structured randomization to enhance internal validity and minimize extraneous variation; 2) longitudinal analytical techniques to examine trends in outcomes; and 3) empirically-validated and target-population-calibrated instruments to ensure the measurement reliability, reproducibility, and validity of the measures and indicators we use. Our research results and products advance a fundamental understanding of how STEM-oriented CVPs influence psychosocial outcomes and ultimately, persistence in STEM.

Citation
Format

Ynalvez, M. A., & San Miguel, C., & Ynalvez, R., & Ganta, D., & Lin, R., & Moran, M., & Preciado, L., & Garza, M. A., & Rangel, R., & Prado, V. J. (2024, June), Board 436: Work in Progress: Testing and Examining the Impact of a Set of STEM-Oriented Creative Video Projects on STEM Students’ Psychosocial, Persistence, and Scholastic Outcomes Paper presented at 2024 ASEE Annual Conference & Exposition, Portland, Oregon. https://strategy.asee.org/47027

TY  - CPAPER
AB  - We present preliminary results from a scientific research study conducted at Texas A&amp;amp;M International University (TAMIU); a Hispanic-Serving Institution located along the U.S-Mexico border. Our study focuses on generating knowledge about learning strategies that improve and enhance undergraduate STEM education. As such, our study has both a programmatic and a research component. Through our project&#39;s programmatic component, we aim at increasing the quantity and improving the quality of retained and graduated TAMIU STEM-students. We do this by engaging 3 consecutive cohorts (one cohort per year) of students in a 4-semester pre-/early-college (i.e., pre-college summer; and freshman fall/spring/summer semesters) curriculum-based STEM-enrichment program called USTEM. Through USTEM, we implement high-impact and proven STEM-enrichment activities, practices, and strategies published in the STEM-education literature. Through our project’s research component, we examine how a set of creative video projects (CVPs) that we designed influences students’ psychosocial, scholastic, and persistence outcomes. 

Casted as a longitudinal RCT-type experiment in generalized randomized block design (GRBD; with cohorts as complete blocks and students serving as replications within complete blocks), we randomly assign half of each cohort to participate in USTEM without CVPs (USTEM1); the other half of each cohort to participate in USTEM with CVPs (USTEM2). USTEM2 participants produced four CVPs in the form of: 1) a biography of a STEM scientist, 2) a position statement on a STEM controversy, 3) a tutorial on a STEM technique, and 4) a methodological critique of a STEM peer-reviewed research article. Outcomes were measured every end-of-semester.

The longitudinal data set generated allows us to compare and evaluate the efficacy of USTEM1 versus USTEM2, and to parametrically characterize trends across semesters; and to assess and evaluate USTEM as a STEM-enrichment program methodically and statistically. We performinferential analyses using SAS 9.4 (e.g., PROC MIXED) and SPSS 29 Premium Version (Generalized Linear Models). In consideration of the level of measurement and the empirical distribution of outcomes, and our objectives, the analytical techniques we use are in the form of analysis of variance, generalized linear models using normal (for scores) and logistic (for binary outcomes; e.g., graduated or not) link functions, and longitudinal analysis with trend analysis.

The intellectual merit of our research derives from our use of: 1) RCT-design, blocking and replication techniques, and GRBD-structured randomization to enhance internal validity and minimize extraneous variation; 2) longitudinal analytical techniques to examine trends in outcomes; and 3) empirically-validated and target-population-calibrated instruments to ensure the measurement reliability, reproducibility, and validity of the measures and indicators we use. Our research results and products advance a fundamental understanding of how STEM-oriented CVPs influence psychosocial outcomes and ultimately, persistence in STEM.

AU  - Marcus Antonius Ynalvez
AU  - Claudia San Miguel
AU  - Ruby Ynalvez
AU  - Deepak Ganta
AU  - Runchang Lin
AU  - Marcela Moran
AU  - Leonela Preciado
AU  - Mayra Alejandra Garza
AU  - Rene Rangel Jr.
AU  - Veronica Judith Prado
CY  - Portland, Oregon
DA  - 2024/06/23
PB  - ASEE Conferences
TI  - Board 436: Work in Progress: Testing and Examining the Impact of a Set of STEM-Oriented Creative Video Projects on STEM Students’ Psychosocial, Persistence, and Scholastic Outcomes 
UR  - https://strategy.asee.org/47027
ER  -