Evaluating and Comparing Delivery Strategies for Hardware-Based Online Labs

Christopher A. Sanchez; Kahlan Fleiger-Holmes; Brian John Zhang; Naomi T. Fitter

Download Paper | Permalink

Conference: 2024 ASEE Annual Conference & Exposition
Location: Portland, Oregon
Publication Date: June 23, 2024
Start Date: June 23, 2024
End Date: July 12, 2024
Conference Session: Educational Research and Methods Division (ERM) Technical Session 26
Tagged Division: Educational Research and Methods Division (ERM)
Permanent URL: https://peer.asee.org/47340

Request a correction

Paper Authors

biography

Christopher A. Sanchez Oregon State University

visit author page

Dr. Sanchez is a cognitive psychologist with explicit interests in STEM education; specifically in the areas of engineering and design. He is currently an Associate Professor of Engineering Psychology at Oregon State University where he heads the Applied Cognitive Theory, Usability and Learning (ACTUAL) Laboratory.

visit author page

author page

Dr. Naomi T. Fitter is an Assistant Professor in the School of Mechanical, Industrial, and Manufacturing Engineering at Oregon State University. Her past degrees include a B.S. and B.A. in mechanical engineering and Spanish from the University of Cincinnati and an M.S.E. and Ph.D. in robotics and mechanical engineering and applied mechanics from the University of Pennsylvania, and she completed her postdoctoral work at the University of Southern California. As a member of the Collaborative Robotics and Intelligent Systems (CoRIS) Institute, Dr. Fitter aims to equip robots with the ability to engage and empower people in interactions from playful high-fives to challenging physical therapy routines.

visit author page

Download Paper | Permalink

Abstract

Paper Type: We are proposing our past work on undergraduate engineering outcomes in an online lab-based measurement & instrumentation course as a Research paper at the 2024 ASEE Annual Conference.

Motivation and Background: Since the rise of online education, researchers in engineering education have been studying the virtual delivery of coursework, especially for job training or re-training topics like programming and mechatronics. Yet gaps in online course delivery and understanding remain, especially for lab classes that require hands-on experiential learning with real hardware. This type of instruction is critical for student comprehension and skill transference, but to date there is limited consensus on how best to deliver this experiential course content, especially in online education contexts. Our research centered on studying student experiences and learning outcomes across different levels of synchronous delivery of an online lab class (relative to an in-person class in the same student body) to help answer questions about how to administer hardware-based lab learning online and how much synchronous engagement is enough in these cases.

Methods: This project considered student experiences and learning outcomes in an upperclassmen-level lab-based measurement and instrumentation class at a large public university, which uses a “lab kit-in-a-box” model. We collected data from versions of the course that varied instruction synchronicity, spanning the following scenarios: asynchronous, synchronous, and in-person. Asynchronous offerings involved no synchronous interactions with the teaching team, aside from almost fully unused interaction with teaching team members during office hours (held via Zoom). Synchronous offerings involved fully synchronous labs (held via the gather.town platform) and office hours (held via Zoom).

Results: We collected data from approximately 200 consenting undergraduate mechanical engineering students in each of the synchronicity options (N > 600) and analyzed the data from varying levels of course synchronicity using statistical tests. This assessment compared student experiences and learning outcomes across all three variations of the studied class: asynchronous, synchronous, and in-person. Key results included the insight that certain lab experiences (e.g., early labs with high levels of early skill-building for the class) went best in the synchronous online iterations, while later labs with deeper dives into specific skills were experienced similarly between the synchronous online and in-person delivery conditions. Importantly, synchronous online delivery was often indistinguishable in end result from in-person delivery, which is encouraging news.

Implications: This work helps to answer important open questions about how to deliver hands-on experiential training to engineering students in online learning settings. Outcomes from the work can help to lay the groundwork for broader and theoretical investigation into pedagogical question on hardware-based Ecampus lab work, as well as synchronicity in online learning, while also addressing the pressing need for access to high-quality engineering training for all learners. The results of this investigation can benefit engineering educators, as well as those with interest in online physical labs in other disciplines.

Keywords: Online Education, Laboratory Learning, Student Experience

Citation
Format

Sanchez, C. A., & Fleiger-Holmes, K., & Zhang, B. J., & Fitter, N. T. (2024, June), Evaluating and Comparing Delivery Strategies for Hardware-Based Online Labs Paper presented at 2024 ASEE Annual Conference & Exposition, Portland, Oregon. https://peer.asee.org/47340

TY  - CPAPER
AB  - Paper Type: We are proposing our past work on undergraduate engineering outcomes in an online lab-based measurement &amp;amp; instrumentation course as a Research paper at the 2024 ASEE Annual Conference.

Motivation and Background: Since the rise of online education, researchers in engineering education have been studying the virtual delivery of coursework, especially for job training or re-training topics like programming and mechatronics. Yet gaps in online course delivery and understanding remain, especially for lab classes that require hands-on experiential learning with real hardware. This type of instruction is critical for student comprehension and skill transference, but to date there is limited consensus on how best to deliver this experiential course content, especially in online education contexts. Our research centered on studying student experiences and learning outcomes across different levels of synchronous delivery of an online lab class (relative to an in-person class in the same student body) to help answer questions about how to administer hardware-based lab learning online and how much synchronous engagement is enough in these cases.

Methods: This project considered student experiences and learning outcomes in an upperclassmen-level lab-based measurement and instrumentation class at a large public university, which uses a “lab kit-in-a-box” model. We collected data from versions of the course that varied instruction synchronicity, spanning the following scenarios: asynchronous, synchronous, and in-person. Asynchronous offerings involved no synchronous interactions with the teaching team, aside from almost fully unused interaction with teaching team members during office hours (held via Zoom). Synchronous offerings involved fully synchronous labs (held via the gather.town platform) and office hours (held via Zoom). 

Results: We collected data from approximately 200 consenting undergraduate mechanical engineering students in each of the synchronicity options (N &amp;gt; 600) and analyzed the data from varying levels of course synchronicity using statistical tests. This assessment compared student experiences and learning outcomes across all three variations of the studied class: asynchronous, synchronous, and in-person. Key results included the insight that certain lab experiences (e.g., early labs with high levels of early skill-building for the class) went best in the synchronous online iterations, while later labs with deeper dives into specific skills were experienced similarly between the synchronous online and in-person delivery conditions. Importantly, synchronous online delivery was often indistinguishable in end result from in-person delivery, which is encouraging news.

Implications: This work helps to answer important open questions about how to deliver hands-on experiential training to engineering students in online learning settings. Outcomes from the work can help to lay the groundwork for broader and theoretical investigation into pedagogical question on hardware-based Ecampus lab work, as well as synchronicity in online learning, while also addressing the pressing need for access to high-quality engineering training for all learners. The results of this investigation can benefit engineering educators, as well as those with interest in online physical labs in other disciplines.

Keywords: Online Education, Laboratory Learning, Student Experience
AU  - Christopher A. Sanchez
AU  - Kahlan Fleiger-Holmes
AU  - Brian John Zhang
AU  - Naomi T. Fitter
CY  - Portland, Oregon
DA  - 2024/06/23
PB  - ASEE Conferences
TI  - Evaluating and Comparing Delivery Strategies for Hardware-Based Online Labs
UR  - https://peer.asee.org/47340
ER  -