Dickson, D., & Jonczyk, R., & Gunay, E., & Van Hell, J., & Siddique, Z. (2022, August), Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings  Paper presented at 2022 ASEE Annual Conference & Exposition, Minneapolis, MN. 10.18260/1-2--41126

\bibitem{asee_peer_41126}
  Dickson, D., \& Jonczyk, R., \& Gunay, E., \& Van Hell, J., \& Siddique, Z. (2022, August), \emph{Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings}
  Paper presented at 2022 ASEE Annual Conference \& Exposition, Minneapolis, MN.
  10.18260/1-2--41126

Danielle Dickson, Rafal Jonczyk, Elif Gunay, Janet Van Hell, and Zahed Siddique.  "Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings".  2022 ASEE Annual Conference & Exposition, Minneapolis, MN, 2022, August.  ASEE Conferences, 2022.  https://strategy.asee.org/41126 Internet.  18 Aug, 2024

\bibitem{asee_peer_41126}
  Danielle Dickson, Rafal Jonczyk, Elif Gunay, Janet Van Hell, and Zahed Siddique.
  "Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings".
  \emph{2022 ASEE Annual Conference \& Exposition, Minneapolis, MN, 2022, August}.
  ASEE Conferences, 2022.
  https://strategy.asee.org/41126 Internet.  18 Aug, 2024

@INPROCEEDINGS{asee_peer_41126
author = "Danielle Dickson, Rafal Jonczyk, Elif Gunay, Janet Van Hell, and Zahed Siddique"
title = "Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings"
booktitle = "2022 ASEE Annual Conference \& Exposition"
year = "2022"
month = "August"
address = "Minneapolis, MN"
publisher = "ASEE Conferences"
note = {https://strategy.asee.org/41126}
number = {10.18260/1-2--41126}
}

TY  - CPAPER
AB  - Measuring an individual’s creativity typically relies on labor-intensive subjective ratings of the quality of ideas and solutions to problems. In the Alternate Uses Task (AUT), frequently used in engineering design education for concept generation and to gauge creative function-object relationships, participants generate as many novel uses of everyday objects as possible within a given time frame. Unfortunately, objective and rapid evaluation of AUT responses for levels of originality and usefulness is difficult. Recently, an automatized method for generating scores has been developed, the freely accessible Semantic Distance (SemDis) tool [1]. Given the linguistic and cultural diversity of engineering students in the U.S., it seems fair to question how well this type of automatic rating system, based on prototypical language models, captures the creativity of engineering students who may be nonnative speakers of English. We extensively trained human raters to score the AUT responses of multilingual engineering students living in either a non-English environment or in the US, and the AUT responses of monolingual English engineering students. We found that the human ratings of all three groups of engineering students correlated strongly, and positively, with the automatic SemDis ratings. This forms proof of concept for using automatic rating systems such as SemDis in engineering classroom settings. In addition to saving evaluators’ time, this method may also be preferred because it is unbiased to cultural and linguistic features of responders’ answers that might reveal their gender, race, ethnic or linguistic background information. 
AU  - Danielle Dickson
AU  - Rafal Jonczyk
AU  - Elif Gunay
AU  - Janet Van Hell
AU  - Zahed Siddique
CY  - Minneapolis, MN
DA  - 2022/08/23
PB  - ASEE Conferences
TI  - Utilization of Automatized Creativity Ratings in  Linguistically Diverse Populations:  Automated Scores Align with Human Ratings
UR  - https://strategy.asee.org/41126
DO  - 10.18260/1-2--41126
ER  -