Cao, C., & Bandara, D. (2024, April), Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models  Paper presented at 2024 ASEE North East Section, Fairfield, Connecticut. 10.18260/1-2--45767

\bibitem{asee_peer_45767}
  Cao, C., \& Bandara, D. (2024, April), \emph{Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models}
  Paper presented at 2024 ASEE North East Section, Fairfield, Connecticut.
  10.18260/1-2--45767

Christina Cao and Danushka Bandara.  "Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models".  2024 ASEE North East Section, Fairfield, Connecticut, 2024, April.  ASEE Conferences, 2024.  https://peer.asee.org/45767 Internet.  02 Jul, 2024

\bibitem{asee_peer_45767}
  Christina Cao and Danushka Bandara.
  "Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models".
  \emph{2024 ASEE North East Section, Fairfield, Connecticut, 2024, April}.
  ASEE Conferences, 2024.
  https://peer.asee.org/45767 Internet.  02 Jul, 2024

@INPROCEEDINGS{asee_peer_45767
author = "Christina Cao and Danushka Bandara"
title = "Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models"
booktitle = "2024 ASEE North East Section"
year = "2024"
month = "April"
address = "Fairfield, Connecticut"
publisher = "ASEE Conferences"
note = {https://peer.asee.org/45767}
number = {10.18260/1-2--45767}
}

TY  - CPAPER
AB  - In this study, we investigate the types of stereotypical bias in Large Language Models (LLMs). We highlight the risks of ignoring bias in LLMs, ranging from perpetuating stereotypes to affecting hiring decisions, medical diagnostics, and criminal justice outcomes. To address these issues, we propose a novel approach to evaluate bias in LLMs using metrics developed by Stereoset [1].
Our experiments involve evaluating several proprietary and open-source LLMs (GPT4, GEMINI PRO, OPENCHAT, LLAMA) for stereotypical bias and examining the attributes that influence bias. We used a selected 100 prompts from the stereoset dataset to query the LLMs via their respective APIs. The results were evaluated using the language modeling score, stereotype score and the combination iCAT[1] score. In particular, open source LLMs showed higher levels of bias in handling stereotypes than proprietary LLMs (40% average stereotype score for the open source LLMs and 47% average stereotype score for the proprietary ones: 50% being the ideal, unbiased stereotype score). The language modeling score was even between the models, with the open source models achieving 94% and the proprietary ones 91%. The combined average iCAT score was 76.6% for the proprietary models and 62.5% for the open source models.
This disparity in stereotypical bias could be due to the regulatory inspection and user testing through reinforcement learning with human feedback (RLHF) that the proprietary models are subject to. We present our findings and discuss their implications for mitigating bias in LLMs. Overall, this research contributes to the understanding of bias in LLMs and provides insights into strategies for improving fairness and equity in NLP applications.

[1] Nadeem, M., Bethke, A., & Reddy, S. (2020). StereoSet: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456.
AU  - Christina Cao
AU  - Danushka Bandara
CY  - Fairfield, Connecticut
DA  - 2024/04/19
PB  - ASEE Conferences
TI  - Evaluating Stereotypical Biases and Implications for Fairness in Large Language Models
UR  - https://peer.asee.org/45767
DO  - 10.18260/1-2--45767
ER  -