METAMORPHIC TESTING FOR FAIRNESS EVALUATION IN LARGE LANGUAGE MODELS
| Author/creator | Anthamola, Harishwar Reddy author |
| Other author | Madhusudan, Dr.Srinivasan degree supervisor. |
| Other author | East Carolina University |
| Format | Theses and dissertations |
| Publication | [Greenville, N.C.] : [East Carolina University], 2025. |
| Description | 73 pages |
| Supplemental Content | Access via ScholarShip |
| Summary | Large Language Models (LLMs) have made significant progress in Natural Language Processing, yet they remain susceptible to fairness-related issues, often reflecting biases from their training data. These biases present risks, mainly when LLMs are used in sensitive domains such as healthcare, finance, and law. This research proposes a metamorphic testing approach to uncover fairness bugs in LLMs systematically. We define and apply fairness-oriented metamorphic relations (MRs) to evaluate state-of-the-art models like LLaMA and GPT across diverse demographic inputs. By generating and analyzing source and follow-up test cases, we identify patterns of bias, particularly in tone and sentiment. Results show that tone-based MRs detected up to 2,200 fairness violations, while sentiment-based MRs detected fewer than 500, highlighting the strength of this method. This study presents a structured strategy for enhancing fairness in LLMs and improving their robustness in critical applications. |
| Dissertation note | East Carolina University 2025. |
| Bibliography note | Includes bibliographical references. |
| Technical details | System requirements: Adobe Reader. |
| Technical details | Mode of access: World Wide Web. |
Availability
| Library | Location | Call Number | Status | Item Actions |
|---|---|---|---|---|
| Electronic Resources | Access Content Online | ✔ Available |