BROWSE
Detail
Conference Paper
Can We Entrust Justice to AI?: How Persona Traps Contaminate Reasoning in Criminal Investigation
- Authors
- Jaewook Lee, Myeong-Cheol Kang, Jong-hun Shin
- Issue Date
- 2026-07
- Citation
- Findings of the Association for Computational Linguistics: ACL 2026, pp.17083-17103
- Publisher
- Association for Computational Linguistics
- Language
- English
- Type
- Conference Paper
- Abstract
- If large language models (LLMs) are deployed to analyze evidence and evaluate suspects in criminal investigations, are they free from the very trap that has led countless human investigators to misjudgment—implicit bias swayed by information irrelevant to the essence of the case? To answer this question, this study systematically injected personas (gender, race, relationship) into neutralized murder mystery scenarios and examined the reasoning stability of LLMs. Experimental results revealed that implicit bias propagation was observed across all models. The phenomenon where models outwardly state “that information is irrelevant to the judgment” while their actual conclusions are already influenced by the injected persona was universally observed. Interestingly, model scale alone did not guarantee stability: while the largest model achieved the lowest instability, several smaller models outperformed much larger ones. The most notable finding concerns the differential vulnerability across persona types: while race and gender were processed relatively stably, relationship information—particularly hostile relationships—induced significantly higher reasoning contamination. More concerning is the fact that even when conclusions were correctly maintained, the reasoning process itself was extensively contaminated. These findings suggest that current alignment techniques have created a blind spot by focusing on identity-based bias while neglecting relationship-based bias, and propose that stability evaluation should encompass not only outputs but also reasoning processes.
- KSP Keywords
- Blind spot, Criminal investigation, Implicit bias, Language Models, Model scale, Reasoning process, Stability evaluation, identity-based
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
