BROWSE
Detail
Conference Paper
Make LLMs See Like Investigators, Not Just Think More: The Role of Structured Analysis in Investigative Reasoning
- Authors
- Jaewook Lee, Myeong-Cheol Kang, Jong-hun Shin
- Issue Date
- 2026-07
- Citation
- Annual Meeting of the Association for Computational Linguistics (ACL) 2026, pp.23037-23058
- Publisher
- Association for Computational Linguistics
- Language
- English
- Type
- Conference Paper
- Abstract
- Criminal investigators and intelligence analysts have developed structured analytic techniques to evaluate competing hypotheses under incomplete information. This study examines whether such human expert investigative methodologies are also effective for narrative-based culprit inference in large language models (LLMs). Focusing on the task of analyzing evidence from complex narratives and identifying the perpetrator among suspects, we conducted experiments on 10 LLMs using the MuSR murder mystery benchmark. The PRISM framework, which applies investigative techniques, consistently outperformed existing general-purpose strategies across all models, with its effectiveness manifesting regardless of model scale. Ablation studies revealed that the hypothesis structuring stage is particularly crucial, accounting for 89% of the methodological improvement beyond information filtering. This suggests that domain-specific structures that specify “what to analyze” are more effective in LLM reasoning than simply increasing the number of reasoning paths.
- KSP Keywords
- Domain-specific, Incomplete Information, Information Filtering, Investigative techniques, Language Models, Model scale, Structured analysis
This work is distributed under the term of Creative Commons License (CCL)
(CC BY)
(CC BY)
