BROWSE
Detail
Conference Paper
From Words to Code: Do NLP Prompting Strategies Generalize to Code Generation?
- Authors
- Erin Woo, Sangyeop Yeo, Hyungkook Jun, Sangcheol Kim, Seung-Won Hwang, Yu-Seung Ma
- Issue Date
- 2026-04
- Citation
- International Conference on Fundamental Approaches to Software Engineering (FASE) 2026, pp.43-63
- Publisher
- Springer
- Language
- English
- Type
- Conference Paper
- Abstract
- Prompt engineering plays an important role in optimizing the performance of Large Language Models (LLMs). Although various prompting techniques have achieved substantial gains in natural language processing (NLP), their transferability to code generation remains underexplored. This paper presents an empirical study that examines the effects of NLP-inspired prompting methods on code generation using five LLMs and two established benchmarks, HumanEval and LiveCodeBench. We find that instruction-based prompting produces surprisingly limited or inconsistent improvements in programming contexts, while reasoning-based prompting delivers stronger and more stable performance. Our analysis identified two forms of reasoning-based prompting—procedural and goal-oriented—each addressing different aspects of reasoning and both effective for code generation. Building on these findings, we explore prompt designs that more fully leverage the reasoning capabilities of advanced LLMs, achieving measurable improvements in code generation accuracy. These results emphasize the continuing importance of prompt design in advancing AI-assisted programming.
- KSP Keywords
- Goal-oriented, Language Models, Natural Language processing, Prompt design, code generation, empirical study, stable performance
This work is distributed under the term of Creative Commons License (CCL)
(CC BY NC ND)
(CC BY NC ND)
