Re:Some thoughts on LLMs and software development
by roadside_picnic on Friday August 29, 2025 @01:31PM
(#45067011)
Here's an entire paper [0] showing the impact of extremely minor structural changes on the quality of the results of the model. Things as simple as not using a colon in the prompt can lead to notably degraded (or improved) performance.
0. https://arxiv.org/pdf/2310.11324