If you know something for a fact, then are you also just parroting back? These models rely on confidence so what else should they return if they get a prompt they have a 99.9999% probability to be a best match?

There's a difference between getting a predictable response for writing a fast inverse square root function and generating a custom solution that perfectly fits your data structure which matches the given context.