As an experienced LLM user, I don't use generative LLMs often

Re:As an experienced LLM user, I don't use generative LLMs o... by thewebguyd on Tuesday May 06, 2025 @11:55AM (#43906568)

This has largely been my experience as well, at least with GH Copilot. I mostly use it as a better Google now, because even with context of my existing code, it can't adhere to style at all. Hell, it can't even get docker compose files right, using various versions and incorrect parameters all the time.

I also noticed language matters a lot as well. It's pretty good with Python, pandas, matplotlib, etc. But ask it to write some PowerShell and it regularly hallucinates modules that don't exist, more than any other language I've tried to use it with.

And good luck if you're working with a stack that's not flavor of the month with plenty of online information available. ERP systems with its documentation living behind a paywall, so it's not in the training data - you know, real world enterprise CRUD use cases where I'd want to use it the most, it's the least helpful.

[ Parent | on HN ]

Re:As an experienced LLM user, I don't use generative LLMs o... by namaria on Wednesday May 07, 2025 @05:21AM (#43913648)

To be fair, I find ChatGPT useful for Elixir, which is pretty niche. The great error messages (if a bit verbose) and the atomic nature of functions in a functional language goes with the grain of LLMs I think.

Still, at most I get it to help me with snippets. I wouldn't want it to just generate lots of code, for one it's pretty easy to write Elixir...

[ Parent | on HN ]