This statement nicely describes my experience with LLMs. They may have a hard time staying on topic (especially with larger untuned models like LLaMA 13B+), but if you help them stay on track, they become very useful.