It only makes sense if traditional LLMs are either too expensive or too slow.

That’s it, that’s the only use case.

However there are use cases that meet that requirement, for example, near instant labeling of dynamically generated content on the screen.