News for hackers. Stuff that matters.
Re:Phind 2: AI search with visual answers and multi-step rea... by cholantesh on Thursday February 13, 2025 @09:14PM (#43043995)
If it's costly to run, maybe it's reasonable to expect that persisting settings, which is also costly, has some level of gatekeeping? I'm as ambivalent about LLMs as the next guy, but these are frankly nonsense concerns.
Re:Phind 2: AI search with visual answers and multi-step rea... by rufffered on Friday February 14, 2025 @12:20AM (#43045108)
Either you are confused or maybe I am?

The ‘costly’ bit is referring to when asking for a SELECT statement instead of just receiving the SELECT statement I am given pages of overly verbose flowery text, reminders, and custom generated flow chart diagrams.

My understanding is most of these things charge per token so I am assuming generating more tokens incurs more costs, and I’m saying it’s generating needless tokens that frustrate me, so cui bono these additional costs?

Also more token generation means more energy resources consumed, so it’s burning the planet to frustrate someone it is trying to convince to become a paying customer.

How are these nonsense concerns?

It is unnecessary to persist any settings if I can just click a “just answer the question” checkbox before clicking send on the prompt.