News for hackers. Stuff that matters.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by mejutoco on Thursday February 06, 2025 @03:51AM (#42960435)
> and every single week the results were slightly different.

This is one of the reasons why open source offline models will always be part of the solution, if not the whole solution.

Re:Ingesting PDFs and why Gemini 2.0 changes everything by rafaelmn on Thursday February 06, 2025 @04:27AM (#42960642)
Inconsistency comes from scaling - if you are optimizing your infra to be cos effective you will arrive at same tradeoffs. Not saying it's not nice to be able to make some of those decisions on your own - but if you're picking LLMs for simplicity - we are years away from running your own being in the same league for most people.
Re:Ingesting PDFs and why Gemini 2.0 changes everything by mejutoco on Thursday February 06, 2025 @07:53AM (#42961858)
And if you are not you wont.

You can decide if you change your local setup or not. You cannot decide the same of a service.

There is nothing inevitable about inconsistency in a local setup.