News for hackers. Stuff that matters.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by staticman2 on Saturday September 21, 2024 @12:04PM (#41610793)
I'm really curious what you are doing with an LLM that can be solved 80% of the time with a 8b model.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by albertgoeswoof on Saturday September 21, 2024 @02:46PM (#41611831)
It’s mostly how would you solve this programming problem, or reminders on syntax, scaffolding a configuration file etc.

Often it’s a form of rubber duck programming, with a smarter rubber duck.

Re:Forget ChatGPT: why researchers now run small AIs on thei... by skydhash on Saturday September 21, 2024 @05:59PM (#41612946)
All of this can be solved with a 3-20MB PDF file, a 10kb snippet/template file, and a whiteboard.
Re:Forget ChatGPT: why researchers now run small AIs on thei... by rNULLED on Saturday September 21, 2024 @06:46PM (#41613222)
Don’t forget the duct tape
Re:Forget ChatGPT: why researchers now run small AIs on thei... by remram on Sunday September 22, 2024 @01:34PM (#41618545)
"Dropbox will never work, you can already build such a system yourself quite trivially by getting an FTP account and mounting it locally with curlftpfs"