News for hackers. Stuff that matters.

A comment on Forget ChatGPT: why researchers now run small AIs on their laptops. Parent comment

Re:Forget ChatGPT: why researchers now run small AIs on thei... by kaoD on Saturday September 21, 2024 @02:51PM (#41611867)
Well this was my experience...

    User: Hey, how are you?
    Llama: [object Object]
It's funny but I don't think I did anything wrong?
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by AlienRobot on Saturday September 21, 2024 @03:03PM (#41611927)
2000: Javascript is webpages.

2010: Javascript is webservers.

2020: Javascript is desktop applications.

2024: Javascript is AI.

[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by evbogue on Saturday September 21, 2024 @03:10PM (#41611980)
From this data we must conclude that within our lifetimes all matter in the universe will eventually be reprogrammed in JavaScript.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by mnky9800n on Saturday September 21, 2024 @03:43PM (#41612202)
I'm not sure I want to live in that reality.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by mortenjorck on Saturday September 21, 2024 @04:08PM (#41612357)
If the simulation hypothesis is real, perhaps it would follow that all the dark matter and dark energy in the universe is really just extra cycles being burned on layers of interpreters and JIT compilation of a loosely-typed scripting language.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by AlienRobot on Saturday September 21, 2024 @04:20PM (#41612428)
It's fine, it will be Typescript.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by anotherjesse on Saturday September 21, 2024 @04:49PM (#41612583)
WAT? https://www.destroyallsoftware.com/talks/wat
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by heresie-dabord on Monday September 23, 2024 @01:20PM (#41628380)
... a reality where everything in software development that was previously established as robust foundation is discarded, only to be re-learned and re-implemented less well while burning VC cash.
[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by Jedd on Saturday September 21, 2024 @08:51PM (#41613763)
Often you'll find there's '-chat-' and '-instruct-' variants of an LLM available.

Trying to chat to an INSTRUCT model will be disappointing, much as you describe.

[ Parent | on HN ]
Re:Forget ChatGPT: why researchers now run small AIs on thei... by kaoD on Saturday September 21, 2024 @09:28PM (#41613951)
This was on their example LLaVA 1.5 7b q4 with all default parameters which does not specify chat or instruct... but after the first message it actually worked as expected so I guess it's RLHF'd for chat or chat+instruct.

I don't know if it was some sort of error on the UI or what.

Trying to interrogate it about the first message yielded no results. It just repeated back my question, verbatim, unlike the rest of the chat which was more or less chat-like :shrugh:

[ Parent | on HN ]