OpenAI Major Outage

Re:OpenAI Major Outage by moffkalast on Wednesday May 24, 2023 @05:19PM (#36063995)

Just saying, Guanaco LLama model just got released that actually beats GPT-3.5 in a fair few metrics. So right now it's already possible to run a local version with a beefy GPU and it'll only get better as time goes on.

In a strange coincidence I've recently been doing some tests with small 10 W solar panels and with two or three of those plus an Nvidia Xavier (20 W TDP) one could actually run a solar powered LLM right now with only about as much solar as fits on a person's back (though only the smaller 13B versions).

Give it a few years and we'll have them integrated into smartphones. So yes, you will in fact always have an LLM in your pocket just like the ol' calculator excuse.

[ Parent | on HN ]

Re:OpenAI Major Outage by gnicholas on Wednesday May 24, 2023 @05:30PM (#36064110)

Good to know! I'd still be surprised if we had solar-powered AI assistants that are powered via ambient indoor lighting in the next few decades.

[ Parent | on HN ]

Re:OpenAI Major Outage by moffkalast on Wednesday May 24, 2023 @05:43PM (#36064251)

That I doubt, but then again we've come ridiculously far in the last 20 years and having AI assistants will only accelerate research further. If the singularity is really just 6 years out as some calculate, then anything and everything is possible afterwards. If you believe such things of course.

[ Parent | on HN ]

Re:OpenAI Major Outage by BLKNSLVR on Wednesday May 24, 2023 @07:02PM (#36064970)

If the Singularity is only 6 years out then that means fusion power must be only 10 years out.

[ Parent | on HN ]