News for hackers. Stuff that matters.
Re:AI Crap – Drew Devault by ben_w on Tuesday August 29, 2023 @07:20AM (#37306052)
If the OpenAI pricing is indicative, reading 16k token of medical history and giving a 4k token response will cost $1.50 on GPT-4 and 6.4¢ on GPT-3.5-turbo.

The lower of those two is roughly what someone at the UN abject poverty threshold will spend in 48 minutes 30 seconds on "not literally starving to death".

Re:AI Crap – Drew Devault by danielbln on Tuesday August 29, 2023 @09:06AM (#37307250)
And if you use fine tuning and RAG you can cut the cost by an order of magnitude. Also, how much did it cost 2 years ago?
Re:AI Crap – Drew Devault by ben_w on Tuesday August 29, 2023 @09:14AM (#37307363)
Was it[0] available at any price 2 years ago?

(Assuming you mean literally an order of magnitude: 0.64¢ is, judging by Amazon.com, less than the bulk price of a single sheet of unused printer paper, or two thirds of a paperclip).

[0] 3 or anything equivalent to it, given 4 obviously wasn't

Re:AI Crap – Drew Devault by danielbln on Tuesday August 29, 2023 @09:22AM (#37307501)
I was making the point that this is new tech, not available to us at all a few mere years ago, so assuming a constant cost when making predictions is difficult. Assume inference prices will go down, not up.
Re:AI Crap – Drew Devault by ben_w on Tuesday August 29, 2023 @09:41AM (#37307790)
Ah, in that case we're on the same page. I'm expecting at least a factor of 1000 to be possible given the apparent higher efficiency of the human brain vs current computers, which is of course terrifying given how good and cheap the various creative AI already are, while also seeming like a prerequisite for robotic/car AI to be all three of "good enough", "fast enough", and "within the limited power budget".
Re:AI Crap – Drew Devault by tim333 on Wednesday August 30, 2023 @05:33AM (#37319484)
>spend in 48 minutes 30 seconds on "not literally starving to death".

I don't get that. In the poorest people get by on the equivalent of about $1 per day and not many starve. In fact the only part of the planet where the population is booming at the moment is sub Saharan Africa.

Chat GTP and similar will presumably have free tiers.