Show HN: I made the slowest, most expensive GPT

Re:Show HN: I made the slowest, most expensive GPT by zamadatix on Friday December 13, 2024 @02:35PM (#42411600)

Interesting idea, cool concept. I tried asking "What is the best SNES game most people haven't played". The top answer (Terranigma) was unfortunately the same as I got just asking any of Claude/ChatGPT/Llama/Qwen (maybe too easy a question) but the rest of the list did seem a bit more balanced. Thanks for the free try without a login!

Thought: there is a marquee of example queries but it doesn't seem like there is a way to see what an answer looks like without individually consuming a search as a user. Maybe if these were clickable to a cached version it'd be easier to get an idea of the outputs without costing so much?

[ Parent | on HN ]

Re:Show HN: I made the slowest, most expensive GPT by wluk on Friday December 13, 2024 @03:35PM (#42412123)

That's a good idea! I have a feeling that Perplexity and ChatGPT are doing something similar, since common questions I'd ask like "top movies this year" will be answered nearly-instantaneously, way faster than GPT-4o could have done on its own.

The only explanation for this is that so many users ask certain questions, they cache the response and return the cached answer.

I'd love to do this for Ithy, but it'll be a while before I get the scale of ChatGPT/Perplexity that's needed for this...

[ Parent | on HN ]

Re:Show HN: I made the slowest, most expensive GPT by ricktdotorg on Friday December 13, 2024 @06:24PM (#42413288)

already mentioned in another comment by me but this would/could be a primo use-case of Cloudflare AI gateway. i'm not related/affiliated with them at all, just a user/dev with very little traffic thinking it might help someone with a lot of it

[ Parent | on HN ]