What about these things excite you?
Just the tech hubris of growth at all costs or the hope of some use case that has yet to manifest?
> 1. Very large foundational models (such as GPT5-level LLMs)
Has work been announced on or a release date been set for a GPT5 or are you just excited it might happen? Why stop there? Go ahead, be excited about MilleniumGPT.
Is there evidence that bigger is better forever?
> 2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs
To do what exactly?
Write fan letters to olympians for me?
Replace all of the real human friendships in my life?
To write an annoyingly verbose email from a bullet list that the recipient will be loathe to read and so will feed it into another agent to turn the email back into the same bullet list?
That they will annoy the hell out of you. ;)
There are two AI developments that I'm quite excited for:
1. Very large foundational models (such as GPT5-level LLMs)
2. Optimizations for smaller models, context size, inference speed, and multimodal LLMs
I think 2024 has been the year for #2, which is why the hype has died down a little. No splash big models that shock the world and make white collar workers shiver. But #2 is crucial to actually deploying LLMs to the masses.