(Purely from memory from reading some Mechwarrior books about 30 years ago)
Can ChatGPT Omni read? I can't wait for future people to be illiterate and just ask the robot to read things for them, Ancient Roman slave style.
Further, even if end-users only have access to token input to steer model behavior, we likely have the ability to reverse engineer optimal inputs to drive desired behaviors; convergent internal representations[2] means this research might transfer across models as well (particularly, Gemma -> Gemini, as I believe they share the same architecture and training data).
I suspect we'll see understandable super-human prompting (and higher-level control) emerge from GAN and interpretability work within the next few years.
[1]: https://transformer-circuits.pub/2024/scaling-monosemanticit... [2]: https://arxiv.org/abs/2405.07987
I don't know why but reading this thread made me feel depressed, like watching a bunch of tribal people trying all kinds of rituals in front of a totem, in hope of an answer. Say the magic incantation and watch the magic unfurl!
Not saying it doesn't work, I did witness the magic myself, just saying the whole thing it's very depressing from a rationalist/scientific point of view.