News for hackers. Stuff that matters.

echohive42

Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @07:31PM (#49948835)
i hope not :)
Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @04:35PM (#49947519)
totally agreed on the "focus" aspect of it that is why i was so happy about composer models from cursor when they came out but they werent very great imagine opsu 5.5 level models at those speeds and faster.
Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @02:45AM (#49941904)
I hope so :)
Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @02:39AM (#49941879)
yeah very true. I asked Opus 5.5 max if even such a thing is possible and it thought so, albeit after a lot of hurdles, especially memory related ones being overcome.

it also thought it could happen by 2033

Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @02:24AM (#49941810)
maybe we will all hang once again at the clubhouse like app, not sure if you experienced it in its heyday. it was amazing! :)
Re:What if AI worked at 1.000.000 tokens per seconds? on Saturday October 03, 2026 @01:59AM (#49941702)
I think you are right and I think we are close to that speed, with codex ultrafast we are near 500 TPS but only with Astra and that is not financially viable. I would guess we will have wide spread near 1000 TPS with 6.1 sol level model with enough usage to, without worry, do the kind of things you describe in about 6 months max
ok actually, you are right I really got hooked on these for a bit :)
hard part being the ideation is very true. i struggle with this all the time. even meditate on it for hours. but I think it is an important muscle to practice these days
thank you very much. I was very dismayed by the flag but I am glad you enjoyed it
thank you! I let opus 5.5 choose the music from a folder of mp3s i have and it matched the scene's dynamism looking at its waveform
I can understand how you might feel that way. this was the name of one of the first text to image apps I built 4 years ago with one of world's first auto prompt enhancement with a fine tuned currie model

then I changed course but the name stayed :) here is the original video from 4 years ago about my app: https://youtu.be/-fw4sjopYt4?si=37QDUgVEisdZRmq1

thank you! yeah that was one thing I was struck by that so much is possible now and can't imagine even the near future

what a time!

Older »