News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by int_19h on Friday April 07, 2023 @04:22PM (#35486509)
I don't think we're anywhere close to the limit of sheer hardware scalability on this. Returns are diminishing, but if GPT-4 (with its 8+ k context window) is any indication, even those diminishing returns are still very worthwhile.

If anything, I wonder if the actual limit that'll be hit first will be the global manufacturing capacity for relevant hardware. Check out the stock price of NVDA since last October.

There are no comments on this comment yet.