News for hackers. Stuff that matters.

A comment on Sam Altman, Greg Brockman and others to join Microsoft. Parent comment

Re:Sam Altman, Greg Brockman and others to join Microsoft by suslik on Monday November 20, 2023 @07:07AM (#38346844)
Was GPT4 a success due to the brilliance of OpenAI's tech team vs first movers advantage and good GPU deals with MS? I might be missing something here, but to me nothing about this technology feels like rocket science (obviously, there is a lot of nuance, yada yada, but nothing that seems intractable). I have a strong suspicion that the reason Amazon, Google and so on are not particularly interested in building GPT-scale transformers is that they know they can do it anytime - they are just waiting for others to pave the path to actually good stuff.
[ Parent | on HN ]
Re:Sam Altman, Greg Brockman and others to join Microsoft by htrp on Monday November 20, 2023 @08:03AM (#38347382)
>I have a strong suspicion that the reason Amazon, Google and so on are not particularly interested in building GPT-scale transformers is that they know they can do it anytime - they are just waiting for others to pave the path to actually good stuff.

Google has been hyping gemini since the spring (and not delivering it)

Amazon's Titan Model is not quite there yet.

[ Parent | on HN ]
Re:Sam Altman, Greg Brockman and others to join Microsoft by suslik on Monday November 20, 2023 @11:13AM (#38349924)
Yes - but I do have a feeling they didn't try too hard.
[ Parent | on HN ]
Re:Sam Altman, Greg Brockman and others to join Microsoft by ls612 on Monday November 20, 2023 @02:41PM (#38353381)
Amazon at least wants to be also making money renting out H100-H200 instances in AWS so they may be intentionally only using some of their hardware for themselves.
[ Parent | on HN ]