Re:GPT4 is 8 x 220B params = 1.7T params
by jimmySixDOF on Wednesday June 21, 2023 @12:09AM
(#36414289)
Well he picked the right problem at the time which was (and still is!) search. I was really looking forward to some progress on this and then he deleted tweets and dropped off the system. I would love to see a podcast of him talking about that & fyi @realGeorgeHotz is back on it now to promote Tiny grad/box/corp.
[ Parent
| on HN ]
Re:GPT4 is 8 x 220B params = 1.7T params
by threeseed on Wednesday June 21, 2023 @02:48AM
(#36415217)
As someone who has spent 20+ years working in large companies you can spot developers like him a mile away i.e. the sort of behaviour you see with skilled but arrogant grads/interns.
The right approach when you're new is to quietly pick a simple problem away from the core services where you can learn the processes and polices needed to get something into Production. More so when you're in a company that is undergoing a brain drain.
Then you can progressively move to solving more demanding and critical issues.
You should write a book or a blog about how to not rock the boat at large companies. Maybe you can call it Going Nowhere Fast.
Large companies normally (unlike Twitter) have achieved strong product market fit and are all about tweaks that deliver marginal revenue. Given that they already have a big slice of the market, the multiplier on marginal revenue makes what you're doing worthwhile.
"Rocking the boat" is more likely than not to make things worse.