News for hackers. Stuff that matters.
Re:TSMC warns AI chip crunch will last another 18 months by Roark66 on Friday September 08, 2023 @10:32AM (#37433990)
I'd bet $50 in 18 months "the crunch" will still be in full swing (and Raspberry Pi will still be "bringing huge volumes to the market any week now").

There is no way in hell all these expensive fabs will pay for themselves if chips are too cheap. So no one (especially not TSMC) will risk oversupply by building too many fabs.

Re:TSMC warns AI chip crunch will last another 18 months by pclmulqdq on Friday September 08, 2023 @10:35AM (#37434033)
The Raspberry Pi wouldn't have issues if not for the fact that they are explicitly an outlet for Broadcom's excess chips, and they have never paid full price for their CPUs. If they doubled the price of the boards, they would be able to get the parts.
Re:TSMC warns AI chip crunch will last another 18 months by Miraste on Friday September 08, 2023 @12:33PM (#37435855)
Why don't they? The current market price is 3 or 4 times the MSRP and has been for years--the Raspberry Pi has lost its place as the affordable hobbyist board. I suppose it would be admitting defeat, but if they'd actually pay for parts and make new Pis again, I'm sure they could at least bring the market prices down.
Re:TSMC warns AI chip crunch will last another 18 months by nsteel on Friday September 08, 2023 @01:02PM (#37436259)
The price in my market is back to normal for the versions I want. Has been for a month or so now. I don't see why the other versions won't follow soon enough, exactly as was promised at the start of the year.
Re:TSMC warns AI chip crunch will last another 18 months by sangnoir on Friday September 08, 2023 @02:43PM (#37437649)
> the Raspberry Pi has lost its place as the affordable hobbyist board

I keep hearing this - but I've seen no evidence of any successor board. Which board would you say is now the go-to board for hobbyists?

Re:TSMC warns AI chip crunch will last another 18 months by Miraste on Friday September 08, 2023 @02:54PM (#37437807)
There isn't one, that's what's so annoying. There are a lot of Pi-likes, but nothing with the same level of support and enthusiasm the Pi used to have. The community has just withered.
Re:TSMC warns AI chip crunch will last another 18 months by harshitaneja on Saturday September 09, 2023 @08:12AM (#37444423)
It's incredibly sad. I was in the hobbyist community as a younger teen since the beginning of pi till 2016-17. When I stopped at that time ESP8266 had just so much potential as the cheap microcontroller with wifi and RPi Zero W as the cheap microcontroller with wifi as well. The development environment had improved so much over the years and things seemed great. The alternative pi clones also were building their own identity and figuring out their software. Over the years I felt guilty for not experimenting given that Rpi4 had 8 gigs of ram! and surely the competition would be better. I bought a bunch of Zeros, ESPs and 4s when I couldn't find other alternatives much but surely that was because I was out of the community and didn't know what to buy. And surely there would have been ESP alternative in all these years with lower power alternatives now that IOT is going to be a bigger thing finally. Alas, last year I came back to the hobbyist scene finally! Excited! And it was all a major disappointment. All my favourite hobbyist stores in my country had shut down or increased prices for basically everything by a huge margin. It all seemed more polished but so much more void of the vibrancy of the earlier scene. All the experimental boards sort of failing. And I can't even buy the boards anymore. Thankfully I could retrieve all the boards I had bought in past so didn't have to chase boards in flash sales as everyone else I knew had to. But it's so sad.
Re:TSMC warns AI chip crunch will last another 18 months by selfhoster11 on Saturday September 09, 2023 @03:45PM (#37449542)
There isn't a successor board, not really. But people have started to buy ultra small form factor (USFF) x86 computers and thin clients that got cycled out by corporations and leasing companies, with great success I might add.

The price/performance (+size) is about the same as for the Pi, the power draw is not as bad as with older Intel/AMD machines, and your I/O options and x86 software compatibility is vastly better.

The only drawback is that you're buying used instead of new, and that your starting price for a small home lab (albeit one that starts at 2-3x the power of a single Pi) is larger, which harms students and other makers on a shoestring budget.

Re:TSMC warns AI chip crunch will last another 18 months by selfhoster11 on Saturday September 09, 2023 @03:38PM (#37449481)
If they doubled the price of their boards, they would simply die to the entire hobbyist market.
Re:TSMC warns AI chip crunch will last another 18 months by ksec on Friday September 08, 2023 @10:57AM (#37434342)
>There is no way in hell all these expensive fabs will pay for themselves if chips are too cheap.

While this isn't exactly the case here since it is Hi-End packaging that is the problem. But I am still happy to read the statement on HN as I have been ranting about 99% of comments giving little to zero credit to current state of art chip manufacturing and cost.

Re:TSMC warns AI chip crunch will last another 18 months by cinntaile on Friday September 08, 2023 @12:33PM (#37435846)
RPi's are freely available nowadays.

https://rpilocator.com/

Re:TSMC warns AI chip crunch will last another 18 months by guiambros on Friday September 08, 2023 @11:48PM (#37442104)
More available than before, yes. But still heavily constrained. In the US, there's no CM4 anywhere, and spotty availability of RPi4.

CM4s are still being sold for hundreds of dollars on eBay.

Re:TSMC warns AI chip crunch will last another 18 months by cinntaile on Sunday September 10, 2023 @04:48AM (#37454065)
Fair point, I only thought about the regular ones.
Re:TSMC warns AI chip crunch will last another 18 months by mschuster91 on Friday September 08, 2023 @12:38PM (#37435932)
> So no one (especially not TSMC) will risk oversupply by building too many fabs.

Everyone and their dog is investing like crazy. Intel and TSMC are both setting up fabs in Silicon Saxony (although the question remains on how productive these will be, given the issues with the far-right in Saxony), TSMC is also expanding capacity in Arizona, and Samsung is building one in Texas.

There will be no oversupply, not for the next few years. Demand from automotive, hyperscalers, AI and pent-up consumer demand is ludicrous.

Re:TSMC warns AI chip crunch will last another 18 months by mikrl on Friday September 08, 2023 @01:58PM (#37437060)
>given the issues with the far-right in Saxony

What does that have to do with anything?

California has plenty of neonazis itself. The western world in general has no lack of far right extremists.

Re:TSMC warns AI chip crunch will last another 18 months by trough on Friday September 08, 2023 @02:33PM (#37437533)
There are some concerns that the internationally recognized image of Saxony as an extremely xenophobic region will deter international talent. The main problem isn’t staffing the plant with human assembly and packaging drones but having engineers and IT join permanently after production starts. Rural saxony is not a place where you want to live if even your last name isn’t deemed ‘white’ or ‘German’ enough. And after years of cultivating this image it started to work against the best interests of the more rural parts of the region: brain drain galore and no sane person seeking work in a future proof place to build a life would come.
Re:TSMC warns AI chip crunch will last another 18 months by telotortium on Friday September 08, 2023 @02:43PM (#37437654)
Let me know when companies actually start pulling out of Saxony (not blog posts from randos - most people don't care as much about politics as the people who wrote those blog posts do).
Re:TSMC warns AI chip crunch will last another 18 months by sillysaurusx on Friday September 08, 2023 @02:46PM (#37437699)
Translation: there are a lot of talented Asians, and we’re worried they won’t want to live there. Is that accurate?

It seems like most of the US has this problem. And yet rural IT always seems to find a way. I’m in Lake Saint Louis with gigabit symmetric fiber, which is a dream. We were backwater for awhile, but post COVID a lot of talent can be sourced remotely, at least for software.

Is a fab really so regional? I could imagine them having a team in Taiwan who they work with remotely. But I know very little about fab plants, and it sounds like you have a better idea of their engineering and IT requirements.

I used to work at Groq, a hardware company, and we were fully remote. So I’ve seen this work in practice. (It’s a tossup whether Groq will succeed, but that’s a separate conversation.)

Re:TSMC warns AI chip crunch will last another 18 months by sho_hn on Friday September 08, 2023 @02:51PM (#37437772)
> It seems like most of the US has this problem.

The US still benefits from latent good marketing/rep in the 80s/90s, and projection of military power in decades past. For example, until relatively recently (the Trump era and especially how it ended disillusioned many), South Koreans still looked to the US as their model of the developed world. If you'd send your children anywhere to get educated or marry, it would be there. Inner benchmarks were done against the US. The rose-tinted glasses were enough to convince many to move without checking too carefully what the place they'd be moving to would actually be like.

This is changing, and more recently more attention is being paid to Europe, partially because the national conversation has shifted more toward quality of life, birthrate problems, aging population, etc. and there's more interest in social systems, healthcare, family planning support and so on.

Still, Koreans have a lot of memes about this or that place in Europe being racist in this or that way (and of course, quite lot of it is true), so it remains a big impediment.

Re:TSMC warns AI chip crunch will last another 18 months by nisa on Friday September 08, 2023 @06:32PM (#37440141)
Have you actually been there? I won't deny the problem in saxony with the extreme right but your comment has little to do with reality - Dresden, Leipzig are international cities with people from all over the world living peaceful together.

People in the rural areas vote for AfD because they are ignorant or frustrated about unchecked immigration and that is nothing to ignore but it's very different from the reality how they treat foreigners in my experience.

I grew up in rural saxony. We have an Iranian Woman in our family and while there is racism it's luckily not as extreme. And I promise you'll get a similar treatment as in stupid looks and stupid comments in other rural areas of Germany as well unfortunately. And these incidents were rare. Actual violence is very uncommon luckily.

Re:TSMC warns AI chip crunch will last another 18 months by qwytw on Saturday September 09, 2023 @03:21AM (#37443025)
> Saxony as an extremely xenophobic region

That seems like a 'slight' overstatement. Saxony is also full of crypto-communists (third highest polling state for Linke)...

> The main problem isn’t staffing the plant with human assembly and packaging

So why on earth are these companies building they are fabs there instead of some other place in Germany? I mean they can't be that stupid to not understand all of this?

Re:TSMC warns AI chip crunch will last another 18 months by ARandomerDude on Friday September 08, 2023 @02:08PM (#37437183)
Or far-left ones, for that matter.
Re:TSMC warns AI chip crunch will last another 18 months by mschuster91 on Friday September 08, 2023 @03:12PM (#37438039)
Far left ones don't go and shout "Ausländer raus" while marching in the thousands, which was a common occurrence during the high days of the weekly "Pegida" nazi marches in Dresden.
Re:TSMC warns AI chip crunch will last another 18 months by trashtester on Friday September 08, 2023 @04:36PM (#37439076)
While far left violence is currently a smaller problem in Germany than far right violence, it certainly exists.

This article [1] claims that there were 399 reported assaults associated with left-wing extremists, compared to 1013 associated with right-wing extremists.

Edit: and when it comes to property damage and arson, the far left is worse than the far right by about 3:1 [2]. This may be particularily relevant for companies who want to start new businesses.

[1] https://www.dw.com/en/left-wing-extremism-in-germany-how-muc...

[2] https://www.statista.com/statistics/963069/right-wing-left-w...

Re:TSMC warns AI chip crunch will last another 18 months by mschuster91 on Friday September 08, 2023 @03:10PM (#37438014)
Because discrimination is a common cause that makes people leave, most notably in Eastern Germany [1].

[1] https://www.spiegel.de/wirtschaft/fachkraeftemangel-bloss-ni...

Re:TSMC warns AI chip crunch will last another 18 months by mikrl on Friday September 08, 2023 @10:02PM (#37441472)
How are the bordering regions of Czechia and Poland?

Do they have the same issues?

I assume the open border facilitates travel somewhat.

Re:TSMC warns AI chip crunch will last another 18 months by YetAnotherNick on Friday September 08, 2023 @01:14PM (#37436415)
Increasing supply is not an issue if there is demand. As long as building more fabs brings more profit(even if at smaller margin), I can't see any reason why they won't be building it. It's economics 101. Also as moore's law is coming to end, the number of fabs has no way to go but up.

Also I don't think manufacturing cost is the biggest of issue, because the margins are significantly higher than consumer GPUs which are in oversupply now for Nvidia. It's that Nvidia has to commit years in advance for the capacity.

Re:TSMC warns AI chip crunch will last another 18 months by SilverBirch on Friday September 08, 2023 @02:44PM (#37437674)
The problem is the bull whip effect. Yes there’s loads of demand now, but are we really saying that the AI boom is a permanent uptick in demand for silicon, or is it more likely that the hype dies down? By the time capacity comes online demand may well gave peaked and dropped. Suddenly these massive sunk cost fabs will be taking any business they can to amortise the costs.
Re:TSMC warns AI chip crunch will last another 18 months by ethbr1 on Friday September 08, 2023 @05:00PM (#37439358)
It seems more likely that efficiency gains decrease aggregate compute requirements than people stop using AI tools altogether.

At minimum, LLMs work as a better human-software interface medium, which means they're going to be infused in almost everything non-technical consumer-facing.

Even absent any other breakthroughs, that seems like a huge consumer of AI hardware capacity.

Re:TSMC warns AI chip crunch will last another 18 months by jsight on Friday September 08, 2023 @01:33PM (#37436697)
Pi availability has been improving steadily since the beginning of the year.