News for hackers. Stuff that matters.
Re:What Transistors Will Look Like at 5nm by n00b101 on Monday August 22, 2016 @01:12AM (#12334252)
“My current assumption is that 5nm will happen, but it won’t hit high-volume manufacturing until after 2020,” said Bob Johnson, an analyst at Gartner. “If I were to guess, I’d say 2021 to 2022." ... In R&D, chipmakers are also looking at 3nm and beyond, although it’s unclear if these nodes will ever happen.

What this all seems to be pointing to is that, in all likelihood, the "party" will be over within the next 3 to 6 years. It seems to me like there is an insufficient level of panic happening in the world over this issue (the imminent end of Moore's Law after 30+ years of non-stop exponential growth). Moore's Law was a massive, earth-shattering, 30+ year continuous exponential curve, that we all have been riding. I think the collapse of this curve could have serious implications for more than just chip designers and manufacturers. In my view, some groups that seem over-exposed and under-concerned are the software and startup industries.

For the past 30+ years, the market has seen better/smaller/bigger/faster silicon computing devices arriving with unrelenting regularity. Now that will suddenly stop with one final, ultimate silicon product generation. After which, it sounds like we don't get faster or cheaper CPUs, or bigger CPU caches, or more CPU cores, or more RAM, or better or cheaper GPUs, or bigger or cheaper SSDs, or better/cheaper LED lights or OLED screens, or better/smaller/faster/cheaper smart phones/tablets/digital cameras/sensors/broadband networking, etc? So the whole show just stops, like a high-speed train hitting a wall. And, by all credible accounts, this cataclysmic event is scheduled to occur within the next 3-6 years (barring some unforeseen, miraculous scientific revolution)!?

Once that happens, all computer technology seems destined to a fate similar to many other commoditized, industrial age technologies. A famous example is the design and performance of commercial aircraft, which has not fundamentally changed in nearly a century. Another example is steel manufacturing - nothing about the cost or other performance dimensions of steel have changed since the industrial revolution. Steel is now a base commodity, and no one is waiting to upgrade all of their steel structures to some next generation steel alloy that will justify the massive expense of a complete "hardware upgrade." Other examples include electro-chemical batteries, internal combustion engines, rockets, etc.

If this truly is an end-game within the next 4-6 years, then there will be a few niche, interesting areas to eke out performance gains within (let's say) the next 20 to 30 years (e.g. through specialized hardware designs and new software optimizations), but these gains seem to be very different from the economic miracle of the endless PC/server/smartphone/software upgrade cycle that everyone has become so accustomed to. No such "eke out optimizations" will be able to compensate for the massive, negative economic impact of Moore's Law ending, considering that our global economy seem to be fundamentally dependent on technology consumption cycles stemming from Moore's Law.

This situation reminds me of the 2008-2009 global financial crisis, where US sub-prime residential real estate prices had started falling in 2006 but everyone kept on ignoring the problem and hoping that it would just go away. It also reminds me of global warming, where the consequences are dire, and there is no solution in sight, but everyone is hoping that some new fundamental scientific discovery will revolutionize the energy industry. It could happen ... we could possibly discover a fundamentally new energy technology that replaces conventional fossil fuels, electro-chemical batteries, etc. And we could possibly discover a fundamentally new science that replaces "Complementary Metal–Oxide–Semiconductor (CMOS)" silicon technology. On the other hand, perhaps the laws of physics do not admit such a possibility? Or worse, even if it is physically possible, what if our global socio-economic system should collapse long before we are able to fund the necessary discovery? For example, is it possible that Moore's Law stalling within the next 5-10 years could trigger a financial crisis so massive that it economically ends Moore's Law for good, before the research can be funded to solve the problem?

Re:What Transistors Will Look Like at 5nm by adwn on Monday August 22, 2016 @02:02AM (#12334387)
Your proposal for immediate panic is an unnecessary overreaction.

> it sounds like we don't get faster or cheaper CPUs

The progress in desktop CPUs has been a near-plateau for several years now.

> bigger CPU caches

Diminishing returns have been hit several years ago.

> more CPU cores

Dito for most use cases.

> more RAM

Dito for most use cases.

> better or cheaper GPUs

GPUs have become so fast and cheap that integrated GPUs are good enough for most use cases.

> better/cheaper LED lights or OLED screens

I don't think they are related to the semiconductor nodes of digital logic?

> So the whole show just stops, like a high-speed train hitting a wall.

No, the train has already started slowing down several kilometers away, and most people on it have realized it. There will be no wall-hitting.

> Steel is now a base commodity

Steel may be a commodity, but the steel-using industry (in this analogy, the software industry) is alive and well.

> no one is waiting to upgrade all of their steel structures to some next generation steel alloy that will justify the massive expense of a complete "hardware upgrade."

This is actually a good thing. Besides, the sentiment "no need to optimize, just wait a year and computers will be fast enough" died over ten years ago and was stupid to begin with.

> our global economy seem to be fundamentally dependent on technology consumption cycles stemming from Moore's Law

It's really, really not. At least not outside of the SV-startup-scene cognitive bubble.

Re:What Transistors Will Look Like at 5nm by jdietrich on Monday August 22, 2016 @03:31AM (#12334670)
IT infrastructure consumes a non-trivial proportion of global electricity production, ~10% by some estimates. That consumption is growing at an alarming rate. Most of our electricity still comes from coal.

Performance-per-core may have stagnated, but performance-per-watt continues to improve at an exponential rate. Without the efficiency dividend provided by Moore's Law, IT infrastructure could become one of the biggest obstacles in our transition to sustainable energy.

Re:What Transistors Will Look Like at 5nm by snovv_crash on Monday August 22, 2016 @03:21AM (#12334640)
> This is actually a good thing. Besides, the sentiment "no need to optimize, just wait a year and computers will be fast enough" died over ten years ago and was stupid to begin with.

Ruby, Python, PHP :-/

Maybe with the next few years of performance not improving developers will wake up to the fact that doing stuff in a slow language limits the scale you can push it to.

Re:What Transistors Will Look Like at 5nm by cstejerean on Monday August 22, 2016 @03:31AM (#12334672)
Or maybe most developers aren't worried about the scale you can push something too. Most projects never go anywhere. If one turns into a runaway success you can deal with performance later. Designing everything as if it is going to require Google scale infrastructure is a good way to get distracted by cool technology and procrastinate on actually solving any useful problems.
Re:What Transistors Will Look Like at 5nm by adwn on Monday August 22, 2016 @05:11AM (#12335005)
Thankfully, programmers are already waking up to the fact that C and Python are not the only choices. Compare the success of Rust.
Re:What Transistors Will Look Like at 5nm by ido on Monday August 22, 2016 @08:18AM (#12335736)
I was astonished how fast plain-old JS has become (probably closer to c++ than to Ruby or Python, in terms of performance - even more impressive with support for stuff such as asm.js).

And recent versions of ECMAScript/JS (which are gradually albeit slowly become more and more available for real-world usage) actually make for a pretty nice language.

Re:What Transistors Will Look Like at 5nm by n00b101 on Monday August 22, 2016 @02:22AM (#12334441)
If I can summarize what you are saying, we have been experiencing early symptoms of end of Moore's Law for the past 5 to 10 years, and nothing drastic has happened yet, so there's nothing to worry about?

Consider the possibility that such a narrative is simply describing a "slow-motion train wreck" as opposed to the absence of a "train wreck?"

There is no doubt that the slow-down has been occurring for several years. One turning point was the collapse of Dennard Scaling around 2005, which led to stalling CPU clock speeds and the "multi-core crisis." I know that CPU clock speed has plateaued over a decade ago. I have not tracked costs, cache sizes, and other factors as closely, but comments here seem to be confirming that many factors have been stalled for the past 5 to 10 years (somewhere between the failure of Dennard Scaling and 28nm nodes). There have been other slow-motion slowdowns happening as well, including the collapse of PC sales growth and now the emerging collapse of smartphone sales growth. The fact that this has been happening for "a while" does not make me feel any more at ease.

To be frank, I am less confident in your comments regarding the dependence (or lack thereof) of global economic growth on technology consumption. I beg to differ that it is just a "SV-startup-scene cognitive bubble" ... I'm pretty sure technology is systemically important to global economic growth.

Re:What Transistors Will Look Like at 5nm by aleksei on Monday August 22, 2016 @02:52AM (#12334540)
This is OT, but I can't wrap my head around the reverence of global economic growth. Surely it is unsustainable in the long run. It would seem far better if people weren't required to buy a new, slightly shinier, device every few years just to keep society from collapsing.

As for the stalling of technological progress & sales, I would venture it's partly because the technology has caught up with other industries; eg. I can now watch HD movies on demand on my smartphone, at practically no cost. While it may be impractical to design smaller CPUs, there is also no incentive to do that, as people don't really have a need for it (also, see the rise in high end GPUs for VR gear, since that's what people want). However, I'd say there are other avenues of progress available than mere clock speeds, eg. energy consumption. I doubt marketing departments around the world will shrug and say 'Well, we had a good run, now it's time to call it a day'. Although that's what I'd hope for.

Re:What Transistors Will Look Like at 5nm by skybrian on Monday August 22, 2016 @03:20AM (#12334637)
The thing is, we're not actually all in the same industry. Companies that sell phones might not be so happy if sales level off or decline, but others will do fine. On the software side, there are plenty of ways to innovate without the hardware getting better.

If people stop upgrading phones, all the companies writing software to run on phones can still do their thing. Uber and AirBnB aren't really going to care; their apps already work. New businesses can come along based on mobile phone apps that put today's hardware to good use, even if the specs don't get any better.

Or looking at entertainment, the game industry doesn't actually depend on better hardware. If the VR thing turns out to be a fad, game designers will still manage to come up with innovative new video games for existing platforms, and people will keep playing them. (Minecraft doesn't require the latest hardware.)

Also, the design of phones can improve even if the raw hardware specs for CPU or memory aren't any better. You can see hardware innovations in other areas (like new sensors). Most recently, the fingerprint sensor is a good improvement.

There are all sorts of opportunities for innovation and refinement that have nothing to do with Moore's law.

Re:What Transistors Will Look Like at 5nm by jacquesm on Monday August 22, 2016 @05:23AM (#12335061)
When phones were wired you didn't 'upgrade' your phone for years if not decades.

All the end of Moore's law indicates is the end of the free lunch: free performance increase for software without any work on that software.

So instead of 'doom and gloom' I predict a very healthy re-surgence in reduction of bloat and efficiency, something that as far as I'm concerned can't happen fast enough.

FWIW my cell phone is 6 years old and as long as it works I'll happily use it. If a phone is a status symbol or a fashion accessory then there are plenty of ways to get people to upgrade even if the underlying tech doesn't change so I'm quite sure that manufacturers will find a way to re-package the same tech in ways that allows them to sell into the elective replacement market.

Re:What Transistors Will Look Like at 5nm by brian-armstrong on Monday August 22, 2016 @02:41AM (#12334497)
Most software companies won't have a lot of exposure here, since they just depend on the devices being out there. As long as there's no shortage of ideas, software advancements are still possible.

There is certainly quite a lot of downside for hardware and device companies, though, and it's hard to guess how that will also ripple into companies that just do software

Re:What Transistors Will Look Like at 5nm by adwn on Monday August 22, 2016 @05:57AM (#12335186)
> If I can summarize what you are saying, we have been experiencing early symptoms of end of Moore's Law for the past 5 to 10 years, and nothing drastic has happened yet, so there's nothing to worry about?

Yes, and what's more, the software industry seems to be stronger than ever.

> To be frank, I am less confident in your comments regarding the dependence (or lack thereof) of global economic growth on technology consumption.

Oh no, I think a large part of global economic growth depends on technology, I just don't think it depends on continued exponential improvements in the underlying semiconductor process nodes. There are other ways to innovate than just relying on automatic hardware improvements.

Re:What Transistors Will Look Like at 5nm by UweSchmidt on Monday August 22, 2016 @05:13AM (#12335019)
Excellent point. We have received technological advancement reliably and automatically for a long time. "Oops looks like we can have navigation software on the phone, just like that." - "Oh and VR goggles have just become viable, thanks Moore's Law".

There is plenty of stuff to do with our current hardware, but a new breakthrough would be nice.

Re:What Transistors Will Look Like at 5nm by imtringued on Monday August 22, 2016 @10:15AM (#12336463)
The jump from 28nm to 14nm for graphics cards enabled a massive jump for mobile graphics card made by nvidia. They are no longer a seperate product from the desktop cards. The difference is so massive that even the lowest end model, the 1060, is 15% faster than the highest end mobile graphics card (980M) from the last generation.
Re:What Transistors Will Look Like at 5nm by tmikaeld on Monday August 22, 2016 @02:14AM (#12334411)
"GPUs have become so fast and cheap that integrated GPUs are good enough for most use cases."

Except for realistic VR I'd argue, this will be an issue.

Re:What Transistors Will Look Like at 5nm by adwn on Monday August 22, 2016 @05:25AM (#12335073)
I agree that not having realistic VR due to a lack of hardware performance would be sad, but my arguments mostly concerned the global economic collapse (or rather, a lack thereof) mentioned in the parent comment.
Re:What Transistors Will Look Like at 5nm by tmikaeld on Monday August 22, 2016 @03:29PM (#12338752)
Yes of course, I'm not disagreeing with that - just adding that VR is a difficult case right now and something that i don't think can be solved with software or hardware in the short term.
Re:What Transistors Will Look Like at 5nm by jon_richards on Monday August 22, 2016 @02:46AM (#12334520)
640K ought to be enough for anyone.
Re:What Transistors Will Look Like at 5nm by johncolanduoni on Monday August 22, 2016 @02:45AM (#12334516)
New software optimizations is unlikely to stay a niche area where we only manage to eke out a bit of performance. Look at our popular languages today: pretty much none of them even do something as simple as combine a GC with true composition of data types (Go is the only one I can think of, and it makes up the difference elsewhere). This isn't about high level abstractions being bad, it's about our current arbitrary limits on high level abstractions being bad. The JIT languages are of course severely limited in the complexity of their optimizations due to time constraints. But most compiled languages experience the same because they either don't provide a good set of semantics for a compiler to reason about the code (e.g. C/C++), or use one that is so limited that you simply can't get the compiler to generate sufficiently efficient code in some instances (e.g. Haskell).

On top of this, a programmer's input to the optimization process rarely extends past "inline/don't inline this function". Compilers have to make optimizations that are either strictly better or base it on a wild guess of the time, instead of using profiling to either automatically or manually (i.e. overridden by humans after they test the code) invoke optimizations. Many compilers offer profile-guided optimization but few projects use it, and the JVM just uses it to smooth over some of the performance loss from lacking things like value types or refined generics. In languages that provide sufficiently low level operations you can sometimes get what you want by altering the code, but that doesn't always work.

I'm excited for us to stop using Moore's law as a crutch (which has stopped on desktop CPUs for a while now as far as performance if not price) and to look at things like improved tooling, improved languages, and hopefully even improved architectures. I find it hard to believe that "5nm transistors arranged into x86 processors running hand-optimized C code" is the epitome of feasible computing in our universe, and that's forgetting that most of our code isn't optimized anywhere near that much.

Re:What Transistors Will Look Like at 5nm by bogomipz on Monday August 22, 2016 @03:53AM (#12334750)
>"combine a GC with true composition of data types"

Could you elaborate on how combining a garbage collector with composition of data types works as an optimization?

Is this distinctly different than GC with an inheritance object model?

Re:What Transistors Will Look Like at 5nm by johncolanduoni on Monday August 22, 2016 @04:09AM (#12334802)
It's not about inheritance, it's about how to implement composition. In C++, B inheriting A is implemented to same as B containing a member variable of type A as far as memory layout: the form one allocation with space for A's fields as well as B. In Java or .NET, fields which are objects are pointers to a separate allocation, like they would be if they were pointed to in C++, even if you assign them once and never change them. This increases indirection, memory and GC overhead, and reduces locality. Since you can nest containment, the effect from this can be quite large. .NET has structs to offset this a bit, but they make you decide for each type instead of each variable and you can't really operate on references to them.

Obviously there are cases where you need that indirection (e.g if you're swapping out pointers to different objects in that field) but there are plenty cases where you don't (this usage pattern is a big part of the reason why write barriers work okay for these languages). Also note that you don't need to use indirection if all you want to do is use/store a garbage collected pointer to the field's object elsewhere in your program; the .NET garbage collector already has the ability to deal with pointers within allocations. It's just that they've stuck to not discriminating between these within the language for simplicity (IIRC the .NET runtime can sort of use interior pointers to structs, but this isn't exposed in C#).

Re:What Transistors Will Look Like at 5nm by imtringued on Monday August 22, 2016 @10:38AM (#12336600)
A GC needs to visit every pointer in live memory. The less pointers you have the quicker the GC can finish it's job.
Re:What Transistors Will Look Like at 5nm by imtringued on Monday August 22, 2016 @10:54AM (#12336722)
Who has the luxury of having a CPU bound problem these days? The developers of games for handheld games consoles maybe. Most problems are memory or IO bound nowadays and in this era the latest crutch is the SSD. Since random access is faster than on an HDD the developers care less about optimizations. Heck even in the games with fast loading screens there is still low hanging fruit like "oh you are in a queue for map X? let me preload it for you in the background instead of waiting until the match starts and then loading it" for example.
Re:What Transistors Will Look Like at 5nm by brian-armstrong on Monday August 22, 2016 @01:36AM (#12334325)
Well, I agree partly with this, but keep in mind that FinFET is also too expensive for many of the applications you listed. 28nm was actually the last generation for quite a few architectures, especially embedded or otherwise cost-limited ones

Also, SSD density doesn't exactly depend on Moore's Law per se anyway

Re:What Transistors Will Look Like at 5nm by kurthr on Monday August 22, 2016 @02:33AM (#12334478)
I mostly agree with Adwn here... it's been slowing for quite a while. I expect it to be a bit shocking, and Intel has to find something different to do, but the only wall we might hit is Fab/equip building.

Also, OLED and display Fab technologies are completely different and they have years more to go... an OLED today isn't more than 6% total efficiency. What changed there is that resolution isn't the treadmill anymore so something else (color, power, refresh) will have to take its place.

Re:What Transistors Will Look Like at 5nm by SixSigma on Monday August 22, 2016 @08:17AM (#12335731)
I think the end of ever faster hardware will be good for plenty of software people and certainly for the world. The every shifting sands of the programming environment and vast amount of eWaste punishing the physical environment are a wild ride for which there will be a settling.

I cut my teeth in the era 1K of RAM.

Re:What Transistors Will Look Like at 5nm by kozikow on Monday August 22, 2016 @04:26AM (#12334856)
IMO except a few small sub-domains like neural networks, we have much more computing power than ideas for things we can do with it or people that can implement those ideas. Supporting people side of the business - salaries, benefits or offices are much bigger costs than machines, especially in SV.
Re:What Transistors Will Look Like at 5nm by Andys on Monday August 22, 2016 @01:36AM (#12334324)
Although the technological aspect may cease to advance, I think for a lot longer after 3-6 years, things will continue to get cheaper, and this will hide what is happening for consumers for at least a decade.
Re:What Transistors Will Look Like at 5nm by cornholio on Monday August 22, 2016 @11:06AM (#12336815)
Since you mentioned steel and airplanes, I need to ask what were the disastrous effects of the "plateau".

While airplanes reached the physical limits in the 70s, there were still many revolutions ahead, for example the low cost revolution that brought air-flight to the masses.