Re:Tesla bulks up its GPU-powered AI super
by nodja on Thursday August 18, 2022 @08:41AM
(#32508784)
> But can a 10-node-iphone-cluster really match an A100 for pure flops?!
Only if the data is local, small, easily synchronizable, doesn't require fp32 precision and a dozen other caveats.
Can a 10 iphone cluster match an A100 in calculating digits of pi? Yes. Can it do backpropagation in large machine learning models? The gradients won't even fit.
Re:Tesla bulks up its GPU-powered AI super
by calaphos on Thursday August 18, 2022 @09:49AM
(#32509543)
The number is for FP64 double precision terraflops. For vector operations, not matrix operations as well.
Double precision is important for a lot of simulation codes because of numerical issues. For Deep learning applications it's basically unused, single precision or half precision formats dominate training. The same numerical issues don't show up, so this is a lot more efficient.
Additionally a lot of the 'AI' flops are achieved through matrix cores, fitting Deep learning the workload well. This brings an A100 from only 17 to ~200 tflops.
> But can a 10-node-iphone-cluster really match an A100 for pure flops?!
The iphone number is probably fp32 if not lower precision. However the combined SoCs of 10 iphones have tripple the transistor count and a larger chip area among them. So the comparison is not totally off.
Re:Tesla bulks up its GPU-powered AI super
by axg11 on Thursday August 18, 2022 @08:54AM
(#32508926)
It's a testament to the immediate applications of AI/ML. In the past, supercomputers were mainly a tool for research, with expected returns from that research in the order of years to decades. Now, as demonstrated by how large language models are generative image models are scaling, there's a reasonable expectation of short term returns from investment.
Re:Tesla bulks up its GPU-powered AI super
by twic on Thursday August 18, 2022 @09:28AM
(#32509278)
I'm not sure that adoption by that particular list of companies is evidence for "a reasonable expectation of short term returns from investment". VC-backed startups and cresting tech giants are traditionally willing to splurge huge amounts of cash on mad plans which have a slim chance of delivering universal domination.
If all of my local pizza parlours were installing (well, renting) AI/ML rigs, it would be a different story.
Re:Tesla bulks up its GPU-powered AI super
by barkingcat on Thursday August 18, 2022 @09:51AM
(#32509575)
Private companies likely would have clusters that dwarf the majority of computers on the public lists. Except they don't tell you about them.
Why would they? So their competitors can copy their business plan?
IBM has had large clusters for decades.
Any large bank or trading company would have clusters that would be at home in that list.
You don't want to know what the Apple cluster is like: they have to train for Siri, in multiple languages, etc. I be that's several orders of magnitude larger than Tesla.
AWS itself is probably several orders larger than most university clusters, probably larger than most country's combined computational capacity.
Re:Tesla bulks up its GPU-powered AI super
by calaphos on Thursday August 18, 2022 @09:39AM
(#32509420)
Similar classes of machines have been build and used for simulations in industries for decades now.
In fact if you look through the historic top500 lists a lot of the space outside the top10 is occupied by industry clusters. Classically oil and gas has been one of the big consumers. In recent years there are more and more cloud clusters in there as well.
So this Tesla cluster isn't really anything unusual.
Re:Tesla bulks up its GPU-powered AI super
by titoCA321 on Sunday August 21, 2022 @01:59PM
(#32542709)
The entire company only has a single DGX or your section/office/division has only a single DGX? Many of these large companies are so big the left hand doesn't know what the right hand is doing. One department may be starving for cash while another one across the office cubic is awash in funding.
There are some companies that don't have centralized high-performance compute resources so each department goes out and builds or buys and their own performance compute resources and strings it along. Many universities do this too where physics has a compute cluster and economics and bio-sciences have another cluster and sometimes they are underpowered and if all the departments grouped together and pooled their resources they would have adept system administrators and developers and hardware to support their computing needs but it doesn't always happen with poor governance so they end up with stuff that appears to be built from someone's basement and when that person leaves, retires, graduates there's so much poor documentation none know what to make of anything.
Re:Tesla bulks up its GPU-powered AI super
by pclmulqdq on Thursday August 18, 2022 @09:36AM
(#32509371)
The privately owned machines are undercounted on public lists, and always have been. Before it was ML it was big engineering firms and oil companies who owned the huge computers.
Re:Tesla bulks up its GPU-powered AI super
by wongarsu on Thursday August 18, 2022 @09:34AM
(#32509345)
Of the top500 supercomputers, 47% are owned by for-profit industry [1]. They are underrepresented in the top ranks: they only make up 16.7% of the total performance of the list, and from a quick skim it seems like of the top 25 only 5 are from private companies (two energy companies, Samsung, Yandex and MS Azure).
Re:Tesla bulks up its GPU-powered AI super
by titoCA321 on Sunday August 21, 2022 @02:10PM
(#32542795)
Academics publish their research even when it contributes nothing to society. Private enterprises and government agencies aren't as aggressive in publishing even when the publication of their research may benefit society more than many of the stuff coming out of academia. Some do for various reasons but sometimes they don't. That's why when companies go belly up and historians have their field day, we find out stuff such as Kodak discovering the benefits of digital photography since the 1960's and certain employees within different departments were pushing for Kodak to take the lead, yet Kodak executives didn't know what to make of it and where afraid of digital photography eating into their film business.
We also learn stuff such as ATT developing video phones since the 1960's but they were too early and it never go anywhere until decades later when ATT was a lesser relevant player in the telecom industry. And the Post Office foresaw the coming trend of online bill pay and email eating into their mail volume since the early 90's, yet when their they had projects that would enable senders and receivers to received mail scanned to a USPS account or pay bank statements through a USPS account for those early bill pay adopters, Postal Management did nothing with it.
Re:Tesla bulks up its GPU-powered AI super
by randcraw on Thursday August 18, 2022 @10:58AM
(#32510574)
What does Tesla use this for, other than full self driving? Other FAANGs would use such a beast to serve myriad tasks, from vision to text to speech. But Tesla likely licenses all their non-FSD AI tech from 3rd parties since it doesn't motivate the sales of their products the way FSD does.
Thus a 70 petaflop ultracomputer is quite a big investment to support an increasingly unpopular car option that's inessential and mostly promotional, ergo, a geek tickler.
Re:Tesla bulks up its GPU-powered AI super
by panick21_ on Thursday August 18, 2022 @11:53AM
(#32511309)
> licenses all their non-FSD AI tech from 3rd parties
Tesla is well known to be one of the most vertically integrated companies in the industry. The are well known to use AI for their factories as well. The run lots of simulations for crash testing as well.
What products are they are buying? They do probably buy somethings but unless you have evidence that they buy most things, I not gone believe you without some kind of source.
> Meanwhile, FSD is installed on only 7% of Tesla's cars
You realize it can be bought in later as well right? If quality improves lots of people have to option to buy it.
> that's inessential and mostly promotional, ergo, a geek tickler.
That's your opinion, an opinion that Tesla clearly doesn't share.
Re:Tesla bulks up its GPU-powered AI super
by chinabot on Thursday August 18, 2022 @07:03PM
(#32515870)
Costs you $10K for FSD but 3 million Teslas can still send real life driving experiences back to home base for it to learn from.
They are obviously not doing this (or not doing it well) as there are several spots on the state highway I repeatedly drive through where my car always slows down from 100KMH to 50KMH for and I have to repeatedly override with the accelerator to stop the person behind going in to me.
Re:Tesla bulks up its GPU-powered AI super
by panick21_ on Thursday August 18, 2022 @10:00PM
(#32516941)
I didn't defend the current product. I was just pointing out that from Tesla perspective the investment is worth it because they see a huge market potential, both in incremental level 2 updates and things beyond that.
Re:Tesla bulks up its GPU-powered AI super
by syntaxing on Thursday August 18, 2022 @12:31PM
(#32511797)
Super curious to read more about how Tesla uses AI in their factory and design! From what I know, solvers used in “traditional” programs are heavily optimized for CUDA and Intel chips. Like decades and hundreds of PhDs has dedicated their lives just to make that happen. So curious how Tesla replaced or improved on that.
Re:Tesla bulks up its GPU-powered AI super
by dragontamer on Thursday August 18, 2022 @07:31AM
(#32508038)
It never seemed to me like the custom chip from Tesla could possibly ever keep up with the economics of mass chip production from NVidia, or whoever else became #1 at neural net hardware.
New chips are always fun to see and get discussed, but there are simple economic / mass design issues at play here. The Tesla custom chip just won't be made at the volume of NVidia or AMD.
And Intel's attempt to join the market seems like the better approach (even if it fails). You need to get the video game crowd to fund the research and development these days.
Video gamers want high speed SIMD for faster graphics. Without this source of money (and millions of chips sold per year), it looks difficult to sustainably upgrade an architecture.
--------
If not the PC market, then at least try to get the console market or phone market or some other consumer electronics fad wrapped up in things.
Re:Tesla bulks up its GPU-powered AI super
by sidibe on Thursday August 18, 2022 @08:38AM
(#32508749)
Google has a ton of internal and external customers that can amortize the cost of this kind of project. They've also got lots of similar programs of developing server hardware and some organizational experience in how to hook new stuff up and keep it utilized. The whole dojo program always seemed wildly ambitious reach to me for a company like Tesla. More power to them if they pull it off but it's not a surprise to me that it's not what they're using a year after they thought it was almost ready
Re:Tesla bulks up its GPU-powered AI super
by Voloskaya on Thursday August 18, 2022 @10:15AM
(#32509908)
> It never seemed to me like the custom chip from Tesla could possibly ever keep up with the economics of mass chip production from NVidia
> The Tesla custom chip just won't be made at the volume of NVidia or AMD.
I don't think Tesla ever aimed to produce a chip for the public, it's purely to be used in their own products, so they don't have to be competitive with NVIDIA in flops/$ or worry about keeping up with NVIDIA production rate.
The chip only needs to be better, for the specific task they care about, for a specific metric they care about.
Considering that NVIDIA has to make a card that works for everyone, they have to make a huge number of tradeoffs, such as supporting many different number formats going from FP64 to INT4, their cores have to support a ton of different instructions, they need to keep a large amount of space on the chip for large memory buffers to support training of models with billions of parameters, they need to support GPUs interconnect for clustering etc. etc.
Given the importance of real estate on a chip, those tradeoff have large implications.
Tesla has 10x less constraints:
* For the training chip they only support their custom 8 and 16 bits format iic, so they can redistribute cores in consequence. They can ditch many instructions that they'll never use. They can size the memories to be exactly what they need, which is probably less than 80GB needed for large transformers, and use the freed space to add more cores etc.
* For the inference chip, they can additionally ditch all the interconnects as they just need one per car and reduce memory drastically freeing up even more space for cores.
If NVIDIA didn't have to balance so many different use cases on such a small area, then yes it would probably make no sense to try to do your own thing. But since they have to be general purpose, if you target a very specific use case you can be far less knowledgeable than them in GPU architecture and still come out ahead for your use case.
Specificity is the same reason why it still possible to write CUDA kernels for some basic operation that will run 3x faster than the official NVIDIA implementation that was done by some amazing engineers: they have to make their operations efficient for every input size, you don't.
Re:Tesla bulks up its GPU-powered AI super
by dragontamer on Thursday August 18, 2022 @12:54PM
(#32512123)
Except this is an article about how Tesla has bought 7000+ Nvidia A100 GPUs in their latest supercomputer, rather than their D1 Dojo custom chip.
-----
EDIT: And ~7000 chips seems too small for a custom-run of chips. Any "supercomputer" Tesla builds has to be much much larger than this before a custom-chip project likely becomes cost-efficient.
Re:Tesla bulks up its GPU-powered AI super
by panick21_ on Thursday August 18, 2022 @05:55PM
(#32515355)
Because building not just a costume chip but a literal custom data center from the ground including software to run up takes a while and they have workloads that they need now. Production of such a chip and surrounding infrastructure takes a while to ramp up.
Re:Tesla bulks up its GPU-powered AI super
by dragontamer on Thursday August 18, 2022 @07:38PM
(#32516096)
Yes, and D1 is 7nm while TSMC is sampling 3nm to Apple, while NVidia Hopper will be delivered at 4nm.
It takes so much time to build that the D1 chip is seemingly going to be obsolete before the supercomputer is even built. Obviously, the D2 needs to be announced soon to remain competitive. But another run of chips is even a few hundred-million bucks down the drain again.
At some point, you have to wonder if the custom chip was worth it at all. A run on a high-end process like 7nm isn't cheap at all, and being forced to make another run at 5nm or 4nm or 3nm as technology improves only shows how difficult the hardware business is.
Will Tesla be able to deliver its chips internally before later NVidia chips (like Hopper) get delivered? Or whatever other AI companies are making chips?
Re:Tesla bulks up its GPU-powered AI super
by panick21_ on Thursday August 18, 2022 @09:59PM
(#32516938)
Those are all fair points.
Not paying large margin to Nvidia might also matters on the economics.
Sometimes the first version of something isn't strictly speaking worth it but its still important for the company and what it wants to do.
Its certainty risky, but Tesla has just decided that they are vertical integration is important for them. So far this strategy is working for them but any individual project can of course not work.
Re:Tesla bulks up its GPU-powered AI super
by Geee on Thursday August 18, 2022 @07:52AM
(#32508244)
Making a chip for your own use should be more optimal than a chip made for a wide range of customers. Also, you don't need to pay the hefty markup for NVidia. If you need a lot of chips, there's a point on the curve where it becomes more economical to design your own chip.
Re:Tesla bulks up its GPU-powered AI super
by titoCA321 on Sunday August 21, 2022 @02:14PM
(#32542837)
You have to invest into the people and the hardware and software to make the chip. And then you have to support that chip throughout the years. There's reason the U.S Government got out of making their own chips and laying their own fiber-cables.
Re:Tesla bulks up its GPU-powered AI super
by sigmoid10 on Thursday August 18, 2022 @07:18AM
(#32507937)
Tesla will be at the Machine Learning and Systems conference in 2 weeks and if not then we'll probably hear about the Dojo D1 chip at Tesla AI day which is one month later.
Re:Tesla bulks up its GPU-powered AI super
by dmurray on Thursday August 18, 2022 @07:25AM
(#32507989)
The A100 consumes up to 300W [0]. So in total 2.2 MW for the GPUs. Add the same again for CPUs, storage, networking, and cooling the whole thing and maybe it uses 5 MW. About the equivalent of 30 Tesla superchargers, of the 35,000 they operate.
Re:Tesla bulks up its GPU-powered AI super
by bertil on Thursday August 18, 2022 @07:34AM
(#32508063)
Tesla advertised being entirely powered by renewables, presumably mostly the solar panels on the roof of the factory (tooling in there likely represents the bulk of the energy consumed). There could be some accounting sleight-of-hand if there are no solar panels on office roofs. However, solar is a lot cheaper and they presumably have access to a lot, so I doubt it.
I think a better question is: could the heat be re-used, for example, to warm water in bathrooms? Capturing waste heat from computing centers with heat pumps seems like a very doable approach and a practice that is both responsible and profitable.
Re:Tesla bulks up its GPU-powered AI super
by panick21_ on Thursday August 18, 2022 @11:45AM
(#32511216)
That video was clearly faked, I mean it wasn't even faked very well. You can even see how FSD wasn't enabled at one point you can see the car flashing warning signs (but the audio of course was removed so people wouldn't notice). The driver manually over-wrote the system and that behavior is clearly explained in the user-manual and its how the car is supposed to work.
Do you always take internet videos made by literal competitors over the state licensed regulators?
Re:Tesla bulks up its GPU-powered AI super
by xedeon on Thursday August 18, 2022 @12:58PM
(#32512181)
Yeah, there were so many red flags that don't seem obvious to the untrained eye:
1. No clear indication that it was even on FSD. Only TACC was probably engaged.
2. Video was posted in 480p so it's hard to see what's on the screen.
2. YouTube Comments were turned off.
3. Bottom half of the screen was cut off on the initial video (most glaring omission IMO). Which would show if the warning that the accelerator pedal was being held down and that the vehicle would not stop. It looks like this: https://i.imgur.com/G3l9Rp1.png
4. Additional footage that was lasted released (also in 480p it's 2022, why?) CONFIRMED this: https://i.imgur.com/1PMbG9f.png
These are just a few examples. But it's hard to believe that the video was not made in good faith.
Re:Tesla bulks up its GPU-powered AI super
by retSava on Thursday August 18, 2022 @08:11AM
(#32508466)
> An even larger AI supercomputer – from Meta/Facebook – was detailed earlier this year. The AI Research SuperCluster (RSC) will employ 16,000 A100 GPUs, delivering more than 200 double-precision petaflops, once completed this summer.
Yay, let's further our efforts into hooking people and showing them ads! /s
How is an A100 worth "only" 17 tera-flops?
There are multiple home gpus and even mobile chips rated at tera-flops. And the A100 really is a gigantic chip.
I realize all about bandwidth, and full vs half precision, and inflated marketing vs actual benchmark.
But can a 10-node-iphone-cluster really match an A100 for pure flops?!
Only if the data is local, small, easily synchronizable, doesn't require fp32 precision and a dozen other caveats.
Can a 10 iphone cluster match an A100 in calculating digits of pi? Yes. Can it do backpropagation in large machine learning models? The gradients won't even fit.
It's optimized for TF32, INT8, bfloat16, and other similar data types that the tensor cores like.
Double precision is important for a lot of simulation codes because of numerical issues. For Deep learning applications it's basically unused, single precision or half precision formats dominate training. The same numerical issues don't show up, so this is a lot more efficient.
Additionally a lot of the 'AI' flops are achieved through matrix cores, fitting Deep learning the workload well. This brings an A100 from only 17 to ~200 tflops.
> But can a 10-node-iphone-cluster really match an A100 for pure flops?!
The iphone number is probably fp32 if not lower precision. However the combined SoCs of 10 iphones have tripple the transistor count and a larger chip area among them. So the comparison is not totally off.
https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Cent...
Typically these are things built by national laboratories, university research labs...
If all of my local pizza parlours were installing (well, renting) AI/ML rigs, it would be a different story.
Why would they? So their competitors can copy their business plan?
IBM has had large clusters for decades.
Any large bank or trading company would have clusters that would be at home in that list.
You don't want to know what the Apple cluster is like: they have to train for Siri, in multiple languages, etc. I be that's several orders of magnitude larger than Tesla.
AWS itself is probably several orders larger than most university clusters, probably larger than most country's combined computational capacity.
In fact if you look through the historic top500 lists a lot of the space outside the top10 is occupied by industry clusters. Classically oil and gas has been one of the big consumers. In recent years there are more and more cloud clusters in there as well.
So this Tesla cluster isn't really anything unusual.
There are some companies that don't have centralized high-performance compute resources so each department goes out and builds or buys and their own performance compute resources and strings it along. Many universities do this too where physics has a compute cluster and economics and bio-sciences have another cluster and sometimes they are underpowered and if all the departments grouped together and pooled their resources they would have adept system administrators and developers and hardware to support their computing needs but it doesn't always happen with poor governance so they end up with stuff that appears to be built from someone's basement and when that person leaves, retires, graduates there's so much poor documentation none know what to make of anything.
1: https://www.top500.org/statistics/list/ (select the "segments" category)
We also learn stuff such as ATT developing video phones since the 1960's but they were too early and it never go anywhere until decades later when ATT was a lesser relevant player in the telecom industry. And the Post Office foresaw the coming trend of online bill pay and email eating into their mail volume since the early 90's, yet when their they had projects that would enable senders and receivers to received mail scanned to a USPS account or pay bank statements through a USPS account for those early bill pay adopters, Postal Management did nothing with it.
Meanwhile, FSD is installed on only 7% of Tesla's cars, down from over 50% in 2019. https://www.torquenews.com/1083/teslas-low-fsd-take-rate-off...
Thus a 70 petaflop ultracomputer is quite a big investment to support an increasingly unpopular car option that's inessential and mostly promotional, ergo, a geek tickler.
Tesla is well known to be one of the most vertically integrated companies in the industry. The are well known to use AI for their factories as well. The run lots of simulations for crash testing as well.
What products are they are buying? They do probably buy somethings but unless you have evidence that they buy most things, I not gone believe you without some kind of source.
> Meanwhile, FSD is installed on only 7% of Tesla's cars
You realize it can be bought in later as well right? If quality improves lots of people have to option to buy it.
> that's inessential and mostly promotional, ergo, a geek tickler.
That's your opinion, an opinion that Tesla clearly doesn't share.
They are obviously not doing this (or not doing it well) as there are several spots on the state highway I repeatedly drive through where my car always slows down from 100KMH to 50KMH for and I have to repeatedly override with the accelerator to stop the person behind going in to me.
Original site I found the video at: https://www.supplychaintoday.com/tesla-artificial-intelligen....
More info: https://www.google.com/search?q=tesla+using+ai+in+factorys&r...
Maybe we'll learn something new from the Hot Chips event mentioned in TFA.
New chips are always fun to see and get discussed, but there are simple economic / mass design issues at play here. The Tesla custom chip just won't be made at the volume of NVidia or AMD.
And Intel's attempt to join the market seems like the better approach (even if it fails). You need to get the video game crowd to fund the research and development these days.
Video gamers want high speed SIMD for faster graphics. Without this source of money (and millions of chips sold per year), it looks difficult to sustainably upgrade an architecture.
--------
If not the PC market, then at least try to get the console market or phone market or some other consumer electronics fad wrapped up in things.
I don't think Tesla ever aimed to produce a chip for the public, it's purely to be used in their own products, so they don't have to be competitive with NVIDIA in flops/$ or worry about keeping up with NVIDIA production rate.
The chip only needs to be better, for the specific task they care about, for a specific metric they care about.
Considering that NVIDIA has to make a card that works for everyone, they have to make a huge number of tradeoffs, such as supporting many different number formats going from FP64 to INT4, their cores have to support a ton of different instructions, they need to keep a large amount of space on the chip for large memory buffers to support training of models with billions of parameters, they need to support GPUs interconnect for clustering etc. etc.
Given the importance of real estate on a chip, those tradeoff have large implications.
Tesla has 10x less constraints:
* For the training chip they only support their custom 8 and 16 bits format iic, so they can redistribute cores in consequence. They can ditch many instructions that they'll never use. They can size the memories to be exactly what they need, which is probably less than 80GB needed for large transformers, and use the freed space to add more cores etc.
* For the inference chip, they can additionally ditch all the interconnects as they just need one per car and reduce memory drastically freeing up even more space for cores.
If NVIDIA didn't have to balance so many different use cases on such a small area, then yes it would probably make no sense to try to do your own thing. But since they have to be general purpose, if you target a very specific use case you can be far less knowledgeable than them in GPU architecture and still come out ahead for your use case.
Specificity is the same reason why it still possible to write CUDA kernels for some basic operation that will run 3x faster than the official NVIDIA implementation that was done by some amazing engineers: they have to make their operations efficient for every input size, you don't.
-----
EDIT: And ~7000 chips seems too small for a custom-run of chips. Any "supercomputer" Tesla builds has to be much much larger than this before a custom-chip project likely becomes cost-efficient.
It takes so much time to build that the D1 chip is seemingly going to be obsolete before the supercomputer is even built. Obviously, the D2 needs to be announced soon to remain competitive. But another run of chips is even a few hundred-million bucks down the drain again.
At some point, you have to wonder if the custom chip was worth it at all. A run on a high-end process like 7nm isn't cheap at all, and being forced to make another run at 5nm or 4nm or 3nm as technology improves only shows how difficult the hardware business is.
Will Tesla be able to deliver its chips internally before later NVidia chips (like Hopper) get delivered? Or whatever other AI companies are making chips?
Not paying large margin to Nvidia might also matters on the economics.
Sometimes the first version of something isn't strictly speaking worth it but its still important for the company and what it wants to do.
Its certainty risky, but Tesla has just decided that they are vertical integration is important for them. So far this strategy is working for them but any individual project can of course not work.
[0] https://www.anandtech.com/show/16792/nvidia-unveils-pcie-ver...
I think a better question is: could the heat be re-used, for example, to warm water in bathrooms? Capturing waste heat from computing centers with heat pumps seems like a very doable approach and a practice that is both responsible and profitable.
Do you always take internet videos made by literal competitors over the state licensed regulators?
1. No clear indication that it was even on FSD. Only TACC was probably engaged.
2. Video was posted in 480p so it's hard to see what's on the screen.
2. YouTube Comments were turned off.
3. Bottom half of the screen was cut off on the initial video (most glaring omission IMO). Which would show if the warning that the accelerator pedal was being held down and that the vehicle would not stop. It looks like this: https://i.imgur.com/G3l9Rp1.png
4. Additional footage that was lasted released (also in 480p it's 2022, why?) CONFIRMED this: https://i.imgur.com/1PMbG9f.png
These are just a few examples. But it's hard to believe that the video was not made in good faith.
Yay, let's further our efforts into hooking people and showing them ads! /s