News for hackers. Stuff that matters.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by latch on Thursday November 11, 2021 @10:32PM (#29196060)
I take pretty unhealthy pleasure in looking at EC2/GC announcements and comparing them to random offers on the WebHostingTalk's Dedicated Hosting Offers section. The cloud offerings almost always end up being 2-4x more expensive (or more) and 2-4x slower.

Except when GPUs are involved. This just seems like something that dedicated hosting industry isn't on top of _at all_. I don't know if it's hardware availability, upfront costs, unreliable demand, an inability to compete on price, or if the usage really is so much more elastic.

The best I could [quickly] find was a 5600X w/32G Ram, 1TB SSD and 12GB 3060 for $189/m.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by toomuchtodo on Thursday November 11, 2021 @10:50PM (#29196149)
You’re not paying for the compute, you’re paying for IAM, the service ecosystem, unified enterprise billing, and the engineering experience. Totally different market than bare metal colocated. Like comparing a crated LS engine to a showroom Corvette.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by latch on Thursday November 11, 2021 @11:02PM (#29196201)
That's one reason. Some others:

1 - Free credits

2 - No one ever got fired for buying IBM

3 - AWS is sold to CTO/CIOs. AWS is a massive marketing and sales success

4 - An entire job type has sprung up around cloud-complexity. These people have a vested interest is staying on cloud.

5 - Growing number of people think the choice is exclusively between cloud or colo.

6 - Entire generations brought up on cloud: a lot of people don't realize just how expensive cloud is.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by mschuster91 on Friday November 12, 2021 @05:28AM (#29197909)
> 3 - AWS is sold to CTO/CIOs. AWS is a massive marketing and sales success

Not always. People on the ground push for cloud stuff because it makes their lives easier and they are used to it from their side projects (where they, more likely than not, used the generous free credits).

It's just like back in ye olde days when all you needed to do to get a copy of Photoshop was the official installer and a keygen... Adobe didn't invest much in marketing and didn't do much against piracy until the end of CS6/the rise of CC, simply to become the universal industry standard.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by judge2020 on Friday November 12, 2021 @12:00AM (#29196436)
Obviously 5 is really only a problem when you get into enterprises that have enough servers and monthly spend to where it would make more sense to invest in the overhead that is having your own servers.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by vmception on Thursday November 11, 2021 @11:25PM (#29196288)
> 6 - Entire generations brought up on cloud: a lot of people don't realize just how expensive cloud is.

Ah, so true. Heroku was my "solution" for so long, when its really so expensive on its own. All the pricing models are so messed up.

I have some Digital Ocean nodes at either $5 or $20/mo, I need to shut those down.

Deploying stuff that can communicate to other stuff is so easy right now and so cheap ... somewhere. Vercel to the rescue, for now.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by philliphaydon on Friday November 12, 2021 @01:04AM (#29196709)
> 6 - Entire generations brought up on cloud: a lot of people don't realize just how expensive cloud is.

The same people who know it’s expensive seem to not know how cheap it is.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by capableweb on Friday November 12, 2021 @04:08AM (#29197480)
If we're talking low amount of traffic, then maybe cloud is cheaper than dedicated. But for anything medium to high amount of traffic, cloud will always end up more expensive, or you have some unique use case where cloud is actually cheaper than dedicated over time?
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by philliphaydon on Friday November 12, 2021 @07:42AM (#29198740)
If we are only considering traffic then sure AWS can be expensive. Costs me $730 for 17TB of data at the moment. But looking at where money is being saved. 6 ec2 instances previously was $648.24/m, now its $6.82/m after moving to Step Functions / Lambda's, and it just works better as there's no fighting for resources anymore.

You know whats expensive in AWS. S3 Storage. Got some odd ~500TB stored in there. But at 6k/m I can't imagine trying to keep that in dedicated hardware. Atleast in S3 I feel it's safe.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by zoover2020 on Friday November 12, 2021 @04:24AM (#29197572)
A lot of hobby and or small websites and business could benefit from a pay-per-ms model like AWS Lambda.

It's literally pennies in some cases, vs. renting a server that sits idle 99% of the time.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by capableweb on Friday November 12, 2021 @04:49AM (#29197728)
What "hobby and or small websites and business" deal with medium to high amount of traffic? Those seems to strictly fall into the "low amount of traffic" bucket.

Besides, you could either rent a $5/month VPS that you know will always be $5/month, or you can use AWS Lambda and never know what your bill is gonna be at the end. Your new blogpost hit frontpage of HN? Good news, your bill is now $40 for this month.

Most (85% maybe) of my clients I work with want consistent costs over cheaper costs.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by speedgoose on Friday November 12, 2021 @05:08AM (#29197813)
A can rent a few €/month VM that is idling all the time but who cares, or struggle developing with AWS Lambda and risk paying orders of magnitude more.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by toomuchtodo on Thursday November 11, 2021 @11:06PM (#29196218)
All excellent points.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by dannyw on Thursday November 11, 2021 @11:00PM (#29196188)
Yeah, but for compute or bandwidth intense businesses, you might not need IAM, unified enterprise billing, or the "engineering experience".

I helped a niche API-as-a-service company go from -20% margins to being profitable. How? Moving away from AWS to Hetzner.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by whatever1 on Thursday November 11, 2021 @11:19PM (#29196265)
Administration is not free. Given today’s risks I really doubt a small scale company can afford in-house properly secured hosting/storing of anything valuable.

Yes your monthly bill is lower, but now the liability is all yours.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by latch on Thursday November 11, 2021 @11:58PM (#29196428)
These types of comments constantly come up. It's a false dichotomy. Following HN guidelines, I'll assume best intention rather than trolling or FUD.

There are other options than the two that you've described - namely VPS providers and dedicated providers.

Can you help me understand why you thought those were the only two options? Maybe people who joined the industry after, say ~2010, were primarily exposed only to AWS?

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by judge2020 on Friday November 12, 2021 @12:30AM (#29196563)
I don’t think anyone is saying that VPS and dedicated server providers aren’t an option. Rather, most startups rule them out since, if you grow enough to where the administration control of the Cloud is warranted, that past decision now warrants a host migration and the month+ of planning that goes into that. Unless the company really started as a side-project whose main funding was extra cash from the founder, it doesn’t make sense to artificially limit your growth.

Once more, it’s not like AWS is absolutely nothing. Chances are that any web-based startup would indeed be able to take advantage of the many autoscale-as-a-service features of AWS, enabling them to handle the next quarterly 100x increase in customers and throughout.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by aprdm on Friday November 12, 2021 @09:34AM (#29199603)
Feels to me like you have zero experience scaling outside the big cloud provider as this is simply not true
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by judge2020 on Friday November 12, 2021 @01:28PM (#29202822)
I'm only talking about why you would choose a cloud provider over VPS/dedicated, not that they're the only possible choice if you want to scale, so I don't see what is "not true" about my comment.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by throwaway2077 on Friday November 12, 2021 @02:14AM (#29197023)
>These types of comments constantly come up

because triple++ digit margins enable cloud service providers to allocate vast amounts of money towards marketing.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by whatever1 on Friday November 12, 2021 @08:10AM (#29198920)
Give us your contacts to us to receive our gift cards then.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by vidarh on Friday November 12, 2021 @02:26AM (#29197079)
You don't need in house hosting. Managed hosting at smaller providers almost always beats AWS by a huge margin. There are valid reasons to pick AWS but cost is almost never one of them - it's the expensive luxury option.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by can16358p on Friday November 12, 2021 @12:59AM (#29196682)
Anectodal: I work for a small scale company and we've just moved from self-hosted GitLab to GitHub for exactly this reason, after our (not-patched-since-eternity-because-no-one-has-time) GitLab servers got infected and started participating in a [D]DoS attack.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by raffraffraff on Friday November 12, 2021 @02:21AM (#29197061)
Unrelated to the original post, but why not go from hosted gitlab to SaaS gitlab? As someone who has used both, I would have stuck with gitlab, even if it was simply to keep things as similar as possible for engineers.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by can16358p on Saturday November 13, 2021 @04:02PM (#29213141)
We were actually deciding between GitHub and GitLab, and think GitHub in the long run was better as it's now owned by a giant like Microsoft which I'd trust more in terms of company size and stability. I know it's kind of a capitalistic view, but I have to think about my own (projects') security/safety and letting MS host feels safer than letting GitLab host.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by chillfox on Friday November 12, 2021 @02:05AM (#29196984)
If your service goes down then, usually customers aren't impressed by you screaming about it being some suppliers fault and it being their liability.

My point is that you can't outsource reputational damage and blame.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by ju-st on Friday November 12, 2021 @02:50AM (#29197181)
You can outsource it, at least partially, by buying the market leader, i.e. AWS or previously IBM.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by growse on Friday November 12, 2021 @03:15AM (#29197277)
When my service is down and my competitor's isn't, the customers don't care that "it's ok, it's because I chose the market leader and they're having an outage".

My customers don't have a contract with AWS. A service they're paying for is down, and what am I going to do about it?

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by whatever1 on Friday November 12, 2021 @08:08AM (#29198906)
Your customers cannot sue you for reasonable downtime. Your contract always has a downtime clause, and nobody is promising 100% availability.

But they can sue you to bankruptcy if you mess up with their data. And these incidents happen way too frequently, even to big players, to ignore them.

You cannot casually say I am able to setup a Linux box myself, no need to hire experts / outsource this task to experts.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by scottcodie on Friday November 12, 2021 @02:29AM (#29197099)
IMO, you're mostly paying for the future value of having your ecosystem in aws. It's nice being able to leverage the things aws provides without an additional switching cost.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by pritambarhate on Friday November 12, 2021 @02:39PM (#29203656)
Some other reasons to pay extra charges are: Trust, Compliance and Competency. When AWS says my RDS is backed up and point in time recovery is available, I can trust that it is really available. In self hosted databases, admins sometimes make mistakes and data is lost.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by CobsterLock on Friday November 12, 2021 @01:00AM (#29196691)
I really like that analogy
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by totoglazer on Thursday November 11, 2021 @11:05PM (#29196215)
I think this really is much more elastic for some workloads. I want to use hundreds of A100s for a few weeks. Then not use them for a quarter while I use and analyze what I trained, fine tune on smaller machines, etc. We’d never be able to justify buying a cluster that large and managing it for intermittent use, much better to have it burst properly.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by fxtentacle on Friday November 12, 2021 @04:01AM (#29197453)
When I needed GPU instances, I asked my long-term bare metal hoster (hetzner.de) and they sent me a private price list.

My theory is that publicly advertising GPU instances tends to attract people who want to convert stolen credit cards into crypto mining power. I mean it's the same reason why the 3090 == GPU most suitable for crypto has been sold out for a year.

That's also in line with the fact that I had to sign a voucher stating that I will NOT do any kind of crypto hosting / mining / processing on any of their servers before I got that GPU instance.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by iamcreasy on Friday November 12, 2021 @05:19AM (#29197865)
Are the prices at the private price list considerably cheaper?
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by nh2 on Friday November 12, 2021 @08:00AM (#29198851)
When was that?

I also asked Hetzner for GPU instances after they took down the ones from the website, and a price list was not available at the time, but for a sufficiently sized order they said they would provide me some.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by k8sToGo on Friday November 12, 2021 @08:49AM (#29199201)
I thought it is possible to send them your own GPU and they would put it in your server.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by rjzzleep on Thursday November 11, 2021 @10:38PM (#29196093)
Apparently Hetzner discontinued theirs because of cryptocurrency abuse(whatever that means)
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by jiggawatts on Thursday November 11, 2021 @10:56PM (#29196166)
There was a related discussion here on YC News.

The gist of it was that these hosting providers exchange credit for cash-equivalents. For example, you can sign up with a credit card, and then immediately start using the compute that you have purchased to mine crypto.

Now, if you pay your bill, this ought not to matter. Who cares what you use your rented computer power for? (As long at is not hideously illegal child porn hosting or what have you.)

The problem was that the smaller providers were being mercilessly abused by criminals signing up with stolen credit card numbers. They would extract sufficient crypto coins before the provider shut them down for this to be worth doing over and over.

The providers could have simply requested up-front payment for compute until a "track record" was established, and this would have solved the problem.

Instead, they all opted to maximise the "sign ups per month" metric to get those sweet, sweet KPIs met, and then killed the crypto-mining accounts mercilessly with AI detection.

... which also killed several legitimate customer's businesses outright. Typically with no recourse.

Oops.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by krasin on Friday November 12, 2021 @12:43AM (#29196614)
Specifically Hetzner required me to put a deposit, when I rented a server a few months ago. It was a reasonable amount, and you're right about the reasons.

Edit. Found their message:

"At the following link you can upload the copy of your ID, or you can use our pre-paid option, where you pay €20 in advance via PayPal: https://accounts.hetzner.com"

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by slownews45 on Friday November 12, 2021 @02:23AM (#29197078)
if you like following WHT dedicated hosting offers one fun thing is to just see how long lasting (or not) these providers are.

Despite supposedly being 4x faster and 4x cheaper, these dedicated hosting offer guys come and go like moths circling a burning flame.

Same thing with the s3 competitor file hosting companies. I haven't followed this space recently from hotfile / filesonic etc etc. All supposedly way cheaper than S3 - but boy do they disappear in the night at times.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by latch on Friday November 12, 2021 @03:05AM (#29197231)
On the flip side, there's no shortage of providers that have been around since before AWS was a thing.

For example, the quote that I found was from a provider I used over a decade ago (no affiliation), and who have been in business since 1999.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by slownews45 on Friday November 12, 2021 @11:39AM (#29201228)
I just checked my old provider pair networks.

Processor 8 Cores HD 240GB SSD RAM 16GB $311 / month

This is not that competitive with m5a.4xlarge reserved for one year.

64GB / 16 core machines - good modern gen cores

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by reitzensteinm on Saturday November 13, 2021 @06:41AM (#29209136)
Those are managed dedicated servers, where they'll install and maintain software for you. It's an entirely separate class.

And even if it wasn't, the existence of a single expensive dedicated server provider wouldn't disprove parent's claims.

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by ev1 on Friday November 12, 2021 @01:37AM (#29196844)
IIRC, you are not allowed to use a RTX/GTX in a datacentre.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by cbg0 on Friday November 12, 2021 @05:57AM (#29198053)
Says who, Nvidia? They might not honor the warranty, but there's nothing they can do to stop you.
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by karmasimida on Friday November 12, 2021 @07:03PM (#29206002)
EULA says it

If you are at AWS scale, NVIDIA would definitely sue you ...

Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by NikolaeVarius on Friday November 12, 2021 @09:27AM (#29199536)
Licenses are a thing?
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by short12 on Friday November 12, 2021 @04:00PM (#29204463)
I bought a card not a license
Re:New – EC2 Instances (G5) with Nvidia A10G Tensor Core GPUs by buildbot on Friday November 12, 2021 @04:14AM (#29197518)
There’s vast.ai!