News for hackers. Stuff that matters.
Re:You Are Not Google (2017) by paganel on Thursday April 04, 2019 @04:43PM (#19576906)
> My goal is to be totally unable to SSH into everything that powers my app

That sounds like a nightmare to me, and I'm not even a server guy, I'm a backend guy only managing my personal projects.

> I'll pay Amazon $N/month to do that for me, all that matters is the product.

I don't want to pay Amazon anything, I want to pay Linode/Digital Ocean 5 or 10 or 20 dollars per month and I can do the rest myself pretty well. My personal projects will never ever going to reach Google's scale and seeing that they don't bring me anything (they're not intended to) I'm not that eager to pay an order a magnitude more to a company like Amazon or Google in order to host those projects.

Re:You Are Not Google (2017) by leeoniya on Thursday April 04, 2019 @05:26PM (#19577290)
it's astounding how much a $20 linode can handle (as a web host) with a proper software stack and performance-minded coding.

but companies throw money, hardware and vendor lock-in at problems way before commiting to sound engineering practices.

i have a friend who works at an online sub-prime lender, says their ruby backend does hundreds of queries per request and takes seconds to load. but they have money to burn so they just throw hardware at it. they spend mid-five figures per month on their infrastructure and third party devops stuff).

meanwhile, we run a 20k/day pageview ecommerce site on a $40/mo linode at 25% peak load. it's bonkers how much waste there is.

i think offloading this stuff to "someone else" and micro-services just makes you care even less about how big a pile of shit your code is.

Re:You Are Not Google (2017) by 72deluxe on Thursday April 04, 2019 @05:56PM (#19577504)
And we just thought the frontend of websites and services was bad.

Seems the insanely bad coding and ignorance of speed and performance goes all the way to the backend too!

Disappointing.

Re:You Are Not Google (2017) by DylanBohlender on Thursday April 04, 2019 @06:57PM (#19577936)
One of the things I'm most grateful for as a programmer was the ability to learn a lot of performance-minded backend design principles within the Salesforce ecosystem. Salesforce was always brutally unforgiving in terms of the amount of I/O it would let you do per transaction, which led me to become much more aware of how those things worked under the hood, and had the effect of teaching me how to better design my code to fit within the limits.

When you can't use more than a couple seconds of CPU time per transaction, or you have a fixed and spartan heap size for a big algorithm, you learn good habits real quick.

I imagine a lot of engineers today haven't had the experience of working within hardware limits, hence all the waste everywhere.

Re:You Are Not Google (2017) by leeoniya on Thursday April 04, 2019 @07:58PM (#19578341)
> When you can't use more than a couple seconds of CPU time per transaction

hmm, i guess that explains why salesforce is universally known for being slow; 2 seconds is an eternity.

we deliver every full page on the site within 250ms from initial request to page fully loaded (with js and css fully executed and settled). images/videos finish later depending on sizes and qtys.

Re:You Are Not Google (2017) by sbr464 on Thursday April 04, 2019 @08:34PM (#19578526)
I don’t disagree that Salesforce is slow but this is a different workload, think db/business logic to perform a task, processing records, etc, not loading a typical page/assets.
Re:You Are Not Google (2017) by leeoniya on Thursday April 04, 2019 @10:19PM (#19579073)
i just signed up for a trial of salesforce and at least when there's not much data in the account it doesnt seem too slow. i was going off of what some coworkers related to me from past experience.

i think it's expected that if you're doing some editing/reporting/exporting en masse, then a couple seconds could be okay (assuming it's thousands or tens of thousands of records, not a hundred). but not for single-record actions / interactions.

Re:You Are Not Google (2017) by nukeop on Friday April 05, 2019 @04:40AM (#19580804)
Astonishingly it turns out that bad programmers are everywhere and aren't made any better by handling a different domain of problems. Truly shocking.
Re:You Are Not Google (2017) by raviolo on Thursday April 04, 2019 @09:11PM (#19578720)
We process up to 15 million events per second on a $15K HP server.
Re:You Are Not Google (2017) by leeoniya on Thursday April 04, 2019 @09:57PM (#19578979)
a pretty meaningless metric without knowing what an "event" is.
Re:You Are Not Google (2017) by raviolo on Thursday April 04, 2019 @11:01PM (#19579284)
The event is market data update. On one hand it is in fact pretty simple. On the other hand, it is not much simpler than something like “user X liked Y” or even “product Z added to cart”. I think it shows what a well designed, optimized code can do on a normal hardware. Remember there is 3-4 billion instructions that a modern cpu is pumping out per second.

One large bank I used to work for had a payment processing system doing about 40 thousand transactions per day. It ran on about $8 million worth of hardware - mainly IBM mainframe. I was impressed until I found out each transaction was essentially a 60-100 byte text message. I can confidently say a well designed system can do 1000 times that load on an iPhone.

Re:You Are Not Google (2017) by cbzoiav on Friday April 05, 2019 @11:51AM (#19583730)
Not that it isn't probably still terrible code but the banking system is likely logging the full transaction details every time it is modified / passed to a different part of the system. I.e. fully auditable - if something goes wrong with the transaction it can be fully traced back, corrected and the underlying issue investigated.
Re:You Are Not Google (2017) by everdev on Thursday April 04, 2019 @05:24PM (#19577272)
Cloud providers have generous free tiers, so many personal projects pay $0. However, I'm in the same boat. I'd rather pay $20/month to DO and risk my site going down in a DDoS attack than having a REST endpoint basically tied to my credit card and hoping Amazon blocks all the malicious traffic.
Re:You Are Not Google (2017) by jcadam on Thursday April 04, 2019 @10:11PM (#19579044)
Yep, keep your stuff portable and you can always migrate to AWS/Azure/etc. later if your personal project should turn into something bigger.
Re:You Are Not Google (2017) by staticassertion on Thursday April 04, 2019 @05:16PM (#19577201)
As someone tasked with protecting infrastructure, devs not being able to SSH into production is a godsend.
Re:You Are Not Google (2017) by scaryclam on Thursday April 04, 2019 @08:46PM (#19578582)
There's a difference from devs not being able to ssh in due to access restrictions and devs not being able to ssh in because it's not a feature of the service. I actually agree that not having unilateral access to the production system is a good thing. But not being able to have anyone able to be granted access, even for a limited time, is neither productive or safe.
Re:You Are Not Google (2017) by hackerpacker on Thursday April 04, 2019 @10:34PM (#19579153)
so, what is to stop them from running code from the app?!? Who do you call when something breaks? Do you expect the dev to not be able to log in and investigate at 3am or whenever?

I mean if you can't trust your dev team, or the procedures surrounding them, you are kinda screwed.

Re:You Are Not Google (2017) by staticassertion on Thursday April 04, 2019 @10:36PM (#19579160)
To be clear, the issue isn't about trusting developers in prod. It's about limiting access to prod as an avenue for attackers who will be looking to get in there and exfil sensitive data.

Nothing to do with trust of devs.