News for hackers. Stuff that matters.
Re:Meta is about to start its next round of layoffs by EMM_386 on Tuesday April 18, 2023 @07:38PM (#35622047)
Isn't a lot of this silliness due to them feeling like they needed to "poach" talented developers, so that the competion wouldn't get them?

That, of course, is absurd on the surface. Hiring people for the sake of hiring ... so they can stand around the watercooler discussing the weather.

That led to double or triple the headcount! 85,000+ employees to work on Instagram, Facebook, and pet projects.

That number alone boggles my mind. I work with three other senior developers and we run an entire phone company with five-nines uptime. Yes, three.

And now suddenly everyone is shocked about layoffs!

Re:Meta is about to start its next round of layoffs by loeg on Tuesday April 18, 2023 @07:54PM (#35622214)
You started with an absurd conspiracy theory and just ran with it.

> Isn't a lot of this silliness due to them feeling like they needed to "poach" talented developers, so that the competion wouldn't get them?

No! No one does this!

Re:Meta is about to start its next round of layoffs by EMM_386 on Tuesday April 18, 2023 @08:13PM (#35622421)
Oh, come on. Yes they do.

> Is Apple throwing enough money at key engineers to prevent defection to Meta?

https://www.idownloadblog.com/2021/12/29/apple-meta-poaching...

Re:Meta is about to start its next round of layoffs by colecut on Tuesday April 18, 2023 @08:34PM (#35622597)
Paying enough to keep key engineers is not the same as hiring new ones they don't need
Re:Meta is about to start its next round of layoffs by 1letterunixname on Tuesday April 18, 2023 @08:44PM (#35622670)
Supposedly, there is software that uses "internet-based signals" behavioral predictions to identify which key technical people are being courted and/or are considering moving to a new gig.

Poaching is a big part of the game. You can't get a raise compared to what you can playing the game.

Re:Meta is about to start its next round of layoffs by boomerango on Tuesday April 18, 2023 @10:52PM (#35623715)
“Hey this guy just updated his linked-in for the first time in two years!”
Re:Meta is about to start its next round of layoffs by guiambros on Tuesday April 18, 2023 @11:17PM (#35623871)
I love how people assume that a poorly written and tangentially related article, with a question mark in the title nonetheless, becomes the official proof of <wild speculation that bigcorp is doing X>.

Wait until we see the flood of ChatGPT-generated articles. Oh, wait...

Re:Meta is about to start its next round of layoffs by pc86 on Wednesday April 19, 2023 @09:53AM (#35628143)
Are you not familiar with the world-class investigative tech journalism coming out of iDownloadBlog.com? I mean the guy lying about his day job posted it so clearly it's a very legitimate and prestigious publication.
Re:Meta is about to start its next round of layoffs by 1letterunixname on Tuesday April 18, 2023 @07:56PM (#35622229)
The public already knows: the headcount graph trended upwards and accelerated in recent years until recently.

I joke with people in another department that we're a poaching ground for TikTok. Mostly, I work with people who have been at the company many years and are senior production engineers, so I can't appreciate dotcom-style spending in non-engineering business units. For the same space, Alphabet has 10x headcount compared to us.

Re:Meta is about to start its next round of layoffs by vineyardmike on Tuesday April 18, 2023 @11:28PM (#35623949)
Is this actually true though?

The data seems to suggest that for most companies the trend was constant, and they just reached a point where it was no longer economical, which was exacerbated by hiring freezes halting attrition.

https://stratechery.com/2023/tech-layoffs-big-techs-hiring-r...

Re:Meta is about to start its next round of layoffs by mupuff1234 on Tuesday April 18, 2023 @07:58PM (#35622262)
Perhaps one way to view hiring (at the scale of big tech) is a bit like a VC, you hire 100 people knowing 99 of them won't do anything special, but that 1/100 will make it worth it.

And like VCs the math makes more sense when money is cheap and there's a bull market.

Re:Meta is about to start its next round of layoffs by selcuka on Tuesday April 18, 2023 @08:10PM (#35622397)
An SAP consultant once told me that they had a term that can roughly translate to "make a crowd" (sorry, no idea about the actual phrase used by consultants in English speaking countries, if there is one). It basically means that whenever a big customer have an issue, they send more people than actually needed, and one senior consultant works on solving the problem while others just walk around and look busy. It gives the impression that they are taking the issue seriously.
Re:Meta is about to start its next round of layoffs by redeeman on Tuesday April 18, 2023 @08:45PM (#35622680)
this would explain the cost surrounding SAP :)
Re:Meta is about to start its next round of layoffs by tmpz22 on Wednesday April 19, 2023 @10:11AM (#35628383)
I’ve seen a version of this in sales where you have a welcoming call with the new client with the entire service team acting all cheery. Leaves the impression that their spend gets all those people when in reality it does not.
Re:Meta is about to start its next round of layoffs by red-iron-pine on Wednesday April 19, 2023 @11:17AM (#35629216)
'Tis true with Incident Mgmt and some highly sensitive projects, too. Nothing SAP related at all, but gives the appearance to PMs and Ops leaderships that we're going extra hard on the issue.

And to be fair, it's useful for incident mgmt since you don't know what you'll find, and will often have lots of people up your ass; having supernumerary bodies means I can throw them at something if I find an artifact or concern, and it also gives me a distraction-shield: I communicate only to Senior Engineer X, and all inquiries from Mgmt and Customers go to X; I only have to update X instead of 10+ irritated users/owners.

Re:Meta is about to start its next round of layoffs by loeg on Tuesday April 18, 2023 @10:08PM (#35623399)
In engineering, it's much closer to 2 than 100.
Re:Meta is about to start its next round of layoffs by idispatch on Tuesday April 18, 2023 @11:08PM (#35623811)
To be more precise, to e.
Re:Meta is about to start its next round of layoffs by noisenotsignal on Tuesday April 18, 2023 @08:00PM (#35622291)
4 engineers for an entire phone company sounds scary. I’m sure your engineering is robust enough such that outages are minimal, but that still sounds like a lot of on call (rotation of 4 = once a month?). Even if you only get paged once every few months, you still need to worry about getting paged until your shift is over! Even if you don’t worry in the psychological sense, you still have to schedule around it.
Re:Meta is about to start its next round of layoffs by EMM_386 on Tuesday April 18, 2023 @08:10PM (#35622395)
I actually screwed that up, we only have 3 total software engineers. Including myself.

We do have other employees who maintain the hardware, on-call DBAs to manage issues, etc. I'm only speaking to the software engineers.

And we have lots of hardware and lots of open-source solutions that handle the actual calls.

I'm full-stack but lead on the front-end, a complex Angular application to manage everything from huge call centers to small restaurants.

We have C# for APIs, cloud Oracle for the database, and a whole slew of other software and services to manage the actual calls.

Each of us is specialized in specific parts. Our up-time is tremendous given the amount of code we've written. It's extremely stable.

I've been at this 20+ years, as have the other 2. We know enough between us to get this done.

I've never been called after normal work hours. We release the updated front-end every week and haven't had any issues. And a lot of changes/improvements go into that ... that's a lot of my job.

It's well-architectured, well-tested, fault-tolerant software.

Re:Meta is about to start its next round of layoffs by throwaway1946 on Tuesday April 18, 2023 @09:29PM (#35623130)
Sorry, but I'm skeptical that you actually run "an entire phone company" in the way that most people understand the term. You mention that you use lots of open-source solutions, and I'm guessing you outsource the build and operation of the network to a real phone company, probably similar to an MVNO. Am I wrong?

Meta is very different from that, they build the products that users interact with, but also build things at the bottom of the tech stack. At their scale, this makes business sense to do so, and comparing your headcount with theirs makes no sense.

I don't really understand why software engineers keep dunking on each other like this. I get that people want to broadcast how smart they are, but in reality we're just giving the general public a warped sense of how much work is actually involved in building large-scale software systems, which is a bit of a dick move when people are getting laid off.

Re:Meta is about to start its next round of layoffs by EMM_386 on Tuesday April 18, 2023 @10:49PM (#35623697)
> I don't really understand why software engineers keep dunking on each other like this.

I'm not dunking on anyone, I'm explaining my day-to-day job with a very small number of senior engineers.

We run a highly complex system. There's no way we could handle millions of calls with five-nines otherwise.

I won't get further into the details because I don't want to reveal too much PII.

I fully understand how much "behind the scenes" work goes on at a place like Facebook. I'm not sitting here imagining rooms of graphic designers thinking what the CSS button radius should be (although I'm sure with 85,000 employees, those happen also).

But note that Musk walked into Twitter, fired en-masse, and it still seems the same to me.

Yes, there are senior engineers who keep the core functionality working.

That is still far less than 85,000 employees.

In our case, it's 3 of us handling all software development. And we write a lot of mission critical code.

Re:Meta is about to start its next round of layoffs by opportune on Tuesday April 18, 2023 @10:56PM (#35623750)
I’m also skeptical any time someone mentions 5 nines uptime at a small scale. For one, it takes a lot of engineering to be able to actually monitor and detect that with precision (that is, how do you know you are 99.999 and not 99.995?) and with so few people there may be holes in what’s monitored (there are so many places you can drop requests/whatever and lose availability). There’s also tail risks like datacenter incidents (if your servers are on three racks in two data centers) or dependencies like power outages that you may be getting lucky on avoiding due to small scale, rather than amortizing over a huge fleet - that is to say, if there is a 1% risk per year that one of your racks goes down and takes you 3 9s when that happens, you are really at slightly under 4 9s, but with only a few racks it doesn’t happen most years.

That last one is I suspect what makes it so small scale operators can achieve “5 9s” with a fraction of the engineering of larger operators. You can get a lot of 9s most years because you dodge infrequent risks.

Re:Meta is about to start its next round of layoffs by EMM_386 on Tuesday April 18, 2023 @11:19PM (#35623881)
> I’m also skeptical any time someone mentions 5 nines uptime at a small scale. For one, it takes a lot of engineering to be able to actually monitor and detect that with precision (that is, how do you know you are 99.999 and not 99.995?)

We have that in place. We run phone systems that businesses depend on, and we have SLAs that guarantee this uptime in order to secure customers. We have network engineers dedicated to everything from guaranteeing it on the cloud side to checking Wireshark traces for any hint of abnormalities, every day. When I say 3 people, I mean those of us writing the front-end, back-end, database procs, and code that the open-source libraries require, including forking and custom patches. We have other team members ensuring our HA pairs, load balancing, redundancy, fail-overs, and all the other associated technology is working as expected.

I won't get into the details, but we have not violated our SLAs, ever.

And you'd be surprised at what open-source software we are using to drive parts of this system. Kudos to them, they are helping us maintain this with some rock-solid software.

Re:Meta is about to start its next round of layoffs by linza on Wednesday April 19, 2023 @02:41AM (#35624999)
I think you cannot really salvage this argument. The way you describe it makes it sound to me that your company's success is ore likely due to luck and not just competence. It's also not clear if you really think this is a model that can scale to the size of Meta or if you just wanted to slide in a humblebrag.
Re:Meta is about to start its next round of layoffs by 908B64B197 on Wednesday April 19, 2023 @11:18AM (#35629233)
> It's also not clear if you really think this is a model that can scale to the size of Meta or if you just wanted to slide in a humblebrag.

It can't. It depends on "software services" hosted and coded by "other software companies" so his infra's SLA is basically outsourced to either Amazon, Microsoft or Oracle.

Re:Meta is about to start its next round of layoffs by EMM_386 on Wednesday April 19, 2023 @12:21PM (#35630078)
> It depends on "software services" hosted and coded by "other software companies" so his infra's SLA is basically outsourced to either Amazon, Microsoft or Oracle.

It also depends on an incredible amount of in-house custom code.

If I deploy a change that breaks our Angular front-end, or a C# API change that has a typo that routes calls to the wrong places, or a configuration file for our open-source software that handles the phone systems, how exactly do we tell our thousands of customers they can't run their call centers? Or our restaurant customers can't take orders because their phone systems are dead?

Let's not be ridiculous. I'm not humble-bragging. I'm telling you what I do at my job.

Re:Meta is about to start its next round of layoffs by deadly_syn on Saturday April 22, 2023 @07:52AM (#35665628)
Arent most peoples at this point?
Re:Meta is about to start its next round of layoffs by andsoitis on Wednesday April 19, 2023 @09:40AM (#35628012)
> I've been at this 20+ years, as have the other 2

> We release the updated front-end every week and haven't had any issues. And a lot of changes/improvements go into it

In 20 years zero issues? I don’t believe you.

Re:Meta is about to start its next round of layoffs by hintymad on Tuesday April 18, 2023 @09:17PM (#35622985)
> Even if you only get paged once every few months, you still need to worry about getting paged until your shift is over!

I'm not sure what you mean. A page every few months will be considered world-class achievement in a FAANG-like company. Take Amazon for instance, the oncall is brutal and getting several pagers per day is normal. Other companies may be better, but not one pager per few months better.

Re:Meta is about to start its next round of layoffs by vineyardmike on Tuesday April 18, 2023 @11:20PM (#35623888)
When you're on-call, you need to be prepared for a page. That means you can't get drunk with your friends, or get on a plane, etc. Being on-call means being ready to answer a page, whether it comes or not.

> A page every few months will be considered world-class achievement in a FAANG-like company.

Except maybe it's a different beast entirely. At amazon, they're constantly pushing new features at most teams. A stable phone company may just be handling pages for when hardware fails. Presumably there's bugs in fast-moving new code more frequently than hardware failure of a tiny org.

Also, fwiw I've been at amazon and had on-call rotations where we didn't get paged monthly. Your manager/team isn't allowing you to allocate resources to fixing your alarms or bugs if you're getting paged that often and not a crazy critical service.

Re:Meta is about to start its next round of layoffs by drw85 on Wednesday April 19, 2023 @04:24AM (#35625748)
I think all those big corps do a lot of change for the sake of change.

That's why we have so much churn in frameworks, etc.

If you're not "innovating" somewhere, you're not good enough to work there.

Traditional companies are more long term and stable with their tooling and decision making.

Re:Meta is about to start its next round of layoffs by charcircuit on Tuesday April 18, 2023 @08:39PM (#35622636)
With three people there are limits with what you can build and how fast you can build it. At large tech companies there is a gigantic amount of scope. People will make up scope to justify their job, or to justify why they need to grow their teams to accomplish goals. If a company wants to invest into doing everything over prioriting what should be worked on then headcount will explode.
Re:Meta is about to start its next round of layoffs by hintymad on Tuesday April 18, 2023 @08:56PM (#35622772)
> Isn't a lot of this silliness due to them feeling like they needed to "poach" talented developers, so that the competion wouldn't get them

People say this from time to time, but have we ever got evidence from any company? A director or VP gave such mandates, a leaked email that discussed such strategy?

Re:Meta is about to start its next round of layoffs by asdfman123 on Wednesday April 19, 2023 @12:59AM (#35624403)
No one ever seems to explain how the companies are coordinating to suck up talent. Otherwise, there would be a free rider problem. Why not let Google suck it up instead?
Re:Meta is about to start its next round of layoffs by andsoitis on Wednesday April 19, 2023 @09:36AM (#35627974)
> Isn't a lot of this silliness due to them feeling like they needed to "poach" talented developers, so that the competion wouldn't get them?

Rumor.

Re:Meta is about to start its next round of layoffs by papito on Wednesday April 19, 2023 @01:30PM (#35630898)
A team of 3 star engineers can take on the world. It's a killer setup.