This depends to an incredible degree on what kind of "consultant" you're talking about. For the traditional "strategic consulting" type consultants it seems basically as impossible to quantify as for software developers, or rely most other people working in large companies.
I’d personally disagree with the cost effectiveness argument though. Unless your engineering work really cannot benefit from more skill (and as often as I’ve heard management think their work is relatively simple, in practice I’ve rarely seen it) then you’d have to replace a highly skilled engineer with a small team that would likely cost more than $500k. Packing your engineering firepower into as few bodies as possible is a highly cost efficient strategy, as most of the successful techs know.
On the other hand, a small team is less vulnerable to getting hit by a bus or hired out.
Yes, it is difficult, but possible.
Here's quick and dirty analysis - consider Sears, Walmart, and Amazon:
- Amazon pays its engineers near top of market - $1.5T market cap.
- Walmart has a pretty good engineering culture. They acquired a tech company to start Walmart Labs for data science stuff and they even have popular open source software (Hapi.js) - they're the largest company by revenue and $370B market cap.
- Ever been to Sears.com? Me neither - largest retailer in 1980 to bankrupt in 2018, stock price at $0.23 and $94M market cap.
I deduce that investment in software engineers == higher stock price.
Easy to do when you cherry-pick three companies.
Run your analysis on 10,000 companies large and small and you might have something.
* Netflix vs Blockbuster
* Uber / Lyft vs taxi cabs
* Airbnb vs hotels
* Blogs vs print media
* Youtube /Instagram vs TV
* porn tube sites vs porn studios
I could keep going.
I've also tried the corollary - companies that are successful while cutting cost in tech, but I can't think of any successful companies that are cutting investment in tech.
Would it prove or disprove this statemenet?
Of course there is still meaningful signal you can use to differentiate developers, but it's going to be fuzzy. I-banking and consulting increase wages for their employees by firing everyone who doesn't meet a certain bar. In addition to creating a toxic work environment, this practice isn't possible with only fuzzy signals.
Also, it's much more difficult to quantify the impact of a software engineer compared to investment bankers and consultants. The latter two are directly making money for the firm.