News for hackers. Stuff that matters.
Re:My First Year as a Freelance AI Engineer by nvilcins on Saturday May 02, 2020 @02:14PM (#23053717)
New to freelancing, and while I get the hustle and pricing according to the value for the client, it's still hard to wrap my head around people charging 500$/h+. Like, what is the value an AI contractor can deliver in ~50h that easily justifies spending 25k (and without much prior knowledge about the product, systems in place, etc.). Honest question, trying to understand the game.
Re:My First Year as a Freelance AI Engineer by ska on Saturday May 02, 2020 @05:27PM (#23055063)
This has nothing to do with AI specifically. Basically if you are hiring a contractor/consultant you are doing one of two things - bringing on capacity, or bringing on capability. Sometime a mix of both.

The former category buys you a little bit of flexibility in hiring, etc., so you should be willing to pay a little more than you would fully loaded (e.g. 1.25.x - 2x salary, depending on a bunch of factors) with no complaint, but that's about it. The great thing about capacity freelancers is you can turn them on and off easily as your needs change.

That capability category is a vastly different space though. Imagine I'm a specialized skill/experience sort of consultant or freelancer. If you hire me to show you how to do something you don't know how to do, how much is that worth? Or what if bringing me on for 3 months can pull your time-to-market ahead by a year? Maybe you would love to hire me full time but can't afford it (or I just don't want full time with you) - or maybe you just don't have enough of this sort of work to justify an expensive hire.

It all comes down to value. If 50k worth of my time will save you 3 million dollars, why do you care how much time that is?

Sometimes a 2 hour conversation can save you from a 300k mistake. Should I be charging you for the time, or the impact?

Re:My First Year as a Freelance AI Engineer by ganstyles on Saturday May 02, 2020 @05:34PM (#23055115)
Just responded to the person you were responding to, but well put. In my case it was very much the latter, and we don't know the true results yet, but will potentially allow us to get operational significantly faster, with fewer mistakes, with a better product. Win win win.
Re:My First Year as a Freelance AI Engineer by ganstyles on Saturday May 02, 2020 @05:32PM (#23055101)
Imagine developing a core competency for your company where it's complicated enough that you're not sure what route to take. Also assume you have a team of maybe 8-10 ML engineers who all make what ML engineers make. It makes so much more sense to pay $25k to get direct knowledge of systems and techniques versus your team spending a bunch of time exploring different products/methods/algos to find something that might work in the end, or might fail in a few months. $25k is like 5 MacBooks, hardly worth thinking about versus being able to get experienced direction from someone who has done what you're trying to do and saving your team literally hundreds of hours of exploratory work. It's not really a game, it's good sense. Yeah given the covo here I probably could have negotiated them down, but that's my time doing that and then things have to be vetted with outside counsel and the CFO, also time wasted, versus just telling them this is what the person charges, we need them for 50 hours, "authorize the charges please." And at what cost, saving a few thousand dollars?
Re:My First Year as a Freelance AI Engineer by mlthoughts2018 on Saturday May 02, 2020 @06:21PM (#23055356)
How do you develop a business connection and market your service as being more valuable that the wide abundance of free materials, engineering blogs, research papers, etc., in this space?

Just for example, I run a team of 10 machine learning engineers at a large ecommerce company. We mostly do NLP and computer vision, some time series forecasting.

I cannot imagine ever paying anything close to $25k for consulting advice, that’s just bananas to me. We recently purchased licenses to use the data annotation tool prodigy from the spaCy creators at explosion.ai. That was ~$4000 and the decision whether to build our own data annotation system or not was excruciating, involved all kinds of business documentation, RFCs, approvals, NDA processes, etc. It was deeply non-trivial to procure that, and building our own was a very serious option we pursued with tech specs and prototypes and everything.

Spending 6x that amount for _advice_ about NLP, which practically grows on trees today, is just totally unrealistic.

It makes me suspect the real target customer for you is not companies with actual ML engineering teams or ambitious data-driven projects, but more like someone looking for McKinsey-lite. Some place that has no serious ML use case beyond drop-in pretrained models and sees $25k as the cheaper path to rubber stamp certification that dissolves internal political feuds. Most likely just selling super cookie cutter NLP models as if they are advanced and represent some sexy leap forward for a company with a couple junior data scientists. Algolia or just some drop-in Elastic tfidf search is more than enough for these companies. Spend the $25k on an intern who can tell you anything you need to know about neural network frameworks.

In reality, the 4-5 ML engineers you already hired are very likely more knowledgeable than the freelance consultant you might hire. They can tell you much more about state of the art and simultaneously know the specific integration path in your company’s web service and data ecosystem. Those folks won’t be wasting time prototyping - they would be pursuing a more efficient way to get the answers you need than advice from a freelancer, even if that freelancer was Bengio for pete’s sake.

I just cannot see the value prop here except for the usual story of paying for consulting as a virtue signal / credential / politics kind of thing.

Re:My First Year as a Freelance AI Engineer by ganstyles on Saturday May 02, 2020 @07:55PM (#23055822)
I just really don't know what to tell you, I'm sorry. We saw the value, pursued the person, and had an engagement with them effectively consulting for 50 hours. There was no justification to anyone outside of our team, other than getting the very quick approval, and the consultant worked with our team directly and not to anyone outside the team. There was no internal politics at play.

And again, this wasn't a "freelance consultant" in the sense of the original story posted to HN, but an accomplished person at a very respected company who was able to secure the approvals from their side to help us out. This was novel/niche work for which "drop in pretrained models" don't really exist or apply.

Frankly to judge and belittle someone else who is just sharing their experience by saying they're not doing serious work and don't have serious customers is very rude.

Re:My First Year as a Freelance AI Engineer by mlthoughts2018 on Saturday May 02, 2020 @10:12PM (#23056348)
It’s not rude at all to highlight how this warrants huge skepticism. “Just calling someone up” to spend $25k+ on “advice” and claiming it’s justified in time saved of your existing staff not flailing around to research the same topic is _very_ weird. That doesn’t line up with any professional experience I’ve ever seen in any machine learning team at Fortune 500, startup, finance & academia jobs. _Maybe_ for appearance fees to have a big name researcher come and give a company presentation or keynote. _Maybe_. Absolutely not believing it for ad hoc freelance consulting based on someone having some NLP projects on GitHub, conference presentations or publications, or gigs at “fancy” AI employers, and I find it’s worth making this comment so other readers can consider how extremely shaky that premise is.
Re:My First Year as a Freelance AI Engineer by arbitrary_name on Saturday May 02, 2020 @10:25PM (#23056408)
Just to provide another perspective : I've consulted for 20+ companies. Spending money for outside advice or actual work products is extremely common and generally worthwhile if done right. There's a reason why consulting is a multi billion dollar industry.
Re:My First Year as a Freelance AI Engineer by mlthoughts2018 on Saturday May 02, 2020 @10:36PM (#23056462)
I disagree. Consulting is fashion signaling. It’s a huge business because it’s about buying and selling political status in the context of company decision making. It offers value from social signaling, not from strategic facts that demonstrably yield improvements to success metrics.
Re:My First Year as a Freelance AI Engineer by arbitrary_name on Saturday May 02, 2020 @10:22PM (#23056392)
>That was ~$4000 and the decision whether to build our own data annotation system or not was excruciating, involved all kinds of business documentation, RFCs, approvals, NDA processes, etc. It was deeply non-trivial to procure that, and building our own was a very serious option we pursued with tech specs and prototypes and everything.

The fact that you went through all of that for a 4k line item means there's something wrong at your end. You would have burned through multiples of that putting together a prototype, only to them spend lots of hours on the procurement process for my team would have just put on a credit card (exaggerating but only somewhat).

Sounds like you are not really accounting for the opportunity cost of your peoples time.

Re:My First Year as a Freelance AI Engineer by mlthoughts2018 on Saturday May 02, 2020 @10:31PM (#23056439)
> You would have burned through multiples of that putting together a prototype

No, we had the prototype we needed for making the decision with 1 team member working on it part-time for 4 weeks.

Your economics are way off. The cost of the prototype pales in comparison to risks around vendor lock-in, security issues, license growth, etc. The legal team vetting the contract and NDAs is the real expense - and well worth it to be quite careful about vendor software.

The cheap quick prototype helped us realize the longterm cost of maintaining that tool was too large, and the upfront procurement costs were worth it.

In a “move fast and break things” shitshow where you just instantly buy the vendor software, the risk of getting burned on a bad / unsafe contract is huge, and you end up playing hot potato with the 3 licenses you bought because you didn’t appropriately plan for license growth, dealing with data breaches, etc.

I think you’re naively reacting to the perception of a bureaucracy unable to do anything, but it’s totally not. This type of vetting is very cost effective.

It’s also why nobody is just quickly dropping $25k on consulting from freelancers.

Re:My First Year as a Freelance AI Engineer by CinchWrench on Sunday May 03, 2020 @10:07AM (#23059070)
I work at an f500, and I have worked in other data science groups at companies in the same industry. It's no huge thing for a large consultancy to be thrown 500k-3M for a 6 month "predictive" project whose deliverables are some python code that trains simple scikit models.

Absolutely grinds my gears too because the consultants turn in dreck that we're expected to fix to help the VP who hired them save face.

Not sure why I'm sharing except that the last line of your comment really hit home for me.

Re:My First Year as a Freelance AI Engineer by esoterica on Sunday May 03, 2020 @12:52AM (#23056932)
> I cannot imagine ever paying anything close to $25k for consulting advice, that’s just bananas to me

The parent already explained why he was willing to pay $25k for a consultant, but you ignored his explanation and just started talking right past him and insulting the work he's doing.

" It makes so much more sense to pay $25k to get direct knowledge of systems and techniques versus your team spending a bunch of time exploring different products/methods/algos to find something that might work in the end, or might fail in a few months. $25k is like 5 MacBooks, hardly worth thinking about versus being able to get experienced direction from someone who has done what you're trying to do and saving your team literally hundreds of hours of exploratory work."

>Spending 6x that amount for _advice_ about NLP, which practically grows on trees today, is just totally unrealistic.

If you can't conceive of what useful advice might look like then that's just a failure of imagination on your part. Getting any ML model to work properly involves a lot of esoteric domain-specific tricks. You have to use A,B,C to model the problem domain, apply X to transform the data, clean the data by throwing out Y, impose constraints Z on the model. You can pay your full-time employees hundreds of thousands of dollars to spend hundreds of hours discovering these through trial and error, or you can just pay someone $25k to explain these to you up front.

Of course you can find a billion worthless, generic, baby's first bag-of-words spam filter type NLP tutorials online, but that's not the same as commercially applicable expertise.

Re:My First Year as a Freelance AI Engineer by cosmodisk on Sunday May 03, 2020 @05:50AM (#23057996)
Our company was thinking of going after this very large contact,waaaay out of our league. We had experiences in some,but not all areas.We hired an expensive contractor to draft proposals, submit necessary information amd etc.When we read what the guy has produced,it was clear that it would have taken ages to get even half of it+ we would have skipped tons of things.So it was worth it. In a sam way, I could walk into almost any business using certain software and give advice,which would result in cost reductions, optimisations and etc,so I could justify charging $1500 a day or so,as an example.
Re:My First Year as a Freelance AI Engineer by analyst74 on Saturday May 02, 2020 @04:08PM (#23054518)
The last projects I worked on with about 10 other people doing some not-cutting-edge tech to make things more efficient increased the company's yearly revenue by over 500mil. I imagine a consulting team can probably negotiate a fee exceeding $500/hr delivering that kind of returns.

The company is not that special, I don't even know if we make it to Fortune 500. The point being, technology is a force multiplier, and when applied at the right lever for companies above certain size, the returns can be enormous.

Re:My First Year as a Freelance AI Engineer by twomoretime on Saturday May 02, 2020 @02:55PM (#23054011)
Cutting edge applied ML can do things that previously could only be done by humans. You're generating potentially unprecedented insights into your data because neural networks pick up on what I call "nonlinear" correlations - stuff that is missed with typical first order statistics like averages and skews and such.

So basically ML when done right is enormously valuable because it horizontally extends the reach of computation into previously humanlike domains.

But the caveat is that it's hard to do ML right. You need very much to be a generalist, an autodidact (to quickly learn the nature of the domain you're operating in) and I think a background in math and/or physics, or at least some other quantitative field is indispensable. You can do a hell of a lot more with neural networks than sort cat pictures or target ads.

Re:My First Year as a Freelance AI Engineer by esoterica on Sunday May 03, 2020 @12:02AM (#23056783)
Plenty of lawyers charge $500/hour or more, why shouldn't engineers? Having a PhD and domain expertise in a niche field seems at least as valuable as a law degree.

If you're working on a project that's driving $1 billion / year in revenue even a 0.01% increase is $100k/year. It's pretty easy to justify $25k on a contractor if they can demonstrate even a very modest impact on your project.

Re:My First Year as a Freelance AI Engineer by bitL on Saturday May 02, 2020 @02:21PM (#23053758)
Automating away 100 people in some repetitive cognitive task for example.
Re:My First Year as a Freelance AI Engineer by cambalache on Saturday May 02, 2020 @03:06PM (#23054083)
That is about 1 month cost of an average Engineer at a big company. So as longs as the freelancer provide as much as value as your average employee in 1 monh the company is doing a good decision. It is even better because the expertise of the freelancer tends to be high.
Re:My First Year as a Freelance AI Engineer by jorvi on Saturday May 02, 2020 @03:39PM (#23054307)
$500 per hour, 8 hours a day, 5 days a week gives $20k a week, $80k a month or (let's be charitable and say you earn a $40k bonus) $1 million a year. I don't know what the split between benefits and pure salary is in America, but let's put it at 2/3. Does the average engineer at a big corp really pull in $666.000 a year..?
Re:My First Year as a Freelance AI Engineer by jonas21 on Saturday May 02, 2020 @04:40PM (#23054728)
I think you're misunderstanding the parent. Their comparison is between:

(1) a 50 hour contract at $500/hr = $25K

(2) 1 month of paying a full-time engineer = $25K (i.e. $300K/yr including payroll taxes and benefits)

If a freelancer comes in with specialized knowledge for solving a particular problem, it can be quite easy for them to add more value in 50 hours than an average engineer would in a month, and therefore it's worth it.

Re:My First Year as a Freelance AI Engineer by cambalache on Saturday May 02, 2020 @05:52PM (#23055212)
Exactly, I suspect that depending on the problem and the expert the value multiplier could be in the double digits.Something freelancers should think about when proposing and charging their work.
Re:My First Year as a Freelance AI Engineer by TomMarius on Saturday May 02, 2020 @03:53PM (#23054402)
Yes, if you include stock options
Re:My First Year as a Freelance AI Engineer by why_only_15 on Saturday May 02, 2020 @04:03PM (#23054482)
The average engineer doesn't pull this much. Maybe ~300-400k/yr but not 600k/yr, even with RSUs.
Re:My First Year as a Freelance AI Engineer by ska on Saturday May 02, 2020 @05:29PM (#23055080)
For what it's worth the average engineer doesn't get anywhere near 300k/yr. SV rates in some sectors have really distorted peoples view of what is actually being paid across the industry.
Re:My First Year as a Freelance AI Engineer by exdsq on Saturday May 02, 2020 @06:20PM (#23055354)
The average engineer doesn't pull in 300-400k either
Re:My First Year as a Freelance AI Engineer by why_only_15 on Saturday May 02, 2020 @07:08PM (#23055597)
at a faang in the bay area? if not that pretty close to it
Re:My First Year as a Freelance AI Engineer by exdsq on Sunday May 03, 2020 @05:21AM (#23057886)
The average salary of an engineer at one of five companies in a single geographic area is _very_ different to "an average engineer", even just in the State let alone in the US or further afield.
Re:My First Year as a Freelance AI Engineer by TomMarius on Monday May 04, 2020 @12:32AM (#23064578)
So what exaxtly "big corp" means?
Re:My First Year as a Freelance AI Engineer by blackrock on Saturday May 02, 2020 @03:56PM (#23054427)
What is $666.000 a year?

Is this $666 per year? I think you’re missing a comma somewhere.

;-)

Re:My First Year as a Freelance AI Engineer by littleweep on Saturday May 02, 2020 @04:07PM (#23054514)
In parts of the world other than the US they use '.' instead of ',' to punctuate numbers. The poster above meant "$666,000".
Re:My First Year as a Freelance AI Engineer by blackrock on Saturday May 02, 2020 @04:09PM (#23054526)
Obviously..
Re:My First Year as a Freelance AI Engineer by woah on Saturday May 02, 2020 @03:11PM (#23054129)
Having a PhD likely helps. Whatever the value delivered, it will be easy to justify to higher-ups
Re:My First Year as a Freelance AI Engineer by ganstyles on Saturday May 02, 2020 @05:37PM (#23055134)
This seems to be less and less the case. The ML industry changes so much and so quickly that a PhD in some specific subject is obsolete quickly. Of course there are ancillary benefits to having a PhD, and certainly the more stogey "higher ups" of certain mentalities might be convinced, but largely it doesn't move the needle. In fact, most of the really respected people in the industry have told me that one shouldn't get a PhD for ML anymore unless they have very specific goals and it is a tip top program.