News for hackers. Stuff that matters.
Re:Four lessons from a year building tools for machine learning by razcle on Friday July 16, 2021 @06:14PM (#27861829)
Hi Andy, thanks for the feedback on the site! We're actually redesigning at the moment so it should hopefully be fresher soon :P. Also great pointer to Rob Munroe's book. He actually used to be CTO at figure 8 before they were acquired.

You seem to be pretty clued up on the area, what do you see as the pros and cons of an end-to-end approach?

Re:Four lessons from a year building tools for machine learning by andyxor on Friday July 16, 2021 @06:18PM (#27861870)
I'm actually using Scale.AI and few other annotation products, if you can provide a clear example how your product stands out/compares to existing annotations services that would be great. Specifically focusing on quality of annotations.

Normally we do this kind of benchmark internally by sending the same dataset to each service and running some stats on the results, but if a vendor comes in with a ready to use comparison report that would be easier sale.

As for end-to-end you would be competing with large internal ML teams and revenue bringing internal ML engines, i'm probably not the right audience for that type of product. Salesforce seems to be doing alright on that front, but from my discussions with them there is a lot of hand-holding and customizations for each client use case, it's a high-touch thing.

Re:Four lessons from a year building tools for machine learning by razcle on Friday July 16, 2021 @06:28PM (#27861929)
We see ourselves as quite different to Scale really as we don't provide annotation services, mainly the software.

One of the main differences is that we've pretty exclusively focussed on language rather than vision which has quite a different tech stack.

We also view human-in-the-loop not just as a way to get better data but actually as a better deployment paradigm.

P.s You're right that David is awesome btw!