News for hackers. Stuff that matters.
Re:Ask HN: Data Management for AI Training by timsehn on Monday May 01, 2023 @02:28PM (#35777046)
If you are just looking for data versioning there is Dolt:

https://github.com/dolthub/dolt

And that has a user-friendly UI in DoltHub:

https://www.dolthub.com/

You wouldn't store the images themselves in Dolt, those would likely be links to S3 but al the labels and surrounding metadata could be stored in Dolt?

DISCLAIMER: I'm the CEO of DoltHub so this is self-promotion.

There are no comments on this comment yet.