Launch HN: Activeloop (YC S18) – Data lake for deep learning

Re:Launch HN: Activeloop (YC S18) – Data lake for deep learning by avrionov on Tuesday November 15, 2022 @01:58PM (#33613385)

How do you store your data set? And do you have any open source releases?

[ Parent | on HN ]

Re:Launch HN: Activeloop (YC S18) – Data lake for deep learning by davidbuniat on Tuesday November 15, 2022 @02:17PM (#33613614)

You can store your data either remotely or locally (see here on how https://docs.activeloop.ai/getting-started/creating-datasets...).

You can then visualize your datasets if their stored on our cloud, in AWS/GCP, or you can drag and drop your local dataset in Deep Lake format into our UI (https://docs.activeloop.ai/dataset-visualization)

We do, with version control, Python based dataloader and dataset format being open source! Please check out https://github.com/activeloopai/deeplake.

[ Parent | on HN ]

Re:Launch HN: Activeloop (YC S18) – Data lake for deep learning by fxtentacle on Tuesday November 15, 2022 @02:03PM (#33613422)

"HuggingFace datasets" is an open source Python package: https://github.com/huggingface/datasets/

And they also have ready-to-use scripts for A LOT of the usual datasets: https://huggingface.co/datasets

including LAION 400M and LAION 2B: https://huggingface.co/datasets/laion/laion2B-en

[ Parent | on HN ]

Re:Launch HN: Activeloop (YC S18) – Data lake for deep learning by davidbuniat on Tuesday November 15, 2022 @02:25PM (#33613726)

thanks for the context and links! I replied to your comment slightly above in one comment. :)

[ Parent | on HN ]