hamsterbooster
Our thesis is that foundational models will become good and affordable enough to be used in almost all data processing pipelines. We build systems on top of that to manage workflows, integrations, and data applications that people may want to develop.
We believe that AI is only one part of our product. A significant amount of value comes from building robust integrations with different data sources and managing the business logic that operates on top of this unstructured data.
For data ingestion and mapping, I agree that in an ideal world, we would all have first-party API integrations. However, many industries still rely on PDFs and CSV files to transfer data.
There are some elements that might resemble Dagster, but I believe the challenging part is constructing validation systems that ensure high accuracy and correct schemas while processing all kinds of complex PDFs and document edge cases. Over the past few weeks, our engineering team has spent a lot of time developing a vision model robust enough to extract nested tables from documents
Different Type of Mental Models
Ask HN: Getting Data from Data Leaks
I have always been wondering about where I can find the data from the data breach (i.e. equifax leak, facebook, etc ...). Some of these dataset look like a great source to train ML models. It seems like people in hn or website like haveibeenpawned have accessed to these data.
Practical Differential Privacy for programmers with code
Singapore uses Apple watch tracking features to reward healthy citizen
Makani is closing and open sourcing their technology
Ask HN: Where do you go for discussion on deep learning techniques?
When developing ML/DL models, I often have to make decisions about architecture (layers, loss function, shape), preprocessing method (tiling vs. resizing, text embeddings algorithm), optimization algorithm (SGD or ADAM) and hyperparameters choice. In many library/research papers, this decision seems to be made at random. Do we have collective sources of things people have tried that work? ...
GPT-3 generated blog post reach #1 on Hacker News
Ask HN: Hour of reading articles in HN vs. 1 hour of reading books?
I'm debating about what would be a better of use of time between reading different blog posts in HN and other tech blogs/news vs. reading books. Some tech blogs or research paper offers a lot of value and help me come up with new ideas and stay up to date. However, reading a book is also very helpful in understanding a particular topic in details.