Re:Show HN: Dropbase 2.0 – Turn offline files into live data...
by ayazhan on Tuesday August 18, 2020 @01:02PM
(#24201175)
- we use pandas to process data and load it to Postgres using .to_sql (https://pandas.pydata.org/pandas-docs/stable/reference/api/p...). for incremental loads, we set "if_exists" to "append". we're working to add more flexibility to load function, so you can specify how to load your data, handle conflicts, and so on. we're open for suggestions
- PostgREST is great. We are not sponsors at the moment, but looking to do this when we can!
I have two questions:
- How do you handle incremental loads from files (or even google sheets)? Am I able to only load the diff, load full snapshots and get bi-temporality, etc?
- Are you supporting PostgREST as sponsors in any way? It's one of the most solid tools I've ever used, and I love to see that companies build great products on top of it!