Re:Show HN: Query Google Sheet data using PostgreSQL clients
by houqp on Tuesday May 31, 2022 @02:25AM
(#31566639)
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
Re:Show HN: Query Google Sheet data using PostgreSQL clients
by rockwotj on Tuesday May 31, 2022 @02:58AM
(#31566798)
How does cache invalidation work?
Re:Show HN: Query Google Sheet data using PostgreSQL clients
by houqp on Tuesday May 31, 2022 @03:00AM
(#31566812)
It's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh.
I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.
Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?