News for hackers. Stuff that matters.
Re:Show HN: Query Google Sheet data using PostgreSQL clients by hoistbypetard on Tuesday May 31, 2022 @02:16AM (#31566601)
Last time I tried to do the moral equivalent of this (not using SQL, just some custom python), I ran afoul of the rate limits really quickly.

Does this client do something smart to mitigate that, have the limits been relaxed, or is it still a problem?

Re:Show HN: Query Google Sheet data using PostgreSQL clients by houqp on Tuesday May 31, 2022 @02:25AM (#31566639)
We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.
Re:Show HN: Query Google Sheet data using PostgreSQL clients by rockwotj on Tuesday May 31, 2022 @02:58AM (#31566798)
How does cache invalidation work?
Re:Show HN: Query Google Sheet data using PostgreSQL clients by houqp on Tuesday May 31, 2022 @03:00AM (#31566812)
It's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh.

I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.