top | item 31566639

(no title)

houqp | 3 years ago

We cache all the data in memory in Arrow format so queries don't need to go through google api, it will only hit google api when a data refresh is needed.

discuss

order

rockwotj|3 years ago

How does cache invalidation work?

houqp|3 years ago

It's manual for now, ROAPI is designed for slowly moving datasets. You just hit the data update API to force a refresh.

I have plan to add automated streaming data update in the background, starting with delta lake tables. It should all be very straight forward to implement.

darig|3 years ago

[deleted]