top | item 39980451

(no title)

xiasongh | 1 year ago

How does Chronon handle mutable data when backfilling? Or does it make some assumptions on the underlying data?

discuss

order

nikhilsimha|1 year ago

By mutable data do you mean - change data coming from OLTP databases? If yes, we do this via the EntitySource api.

https://www.chronon.ai/authoring_features/Source.html#stream...

xiasongh|1 year ago

> By mutable data do you mean - change data coming from OLTP databases?

Yes, exactly! I see there is some kind of support, but is it possible to use the OLTP database as an event source?

For example, say I had a table in my OLTP database, `data.returns`, that had columns `ts`, the event time, and `status`, which can be PENDING or COMPLETED. I'd like to generate point-in-time correct training data, where the feature is the count of completed returns. It seems like all the necessary information to calculate this is there