top | item 33360220

(no title)

aleandros | 3 years ago

Hi Timja, sorry about that! We have been so focused on this for the past months that is easy to loose perspective.

Data connectors, in the loosest definition possible, is simply a piece of software that moves data from one place to the other. This can be from database A to database B or (as in our case) from a given API into a database.

ETL stands for "Extract, Transform, Load", a process in which you get data from some place, clean it/do something with it, then store it into a desired destination. Probably this term is most frequently used in the context of data warehousing, in which you move data from one or more OLTP databases from the application side, into an OLAP database.

Finally, Snowflake is a very popular (and very cool) database focused on Data Warehousing needs.

discuss

order

Timja|3 years ago

Thanks for the explanations!

I get kind of a "no code" vibe from it?

When I want to read data from an API, transform it and put it into a DB, my approach would be to write a few lines of Python. A script that does an http request to the API, transforms it and then writes the data to SQLite.

That seems much easier and more future proof to me than to bring in a 3rd party service.

aleandros|3 years ago

Yes, the idea is for it to be a no-code solution. We completely understand why some people would like to this work in-house, specially for simple use-cases such as the one you mentioned.