top | item 34008104

(no title)

roeja | 3 years ago

Having deployed DBT Core I am glad I spent the effort to set up self hosting with ci/cd for both dbt runs and docs.

A point of frustration I have is the idea that Data Analysts need a specialized cloud based ide to work in because vscode and git is too difficult to learn. I worked at a large company where analysts would complain the database was down due to the cloud ide falling over and stop work until it is fixed. Meanwhile the group of us using a local ide and a jdbc connection kept working.

Any good data analyst should be able to use vscode and git. Any good data engineer should be able to setup the ci/cd side to the point for the analyst doesn't need to think about deployment.

Analyst writes code -> creates pr when ready to test -> pr builds models into temp location and runs tests -> analyst iterates -> pr review -> merge to main -> deploy to prod runner

discuss

order

No comments yet.