[crustacean]

Sorry to be that one avoids-the-question comment, but:

Without design sessions to figure out your data store design (look up Kimball, Immon), and then monitoring/testing to make sure everything is running smoothly, any data stack will be hell.

Badly designed data brings fatigue and rancor and unnecessary work and is a huge hard-to-quantify money suck.

[dwl285]

IMO the right solution to this is not spending a bunch of time upfront trying to design your warehouse. You just want to adopt a tool that makes it easy to continuously refactor into more optimal formats as your warehouse scales. Happy to discuss more if you're interested! dan at dataform.co

[crustacean]

Edit: *Inmon