[jamann]

Using polars and rust might be the best option right now, offering high level operations such as SQL like joins as well as performance. Although im not a rust programmer and i only use tbe python library polars, so please correct me as necessary.