top | item 26018901

(no title)

jrevels | 5 years ago

Excited to see this release's official inclusion of the pure Julia Arrow implementation [1]!

It's so cool to be able mmap Arrow memory and natively manipulate it from within Julia with virtually no performance overhead. Since the Julia compiler can specialize on the layout of Arrow-backed types at runtime (just as it can with any other type), the notion of needing to build/work with a separate "compiler for fast UDFs" is rendered obsolete.

It feels pretty magical when two tools like this compose so well without either being designed with the other in mind - a testament to the thoughtful design of both :) mad props to Jacob Quinn for spearheading the effort to revive/restart Arrow.jl and get the package into this release.

[1] https://github.com/JuliaData/Arrow.jl

discuss

order

StefanKarpinski|5 years ago

Especially impressive that the first official version ships with such broad feature coverage! Really great work by Jacob.

andyferris|5 years ago

> a separate "compiler for fast UDFs" is rendered obsolete

Agreed. I am excited too. Thanks Jacob!