Polars DataFrames
Polars is a blazingly fast DataFrame library written in Rust.
Polars vs Pandas
- Speed: Polars utilizes all CPU cores and a highly optimized query engine.
- Memory: More memory efficient due to Arrow memory format.
- Syntax: Uses a functional API which makes complex transformations clearer.
We use Polars for the heavy lifting of Data Transformation (Bronze to Silver).