Re:Polars Cloud: The Distributed Cloud Architecture to Run P...
by theLiminator on Monday March 10, 2025 @12:50AM
(#43317108)
Yeah, i think that's what limits the utility of such systems. Polars does typechecking at query planning time. So before you really do computation. I don't expect that much can improve over this model due to the aforementioned limitations.
I think needing network access or file access at compile time is a semi-hard blocker for statically typed dataframes.
I think needing network access or file access at compile time is a semi-hard blocker for statically typed dataframes.