Re:Show HN: Hamilton, a Microframework for Creating Dataframes
by justusw on Tuesday November 09, 2021 @05:18AM
(#29159800)
This project reminds me a lot of Dask https://dask.org/. A library that allows delayed calculation of complex dataframes in Python.
[ Parent
| on HN ]
Re:Show HN: Hamilton, a Microframework for Creating Dataframes
by asavinov on Wednesday November 10, 2021 @11:01AM
(#29176176)
Hamilton is more similar to the Prosto data processing toolkit which also relies on column operations defined via Python functions:
https://github.com/asavinov/prosto
However, Prosto allows for data processing via column operations in many tables (implemented as pandas data frames) by providing a column-oriented equivalents for joins and groupby (hence it has no joins and no groupbys which are known to be quite difficult and require high expertise).
Prosto also provides Column-SQL which might be simpler and more natural in many use cases.
The whole approach is based on the concept-oriented model of data which makes functions first-class elements of the model as opposed to having only sets in the relational model.
Re:Show HN: Hamilton, a Microframework for Creating Dataframes
by krawczstef on Tuesday November 09, 2021 @12:47PM
(#29164825)
Yes I can see how you can make that leap. Right now Hamilton isn't about scaling computation per se, more so about scaling a code base to handle featurization and people using that code base.
Hamilton wouldn't replace Dask. Instead Hamilton could use Dask, we even have a prototype PR to do so.