News for hackers. Stuff that matters.

A comment on Mito – Excel-like interface for Pandas dataframes in Jupyter notebook. Parent comment

Re:Mito – Excel-like interface for Pandas dataframes in Jupy... by pbronez on Friday May 20, 2022 @01:41PM (#31450467)
It would be super fun to implement an intelligent head() function that shows a representative sample rather than the first X rows. Do the profiling & identify a collection of rows that represent the overall distribution.

You could develop some IP around efficient and effective ways to do this. Probably would require an ensemble of unsupervised methods.

[ Parent | on HN ]
Re:Mito – Excel-like interface for Pandas dataframes in Jupy... by aarondia on Friday May 20, 2022 @02:41PM (#31451036)
That's a cool idea! One helpful .head() function could include the most unique data typed data. It could help you identify which columns have mixed dtypes: mostly numbers, and some cells that are supposed to be numbers but are actually strings because of additional decimals.
[ Parent | on HN ]