News for hackers. Stuff that matters.
Re:Less Scatterbrained Scatterplots by niming2 on Sunday October 11, 2020 @10:36AM (#24746088)
Looks like a major upgrade to leaflet.markcluster (https://github.com/Leaflet/Leaflet.markercluster), which supports 50k points at most.
Re:Less Scatterbrained Scatterplots by observercs on Sunday October 11, 2020 @11:58PM (#24751247)
hey nice work. It seems like the hierarchy of observations across zoom levels is prematerialized in a database. How would that impact the ability of the system to handle stream data?"
Re:Less Scatterbrained Scatterplots by setr on Sunday October 11, 2020 @05:01AM (#24744581)
So this is just... plotting with zoom levels and aggregations?

It seems to me the only novelty is to attach zoom to the scrollwheel, which I suppose is less common in BI visualizations (often a button instead)

Re:Less Scatterbrained Scatterplots by jamessb on Sunday October 11, 2020 @05:40AM (#24744705)
The novelty is not the scroll-to-zoom interaction - it's the creation of a declarative grammar for several visualization types (see Figure 2 for examples), and a system that implements this in a way that is scalable to datasets containing billions of observations.

The contributions claimed in the paper are [1]:

> To summarize, we make the following contributions:

> •An integrated system called Kyrix-S for declarative authoring and rendering of SSVs at scale.

> •A concise and expressive declarative grammar for describing SSVs (Section 4).

> •A framework for offline database indexing and online serving that enables interactive browsing of large SSVs (Sections 5 and 6).

[1]: https://arxiv.org/pdf/2007.15904.pdf

Re:Less Scatterbrained Scatterplots by dlivingston on Sunday October 11, 2020 @07:05AM (#24744971)
Very cool. This could give Plot.ly a run for its money in the data science community.

Also regarding Figure 2, and at the risk of sounding cliché: my inner graphic designer is weeping at the use of Comic Sans as their choice of code font.

Re:Less Scatterbrained Scatterplots by tracyhenry on Sunday October 11, 2020 @10:27AM (#24746031)
First author here.

In addition to a declarative grammar, a big thing is the ability to scale past browser memory limits.

The system works with a distributed Postgres (Citus) to perform parallel hierarchical clustering to get the aggregation computed, and uses Postgres spatial indexes to fetch data on demand. We can scale to billions of records (see reddit comment demo in the news article).

Also we are not limited to common representations such as circles. In fact you can create your own in D3.

Here's a live demo of 1.88 million historical wildfires: http://wildfire2.kyrixdemo.live/

Re:Less Scatterbrained Scatterplots by kkytle on Sunday October 11, 2020 @02:27PM (#24747904)
The declarative grammar is cool (flexibility) but the reason we care is because it can SCALE. No more counting points. Forget browser memory limits. BILLIONS of records.
Re:Less Scatterbrained Scatterplots by eternal_answer on Sunday October 11, 2020 @11:58AM (#24746665)
There seems to be a missing gif (the improvement for NTY article)? I wonder what it looks like
Re:Less Scatterbrained Scatterplots by jeremytech on Sunday October 11, 2020 @11:28AM (#24746431)
This is certainly a promising endeavor.
Re:Less Scatterbrained Scatterplots by vote4myboi on Sunday October 11, 2020 @12:44PM (#24747062)
Very cool initiative