News for hackers. Stuff that matters.
Re:Show HN: Datasette Publish – Turn CSVs into a SQLite-Back... by simonw on Wednesday January 17, 2018 @05:59PM (#16172893)
Datasette is specifically designed for publishing static data - it doesn't handle UPDATE/INSERT traffic at all.

This is a good fit for any time you want to share some static data with the world - instead of posting a CSV file, you can share your data as a Datasette instance with a browseable web UI and a JSON API instead.

The three use-cases I'm personally most interested in for this are:

Data journalism: newspapers collect data about e.g. police shootings https://vice-police-shootings.now.sh/ or actions under the antiquities act https://fivethirtyeight.datasettes.com/fivethirtyeight-2628d... - I want to make it as easy as possible to publish the data beneath the stories.

Government open data: cities like San Francisco publish huge amounts if interesting data. I used San Francisco's 190,000 line CSV of trees in the city to build https://sf-tree-search.now.sh/

Cultural institutions: museums, libraries and art galleries have the collection and sharing of data as part of their mandates. I want to make it as easy as possible to build things like the London Science Museum's collection API: https://group.sciencemuseum.org.uk/about-us/collection/using...

Re:Show HN: Datasette Publish – Turn CSVs into a SQLite-Back... by toomuchtodo on Wednesday January 17, 2018 @07:32PM (#16173530)
Why not convert the data from csv to json and serve the json blob from your object store or CDN (if this solution is immutable)? No need for the API interface, just gzip the json blob and have the client retrieve it entirely.

No need for an app, app server, and the json can be cached with the rest of your content. Unless I’m missing something?

Re:Show HN: Datasette Publish – Turn CSVs into a SQLite-Back... by simonw on Wednesday January 17, 2018 @10:06PM (#16174339)
Size. The San Francisco trees database is around 50MB, and I've successfully tested it with multiple GB sized SQLite databases.
Re:Show HN: Datasette Publish – Turn CSVs into a SQLite-Back... by lozzo on Thursday January 18, 2018 @06:36AM (#16176342)
this was a key answer to a good question. I think you should emphasize that part (handling large data sets) as a key aspect of datasette
Re:Show HN: Datasette Publish – Turn CSVs into a SQLite-Back... by bdcravens on Wednesday January 17, 2018 @07:53PM (#16173660)
If you're serving the entire JSON dataset, sure, but this solution allows you to do server-side filtering.