Hosting SQLite databases on GitHub Pages or any static file hoster

Re:Hosting SQLite databases on GitHub Pages or any static fi... by phiresky on Sunday May 02, 2021 @02:34PM (#27017639)

Yeah, that was one of the inspirations for this. That one does not work in the browser though, would be a good project to do that same thing but with sqlite in wasm and integrated with WebTorrent instead of a native torrent program.

I actually did also implement a similar thing fetching data on demand from WebTorrent (and in turn helping to host the data yourself by being on the website): https://phiresky.github.io/tv-show-ratings/ That uses a protobufs split into a hashmap instead of SQLite though.

[ Parent | on HN ]

Re:Hosting SQLite databases on GitHub Pages or any static fi... by westurner on Sunday May 02, 2021 @03:31PM (#27018201)

This looks pretty efficient. Some chains can be interacted with without e.g. web3.js? LevelDB indexes aren't SQLite.

Datasette is one application for views of read-only SQLite dbs with out-of-band replication. https://github.com/simonw/datasette

There are a bunch of *-to-sqlite utilities in corresponding dogsheep project.

Arrow JS for 'paged' browser client access to DuckDB might be possible and faster but without full SQLite SQL compatibility and the SQLite test suite. https://arrow.apache.org/docs/js/

https://duckdb.org/ :

> Direct Parquet & CSV querying

In-browser notebooks like Pyodide and Jyve have local filesystem access with the new "Filesystem Access API", but downloading/copying all data to the browser for every run of a browser-hosted notebook may not be necessary. https://web.dev/file-system-access/

[ Parent | on HN ]

Re:Hosting SQLite databases on GitHub Pages or any static fi... by hfmuehleisen on Monday May 03, 2021 @03:03AM (#27022392)

DuckDB can directly & selectively query Parquet files over HTTP/S3 as well. See here for examples: https://github.com/duckdb/duckdb/blob/6c7c9805fdf1604039ebed...

[ Parent | on HN ]