Re:sqlite-utils - CLI & Python utility functions for manipul...
by MaknMoreGtnLess on Sunday February 27, 2022 @10:23PM
(#30496014)
Do you think unqlite would be a better fit?
Have you looked at unqlite?
Unless you're talking about 10+GBs of JSON I'd recommend importing them and seeing how far you get.
Once the JSON has been loaded into tables the other things you want to do should all be very feasible.
- Fuzzy text search can be done using SQLite trigram indexes https://www.sqlite.org/fts5.html#the_experimental_trigram_to...
- I'd split JSON columns that you want to index out into indexed regular columns - there are a bunch of tricks in sqlite-utils for doing that, see https://simonwillison.net/2021/Aug/6/sqlite-utils-convert/