News for hackers. Stuff that matters.
Re:Architecture Notes: Datasette by samwillis on Friday May 27, 2022 @12:50PM (#31531766)
Not quite the scale you are suggesting but I used it with a 7gb 20m row dataset and it worked incredible well.
Re:Architecture Notes: Datasette by redredrobot on Friday May 27, 2022 @12:58PM (#31531889)
Yeah - it’s probably unfair of me to say it doesn’t scale at all. But between large data and 2 extra orders of magnitudes of rows, the single SQLite file approach quickly breaks down, even if you don’t store the large content in-db.