News for hackers. Stuff that matters.
Re:Architecture Notes: Datasette by simonw on Friday May 27, 2022 @01:47PM (#31532499)
You're right, Datasette isn't the right tool for sharing billion point datasets (actually low-billions might be OK if each row is small enough).

I think of Datasette as a tool for working with "small data" - where I define small data as data that will fit on a USB stick, or on my phone.

My iPhone has a TB of storage these days, so small data can get you a very long way!

Using it for unstructured image and video would work fine using the pattern where those binary files live somewhere like S3 and the Datasette instance exposes URLs to them. I should find somewhere in the documentation to talk about that.

But yes, I should probably take "of any size" off the homepage, it does give a misleading impression.

Re:Architecture Notes: Datasette by simonw on Friday May 27, 2022 @06:26PM (#31535637)
Opened an issue exploring alternatives here: https://github.com/simonw/datasette.io/issues/109

I decided to just drop "any size" but keep "any shape".

Re:Architecture Notes: Datasette by bspammer on Friday May 27, 2022 @06:57PM (#31535894)
Very interesting idea to use GPT3 as a starting point for rewording text. I can see it being an effective way to break writer’s block.
Re:Architecture Notes: Datasette by simonw on Friday May 27, 2022 @07:20PM (#31536042)
Yeah it's surprisingly effective at marketing text and basic web copy.