News for hackers. Stuff that matters.
Re:Show HN: SQLite-S3-query – Python function to query a SQL... by psanford on Sunday August 15, 2021 @08:15AM (#28188134)
Athena is great for if you have _a lot_ of data. It isn't great for real time queries.

I use a SQLite database stored in S3 + SQLite's FTS5 for a really cheap full text search implementation.

Re:Show HN: SQLite-S3-query – Python function to query a SQL... by hk1337 on Tuesday August 24, 2021 @09:06PM (#28296970)
Yeah, Athena is great for doing queries across multiple S3 objects. I have also used sqlite recently too, usually either with pandas reading from S3 then dumping it to a sqlite database table. I don't really like pandas but it's useful for creating the table structure for me.
Re:Show HN: SQLite-S3-query – Python function to query a SQL... by gsempe on Tuesday August 17, 2021 @03:42AM (#28207233)
I'm really interested to read articles or how to around this solution. Do you have anything public that could help me?
Re:Show HN: SQLite-S3-query – Python function to query a SQL... by psanford on Tuesday August 17, 2021 @04:07PM (#28214258)
For accessing the database I use sqlite3vfshttp[0] with an s3 presigned url for authentication.

[0]: https://github.com/psanford/sqlite3vfshttp