News for hackers. Stuff that matters.
Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by tracker1 on Monday September 08, 2025 @08:10PM (#45175797)
Cool... though that would make it difficult to get the hundred or so CSVs into a single table, since it isn't supported I guess stitching them before processing would be easy enough... also, no idea when that feature became available.
Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by JustExAWS on Monday September 08, 2025 @09:08PM (#45176199)
It’s never been a good idea to batch ingest a lot of little single files using any ETL process on AWS, whether it be DDB, Aurora MySQL/Postgres using “load data from S3…”, Redshift batch import from S3, or just using Athena (yeah I’ve done all of them).
Re:Will Amazon S3 Vectors Kill Vector Databases–Or Save Them? by tracker1 on Wednesday September 10, 2025 @11:57AM (#45199618)
These weren't "little" single files... just separated by tld iirc.