Re:Timescale raises $110M Series C
by fourseventy on Tuesday February 22, 2022 @06:20PM
(#30435265)
Not OP but I run a Timescale instance with the same order of magnitude inserts/sec and have been running it for about 2 years now. The database is closing in on 1 TB on disk. We don't use Timescale Cloud, we just host it on a VM in Google cloud with 8 CPU's and 32 gigs of ram, which seems adequate for now. We do WAL backup using the WAL-G tool which backs the db up to google storage.
Re:Timescale raises $110M Series C
by hardwaresofton on Tuesday February 22, 2022 @06:24PM
(#30435312)
Thanks so much for this. 2 years at that insert speed only being about 1TB of data is fantastic.
I've also had many discussions on backups (Barman, backrest, Wal-E/G) etc and always feel like I have to look it up afresh every time to get myself back up to speed on which one I should be using.
Re:Timescale raises $110M Series C
by fourseventy on Wednesday February 23, 2022 @07:22AM
(#30440272)
Ya the backup solutions are complicated. I don't even remember the differences between those different tools. All I remember is that I spent about a day researching the tools and determined that Wal-G was the best one to use for our use case.
I have done no optimization, no WAL partition, no slave (yet). i'm just using a single t3a.xlarge Aws instance with 1500 IOPS (EBS Volume).
we use 1500IOPS just to speed up our read-only jobs and reports.
i'm just using AWS EBS snapshot feature ( every hour ) for backup.
Re:Timescale raises $110M Series C
by hardwaresofton on Wednesday February 23, 2022 @06:46PM
(#30448319)
Thanks for going into the nitty gritty, super helpful to know what your setup is like.
In the I’ve had terrible experiences with on-demand IOPS but now I feel like even 1000 provisioned (the least you can get) is too much for the workload I was running… the app was mostly idle but had bursts that would overwhelm
How are you dealing with backups/WAL and general DB administration? Are you using Timescale Cloud?