News for hackers. Stuff that matters.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by jimaek on Tuesday July 21, 2020 @10:56AM (#23907292)
While influx is pretty bad overall it's super simple to deploy and configure unlike timescale.

It's the main reason we decided to use influx in our small team with simple enough timeseries needs

Re:Monitoring your own infrastructure using Grafana, InfluxD... by avthar on Tuesday July 21, 2020 @11:02AM (#23907336)
Curious what you found difficult to deploy/ configure? Is this in a self-managed context?
Re:Monitoring your own infrastructure using Grafana, InfluxD... by themgt on Tuesday July 21, 2020 @02:23PM (#23909387)
I was testing out both TimescaleDB/InfluxDB recently, including maybe using with Prometheus/Grafana. I was leaning towards Timescale, but InfluxDB was indeed a lot easier to quickly boot a "batteries included" setup and start working with live data.

I eventually spent a while reading about Timescale 1 vs 2, and testing the pg_prometheus[1] adapter and started thinking through integrating its schema to our other needs then realizing it's "sunsetted" and then reading about the new timescale-prometheus[2] adapter and reading through its ongoing design doc[3] with updated schema that I'm less a fan of.

I finally wound up mostly-settling on Timescale although I've put the Prometheus extension question on hold, just pulling in metrics data and outputting with ChartJS and some basic queries got me a lot closer to done for now. Our use case may be a little odd regardless, but I think a timescale-prometheus extension with a some ability to customize how the data is persisted would be quite useful.

[1] https://github.com/timescale/pg_prometheus

[2] https://github.com/timescale/timescale-prometheus

[3] https://docs.google.com/document/d/1e3mAN3eHUpQ2JHDvnmkmn_9r...

Re:Monitoring your own infrastructure using Grafana, InfluxD... by cevian on Tuesday July 21, 2020 @03:50PM (#23910249)
(TimescaleDB engineer) Really curious about finding out more about your reservations about the updated schema. All criticisms welcome.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by themgt on Tuesday July 21, 2020 @06:34PM (#23911702)
Thanks, as I say our use case may be too odd to be worth supporting, but effectively we're trying to add a basic metrics (prom/ad-hoc) feature to an existing product (using Postgres) with an existing sort of opinionated "ORM"/toolkit for inserting/querying data.

Because of that and the small scale required, the choice of table-per-metric would be a tough fit and I think a single table with JSONB and maybe some partial indexes is going to work a lot better for us. It would just be nice if we could somehow code in our schema mapping and use the supported extension, but I get it may be too baked-into the implementation.

Anyway, overall we're quite happy with TimescaleDB!

Re:Monitoring your own infrastructure using Grafana, InfluxD... by cevian on Tuesday July 21, 2020 @09:42PM (#23913098)
I see, that makes a whole lot of sense. This is an interesting use-case. It actually may be possible to use some of the aggregates provided by the extension even with a different schema. If you are interested in exploring further, my username on slack is `mat` and my email is the same @timescale.com
Re:Monitoring your own infrastructure using Grafana, InfluxD... by samstave on Tuesday July 21, 2020 @11:58AM (#23907906)
I found this to be a funny, subtle insult. :-)

"Why is it difficult, because you're self managed?"

Re:Monitoring your own infrastructure using Grafana, InfluxD... by znpy on Tuesday July 21, 2020 @03:57PM (#23910341)
I think it's a honest question. Maybe they want to find out if setting up needs a bit of us work or simplifying.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by avthar on Tuesday July 21, 2020 @12:27PM (#23908215)
No intention to insult - just trying to get more context :)
Re:Monitoring your own infrastructure using Grafana, InfluxD... by samstave on Tuesday July 21, 2020 @01:10PM (#23908664)
I know - I just read it as such and chuckled.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by souldeux on Tuesday July 21, 2020 @12:27PM (#23908216)
What's wrong with influx? I use it and like it, albeit for hobby-level projects.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by chucky_z on Tuesday July 21, 2020 @03:59PM (#23910361)
Influx is so good for hobby-level projects. So good!!

For serious applications, it doesn't cut it. Trying to do more than a few TB a day is a waste of time outside of enterprise, which ain't cheap.

I plopped VictoriaMetrics in place of Influx for my cases and haven't even had a single hiccup.

Re:Monitoring your own infrastructure using Grafana, InfluxD... by mhall119 on Tuesday July 21, 2020 @12:57PM (#23908526)
As with any technology, the right tool for the job is highly dependent on what the job is.
Re:Monitoring your own infrastructure using Grafana, InfluxD... by valyala on Wednesday July 22, 2020 @10:47AM (#23917606)
InfluxDB may have slightly big RAM requirements when working with high number of time series [1].

[1] https://medium.com/@valyala/insert-benchmarks-with-inch-infl...

Re:Monitoring your own infrastructure using Grafana, InfluxD... by valyala on Wednesday July 22, 2020 @11:20AM (#23917947)
If you want the best of both worlds, then try VictoriaMetrics. It is simple to deploy and operate and it is more resource-efficient comparing to InfluxDB. More on this, it supports data ingestion over Influx line protocol [1].

[1] https://victoriametrics.github.io/#how-to-send-data-from-inf...

Re:Monitoring your own infrastructure using Grafana, InfluxD... by heliodor on Tuesday July 21, 2020 @01:51PM (#23909064)
For small and medium needs, InfluxDB is a delight to use. On top of that, the data exploration tool within Chronograf is one-of-a-kind when it comes to exploring your metrics.

If you are looking for a vendor to host, manage, and provide attentive engineering support, check out my company: https://HostedMetrics.com