News for hackers. Stuff that matters.
Re:Cortex: a multi-tenant, horizontally scalable Prometheus-... by sciurus on Wednesday December 19, 2018 @05:08PM (#18720238)
> The way the user runs it means that they don't store any metrics locally

Ah, that's great! I was mistakenly assuming that Prometheus would still have to write the data to disk; I didn't realize you could disable local storage.

> The range of exporters is very extensive

Sure, but that doesn't solve the problem that your heroku dyno, or lambda function, etc cannot expose metrics for Prometheus to pull, but it could easily push metrics somewhere.

> it's designed as one component that someone running at large scale or a SaaS vendors needs. Your comparison isn't apples to apples.

That's fair; I was thinking of Cortex as something to adopt off the shelf, instead of something to integrate with. However, as a SaaS provider you can always build more custom functionality alongside Cortex instead of making it a direct part of the open-source project.

Re:Cortex: a multi-tenant, horizontally scalable Prometheus-... by bboreham on Thursday December 20, 2018 @03:48AM (#18723389)
> I didn't realize you could disable local storage.

You are correct: there is no option to disable so we set to discard after 2 hours. Prometheus doesn’t write continuously to disk so the io is not noticeable.

To your original question, yes we could produce another agent from the Prometheus code which did discovery, scraping and sending but not disk storage. We choose not to as it’s another thing to maintain.

Also we want an option to queue on disk when the network link to push is down.

(I am a Cortex maintainer)