Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by mspier on Wednesday April 08, 2015 @12:19PM
(#9341854)
Goal is a bit different. Vector doesn't collect and persist metrics. We needed something that had as little overhead as possible so it could be deployed to all our hosts and simplify the process of analyzing those metrics.
[ Parent
| on HN ]
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by toomuchtodo on Wednesday April 08, 2015 @12:24PM
(#9341882)
If its not collecting and persisting metrics, is it more of a glorified htop?
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by brendangregg on Wednesday April 08, 2015 @12:34PM
(#9341956)
Not really. htop doesn't visualize historical trends from numerous sources at the same time. Vector also allows us to interface with other metric sources, beyond /proc.
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by cpwatson on Wednesday April 08, 2015 @12:28PM
(#9341917)
doesn't htop require you to go onto the box? We haven't released our custom pcp modules yet which allow more complex visualizations such as flamegraph generation from perf event sampling.
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by lscotte on Wednesday April 08, 2015 @01:34PM
(#9342430)
Yes, exactly - htop is a curses application that shows instantaneous samples of a few system metrics, but it mostly lists processes - this is nothing like Vector at all...
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by davidu on Wednesday April 08, 2015 @01:06PM
(#9342231)
Wait, really?
Why not? Storage is cheap. Do you use something else to get historical visibility into metrics?
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by brendangregg on Wednesday April 08, 2015 @03:25PM
(#9343225)
Yes, Atlas, which is also open source: http://techblog.netflix.com/2014/12/introducing-atlas-netfli... . Atlas monitors cloud-wide, and stores historical metrics at a one minute granularity.
Vector is for per-instance custom drilldowns. I gave a talk last year where I showed how they both fit together: http://www.brendangregg.com/blog/2014-09-27/from-clouds-to-r...
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by davidu on Wednesday April 08, 2015 @03:40PM
(#9343331)
Got it... and thank you Brendan!
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by zantana on Wednesday April 08, 2015 @03:24PM
(#9343207)
I think the reason is they have a bunch of ephemeral hosts which they don't want to put in a central web interface or collect statistics on.
They are only interested in getting some insight as to what went wrong with this host so they can fix it in the future.
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by toomuchtodo on Wednesday April 08, 2015 @02:01PM
(#9342609)
Grafana, Graphite, StatsD, Skyline.
Re:Introducing Vector: Netflix's On-Host Performance Monitor...
by fche on Thursday April 09, 2015 @08:58PM
(#9352007)
pcp is happy to collect & persist metrics; vector just doesn't happen to render them. pcp offers other ways to interact with live or archive-saved data, including other webapps.