The four pillars of data observability: metrics, metadata, lineage, and logs

Re:The four pillars of data observability: metrics, metadata... by kzh_ on Sunday August 14, 2022 @12:55PM (#32460771)

OP here, I only try to write and share things that I find personally interesting, so if it came across as marketing fluff that was the opposite of what I was aiming for :/. But I do appreciate you reading the whole thing. FWIW I also thought including PhD might be pretentious.

[ Parent | on HN ]

Re:The four pillars of data observability: metrics, metadata... by ctxc on Sunday August 14, 2022 @01:26PM (#32461080)

Hi OP! It would be nice to have some examples to go with the article. Some set of minimum data and sample "lineage" etc.

This has broadened my perception of data though, I never linked this with the good old thermodynamic principles.

[ Parent | on HN ]

Re:The four pillars of data observability: metrics, metadata... by kzh_ on Sunday August 14, 2022 @01:40PM (#32461213)

Thanks for reading! Including examples is a great point, because otherwise the article can be kind of abstract, especially because each person has a different mental model of data. I'll add some later on.

Maybe thermodynamics is a hammer that makes all things seem like nails, but the connections pop up all over the place. Entropy is another highly applicable concept to data systems.

[ Parent | on HN ]

Re:The four pillars of data observability: metrics, metadata... by Archelaos on Sunday August 14, 2022 @03:57PM (#32462388)

I would say inlcuding CEO is far more pretentious. A PhD at least means something more substantial, because it requires an external certification.

[ Parent | on HN ]

Re:The four pillars of data observability: metrics, metadata... by Dwolb on Sunday August 14, 2022 @06:01PM (#32463398)

Adding “PhD” and other credentialed titles is standard SEO practice these days.

The thought is Google sees the article as from a “credible source” and ranks you higher.

[ Parent | on HN ]