Re:Building a new vector based storage model
by Darkphibre on Tuesday May 11, 2021 @05:04PM
(#27123498)
Oh, this is fascinating. Seven years ago I architected a true-realtime telemetry pipeline with end-to-end sequential guarantees (with roundtrip times <200ms excluding network latencies, and cloud processing times <20ms, leveraging BOND/ProtocolBuffer over AMQP over Websocket). It's still used by every 1st-party game for a large publisher.
It allowed for non-windowed event sequence analytics, enabling realtime feedback (think achievements that have multiple conditions).
And then the requirement was dropped, and (as you've found), everyone just uses it like a standard telemetry stream and is OK with 5-15min bins. :P
I still have a passion for the space, will definitely be reading up on this. I firmly believe this is the future of telemetry analytics; Congratulations on your efforts seeing the light of day!!
Disclaimer, I currently work for Microsoft, all words here are my own and do not necessarily reflect those of my employer, etc. ;)
It allowed for non-windowed event sequence analytics, enabling realtime feedback (think achievements that have multiple conditions).
And then the requirement was dropped, and (as you've found), everyone just uses it like a standard telemetry stream and is OK with 5-15min bins. :P
I still have a passion for the space, will definitely be reading up on this. I firmly believe this is the future of telemetry analytics; Congratulations on your efforts seeing the light of day!!
Disclaimer, I currently work for Microsoft, all words here are my own and do not necessarily reflect those of my employer, etc. ;)