News for hackers. Stuff that matters.
Re:KSQL: Open Source Streaming SQL for Apache Kafka by tedmiston on Tuesday August 29, 2017 @11:18AM (#15124847)
Yeah, that's the challenge. For instance, how do you handle when a column was one data type but then down the road was changed to another type when the two aren't cross compatible or could potentially break?
Re:KSQL: Open Source Streaming SQL for Apache Kafka by raulk on Wednesday August 30, 2017 @10:35AM (#15132421)
You could retain this info in a meta field of flexible type. For a DB, it could a JSON type. For messages, it could be an extra _meta field on the message that the systems themselves ignore.