Re:Meltano: ELT for the DataOps era
by edgarrmondragon on Monday March 01, 2021 @09:56AM
(#26303309)
AFAIK Meltano uses JSON only in the interface between a tap (source) and a target, to communicate schema, state and records.
It's up to the target what it does with the JSON messages it receives, so you can for example have a target-avro that takes JSON records and outputs them as an Avro file and translates the JSON schema to the corresponding Avro schema.
It's up to the target what it does with the JSON messages it receives, so you can for example have a target-avro that takes JSON records and outputs them as an Avro file and translates the JSON schema to the corresponding Avro schema.