Re:Apache Arrow 3.0
by chrisweekly on Wednesday February 03, 2021 @05:16PM
(#26019893)
For those wondering what a SerDe is:
https://docs.serde.rs/serde/
[ Parent
| on HN ]
The term likely predates the Rust implementation. SerDe is Serializer & Deserializer, which could be any framework or tool that allows the serialization and deserialization of data.
I first came across the concept in Apache Hive.
I first came across the concept when AWS Glue was messing up my CSVs on import
In case you weren't aware, Glue's metastore is an implementation of Apache Hive, so not too different from the person you're replying to.
Re:Apache Arrow 3.0
by waynesonfire on Wednesday February 03, 2021 @05:19PM
(#26019929)
I meant serialize / deserialize in the literal sense.