Re:Parsing Protobuf at 2+GB/S: How I Learned to Love Tail Ca...
by mkoubaa on Sunday April 25, 2021 @02:49PM
(#26935407)
Given that fact I'm wondering if google ever researched custom chips or instruction sets for marshalling pbs, like the TPUs they worked on for ML.
[ Parent
| on HN ]
Re:Parsing Protobuf at 2+GB/S: How I Learned to Love Tail Ca...
by lupire on Sunday April 25, 2021 @03:29PM
(#26935778)
Problem is once you parse the protobuf, you have to immediately do other computations on it in the same process. No one needs to parse protobufs all day long like an ML model or doing hashes for crypto.
Re:Parsing Protobuf at 2+GB/S: How I Learned to Love Tail Ca...
by jeffbee on Sunday April 25, 2021 @03:45PM
(#26935951)
That doesn't seem to preclude hardware assistance. For example they have also explored hardware acceleration for the tcmalloc fast path allocation by adding circuits to general purpose CPUs. Arguably, Intel BMI descends from a request that Google made years ago to speed up protobuf decoding (and other workloads) on x86.