Re:GPU Embedding with GGML
by pizza on Monday October 16, 2023 @11:01AM
(#37900759)
Nice post. Also somewhat surprised Core ML doesn't have an implementation of GeLU since it's so widely used at this point (and not particularly challenging to re-implement, were I the speculative type..)
[ Parent
| on HN ]
Re:GPU Embedding with GGML
by woadwarrior01 on Monday October 16, 2023 @11:35AM
(#37901312)
CoreML has had support[1] for GeLU since the iOS 15 days.
[1]: https://apple.github.io/coremltools/source/coremltools.conve...
ty
Re:GPU Embedding with GGML
by kristjansson on Monday October 16, 2023 @12:31PM
(#37902305)
It's ONNX Runtime that's lacking support, per TFA, not CoreML.