News for hackers. Stuff that matters.

A comment on Direct initialization of transformers using larger pretrained ones.

Re:Direct initialization of transformers using larger pretra... by leeeeeepw on Friday December 22, 2023 @08:12PM (#38740705)
Pretty nice to get downscaled mobile models with will be huge in 2024 when the compilation platforms like onnx coreml webgpu get smooth enough
[ Parent | on HN ]

There are no comments on this comment yet.