News for hackers. Stuff that matters.

A comment on Launch HN: Deepsilicon (YC S24) – Software and hardware for ternary transformers.

Re:Launch HN: Deepsilicon (YC S24) – Software and hardware f... by bjornsing on Tuesday September 10, 2024 @02:24AM (#41497746)
Have you tried implementing your ternary transformers on AVX(-512)? I think it fits relatively well with the hardware philosophy, and being able to run inference without a GPU would be a big plus.
[ Parent | on HN ]
Re:Launch HN: Deepsilicon (YC S24) – Software and hardware f... by areddyyt on Thursday September 12, 2024 @06:35PM (#41526349)
Our CPU implementation for X86/AMD64 utilizes AVX-512 or AVX-2 instructions where possible. We're experimenting with support for ARM with NEON.
[ Parent | on HN ]