Re:80% faster, 50% less memory, 0% loss of accuracy Llama fi...
by danielhanchen on Friday December 01, 2023 @09:18PM
(#38495224)
Ohhh interesting! So like ML Perf or Faster CPython https://github.com/faster-cpython/benchmarking-public?
[ Parent
| on HN ]
Re:80% faster, 50% less memory, 0% loss of accuracy Llama fi...
by kristopolous on Friday December 01, 2023 @09:36PM
(#38495338)
Sure. This thing I propose might already exist in a nascent form.
I haven't checked in a few months and the way things are moving now...
Re:80% faster, 50% less memory, 0% loss of accuracy Llama fi...
by danielhanchen on Friday December 01, 2023 @09:49PM
(#38495412)
Interesting!! I'll talk with my brother about this - sounds very cool!
Re:80% faster, 50% less memory, 0% loss of accuracy Llama fi...
by ptd on Saturday December 02, 2023 @03:23AM
(#38496985)
Hey Daniel, I would love to help out on this. I'm learning about LLMs and this benchmarking project sounds like a fun way to further my knowledge and skills. I sent you a message on LinkedIn.
Cheers!
Re:80% faster, 50% less memory, 0% loss of accuracy Llama fi...
by danielhanchen on Saturday December 02, 2023 @03:40AM
(#38497078)
Cool lets chat on Linkedin! :)