Re:Orca 2: Teaching Small Language Models How to Reason
by fgfm on Tuesday November 21, 2023 @05:19AM
(#38361755)
Orca 2-13B consistently beat Llama 2-70B on most benchmarks in 0-shot. Hopefully, research papers will start to include Mistral/Zephyr 7B & Openchat 3.5. Even though they're smaller, they're getting competitive against much larger models and they're much cheaper to orchestrate.
[ Parent
| on HN ]
There are no comments on this comment yet.