marcelmarais

This should make the use case a bit clearer. It's basically a starting point / wrapper of a few tools when you know you'll probably build something custom later so want to invest 0 time in the beginning but need something that's workable: https://www.differentiated.io/blog/the-modern-document-proce...

Thank you!

Thanks!

With Llama 3 & Phi-3 just being released and achieving incredible benchmark results it makes sense.

However, Deepmind is doing some really cool experiments with different architectures. Recently they have applied the Griffin architecture to Gemma: - Griffin combines gated linear recurrences with local attention to optimize performance on long sequences. - This achieves comparable results to larger models with far fewer training tokens. - During inference, Griffin provides MUCH higher throughput compared to Transformer based models