So is it an improved RAG, where RAG information is analyzed and compressed before being introduced in the LLM?

If so, the context window is still a problem, no?

The license is a mess. Starts with "GNU AFFERO GENERAL PUBLIC LICENSE" then goes into "then distribute that combined work under the terms of your choice" and then adds a non commercial clause "does not grant to you, the right to Sell the Software" ("including without limitation fees for hosting or consulting/support services").

Just chuck a nc on there and be done with it, no point in going 3 ways into a license just to confuse matters.

This is an interesting layer. And how does it handle the ever growing context? Do you run embeddings or what?