Introducing DBRX: A New State-of-the-Art Open LLM by Databricks

Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by sroussey on Wednesday March 27, 2024 @12:24PM (#39841257)

Embeddings are not interchangeable. However, you can setup your system to have multiple embeddings from different providers for the same content.

[ Parent | on HN ]

Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by jimmySixDOF on Wednesday March 27, 2024 @02:34PM (#39842918)

There are people who make the case for custom fine tuned embedding models built to match your specific types of data and associations. Whatever you use internally it gets converted to the foundation model of choice's formats by their tools on the edge. Still Embeddings and the chunking strategies feeding into them are both way too underappreciated parts of the whole pipeline.

[ Parent | on HN ]

Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by swalsh on Wednesday March 27, 2024 @02:20PM (#39842748)

Embeddings are indeed sticky, I was referring to the LLM model itself.

[ Parent | on HN ]