Re:DeepSeek: X2 Speed for WASM with SIMD
by 7thpower on Tuesday January 28, 2025 @03:54PM
(#42857859)
I do not as I'm not in the ecosystem, but groq is openai compliant, so any tool that is openai compliant (99% are) and lets you put in your own baseurl should work.
For example, many tools will let you use local llms. Instead of putting in the url to the local llm, you would just plug in the groq url and key.
For example, many tools will let you use local llms. Instead of putting in the url to the local llm, you would just plug in the groq url and key.
see: https://console.groq.com/docs/openai