Cost-efficient and pluggable Infrastructure components for GenAI inference Posted by rrampage on Saturday February 22, 2025 @11:40PM from the github.com dept. https://github.com/vllm-project/aibrix ( no comments | on HN )
There are no comments yet.