You can also checkout our research paper in zenodo. Also, make sure to try using it on a CPU. Our main goal is to help advance the AI community so that people spend less time configuring vLLM and more on actual testing and dev.