News for hackers. Stuff that matters.
Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by Solvency on Tuesday June 20, 2023 @05:32PM (#36410971)
Semi-related question: this page is full of little charts and diagrams. There are thousands of similar projects/sites/experiment sites with their own charts and diagrams. But it seems like there are always subtle-to-large differences in them that indicate they're made with totally different libraries.

Are there just thousands of homebrewn non-standard chart & diagram builders out there? How does one even begin to pick a standard to whip out quickies like these? Google SEO makes it virtually impossible to get to substance.

Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by daedbe on Tuesday June 20, 2023 @05:49PM (#36411159)
I often see charts produced using matplotlib or plotly - often you can tell based on the colour schemes used. For example, the bar chart at the bottom of this paper looks like it was made with plotly. I think the reason for such variance in the style of charts is largely due to the flexibility frameworks such as matplotlib provide: you can control basically every aspect of a chart and use any number of predefined or custom stylesheets to change the look and feel.
Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by kristjansson on Tuesday June 20, 2023 @06:33PM (#36411641)
The color scheme on these implies Google Drawing, but I don't know how they made them into animations - maybe just manually?
Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by mattnewton on Tuesday June 20, 2023 @06:40PM (#36411721)
Google slides I think.
Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by wskwon on Tuesday June 20, 2023 @06:41PM (#36411734)
We used matplotlib for the performance charts, and used a free website to convert the slides to the animation gifs.
Re:vLLM: 24x faster LLM serving than HuggingFace Transformers by e12e on Wednesday June 21, 2023 @03:31AM (#36415513)
Which "free website"?