Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Show HN: Run Hugging Face models with a single command.
• Install and run open-source models (almost all Hugging Face models)
• Package models with projects so environments are reproducible
• Serve models through an OpenAI compatible API
• Built-in chat UI for interacting with running models
• CLI workflow designed for developers
• Model benchmarking and rankings to help choose models Example:
llmpm serve llama3
This exposes an API endpoint similar to:
http://localhost:8080/v1/chat/completions
There are no comments on this comment yet.
• Install and run open-source models (almost all Hugging Face models)
• Package models with projects so environments are reproducible
• Serve models through an OpenAI compatible API
• Built-in chat UI for interacting with running models
• CLI workflow designed for developers
• Model benchmarking and rankings to help choose models Example:
llmpm serve llama3
This exposes an API endpoint similar to:
http://localhost:8080/v1/chat/completions