News for hackers. Stuff that matters.

mlenz

Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module

https://github.com/mirkolenz/llmhop

LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is not natively supported by vLLM. The LLMhop binary inspects the model field of the request and routes it to the correct backend service with optional handling of authentication. In addition, it contains a NixOS module to run llama.cpp, vLLM, and...

( Read More... | no comments | 2 points | on HN )

Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module

https://github.com/mirkolenz/llmhop

LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is not natively supported by vLLM. The LLMhop binary inspects the model field of the request and routes it to the correct backend service with optional handling of authentication. In addition, it contains a NixOS module to run llama.cpp, vLLM, and...

( Read More... | no comments | on HN )
In this case it‘s about the actual startup time of your shell. When launching a new terminal, starship always need to perform its initialization. If it were slow, I wouldn’t use it because waiting seconds before being able to input anything is kind of annoying. That‘s what they’re referring to.
Re:Firefox Moves to GitHub on Tuesday May 13, 2025 @01:44AM (#43969896)
Great to see, but I wonder what lead to the decision of creating a new org instead of using github.com/mozilla
Great to see this, thanks for sharing! Do you have plans to make it available in nixpkgs and potentially as a home-manager or nix-darwin module? Then I could add it to my config and have everything set up automatically.

Show HN: Easy-to-Use gRPC-Web Proxy Built with Nix/Docker

https://github.com/mirkolenz/grpc-proxy

I work a lot with gRPC services and recently investigated the use in some of my JS apps. I found that gRPC-Web cannot directly communicate with regular gRPC services, requiring to set up some proxy (most likely envoy with its built-in filters).In an effort to make setting up such a proxy easier, I created a ready-to-use Docker image based on envoy. Its parameters can be customized through the...

( Read More... | no comments | on HN )
UI support has vastly improved in recent versions and you are now able to get a pretty good setup without using yaml at all. Some quite interesting integrations however do still require it (e.g., trend, bayesian), so yaml is needed if you want to utilize home assistant to the max.

The things I mentioned are niches however, so I assume for the „regular“ user almost everything can now be setup via the UI.

While they try to move basic config to the UI, most stuff still requires yaml in the end. So I also think they still have a long way to go to appeal to regular users. makejinja also assumes that you know some yaml…

If you try it out and face some issues, feel free to open an issue. Maybe I can do a few things to make this tool easier to use for users without a programming background.

I totally agree, yaml is just messy when used for anything near complex. This is also why most automations in my home assistant setup are written in Python using AppDaemon. But I did not find anything good for dashboards, so I tried to reduce duplicate code as much as possible using makejinja.

Show HN: Makejinja: Automatically generate complex Home Assistant configurations

https://github.com/mirkolenz/makejinja

makejinja can be used to automatically generate files from Jinja templates. This allows you to load variables from external files or create repeating patterns via loops. A very interesting use case for this tool is generating config files for Home Assistant: Using the same language that the built-in templates use, you can greatly simplify your configuration. When creating for example...

( Read More... | 13 comments | 3 points | on HN )
Re:My Preferred Smart Home Vendors on Tuesday July 05, 2022 @09:11AM (#31987792)
Yes, Home Assistant works perfectly with KNX. I have been running it for about half a year now and did not have any issues. To control DALI devices, you need a KNX/DALI gateway. But I think all homes with KNX and DALI will have one, otherwise you could not control your lights via your switches.