News for hackers. Stuff that matters.

akrisanov

How to become an AI infrastructure engineer?

Hi,I currently work on a GenAI platform for one of the largest local industrial companies. My daily work mostly involves building inference infrastructure on top of a 48x H200 GPU, Kubernetes and vLLM. Hence, I'd say it's 80% SRE and 20% software engineering when it comes to building request routing and internal control planes.Although I have a background in backend engineering rather than ML...

( Read More... | 1 comment | 2 points | on HN )
Re: on Wednesday April 22, 2026 @04:16AM (#47860620)
A step-by-step guide to setting up Kubernetes with NVIDIA GPU access inside WSL2 on a Windows laptop.
Re: on Sunday March 29, 2026 @04:03PM (#47566692)
Configure modern Python tooling in Helix: LSP, type checker (ty), code formatter (ruff) and more.
Re: on Wednesday January 28, 2026 @01:40PM (#46799724)
A hands-on guide to vLLM monitoring: the key Prometheus metrics (TTFT, TPOT, queueing, KV cache, swapping), Grafana panels, and alert rules that help you debug latency and plan capacity.
I built a lightweight .NET library to make HttpClient more resilient. Features include retry with jitter, support for Retry-After headers, and a circuit breaker policy.

It integrates with IHttpClientBuilder, has tests, SourceLink symbols, and targets .NET 6, 8, and 9.

Repo: https://github.com/akrisanov/Reliable.HttpClient

NuGet: https://www.nuget.org/packages/Reliable.HttpClient

Feedback on API design, missing features, or integration with OpenTelemetry/health checks would be really valuable.

Re: on Thursday October 12, 2023 @05:34PM (#37863450)
Using Github Actions and pip-tools to compile a requirements.txt file from your dependencies.
In January 2022, I joined the community of one of the proof-of-stake blockchains. To play with what the protocol and its ecosystem offered, I created a wallet account on the official website. Apart from general curiosity, I was interested in how they achieved security in a browser.
Found very interesting project/company https://github.com/status-im which is doing almost everything in Clojure and ClojureScript plus Go.

I track open positions from time to time on next website https://blockchain.works-hub.com/.