News for hackers. Stuff that matters.

anton5mith2

Re:Kubernetes the Hard Way – Vagrant, Ansible, No Cloud on Monday March 04, 2024 @01:22PM (#39593934)
Right!

I starred this awhile back, it’s the really hard way imo, really great for learning: https://github.com/ghik/kubernetes-the-harder-way

Re:Hugging Face Releases Agents on Thursday May 11, 2023 @05:21AM (#35899760)
For now it is CPU only yes, uses AVX instructions. But it's pretty fast anyway, try it out. I have it running on my mbp M1 and it's pretty decent. I think GPU support will come eventually. I wrote an app that uses the openai API and it was nice and simple to just point it at my own local service instead.
Re:Hugging Face Releases Agents on Wednesday May 10, 2023 @06:58PM (#35894628)
Could use LocalAI to get around this: “The openAI models perform better (but require you to have an openAI API key, so cannot be used for free);”

https://www.reddit.com/r/selfhosted/comments/12w4p2f/localai...

At present, you need a CPU with AVX. For memory I’d say 16GB or so.
Re:LocalAI: Local models on CPU with OpenAI compatible API on Thursday April 27, 2023 @08:19AM (#35726935)
LocalAI is the OpenAI compatible API that lets you run AI models locally on your own CPU! Data never leaves your machine! No need for expensive cloud services or GPUs, LocalAI uses llama.cpp and ggml to power your AI projects!

LocalAI supports multiple models backends (such as Alpaca, Cerebras, GPT4ALL-J and StableLM) and works seamlessly with OpenAI API. Join the LocalAI community today and unleash your creativity!

GitHub: https://github.com/go-skynet/LocalAI

We are also on discord! Feel free to join our growing community!

https://discord.gg/uJAeKSAGDy

Re:Planting Undetectable Backdoors in Machine Learning Models on Saturday February 25, 2023 @03:52PM (#34940335)
“Sign in or purchase” seems like some archaic embargo on knowledge. Its 2023, really?
Re:Vxlan over WireGuard (On OpenBSD) on Tuesday February 14, 2023 @05:20PM (#34797013)
Indeed check out my other post here - and it definitely was fun!
Re:Vxlan over WireGuard (On OpenBSD) on Tuesday February 14, 2023 @05:13PM (#34796941)
I took this to extremes last year: I used it to run MAAS from Australia to sweden (which requires layer 2). Granted I used tailscale to make the WireGuard part even easier, but it was a lot of fun.

https://medium.com/@antongslismith/bare-metal-cloud-provisio...

Re:How to run workloads on bare metal Kubernetes with MAAS on Tuesday December 14, 2021 @01:32PM (#29555338)
I'm op:

After many, many long hours working on this bare metal Kubernetes whitepaper, it's FINALLY done and published.

I think I literally did work my a$$ off - at least, sitting in my chair typing this away did make me forget I had legs.

If you are interested in taking a walk down memory lane to see how we got here, how it differs from Virtual Machines, or just want to learn about it - this paper I truly hope will be interesting to you.

It even covers how to practically roll out bare metal Kubernetes and includes a video link (at the end) with a hands on tutorial (also involved in wearing me out).

Go, download, read, skim, enjoy :).

Re:Kubernetes at Home with K3s on Monday December 06, 2021 @04:06PM (#29465711)
you can still use the debs, we have both! https://maas.io/docs/deb/3.1/ui/maas-installation
Re:Kubernetes at Home with K3s on Sunday December 05, 2021 @01:59PM (#29451859)
I’m a new product manager at canonical for maas.io and just spent a fair chunk of time producing a bare metal k8s video tutorial. I did it as a learning exercise and it was really interesting.

Anyway, it uses Juju and a charm called kubernetes-core. I came away impressed (even tho biased) at how easy it was to deploy a cluster, scale it up/down etc. Didn’t see anyone mentioning these in this thread so thought I’d mention it.

https://youtu.be/sLADei_c9Qg

I'm the author of the tutorial, really happy it worked for you! Do you have any thoughts or feedback for me, would love to hear it.
I'm the product manager for https://maas.io and the author of this tutorial, would be awesome to get feedback and suggestions.

The idea was to make it much faster to get hands on with MAAS since not everybody can easily build a physical environment. I decided to use Multipass because of the cloud-init support.

I hoped I could get it to work easily on windows and mac, but had a few issues with nested VMs there. I'm thinking about how to un-nest them, but it might require a few multipass VMs on a bridge. Edit: I have had reports it works fine on Windows with Hyper-V.

Anyway the tutorial as it is should work just fine on Ubuntu for now. I hope people actually try it :).

People might also find the cloud-init setup interesting, auto installing MAAS, auto configuring it, setting up LXD, etc.