News for hackers. Stuff that matters.
Re:A guide for getting started with Self Hosting by dotnet00 on Monday October 24, 2022 @11:42AM (#33318163)
Unfortunately a lot of self-hosted services seem to be heading in the absurd direction of being entirely docker based, often not even having a means of installing the thing normally. It's extremely annoying.
Re:A guide for getting started with Self Hosting by Beltalowda on Monday October 24, 2022 @12:00PM (#33318434)
I think the problem is essentially one of scaling. When folks talk about scaling they usually talk about "being able to do more"; but this often comes at the expense of more simple use cases. Most business software I worked at would be horrible to self-host: maybe 3 or 4 services, if not more, requires PostgreSQL, ElasticSearch, Redis, maybe some queue system, etc. In short: "scaling up" often comes at the expensive of "scaling down".

The current model for a lot of self-hosted software is "make money with a SaaS offering", which is a fine model IMO, but now you have to cater to two different scales: the small "downscale" of the self-hosted user, and the larger "upscale" one of your SaaS offering.

I actually work on one of those "open source with SaaS offering" things, and it's a real challenge to unify these two use cases because the involved tools are quite different, and I don't want to implement everything twice.

Docker can offer a solution to abstract the complexities that are required, although I agree it's not a good solution to 100% rely on it (which is why I don't do it).

Re:A guide for getting started with Self Hosting by dotnet00 on Monday October 24, 2022 @12:39PM (#33318979)
Yes, I understand that there are tradeoffs there, especially for a lot of federated services, which even without SaaS have to be able to scale well.

My complaints mainly stem from how docker is often kind of finnicky, eg in a previous setup of my server, I had to put everything through a VPN, but Docker didn't play well with a VPN running on the main system, so I had to limit myself to things I could install without Docker until I had to migrate to a new install.

Another issue I ran into with migrating servers was restoring a Postgres db dump to docker, which similarly didn't have much documentation, so for that I had to resort to a traditional setup. Which made me pretty happy that they at least support traditional setups, even if they lean more towards Docker.

Re:A guide for getting started with Self Hosting by superkuh on Monday October 24, 2022 @01:38PM (#33319780)
I know this is HN, but we're talking about self-hosting. We aren't talking about bringing work home to show we can do it to potential employers so we can get hired somewhere using those tools makes sense. Scaling is simply not a problem at all in this context.
Re:A guide for getting started with Self Hosting by monkmartinez on Monday October 24, 2022 @12:48PM (#33319100)
If I want to run a bunch services like apprise, n8n, strapi, jupyter notebooks, nocodb, appflowy and more... why wouldn't I run these in containers? Using Docker and the tooling around it makes it super easy. I don't spend weeks configuring every tiny detail just to get the darn things installed.

What you find annoying is empowering tons of people like me to run lot of software. I can try lots of software I wouldn't have bothered with due to ease of setup. I don't bork my host machine when I make mistakes. I just start delete the container and start over, with a few adjusted settings before build or compose steps.

1337 hackers can run circles around me for sure, but I have a freaking datacenter in 3 computers at my house. All of them are internet facing with Cloudflare tunnels pointed at the services I want to share or use away from home. It has never been this good.

Re:A guide for getting started with Self Hosting by horsawlarway on Monday October 24, 2022 @02:03PM (#33320141)
I agree with this take 100 fucking percent.

I want to be able to consume and run code provided by other people on hardware/networks that I own.

In which case - Docker/Containers/K8s(or my preference, MicroK8s) are a fucking godsend compared to 10 years ago.

I host about 25 services, I have all the config in a single repo, and can rebuild the whole fucking thing in about 10 minutes.

Adding a new machine to take load is as easy as installing ubuntu server, adding microK8s, and running a SINGLE freaking line on the cli. Boom - done. I do this basically each time we get a new machine... the old one goes to live in the server farm.

All the backups? Easy, since the storage is my NAS, mounted in microK8s, and I can just run scheduled backups there for literally every new service, without any additional config as I add them.

It's incredible. I have done the whole "SSH into each machine and tediously configure it to run a specific application, configure my router, make sure the config files are in the right place, configure backups, worry about HDD lifespan, etc" bullshit for long enough to know that I don't EVER want to go back to that.

The people that keep talking shit about containers are still incredibly focused on the use-case of "I host my own blog" like that's all that self-hosting is. But it's not - I self host open source applications as a complete replacement for shitty, ad-driven, recurring subscription fee based SaaS companies.

Meal planning (mealie),

Calorie tracking (calorietracker),

Video streaming (jellyfin),

Google Docs/Notion/etc (bookstack/nextcloud),

Authentication (keycloak),

File sharing/storage (seafile),

Digital Library (calibre),

Home automation (openhab),

Asset tracking (snipeit),

todo lists (Taiga),

scheduling (cal)

etc...

Containers aren't there to help you host your blog. They're there to let me host your application. Configured quickly and simply.

If there's company making money through a recurring subscription based website... There is someone who has made a decent clone that I can self-host.

And these tools make that process much easier than it used to be.

Re:A guide for getting started with Self Hosting by 35mm on Monday October 24, 2022 @03:42PM (#33321516)
How do you manage the databases?
Re:A guide for getting started with Self Hosting by horsawlarway on Tuesday October 25, 2022 @10:21AM (#33330808)
Container images that have access to an NFS mount from my NAS.

You need to be careful with your mount options here, since soft mounts can cause corruption in some cases and performance is not fantastic (although nfs v4.1 is better than nfs v3) - but overall it works and keeps backups strategies simple since everything is on the NAS.

Sadly - it's fairly slow (sqlite in particular is painfully slow when under lots of load and needs care to ensure only one machine is writing to it at a time) but right now I'm avoiding more complex setups since it's not normally a problem with just me+family using things.

Long term - I've been considering moving to iSCSI, or something more robust, but it just hasn't been worth the trouble yet.

Did make me like sqlite a whole lot less though - I opt for mariaDB/Postgres on any service that supports a remote db - they seems to do just fine. 3 years in on this setup and no corruption outside of sqlite on a soft mount (which was solved by reverting to my last backups).

Re:A guide for getting started with Self Hosting by superkuh on Friday October 28, 2022 @10:56AM (#33372138)
Meal planning? Text file. Calorie tracking? Text file. Video streaming? Share video file with static webserver. Google Docs? Share documents with static webserver. Authentication? I don't understand what this is or why it is needed. File sharing/storage? Share with a static webserver. Digital library? Files and folders, if you want to share, share with static webserver. Home automation? I don't know what this is. Todo lists? Text file. Scheduling? Text file.

You'd be surprised what you can do with simple files and a single static webserver.

Re:A guide for getting started with Self Hosting by dotnet00 on Monday October 24, 2022 @02:22PM (#33320377)
As I mentioned in another comment, docker containers are fine until you have even a slightly non-standard setup or use case, like the not-so-uncommon setup of having the machine connected to a VPN, in which case docker will proceed to not work at all.

What makes running these things easy isn't the container but that the software is packaged at all and would have the same effect if it were done through a conventional package manager. So of course docker seems like an upgrade when the only other thing they're offering is a loose distribution of files you have to manually copy in and configure.

Re:A guide for getting started with Self Hosting by mrmlz on Tuesday October 25, 2022 @03:20AM (#33327247)
What do you mean "connected to a VPN in which case docker will proceed to not work at all".

... i have a vpn and my docker containers work just fine?

Re:A guide for getting started with Self Hosting by bobdvb on Tuesday October 25, 2022 @10:57AM (#33331382)
As a relative beginner to Docker at home, the biggest issue I've had is that there is a presumption that everything is HTTP. I wanted to run two apps in two Docker containers that both wanted UDP on the same port and couldn't do it. Docker lets you use multiple IPs but apparently you can only use a single port for any app on a single host.

Tedious.

Re:A guide for getting started with Self Hosting by Handytinge on Sunday October 30, 2022 @05:29AM (#33392730)
> What you find annoying is empowering tons of people like me to run lot of software.

In what way does _only_ having a docker install option empower you?

GP wasn't stating that docker is bad, but docker _only_ options are bad.

There are many use cases that are not yours that docker doesn't suit.

Re:A guide for getting started with Self Hosting by jonwest on Tuesday October 25, 2022 @01:15AM (#33326514)
Read the Dockerfile. It is literally a set of instructions to configure a machine to run the software.