Orchestration software for very small server setup, like very very small one? (k8s, nomad, etc)
Hi,
I've written some microservices and am looking to deploy them. Since I am not very confident in cloud pricing (= too expensive right now), I am looking into ways of operating a very small server setup.
Lets say I have 5 services, one is the database, 3 should be run as jobs every minute, one service should be scaled based on load.
I am aware that basically described tasks that k8s or nomad would be very good at it. The issue with them is: While I am going to update the services, etc, I do not need a large cluster. I am very sure that I can start with one pod/node and maybe get a second one, if needed.
For this setup, k8s (or other flavors) is just overkill (learning and maintaining it). Nomad from hashicorp looks totally cool for that, but it is recommended to have 3 servers with crazy specs for each of them (doing quorum, leader follower, replication, etc.) Which is overkill when I plan to have 1 worker node in total :D
Nomad has `-dev` option running server and agent on the same node, but in production? I don't know. Nomads server also uses his ip and other things for identity. When they change, the server instance is basically dead and loses its data. That's why a quorum of 3 servers is recommended as a minimal prod setup.
Docker compose is not ideal, because I would like to update single containers without tearing everything down.
Also, cron for my periodic tasks is not part of docker or docker swarm except plugins, workarounds, or configuring a container running `cron` but then meddling with `flock`, etc.
​
I am aware that it actually does not sound like I need an orchestrator, but monitoring all the jobs and restarting a container manually sounds not optimal for me and maybe there is something out there, that helps me.
Since the tech community knows more than me, I would love to get some other opinions or point of views.
Thanks!
​
​
https://redd.it/182yx0i
@r_SelfHosted
Automated self-hosted music setup?
Let me preface this by saying I have a somewhat working setup right now, but it's the automation that's lacking.
I use Navidome for hosting and am happy with how it works and performs, so switching that is out of the question.
Currently, Lidarr is used to organize my music. I haven't really found anything else as easy to use. I don't really have access to or ratio on trackers to grab the FLACs that I want. So for all intents and purposes, assume that Lidarr does NOT download. It also cannot re-tag (just rename) - because in case it did grab something, this would break torrent hashes.
What I'm looking for is an automatic or semi-automatic way to add new types of downloads into this setup. Think: SoulSeek, Bandcamp purchases, downloads via streaming services, ytl-dlp etc. The source doesn't matter. This stuff can (and probably should) get re-tagged and renamed by Lidarr. I want to keep this in the same library.
​
How do you guys have your music set up?
Do you see any way to have "external" sources managed by Lidarr, without splitting libraries?
Is there any cool, additional software I should know about?
https://redd.it/182uv20
@r_SelfHosted
Any projects coming down the tracks that you are looking forward to?
What are you keeping an eye on?
https://redd.it/182rrbj
@r_SelfHosted
This Week in Self-Hosted (24 November 2023)
Happy Friday, r/selfhosted! Below is a link to This Week in Self-Hosted, a weekly newsletter recap of the latest activity in self-hosted software.
This week's features include:
The latest news in self-hosted software
Noteworthy software updates, launches, and events
Featured content generated by the self-hosted community
A spotlight on Crontab UI, a web interface for managing cronjobs
As usual, feel free to reach out with questions or comments about the newsletter. Thanks!
---
This Week in Self-Hosted (24 November 2023)
https://redd.it/182r9fw
@r_SelfHosted
Black Friday Hunt, share your best finds
Title says it all, in the last couple years Black Friday hasn't been as exciting in terms of deals, that's why this post, if you stumble upon anything interesting and you think it's worth it, you can share it with the community here.
https://redd.it/182mnoi
@r_SelfHosted
Parsec Alternatives, Specifically For Coop Gaming
Does anyone know of any Parsec alternatives that are self-hostable that allow for a solid coop experience? I've been looking at RustDesk (which I will be testing) and I tried Moonlight/Sunshine but it really isn't setup for coop (the audio issues alone are a nightmare). Any help would be greatly appreciated!
https://redd.it/182nj9h
@r_SelfHosted
Accessing my docker webUI with domain names via tailscale
I hope I can explain this properly but I have a domain name that I would like to use to access my dockers hosted on my unraid server but I do not want to open it out to the internet.
Currently I'd be connecting to tailscale and logging in via http://<magicdns>:<port>
But the port numbers are kinda hard to remember and I have a domain name so I was wondering if it's possible to connect via: https://radar.mydomainname.com but only locally via tailscale?
https://redd.it/182m85p
@r_SelfHosted
What is the self hosted solution for Smart/cctv home cameras?
Hi all,
Currently I'm using couple of Xiaomi Home security camera 1080p 2i. Using their app on phone, I can manage the camera functions such as live feeds, two way voice communication, maneuvering positions - up down and rotate.
I want to have my own solution for these functions, is there any available open source self hosted project which can do the same? May be using own AWS or any other cloud account to run live feeds etc.
Also I have noticed when one camera is ON, I can run tv, laptop, phone on the wifi. However when I turn on the other camera which is if same model, my phone and laptop disconnects intermittently but not television.
I see they have same names but different Mac addresses, what could be a culprit?
Also is there any firmware I can flash on them and use them as is with my full control?
Thank you
https://redd.it/182jw02
@r_SelfHosted
Classifieds Software
I am in the market for Classifieds Software however there are a million and more out there, any one used any with success?
https://redd.it/182hg91
@r_SelfHosted
Cloudflare DNS setup for ngrok HTTPS URL
I'm using ngrok to port forward my little Node Express web app to the internet,
and I have set up a static domain for it on ngrok (as only one is available for the free plan), let's say https://some-name.ngrok-free.app.
I have my own domain example.com registered and managed on Cloudflare, and I want to create a CNAME reroute from subdomain.example.com to the ngrok URL, so that when I go to subdomain.example.com I get the Express app.
The problem is that no matter what I do I get a too many redirects error.
I tried creating a CNAME record with and without Cloudflare proxy, same thing.
Any ideas? Is this even possible to pull off with ngrok? I'd like to think that it is because it's just a simple redirect from a domain I own to another website.
I'd like to add that I've managed to create an SRV record that does that exact same thing, but for my local Minecraft server that is port forwarded with ngrok through TCP, and I can connect to it using minecraft.example.com (for example).
Thanks in advance!
https://redd.it/182dkns
@r_SelfHosted
Setting up email server, need a good order of operations
I own a couple domain names through gandi. I do not have the ability to get a static IP from my ISP. My main goal is to get an email server up and running on docker which I can use with mail clients like thunderbird on various devices. (I understand the drawbacks of self hosting email, this is to learn and reduce cost.)
I'm not sure where to start though, do I use something like duckdns first to get my domain name hosted on my server, then do postfix or something? I think once I have a good order of operations I can handle it from there.
This may complicate things, the server in question is a desktop with docker running all my self hosted stuff. The desktop has mullvad on 24/7. Will this vpn interfere with anything I'm trying to do here? If so I will need to figure out a way to split tunnel.
https://redd.it/1826ilt
@r_SelfHosted
Working on a frontend to youtube-dl which doubles as a fully-functional video-hosting website
https://redd.it/1829vzd
@r_SelfHosted
How do you back up all your selfhosted services
Hi Everyone
I need some help
I'm currently selfhosting some of my applications on Digital Ocean and i run a container using Portainer CE. I was wondering how you guys keep backups for the applications running on docker.
I'm currently using Digital ocean's snapshots feature but is there a better way i could use, any help on this is highly appreciated.
https://redd.it/18267f2
@r_SelfHosted
Is there a self-hosted tool that can subscribe to (and transcribe) niche video platforms?
I research far-right groups who are mostly banned from YT. I want some kind of tool that automatically downloads content from their groups (mostly on BitChute, Rumble, Oddysee) and then does a TTS transcribe if subtitles are unavailable.
I've tried Metube, which is really good at downloading from niche sources but lacks the concept of a subscription. In other words, I cannot just give it a bunch of channels I want and then let it do its thing.
Yt-archivist is excellent but is YouTube only. It doesn't support the niche video sites I need.
If only there were a tool with archivist's features but Metube's breadth of support. I've not yet seen any tool that can automatically transcribe the content in a directory, but that would be perfect - some tool that I could feed a directory of content and then have it automatically transcribe anything that doesn't have subtitles.
The reason I need transcription is so that I can search for certain comments. For example, I might want to find out when a particular group started campaigning on an issue or used a particular phrase.
Ideally, I'm looking for stuff that runs as a Docker-Compose configuration. I have a NAS with a few TB of storage. It would be great if I can just run this directly on the NAS and
https://redd.it/182362e
@r_SelfHosted
Yay... tunnels!
https://redd.it/1822bxq
@r_SelfHosted
Benefits of Proxmox VE vs. libvirt/KVM?
Are there any benefits of running Proxmox and virtualizing everything, vs having a host OS and running Docker and libvirt to host VMs for services that need it? I know that Proxmox does some storage management etc, but it seems like I could get everything it does with a well-managed host OS + ZFS/btrfs and using virtualization tools
https://redd.it/182x9mn
@r_SelfHosted
The Irony in Selfh.st Newsletters
https://redd.it/182tiar
@r_SelfHosted
The desire to replace Google Calendar and Contacts
Hello self-hosted world!
Step by step, I'm going into the beautiful world of self-hosting. With Davx9 and agendav, there is beautiful software available for self-hosting and syncing dav-files. Time to start migrating away from Google Calendar and Google Contacts.
However, I'm getting stuck at finding a replacement for the web app. You see, I hate phones (nothing personal, and it'd be much better if my phone had a full mechanical keyboard built-in but physics won't allow it), so I type all my stuff on the computer using contacts.google.com and calendar.google.com \-> it's synched to my phone and I can check it there (plus, notifications!). So in order to get rid of Google, I'd need to have a web app which does that for me, ideally with a shiny Docker image making the setup painless.
I've looked into Nextcloud (which I use), but it's absolute bloat, slow and not particularly user friendly. However, I can't seem to find many options. I can't be alone with this crave for a fast web frontend for cal and contacts.
What are my fellow selfhosting enthousiasts using?
Cheers!
https://redd.it/182pko0
@r_SelfHosted
Is there something I can use to fetch and serve YouTube videos locally?
I am keeping my children away from Youtube, but there are plenty of educational videos that I would like to make available for them to view at their leisure. I would like something that works more or less like this:
1. I add a youtube video url/playlist url/channel url
2. It downloads the videos, possibly with metadata, and stores them locally.
3. It serves them through a nice web interface.
4. (optional) it syncs the channel content and keeps it up to date.
Is there anything similar out there?
https://redd.it/182p315
@r_SelfHosted
The intersection between selfhosted and nosurf
Hello everyone,
One thing I'm sure is in common between self-hosters and people over at r/nosurf is our aversion to the popular big services like Google, Facebook...
I started self-hosting a few years ago because I was sick of depending on big corps, but over time I started getting sick of anything related to technology (even though I'm a dev lol). Recently I've been experiencing downtime on my server and I still haven't figured out the cause, and it's kinda making me feel that I am a slave to my setup, the same way I was a slave to the big corps.
I was wondering if any of you felt something similar, and how would you design a self-hosted setup that's as low-maintenance as possible (I'm already using a VPS instead of a home server to reduce maintenance).
https://redd.it/182on6y
@r_SelfHosted
🚀 Introducing Reactive Resume v4, a free and open-source resume builder!
Hey r/selfhosted, get ready to craft your story like never before!
I’m thrilled to announce that Reactive Resume has just launched its latest version, and it's a game-changer in the resume-building space (at least, I’d like to think so).
Here’s a glimpse of some of the new features:
- A sleek, polished user interface that makes navigation a breeze.
- Faster PDF generation to get your resume out there quicker.
- Integration with OpenAI for smarter assistance.
- Brand new, highly customisable templates to fit your unique style.
- Comprehensive documentation with user-friendly guides.
- Enhanced security with two-factor authentication.
- Available in multiple languages, contributed by the community.
- Quality of life features such as locking resumes, adding personal notes to resumes, tracking views and downloads on your public resume etc.
The best part? It’s 100% free, forever! No ads, no user tracking, just pure resume-building bliss. Plus, for the tech-savvy, it’s also open-source on GitHub and self-hostable through Docker, something special just for this community.
Ready to give it a spin?
You can visit the website on https://rxresu.me, sure. But you're on r/selfhosted, so you're probably more interested in the "how to host it myself" part of the launch. The link to the repository is right here: https://github.com/AmruthPillai/Reactive-Resume/
Self-hosting Reactive Resume is super simple, compared to the nightmare it was in earlier versions having to ensure multiple services are communicating alright. You can check the GitHub repo (under tools/compose for many docker compose examples of how the project could be set up).
I'm excited to see how you make the most of it!
https://redd.it/182n5th
@r_SelfHosted
What Is Up With ClearOS? What Are Your pfSense alternatives?
If I search for ClearOS I find mostly 2+ year old threads. Many older. Many talking about how it has been defunct for years... however if I just visit the site it seems to be still in development and up to date. It also seems like something selfhosted users would like... however I couldn't find any recent discussions on it to see if its garbage or not.
I plan on installing it tomorrow to check it out. I've been trying to migrate away from pfSense but I've been having a hell of a time finding a viable alternative and came across some very old ClearOS threads which is how it got on my radar.
I've been trying to get an OpnSense install up and running but I just can't get it working in the most basic installation. My original plan was just to migrate directly to OpnSense but I've pretty much given up on it.
https://redd.it/182l7kl
@r_SelfHosted
Safely Self-Hosting a Minecraft server
My nephews really enjoy Minecraft and so for Christmas, I want to give them a server for us all to play on (of course, self-hosted). The issue is that I've only got a vague idea about how one can safely self-host it, any ideas are greatly appreciated.
The more safe way that I'd personally do something like this would be to VPN into my homelab (Wireguard + DuckDNS) and access the server that way. For practical reasons that's not going to fly... I'd like to connect to the game server from anywhere, with any account, and without a VPN. This will make it accessible to the kids.
When one adds a server in Minecraft, it seems like they specify a FQDN:Port (MySite.com:25565). I could punch port forwards in my firewall and call it a day, but this seems insecure. Going forward I'm not going to forward any ports without some layer of encryption or authentication on the other side (seems like the latest best practice).
Cloudflare Zero Trust sounded like the ideal solution, notably because it's free, but also that it has intrinsic protection against DoS attacks. This isn't self-hosted though, and to properly utilize this, I would need to purchase my own domain name (not opposed to that, just an extra cost).
How do you guys architect your services to be secure while also being broadly accessible on the Internet? I imagine it's a similar tale for self-hosting a website, just in this case it's a Minecraft server. Thanks much.
https://redd.it/182h7x9
@r_SelfHosted
Thinking about building something useful for self-hosting
Is there anything you guys think that could help you with your self host experience or any service that you wish there is a self hosted version?
https://redd.it/182f9yx
@r_SelfHosted
Looking for an orchestration engine for HTTP requests similar to "Postman flows" I can selfhost.
I've come across this list, but I'm uncertain about which option would suit my requirements without going through a trial-and-error process. Do you have any recommendations for a tool similar to "Postman flows" that enables the creation of chained HTTP requests and allows for response analysis?
https://redd.it/182dn3p
@r_SelfHosted
I setup wg-easy, am I somehow exposed to attacks?
I configured wg-easy on my home-server (docker installation) and want to check if I missed something security-wise:
- I port-forwarded UDP 51820 on my router
- I have a domain which I purchsed, it's managed in Cloudflare and I created an A record pointing to my WAN IP.
- Not sure if it matters, but all I have for my wg.domain.com is a username/password authentication and it's secured with an SSL certificate, which is obviously only valid inside of my LAN.
I currently assume that since I port-forwarded a UDP port, people can't try and access MY_WAN:51820. Is it somewhat correct?
Any tips on this would be great. I'm not interested in exposing my setup to the internet, all I want is a secure VPN to sometimes access my network from my phone.
By the way, huge props to wg-easy, very quick and simple setup.
https://redd.it/18279nd
@r_SelfHosted
Selfhosted Wallpaper Service
HI Guys,
I want to setup a wallpaper service for my extended family and friends. I am looking for a self-hosted server to host a bunch of wallpapers for desktops and mobiles. I will update the collection periodically.
Consumers can set up some apps or software at their end and choose my wallpaper service to dynamically refresh the wallpaper on their devices.
Has anyone come across any self-hosted service like this?
​
https://redd.it/1827vuo
@r_SelfHosted
Nitro - 3mb binary to self-host LLMs
https://nitro.jan.ai/
https://redd.it/1821rg8
@r_SelfHosted
Any self-hosted alternatives to Plex's sonic analysis feature so far?
The recent debacle with Plex has gotten me looking into alternatives again. However they have one really killer feature that, last I looked into it, had no alternatives, which is the sonic analysis features that you can use with Plexamp.
I'm specifically talking about the feature that scans each song in your music library (using a deep learning algorithm) and determines detailed metadata about its qualities like genre, instruments, types of vocals, mood, and other timbral qualities, and then lets you generate playlists based on this data. Here's the page detailing the feature.
My favorite so far is being able to create a "Sonic Adventure" playlist, which lets you pick two or more tracks and then generate a playlist of tracks between them that gradually moves from one track you picked to the next.
Has anyone made an attempt at an open source or self-hosted version of this so far? (Is there even an open source tool for scanning audio to obtain this sort of metadata?)
https://redd.it/18228g1
@r_SelfHosted
More self-hosted solutions
Hello!
I'm aware of this awsome list, but recently I stumbled across this private list that contains other solutions, like IT-Tools and Llama (chat-gpt), so here it is, some other tools that are not in our favorite github page. (maybe the owners there can update it?)
​
​
https://redd.it/1821yie
@r_SelfHosted
