PiHoleDNSync - Automatic Local DNS Names from Docker Compose
PiHoleDNSync \- Update PiHole Local DNS entries automatically with docker compose labels.
As someone who isn't a professional developer, I've managed to create this tool with the help of ChatGPT. I've benefited greatly from this community and wanted to contribute something in return.
The tool might serve a specific need, but it's been quite useful for me. I often struggle with remembering port numbers for the tools I self-host, and I end up with many services I can't easily locate, despite using a dashboard. My solution? A script/container that reads your Docker compose for custom labels or for Traefik router host labels. It then automatically updates your custom.list in Pi-hole with either a default or a specific host IP. You can find examples on the GitHub page.
I'm fully aware that there might be more sophisticated ways to achieve what I've done, and my knowledge of Git and GitHub is quite limited, mainly revolving around self-hosting applications. If there are any adjustments needed to enhance the tool's functionality, I'm open to suggestions.
... Yes ChatGPT rewrote this post for me too.
*** While I attempted to make the script avoid this there is every chance this script overwrites your existing custom.list file, please back it up first!!***
https://redd.it/181bms0
@r_SelfHosted
Starting down a rabbithole
https://redd.it/17kkt0w
@r_SelfHosted
Flyte 1.10: Self-hosted solution to build production-grade data and ML pipelines; now ships with monorepo, new agents and sensors, eager workflows and more 🚀 (4.1k stars on GitHub)
[GitHub Repo](https://github.com/flyteorg/flyte)
Hello, I'm Samhita from Flyte, and I'm thrilled to share an exciting update about our latest release!
Flyte is an open-source orchestrator that facilitates building production-grade data and ML pipelines. It is built for scalability and reproducibility, leveraging Kubernetes as its underlying platform. With Flyte, user teams can construct pipelines using the Python SDK, and seamlessly deploy them on both cloud and on-premises environments, enabling distributed processing and efficient resource utilization.
## Monorepo
The backend development of Flyte has been transitioned to a monorepo. This change will significantly enhance the contribution experience, making it easier to test and merge changes into the backend code. In the near future, a more detailed explanation of why we opted for this monorepo structure, how we executed the migration, and what the development experience will look like will be provided.
# New agents
Flyte 1.10 [agents](https://docs.flyte.org/projects/cookbook/en/latest/auto_examples/development_lifecycle/agent_service.html) are not only more performant than ever — we also support more of them, including Airflow, Memverge, Snowflake, Databricks and sensors!
**Airflow**
The Airflow agent enables the smooth execution of Airflow tasks in the Flyte workflow without requiring any code changes. All the Airflow tasks will be executed on an Airflow agent (long-running server) rather than launching a new pod for each task, significantly reducing overhead.
Here's an example of an Airflow file sensor:
from airflow.sensors.filesystem import FileSensor
from flytekit import task, workflow
@task
def t1():
print("flyte")
@workflow
def wf():
sensor = FileSensor(task_id="id", filepath="/tmp/1234")
sensor >> t1()
if __name__ == "__main__":
wf()
**File sensor**
Sensors are valuable for waiting for specific events to occur. You can inherit the BaseSensor class to create a custom sensor in Flyte. Here's an example of a file sensor that waits for a file to be available:
import asyncio
from typing import Optional, TypeVar
from flytekit import FlyteContextManager
from flytekit.sensor.base_sensor import BaseSensor
T = TypeVar("T")
class FileSensor(BaseSensor):
def __init__(self, name: str, config: Optional[T] = None, **kwargs):
super().__init__(name=name, sensor_config=config, **kwargs)
async def poke(self, path: str) -> bool:
fs = FlyteContextManager.current_context().file_access.get_filesystem_for_path(path, asynchronous=True)
return await asyncio.to_thread(fs.exists, path)
# Eager workflows
Eager workflows enable the use of familiar Python constructs through the `asyncio` API. Here's a simple eager workflow using the `@eager` decorator.
from flytekit import task, workflow
from flytekit.experimental import eager
@task
def add_one(x: int) -> int:
return x + 1
@task
def double(x: int) -> int:
return x * 2
@eager
async def simple_eager_workflow(x: int) -> int:
out = await add_one(x=x)
if out < 0:
return -1
return await double(x=out)
**What can you do with eager workflows?**
* Operate on task and sub-workflow outputs
* Define Python conditionals
* Define loops
* Invoke static workflows
* Nest eager subworkflows
* Catch exceptions
Read the full announcement [blog post](https://flyte.org/blog/flyte-1-10-monorepo-new-agents-eager-workflows-and-more) to discover everything that has been shipped in our 1.10 release.
GitHub: [https://github.com/flyteorg/flyte](https://github.com/flyteorg/flyte)
Website: [https://flyte.org/](https://flyte.org/)
Docs:
Personal domain or not?
I have a personal domain name. I got it because my first name was available with my country tld.
I use it for email, which I will most likely keep forever, but how about my self-hosted stuff?
I use Slack's Nebula to access my self-hosted resources externally.
Would you mind exposing your VPS:es IP:s to the world by adding them as subdomains? In my case lighthouse1.myname.tld and lighthouse2.myname.tld?
I feel much more secure using DuckDNS for those IP:s as it should make it much harder to identify my attack surface.
Does it make sense or am I just paranoid?
I really don't like the idea of my attack surface being easily identifiable just by my email or first name.
https://redd.it/17khjoo
@r_SelfHosted
sshfs is NO longer orphaned
https://github.com/libfuse/sshfs/commit/551752c3a57def3c49ced08a6246fcfdd8640e7a
https://redd.it/17kagjv
@r_SelfHosted
Any selfhosted video hotlink manager
Looking for a selfhosted service that allow me to bulk import URL of NSFW video link from sites that allow hotlinking. The service would allow those links to be organized in categories.
Any suggestions?
https://redd.it/17k5uti
@r_SelfHosted
Business IP/VOIP phone system for small business
I run a small business and I'm also the guy in charge of IT as well because I have to keep costs low and I'm relatively technically savvy. But this business phone line stuff is so confusing, with terms like PBX box, SIP trunking, etc.
I did some basic searching on this subreddit and the general advice seems to be for small businesses, don't run your own pbx box b/c of complexity etc and go with a provider like https://voip.ms//business/pricing
But it seems crazy expensive. For example, if I use my business line 20 hours a week, that means that its 4,800 minutes a month or $48 a month at VOIP.ms level of pricing. Not to mention the fact that there is a $1 charge monthly just to have the number, and a separate charge (albeit small) for all calls received.
That just seems so much more expensive than a normal consumer cell phone bill that has ONLY voice.
I literally just need a separate business phone number that can work through a CISCO IP phone I bought secondhand for myself and a couple of employees. Is there any way to save on the monthly bill / basically only pay for the phone number itself? I can't imagine this day and age where everything goes over the internet and bandwidth is not charged on a usage based basis (at least in the US) that I need to be paying for IP phone calls "by the minute".
Help me understand if there is any way I can set this up using selfhosted or if I'm really looking to do something that is impossible. Just a complete noob to the business phone industry and the software stack needed to run it.
https://redd.it/17k67sp
@r_SelfHosted
Securely but reliably self-hosting Vaultwarden?
Lastpass is out. Aside from all the ongoing issues with vaults being decrypted, I just canceled my paid subscription only to discover the free account is basically useless for anyone who actually uses technology (they limit you to either computers or mobile devices).
I've successfully gotten a Vaultwarden instance running and it works great. But I have a few concerns:
Right now the vault is hosted on my LAN, and I use a VPN to connect to my LAN from my mobile devices as needed to access other internal private services. The problem I see here is that if my LAN goes down for some reason, I might not have access to my passwords...
I thought about hosting the vault on one of my cloud VPS's. However I don't feel as secure having the instance "flapping in the breeze" ready as a target for the first exploit that's found in the server. I strongly prefer the idea of it only being accessible via some sort of VPN.
So, I thought I can just run a VPN on the VPS itself like I do with my home LAN right now, but then I realized my second concern is that if something were ever to happen to me, even temporarily (say I end up hospitalized), my VPS will just shut off as soon as payment isn't received on time and all the other family members who might need to use the instance (e.g. to access my passwords) will be out of luck.
The problem with requiring a VPN to get to the VPS or to my LAN is that I can't use the "give someone else access if I become incapacitated" options. I doubt my mom will ever remember how to activate the VPN and get into the vault, for example. (Not to mention I'd like to be able to offer family accounts on the instance as well, but I still am not sure how I feel about a Vaultwarden instance just sitting there on an open HTTP server.)
For those who self-host Vaultwarden (or even the official Bitwarden server), how do you do it securely and reliably? I know there isn't much to be done about the "it goes down if I don't pay" option other than setup autopay and hope it'll be able to withdraw from your account in your absence, but what about security in general? It really smells bad to run a known password-storing server out on the public Internet for easy scanning and infiltration, plus it just makes your host a prime target...
https://redd.it/17k3gio
@r_SelfHosted
Linux email server for a small business
I have a small business that needed a self hosted mail server.
I've already planned for this server to be hosted on a VPS, and I already have a domain name. Now I just need a mail server that do what I need.
I need it to have:
\- A web interface
\- Be able to easily create new accounts/users from the web interface
\- Be able to create account/user without having to create a user on the server itself (optional)
I've been looking into PostFix, Mailcow and Mail-in-a-box, but I'm not quite sure about them.
Thanks a bunch.
https://redd.it/17k0357
@r_SelfHosted
MarcoPolo Replacement?
I'm wondering if there is anything that can do the same thing as MarcoPolo.
The key features:
\- It's a video walkie-talkie (not a video chat). This means people make videos that are sent to each other
\-The videos are live streamed to the other person as they are recorded. This means that if I am sending you a video message, you can be watching it in real time, and when the message is finished, you can immediately start sending me one back, which I can watch in real time. This gives an effect that feels magical: as soon as I am done recording, a response from you is waiting (not what's actually happening, since you're message isn't waiting, it's just being recorded and live streamed, but it feels magical, and lets you send messages back and forth very quickly since you don't have to wait for the other person to record and send the message before you can listen to it). This is what makes this way better than other messaging apps that let you send videos (e.g., telegram, signal, whatsapp, etc.)
\- Any videos can also be viewed at any time after they are sent. This means I can watch and reply to your video message at my convenience: this is what makes this way better than typical video call.
\- You can make groups of friends you can all send video messages to each other in a thread
\- It works on android and iOS
​
I haven't found anything that is self-hosted to replace these features, but maybe someone else knows of one?
https://redd.it/17jy30s
@r_SelfHosted
What are you using to see and edit files on remote servers?
Hi all,
I seem to see a lot of people using VSC over ssh to see the files and folders on their servers and edit them more conveniently than compared to nano/vim but I'm looking for alternatives for VSC.
I have an increasing number of servers and hosting things with docker compose. Thus I have a lot of /app/docker folders with numerous docker-compose.yaml and other container specific config files.
I dislike VSC so as an alternative I use Notepad++ with nftp plugin (yap, I'm daily driving Windows) to connect to the servers to see and edit said files.
I also tried Jetbrain' fleet but it seems to intall some kind of client on the servers it connects to which requires just enough resources to notably slow down my cheap VPSes.
So other than the 3 examples above, what kind of edit do you know/use to connect to servers and edit files there directly?
https://redd.it/17jrmqv
@r_SelfHosted
Cosmos Cloud Opinions
Looking round for a Dashboard I came across Cosmos Cloud.
Has anyonehad any experience of this self-hosting OS?
It look interesting but just wanted to get opinions/reviews on what it is like, security etc
https://redd.it/17jscpc
@r_SelfHosted
Fritzbox Wireguard or Tailscale on Synology NAS?
I'm currently setting up my first home lab and I wonder which is the best solution for remotely connecting to it.
I have a fritzbox 7590 modem/router, a synology NAS and 2 PCs in my local network. I'd like to access files in NAS and even use PCs via rdp remotely.
AFAIK, the simplest solutions are:
1. use the implementation onf wireguard in the fritzbox https://en.avm.de/service/knowledge-base/dok/FRITZ-Box-7590/3685_Setting-up-a-WireGuard-VPN-to-the-FRITZ-Box-on-the-computer/
2. use the tailscale package in my synology NAS
Which is the safest solution? What are PROs and CONs of each one? Do you have other solutions?
Thanks
https://redd.it/17jq20d
@r_SelfHosted
Migrating from Google Workspace
My university finally stopped offering unlimited Google Drive storage after 9 years. Being so dependent on google Drive I'm between hosting my own cloud or getting a synology. I work in my office and also during at home sometimes and the with google drive I'm using the stream option which only download files when I need it. I would like to keep it that way if possible.
I've heard good things about Synology and it just works out of the box but I've also read that unfortunately if the hardware craps out after warranty I'd pretty much have to get a new one?
I've also read up on TrueNAS and Nextcloud but it seems that it needs alot of post setup maintenance? I'm have experience setting up Linux and other OS's and I'm ok with installing and setting the NAS up initially but I'd rather not spend much time troubleshooting if/when its not working properly. Is it as bad as the comment sections here suggest?
https://redd.it/17jovat
@r_SelfHosted
Open source google fonts alternative
Hello everyone! I'm looking for a self-hosted alternative to Google Fonts. I've noticed that many open-source projects rely on Google Fonts, but in cases like a private LAN, it might not be accessible. I'm wondering if there's an alternative solution that would allow open-source projects to configure their own font provider. Any suggestions?
https://redd.it/17jmx3t
@r_SelfHosted
Found the ultimate Nextcloud / Owncloud replacement!
I just wanted to share my findings with everyone! I've been searching for a fast, easy-to-use self-hosted cloud storage app and that seems to be the best I've stumbled upon.
https://github.com/cloudreve/Cloudreve
Note for Unraid users. Find the app in the app store, but replace the repository as the one provided is very old. https://hub.docker.com/r/cloudreve/cloudreve
https://redd.it/1817x9z
@r_SelfHosted
[https://docs.flyte.org/](https://docs.flyte.org/)
Cheers!
https://redd.it/17kklqn
@r_SelfHosted
nginx and authelia or authentik working docker
hello all,
Apologies if not allowed here .. been struggling to get some kind of 2FA on a self hosted server.
i would like nginx proxy manager behind 2FA
have tried many many docker compose files from google searches
none seem to work
does anyone happen to have this kind of config ?
background:
ubuntu vm is running on promox and network traffic can reach the vm from outside.
cheers
https://redd.it/17kikvv
@r_SelfHosted
Is there any way to host 3 identical file servers in 3 different locations, and have clients automatically connect to whichever one is closest?
Im wanting to replicate the files on my home server to my server at my business and a VPS. Then have it setup in a way where my laptop, iphone, etc... will automatically connect to whichever server is closest or fastest. Clearly the servers would sync amongst themselves so they all 3 stay up to date.
Is this even possible?
https://redd.it/17ka6mi
@r_SelfHosted
ntfy is a great tool. What do you use it for?
https://redd.it/17ke5ax
@r_SelfHosted
no plex players found
Hi,
I have been having this issue from the start of my server set up but was just trying to solve it with different ways but was unsuccessful so I ignored it for a long time but now I have decided I really want to resolve it.
So I am running plex in docker on ubuntu 22.04. I have plex Version 1.32.7.7621 this is the latest version. So the issue is when I ask alexa to play some content I would say "no plex companion players found" At first I thought It was alexa skill that was messed up. However i have notice something else to when ik try to cast something through plex mobile app to my fire tv or my Samsung smart tv to say no player found. i am pretty sure both of them are related. Any help is much appreciated. its just really annoying i hope somebody can help
https://redd.it/17k6o9n
@r_SelfHosted
Storage Management
Hi All!!
Short introduction, started self-hosting a NextCloud instance using an old Optiplex 7060 SFF that got from work (8th gen i5 + 16Gb ram) and it's been rock solid for well over 6 months, but I poke my head into the self-hosting world and...well, started planning upgrades.
Got a new machine at the end of Sept, it's running Proxmox as I plan to run a few LXC's and VM's (13th gen i5 + 64Gb ram). Currently planning the new Nextcloud instance, playing around with the drives... can't figure how to do it right and for the past couple weeks I've tried a few things, just need some fresh minds to share some light if possible?
I do have 3x 4Tb drives that I want to use with Nextcloud, but no raid...all separate since my idea is to put 2/3 users per disk (family members to dump pics/docs from phone and move out of GPhotos). So far NextCloud is running on an Ubuntu VM perfectly fine, with one drive added via passthrough.
Tried playing with a VM running TrueNas, sharing the drives as SMB shares but started to run into some issues copying files (prob permissions not set correctly 🤷🏻♂️) so moved away from it since my brain was hurting while digging info and looking up tutorials...
The plan is to backup all three separate drives into a big 12Tb spinning drive "just in case". What would be the best option here? I thought in doing 3x Ubuntu VM's (basically cloning the first one), add one drive per VM and running a backup script to dump the info into the big drive but not sure if that's ok or how to accomplish in a good an reliable way? Any alternative, even if it's going back to TrueNas for managing the disks (and doing snapshots to the big one) but with a good tutorial on connecting the VM and the drives?
Apologies if it's a bit messy or if I'm doing it all wrong, still learning! Thanks so much in advance!! :)
https://redd.it/17k3vtu
@r_SelfHosted
Hello, Alex from Immich here - We recently got an opportunity to discuss self-hosting complexity with The Vergecast (from theverge.com). It brought some good discussion on there, and I think you guys would like to hear it as well.
https://www.theverge.com/23938533/self-hosting-local-first-software-vergecast
https://redd.it/17k1fa7
@r_SelfHosted
WebForms 0.4.0
Good day community!
WebForms is a versatile tool designed for creating HTML forms with various backend hosting options, featuring DevOps compatibility, mobile-friendly UI, security features, OIDC integration, notification capabilities, templating, CAPTCHA support, extensive customization, scalability, and open-source licensing promoting collaboration. Think about it as simplified and true FOSS version of Baserow or Apitable.
Since my last announcement here about WebForms (0.2.0) a lot of new features added (0.4.0):
* added [OIDC claim-based access](https://web-form.reddec.net/authorization.html#access-control): you may restrict users in each form just using simple expressions such as `policy: '"admin" in groups'`
* added support for Cloudflare Turnstile CAPTCHA
* added code-based access (ie: invitation codes). Codes are passed to template contexts and can be used for field's default value
* added AMQP notifications in addition to WebHooks (ie: RabbitMQ for reliable notifications)
* plenty of refactoring and bug-fixes
Basically, since 0.4.0 you can expose web-forms in a public without securing it via OIDC just by access code and CAPTCHA to protect against bots.
Docs: [https://web-form.reddec.net/](https://web-form.reddec.net/)
Repo: [https://github.com/reddec/web-form](https://github.com/reddec/web-form) (MPL-2.0)
https://redd.it/17jvlyh
@r_SelfHosted
I created Listy - a selfhosted Go application that automatically creates a monthly playlist on Spotify and syncs songs you like to it!
I wanted to share this small application I created that I have been wanting to build for a while, as I'm often listening to music in my car and forget to add songs that come up in radios/smart shuffle to my current monthly playlist.
While Spotify might not be self-hosted, Listy is, and provides a simple Go API to authenticate with Spotify, and then a sync command to add all the songs you liked in the current month to a monthly playlist that follows the naming scheme YYYY MM.
Once you've deployed Listy following the instructions on the Gitea repo, all you need to do to get it going is head to http(s)://listy.example.com/auth/oidc/spotify/redirect where you will be redirected to Spotify for authorization, and then registered in Listy's database for monitoring.
Listy is still a very simple application, but I plan to add some more features in the future to make it more customizable, and also add a management UI with admins to improve control over the instance.
I'm hoping someone finds this useful and look forward to the community's feedback on this idea!
https://redd.it/17jtoe2
@r_SelfHosted
Cloudflare Email Routing now supports subdomains!
https://blog.cloudflare.com/email-routing-subdomains/
>Now you can use Email Routing with any subdomain of any zone in your account. To make this possible we redesigned the dashboard UI experience to make it easier to get you started and manage all your Email Routing domains and subdomains, rules and destination addresses in one single place. Let’s see how it works.
>
>To add Email Routing features to a new subdomain, log in to the Cloudflare dashboard and select your account and zone. Then go to Email \> Email Routing \> Settings and click “Add subdomain”.
​
> there are no changes in pricing, and Email Routing is still free for Cloudflare customers.
https:\/\/blog.cloudflare.com\/content\/images\/2023\/10\/Domain.png
https://redd.it/17jry8f
@r_SelfHosted
Does this exist?
Hey everyone, long time lurker here.
I was wondering if there was a self hosted option for building/storing Cisco device configuration files specifically. Ideally I would love a web interface but that isn't required.
I know Cisco has a zero-touch option for certain switches and routers but I wanted something where I was able to actually build the configuration files myself and then manually load them to the devices when I need to turn them up.
I am also aware that there are some websites you can go to and plug in the info for your devices and they will build the config for you but I don't really like the idea of giving a stranger on the internet the details of my internal network (example: https://www.sharontools.com/tools/config-generator/)
If anyone knows of such an application let me know!!
https://redd.it/17jrtj1
@r_SelfHosted
How do you use NUC in homelab?
I purchased a NUC with 32 GB memory, 512 SSD and AMD 8 core processor. I already have a NAS.
I was wondering how do you guys use NUC? My mostly workload are containers.
Do you install proxmox on NUC itself and run VMs
OR
Just install a Linux on NUC and use it as a docker host?
Suggestions please?
Appreciate your advice, thank you
https://redd.it/17jjbiw
@r_SelfHosted
Searching selfhosted alternative for 12ft.io
12ft.io was a website, that was able to bypass paywalls. Their claim was "If there is a 11ft Paywall, you'll need a 12ft ladder"
It worked very well and was a great tool to keep up freedom of information.
But it seems to be taken down.
I don't know exactly how it works, but as far as I remember, they're using google cached website service.
Wondering, if there is a selfhosted alternative to avoid a take-down.
https://redd.it/17joa0p
@r_SelfHosted
Ambry audiobook service vs Audioserve
Anybody played with Ambry for hosting audiobooks?
Looks like the dev released an android app, and the UI in both the web and app is more slick/visually appealing than Audioserve.
Audiobookshelf is a no go for me - the project is rapidly developing, has lots of bugs, and has caused some serious system failures when doing apt-update. Maybe once it's stable and in maintenance, but for now - no.
I'm torn between the two, and was hoping to field some input as to whether I should set up Ambry or Audioserve.
https://redd.it/17jlydr
@r_SelfHosted
