86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
I messed up (by making a mess) - how to get started to make sense out of my files and folders
I never developed anything since I started working in IT 20+ years ago. Now at my current job (I started here six months ago) I developed a whole bunch of scripts. Never thought I do that but here we are. And of course I am enjoying it.
Problem is, I am a messy person when it comes to 'paperwork'. Always been like that as I had keeping records. Annoyingly my stupid behaviour translated into coding as well.
I am using Mac and love VSCode - but my files are all over the place and I struggle to use command line etc. to move things around (always find an excuse to 'do it later').
Are there any file managers etc. that makes it easier to clean up / sort this mess ?
https://redd.it/1fy31v0
@r_devops
Handpicked Software Engineer Jobs Report (10/2): 150+ recently posted roles in the USA & Abroad. Curated weekly to help your job search. DevOps/SRE/Infra roles included
Hey friends, every week I search the internet for software engineer jobs that have been recently posted on a company's career page. I collect the jobs, put them in a spreadsheet, and share them with anyone whose looking for their next role. All for free.
I added the ability to filter by technology and location on Airtable. Now you can filter by your preferred tech stack and by the location of where those jobs are located. Again we have over 150 roles from Software Engineering to Infrastructure Engineering in cities around the globe.
I hand pick the ones I know are good roles, with market salaries, and no glaring flags (ex: I generally only put roles with posted salary bands). Though its not easy to tell if the roles require leetcode or not. I want to figure out how to get the information in the future (probably will ask people as they interview).
The data is sourced by my own web scraping bots, paid sources, free sources, VC sites, and the typical job board sites. I spend an ungodly amount on the web so you don't have too!
About me, I am a senior software engineer with a decade of work history, and ample job searching experience to know that its a long game and its a numbers game.
If there are other roles you'd like to see, let me know in the comments.
To get the nicely formatted spreadsheet, click here.
If you want to read my write up, click here.
if you want to get these in an email, click here.
Cheers!
https://redd.it/1fxwlw2
@r_devops
Ansible Playbook for Kubernetes cluster installation on Linux
Hey everyone,
I just wanted to share an Ansible project I’ve been working on for deploying a simple Kubernetes cluster using kubeadm on Linux. This is ideal for anyone who’s looking to test and learn the most up-to-date version of Kubernetes.
I understand that there’s Kubespray, which is much more powerful and allows for a lot of customizations, but this playbook is lightweight and simple. It might be a good option for those looking to set up a quick and easy development and testing environment of Kubernetes on Linux.
Feel free to check it out and share any feedback! If you find it interesting, please leave a star!
GitHub Repository: install-k8s-on-linux
This isn’t intended as self-promotion, just sharing in case it helps someone with a similar need.
https://redd.it/1fxn0yo
@r_devops
Free Certifications in the DevOps space
Hello everyone, I was wondering if anyone has any idea on free certifications in our space. I've been eyeing the CNCFs K8s ones but not prepared to splurge at that price. Just wondering if there's a promo like there was for the GitHub Foundations certification that made it free.
https://redd.it/1fxkffk
@r_devops
Requesting recommendations for growing people in platform engineering.
Hi all,
I’m looking for some training recommendations to help grow some of our Windows .net coders into a team that will be doing platform development, automation, and cloud systems. The ideal training would cover a range of skills, from basic cloud architectures to CI/CD practices, scripting and writing systems for cloud deployment and operation. This team will build the platform tooling for other product teams within our company. We already have very decent systems engineers who will deal with the nitty-gritty of operations in the interim.
Here’s a summary of the skills we’re aiming to develop:
- Proficiency in working with Linux command line, and AWS cloud systems including automating, scripting, and collecting/publishing observability
- Good use of containers, CI/CD pipelines, and modern software practices like fast feedback and deployment pipelines
- building test-first and using automaton
As an example, I think that the AWS SAA Adrian Cantril would be great for the AWS bits, but I stand ready to be corrected. I know it's a journey, and often the best way is to learn by doing, but I'd also appreciate any recommendations for specific courses or certifications that provide decent coverage of these areas to help jump-start them.
Cheers!
https://redd.it/1fx8m33
@r_devops
Why do i see some delay in auto scaling when doing load testing in EKS.
I am trying do load test by implementing service auto scaling .
I have chosen target tracking and chosen ecs parameter as activerequestcount. I am observing 6 minutes delay.
I am assuming the target tracking values were tracked using cloud watch alarms and cloud-watch collects metrics on Ava of 5 minutes or the target alarm for scale in is set for 3 data points in 3 minutes and the scaling only happens if the target hits the 3 data points in a row in 3 minutes. Any knowledge transfer here ? Thanks in advance :)
https://redd.it/1fx4lhj
@r_devops
Should I dive into Projects as a beginner and learn and do mistake as I go or just learn the fundamentals first?
Although I have been learning using materials I could find my hands on online, but I feel it's not enough unless I go all in.
As the header implies.
Is it the right way to go?
Your candid responses will go a long way.
Thanks.
https://redd.it/1fx5yw3
@r_devops
Exposing apps/API/services in development
I have two questions for DevOps folks:
- How do you ensure apps and APIs in development remain secure I.e. not exposed to the public internet accidentally.
- What if a dev wants to test the app in development with real-world traffic - traffic from the public internet? Do you even allow that? If so, how?
Eg: example-enterprise-app.com is the public facing app.
Dev is working on example-enterprise-app.com/pricing
https://redd.it/1fwua2i
@r_devops
Transitioning from Fullstack
Hello! So I have a background in fullstack web development. 3 years at a mid size company, 4 months at a really small start up. But I haven’t worked as an engineer for about 1.5years.
I want to get back into tech but leaning towards the DevOps side of things.
Any suggestions on how to get started? (courses, roadmaps, etc)
Has anyone else made a similar transition?
Thanks you in advance for any suggestions!!
https://redd.it/1fwttu0
@r_devops
Considering a Move Back to the US: Remote Work Salaries, PTO, and State Preferences for DevOps/SRE gigs
Hi all,
For some background, I have about 10 years experience in the Devops/SRE/Sysadmin area and have been working in Germany the past 8 years.
I am considering moving back to the US, I am American, due to the job market in Germany but I am kinda out of touch when it comes to American work culture/benefits etc.
Anyways my questions:
* Mostly looking into remote work gigs, so I know salaries can vary but what is a good range in the current market?
* What is a good number of PTO days? This is something I am a bit worried about coming from German working culture. I know unlimited seems to be floating around but IDK.
* Any tips on which states to avoid working remotely for or which states are better for this?
https://redd.it/1fwv7fm
@r_devops
GitLab deprecates Terraform templates (and recommends using OpenTofu instead)
https://docs.gitlab.com/ee/update/deprecations.html#deprecate-terraform-cicd-templates
https://redd.it/1fwtmpk
@r_devops
Systems Administrator Wanting to Learn
Hi Everyone,
I am a current systems admin at a MSP. I am wanting to learn more about devops to see if it might be something I find interesting. Below is a link to my github page where I am planning on documenting my progress. If you all could skim through it and offer advice, it would be appreciated.
https://github.com/BraydenCrumz/Learning-DevOps/blob/main/README.md
https://redd.it/1foxw9y
@r_devops
Have you ever tried reviewing code with AI?
Most of the conversation I've seen online has focused around using AI tools like ChatGPT and more recently Cursor to assist in writing code. Personally I've had mixed results there (although Cursor does feel better than anything else I've used so far).
What I haven't seen talked about very much though, is reviewing code with AI. I've seen some hype around tools like CodeRabbit, Ellipsis and What the Diff, but haven't tried them all out myself. Anyone have any experience using a tool to actually review code? Are they worth it?
https://redd.it/1foq95j
@r_devops
Looking for Accountability Partners: DevOps Engineers Focused on Growth and Consistency
I’m a DevOps engineer working remotely and have been facing the usual challenges of staying productive and consistently leveling up my skills—especially with things like Kubernetes, cloud automation, and infrastructure management. I’m reaching out to see if anyone here would be interested in forming an accountability group to help us all stay on track.
Here’s what I’m thinking:
- Weekly Check-ins: We could have a quick sync-up (over chat or call) to discuss progress, roadblocks, and goals for the upcoming week.
- Sharing Knowledge: If you’ve come across a useful tool, resource, or best practice (whether it’s Terraform tricks, cloud infrastructure tips, or automation hacks), we can share it with the group.
- Focused Career Growth: Whether you're working toward certs, improving CI/CD pipelines, or learning a new tool, we can hold each other accountable for personal and professional growth.
I believe it’s easier to push through tough weeks and hit your goals when you’ve got a group supporting you. If anyone is up for it, drop a comment or send me a DM, and we can get something going.
Let’s help each other grow, stay consistent, and crush those DevOps goals!
https://redd.it/1foq65e
@r_devops
Learning in IT
Hi, i recently started my path in DevOps.
My time and energy are very limited because i have to study for some boring and brain consuming mathematical exams in uni.
I'm trying to figure out what are the best ways to learn the foundations of our field. Do you have any advice?
I'm not questioning what to learn (i'm following the standard learning path) but how to learn. Looking back from your experience do you have some advice to make it in a more efficiently way?
Right now my sources are: tool documentation (very very slow like always), youtube tutorials and general web search.
Thanks a lot 🙏
https://redd.it/1foml2c
@r_devops
I made an AI chatbot that makes a bit easier to manage servers - thoughts?
Hey all,
After one too many 3 AM server emergencies, I built a tool called SleeplessIntern. It's a chatbot that manages servers through conversation.
Quick rundown:
Chat with it like you're talking to a junior admin
It runs commands on your server via SSH
Handles multiple servers
Available 24/7
I've been using it for a few weeks. It's not perfect, but it's saved me a few late-night logins.
Curious what you think. Would you use something like this? Any obvious issues I'm missing?
Check it out if you're interested: https://sleeplessintern.com
14 days free trial
Thanks!
https://redd.it/1fxyzq0
@r_devops
mdtmpl - A dead simple Markdown templating tool
Finally head the time to put this one together quickly https://github.com/FalcoSuessgott/mdtmpl. Always annoyed me having to manually copy files and bump versions in README files. Maybe its of use for someone
https://redd.it/1fxvibo
@r_devops
Why We Chose HashiStack + NGINX Over Kubernetes for Our Service Discovery Needs
We recently switched from Kubernetes to Nomad to manage our infrastructure. There have been a few steep learning curves along the way.
https://journal.hexmos.com/consul-service-discovery/
https://redd.it/1fxljt0
@r_devops
does mongo Atlas(and any api) only uses my server's outbound connection? even when receiving back data from it?
kinda new at this, so I've heard its just the same opened outbound connection, which is used to send data back and forth from the DB to my servers and vice versa. as in, you don't need an inbound rule for DB access into your servers?
setup is MongoDB Atlas talking to AWS EKS/EC2's
https://redd.it/1fxb4xl
@r_devops
TomCat EOL Version with TomEE Plus
I would like to know why Apache TomEE Plus 9.1.3 is shipping EOL Tomcat Version 10.0.27 ?? As per research i have done it shows new vulnerabilities are not tested against 10.0.x branch.
The stable version of TomEE Plus is 9.1.3. TomEE Plus 10.x is a milestone version (if i'm not wrong Milestone stands for under development, please correct me if I'm wrong). The issue is recent vulnerability (CVE-2024-38286) is vulnerable with Tomcat and i can not update Tomcat separately that comes with TomEE Plus.
Can anyone tell me why they are shipping older Tomcat and potential resolution in this scenario. Thanks!!
https://redd.it/1fx96am
@r_devops
CKA Exam - is there a way to get multiple terminals in the test environment?
I keep hearing "virtual desktop with terminal and browser". I have a few questions:
- will it allow you to open multiple browser tabs for k8s docs?
- can you open multiple terminal emulators? Tabs?
- what desktop environment is it? Does the resolution adapt well to your personal machine's resolution (ie - if I access it from a 21:9 monitor, will it fill the whole screen?)
https://redd.it/1fx6p6v
@r_devops
X4: run commands to server via ssh protocol
Hi r/devops,
I wrote a tool in rust, which allows you to run shell commands to server via ssh with rich configuration in json.
## Why?
During my time as a DevOps engineer, I faced challenges with Jenkins. We needed a simpler and more lightweight solution for our deployment process, especially since our primary task was deploying a website on GitHub push events. Here’s what I found:
- Jenkins can be heavy and complex to manage.
- Unused features can lead to unexpected bugs.
### What X4 Offers
X4 streamlines the deployment process, making it easier to manage and more efficient.
I’d love to hear your thoughts or any feedback you might have!
📚 Blog on using x4 to deploy a website on aws ec2 instance: https://github.com/pwnwriter/x4/blob/main/.github/guide.md
✨X4 on GitHub: https://github.com/pwnwriter/x4
Thanks ❤️
https://redd.it/1fx4qpe
@r_devops
Need help to proxy locally to proxy to custom domain
I am trying to create a proxy using nginx (and caddy as well, whatever works), on windows.
So i have custom domain, let's say it is https://myapp.com which forwards to https://localhost:446. That is doable with caddy, nginx or even by just editing my hosts file in windows dir). I created my own self signed certificates, added to trusted root authorities - all good.
However what DOESN'T work - is rerouting https://somethingCustom.myapp.com => to be https://somethingcustom.localhost:446. Certificates fail as well but let's ignore that for now, i can start my browser without that check.
So how can achieve that:
1. Hosts file does not accept expressions, so that somethingCustom needs to be changed everytime manually as it's dynamic.
2. Tried nginx and caddy something like server_name *myapp.com , but that part didn't work, it just doesn't go there. (For caddy i needed to add tls internal, so it started without errors, just didn't forward anything).
So any tips about it?
https://redd.it/1fwyilw
@r_devops
Data Engineering is A Waste: Change My Mind
In the past years I've witnessed the growing trend of data engineering at companies ranging from small startups to fortune 500 enterprises. The same cargo cult pattern of spinning up teams and environments to grab any data they can find. Stream, replicate, dump, and extract nonprod and prod databases, object stores, logs, transactions, metrics, events, etc. Ingest market data, public and private APIs, Twitter feeds, Reddit posts, and internal tooling stats. Even Jira, Slack, and Google Workspace data is not safe under the guise of analyzing KPIs and improving performance. Then comes the ETL or DBT or XYZ process to dump it all into the "Data Lake", which 90% of the time means writing a fat check to Snowflake. And to make sense of it all you need the latest Machine Learning / AI powered Jupyter Notebook / Databricks / Sagemaker / Apache something clone with a team of data engineers. What value actually comes from all this? Do the graphs and reports from the Business Intelligence Tool™ bring such insight to justify the countless hours and thousands of dollars spent? I know I'm not the stakeholder or decision maker here, but I can't imagine what kind of output makes all of the above worth it. Change my mind?
https://redd.it/1fwwn07
@r_devops
Suggest courses that focuses on CI/CD pipeline and deployment aspect for frontend, backend and database
Hello everyone,
I am a full stack developer with 3 years of experience. I used to do MERN before but by now I have coded for almost every famous database.
I do have a working knowledge of AWS. I theoretically understand most of the services but haven't practically done anything in recent time. The last EC2 instance that I had created was almost 4 years ago.
So I am looking to broaden my horizons. I would like to be able to become the guy for my company who can deploy frontend(mostly react based), backend(mostly node based) and database(which can be either mongodb or postgres) and maintain continuous code pipeline from GitHub. I know both databases have managed services for them but I would still like to learn their manual deployments Just in case.
I am looking for something that will quickly get me started. I understand devops is quite complex and vast topic.
I just want to be able to deploy what I code myself but in professional and scalable manner. Something that would make my website with its all components live is what I am aiming for.
Can you guys suggest something that would help me out?
Considering I am a noob any suggestions are welcome.
Thanks a bunch in advance!
https://redd.it/1fwtbkg
@r_devops
Best practices for creating the GKE Autopilot Cluster using TF
Recently have been introduced to a new task which involves the creation of the GKE Autopilot Cluster using Terraform. I have taken the below code as the base for creation of the Autopilot Cluster. What are some of the important things do needed to be taken care of and also what are some of the best practices to be followed while creation of the Autopilot Cluster?!
https://redd.it/1foy4jk
@r_devops
Has anyone done Terraform <0.15 to 1.1x migrations?
Is it easier to just port resources over and start from scratch? Incrementally upgrade with a dummy state file in a branch?
https://redd.it/1fowt8r
@r_devops
Whats the best cloud for dev experience?
Ive only ever used aws so can’t compare to anything else. I assume there’s really only aws, gcp and azure, the other platforms are insignificant.
Internally at amazon developer experience is dog shit but they do put customers first, so I wonder how good aws dev exp is compared to others. For example, I thought logging and ci/cd on aws was kinda bad compared to modern solutions
Java spring seems to like azure, another framework I like only has gcp integration.
https://redd.it/1foqrzn
@r_devops
Terraform for SaaS configuration Management
I've been using Terraform for several years now and it's a always a bit of a love/hate relationship.
While I love having these out-of-the-box providers & ease-of-use, the terraform state has caused some issues before. This is sometimes due to how the provider was written and sometimes just purely because state management can be an issue.
However one thing I've recently been wondering about more & more often is that we often use Terraform for things like creating Azure DevOps resources & policies, SonarQube configuration, HashiCorp Vault configuration, Azure, EntraID, ... Basically everything that has a REST API / provider available. While this works well, it often creates these more complex scenarios for configuration & furthermore it will create a lot more resources than your typical infrastructure terraform scripts bloating terraform states.
Now if you do the typical google of "Terraform for configuration management" everyone will tell you to use Ansible, because for some reason everyone just thinks we're still talking about managing VM's with imperative scripts.
1. Has anyone else experienced this complexity when using Terraform for non-infrastructure resources, and if so, how do you manage these scenarios?
Furthermore we've often work fully GitOps in the sense that we will write down the variables in configuration files and then the CI can be used for Configuration Drift detection etc. but handling self-service at scale becomes cumbersome when you've got multiple repositories that needs entries to be added for new services.
2. Automating this usually just means automatically creating & merging PR's but I would like to here how other people manage the self-service situation with this.
https://redd.it/1fok935
@r_devops
So which monorepo tool do you suggest?
Hi,
I was considering using Bazel for my new project, but it seems to be pretty hated by the community - essentially people say that unless you are a 100 person shop you shouldn't even dream of using it.
Ok then - what is the alternative? What does the community recommend for a monorepo setup?
I am starting with a clean slate, but I will have a pretty typical stack, something like:
1. Typescript + React / NextJS for frontend
2. Python / Go / C++ / tbd for backend
3. Protos & gRPC for communication
4. Everything should ultimately packaged into a docker container, which is then run in the cloud.
I thought this would be a perfect fit for Bazel - many languages, but all of them pretty major (so they should 'just work' out of the box), all co-existing in the same repo. As the amount of code grows I can then start setting up build caches too. Bazel then outputs containers which I push to some cloud provider.
But the community seems to be vehemently opposed to bazel - I have never seen such strong (negative) opinions about a build tool before. Many many people complaining it's literally ruining their life :)
This is making me rethink my choice a bit. So here's the question to you: You hate bazel, but you want a monorepo. What do you do?
https://redd.it/1fokv44
@r_devops