86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
Any good script for running npm install inside every git repo of a folder?
I use a script to update to the last commit in a bunch of repos contained inside a folder, but sometimes, I get ts error, because I don't automatically run npm install. Is there a script or utility for automating npm updates? What's the best way to solve this issue?
https://redd.it/1hj0t5i
@r_devops
Christmas gifts
Maybe its a little late but what’s a Christmas/new year’s or just random gift that you would appreciate receiving from somebody? (Or that you have received)
I’ll start: a Tux Penguin desk toy or plush
https://redd.it/1hiqdo2
@r_devops
Jenkins or Girhub Actions
Hello engineers, do you use GitHub Actions for maintaining and automating the deployment of your EKS cluster or you use GitHub Actions. I am using Jenkins and I feel really confident with it, but I just wanna know which one is popular among you guys and why? GitHub Actions can ensure the infrastructure is at its desired state that is on the main branch in GitHub, but I can also use webhooks with Jenkins to do same thing.
I love you all for your input, keep doing great things!
https://redd.it/1hir6a5
@r_devops
How do you manage updates to 3rd party components, libraries and images with the development cycle?
I have to deal with a great deal of compliance and audits. In the automated scanners it finds a lot of things like there is a CVE in the version of this library you are using, or in the version of the base image we are using etc etc. The devs dont want to address it because of fear it could break things if they do updates. I want to establish a process where by it is the standard to at the beginning of a dev cycle to ensure each image is built with the most recently approved or latest updates. If we do this at the very beginning, and carry it through all the way the testing that happens should cover us if there are breaking changes. I cant imagine this would be common. Someone would have to be responsible for creating a list of all libraries we use, track those and document what is in use etc. But we have to stop building up tech debt a mile high with all the updates the scanners say we should do. Sometimes the scanners disagree on what is actually fixable so there is that. But i am very curious as to what you guys do? I am trying to write up a policy for this and say hey "here is how it is going to work from now on" So what do you think? Any other good write ups on best practices for this?
https://redd.it/1himxby
@r_devops
I made it all the way to CTO just to be glorified tech support...
I worked my entire life to get to this point in my career. I am 42, make 6 figures, have multiple clients, built several of my own small businesses, helped dozens of people build or expand theirs... but I still get talked to like am level 1 tech support.
Does it ever change or am I just working with the wrong people?
EDIT: My issue isn't with the tech team. We get along great. It's the CEO/CMO, etc., who talk down to us, don't see the value in tech and only come around when there's an issue. As the "CTO", I am responsible for the outcome, but I get no say in how we get there...
https://redd.it/1hikt6o
@r_devops
Do you believe these influencers who say they've achieved great DevOps feats in short periods of time? i.e. 6 months, 1 year, etc.
In the past couple of years I've noticed quite a few influencers across the space of youtube, linkedin, etc., within the world of DevOps.
I really enjoy a lot of their content and find there can be great nuggets of information inside.
The thing I always doubted was how good some of these Engineers actually are - especially when a few of them make claims about transitioning from non-tech jobs to DevOps all within a period of months.
Recently, my doubt has been brought into question. Working at a Cloud Consultancy, there was a Junior DevOps Engineer brought in - We hired 3 individuals all from completely non-tech backgrounds but showed the motivation to want to learn. We could hire these engineers cheap, train them up, and they will help with tickets as they learn. A win win for them and the company.
They were all immediately very useless. Completely new to linux, cloud computing, etc. So there was a lot of hand holding early on.
However, one of the 3 individuals really stood out to me. He knew NOTHING. He told me early on that he really enjoyed watching NetworkChuck at home, and tried a few things - but was very much at the beginning.
I noticed within the first couple of months he started taking on tickets without much hand holding, he was contributing to conversations. Then bit by bit I noticed him really being very clear in conversations. He was able to add knowledgeable chunks of information. He got AWS SAA certified very quickly.
His Terraform went from terrible, to really good.
After 1 year, it was so stark his level of competency to the other 2 Juniors. He even started to take charge on some of our projects - having conversations with customers.
I witnessed him in a call do a screen share and implement some operators with one of our K8s clusters - he was really snappy, and he was live troubleshooting in a really smart way.
After, I spoke to him. He told me that he works at the company 8 hours a day. But before work, he puts in about 3 hours of self-learning. Then after work he goes on for a long period. Only stopping to make food, and on some days a visit out to get some fresh air.
He lacks confidence. He comes to me sometimes with all the correct answers, but asks for me to check it over. Confirm with me before he makes a major update. But it's all correct.
I've always believed up till now that this was a fallacy - but this one individual, albeit a bit rough round the edges and lacking in full combat experience, he's light years ahead of where he was where he started. And it's honestly lit a bit of a fire under me to spend some extra time strengthening my weaknesses.
https://redd.it/1hijbxy
@r_devops
GopherDrop: A Simple, Secure Way to Share One-Time Secrets and Files!
Hello /r/devops folks
I just finished building GopherDrop, a self-hostable tool inspired by Bitwarden Send. It's a secure REST API and UI for sharing one-time secrets and files. Built with Go for the backend and Vue.js with Vuetify for the frontend.
You can check it out here: Github Link
Would love to hear your thoughts and suggestions since this is my first open source project.
https://redd.it/1hifr71
@r_devops
ELK Stack implementation on EKS Cluster in AWS
So I am trying to implement ELK Stack (ElasticSearch, LogStash and Kibana) on AWS EKS Cluster to monitor nginx logs
No matter what I do it doesn't happen and I am not able to figure out what's in the wrong.
If all the pods are up and running then the nginx indices don't seem to appear in the Kibana dashboard.
It would be helpful if anyone has an in-depth guide or reference anything on the internet to achieve this task.
https://redd.it/1hiehxp
@r_devops
Transformers: The Engine of Modern AI
I wrote an article summarizing the most-watched YouTube video explaining what a transformer is in the context of Large Language Models (LLMs). It breaks down the key concepts in an easy-to-understand way. I'd love your feedback
rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e">rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e" rel="nofollow">https://medium.com/@rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e
https://redd.it/1hibz4y
@r_devops
Career advice Data Engineer vs Devops
Looking for some career advice, I have been working as a Platform Engineer for the last 4 years, doing the run of the mill Devops tasks, monitoring, docker, K8's, creating AWS architecture in the CDK
I got laid off 2 months ago and am sitting on two offers, one a DevOps engineer with a start-up but in a good area and getting lots of funding, but it's with Azure/Terraform and they are migrating to GCP so would be able to get exposure to all 3 cloud platforms but contractually based in the office 2 days a week but they say it's "flexible"
The other a fully remote Cloud Data Engineer position in a gobal company worldwide, same pay as the devops position but more focusing on AWS data ETL pipelines with Glue/Lambda and S3 and is IaC with the CDK
Would accepting the DE position hurt me career wise or would I be able to with my experience in DevOps hop back in after a year or two? Or would adding the DE experience be better longer term? Much prefer the fully remote role but don't want to be getting out of devops and having knowledge of all 3 cloud platforms would definitely be super good longer term. Any advice?
https://redd.it/1hhu4nu
@r_devops
Would being dependent on AI impact job interviews?
I’m a mid level engineer with 3 years of experience in software engineering and over a year of experience in devops work, all with the same company where I started my career. Now, I'm ready to move on but I'm feeling insecure about my dependence on AI to write my code.
For example, I work regularly with jenkins, terraform, aws, bash scripts, ansible, prometheus etc. However, if interviewers ask me to write something entirely from scratch, I most likely won’t be able to do it. There are so many tools and languages to learn for devops works that I feel, with my level of experience, I understand the concepts but only have a surface level understanding of these tools to perform my job while relying heavily on google and AI.
Would this be a problem in job interviews? What are the expectations for someone at my level? Would understanding the concepts be enough? What are devops interviews like?
https://redd.it/1hi72gl
@r_devops
How to reduce data egress costs?
Working on an idea. and I ran the numbers for 5000 users downloading .5GB per day, totally to 75TB per month. AWS major costs are storage and data egress. Skipping storage costs for now. Data egress charge is .09$ / GB which brings it to 6750$ / month. [About 6L INR / month\]
6L / month for mere 5k active users. And here I was, thinking about bootstrapping this. Need suggestions on how this cost can be reduced.
https://redd.it/1hhxxyi
@r_devops
Tool to analyze actual EBS usage
Hi!
We've been seeing many people playing with databases on Kubernetes using various operators like cloudnativepg or zalando postgres operator. One of the main problems of running stateful workloads on Kubernetes is persistent storage.
On AWS, EBS is a typical solution, exposed via CSI. The problem with EBS is in how it’s provisioned and utilized. Databases allocate storage capacity (GBs) and performance (IOPS) dynamically and planning for future needs, not to run out of storage. This "future-proofing" mindset leads to a significant EBS underutilization.
For example, a database might have 1TB of storage and 5,000 IOPS allocated but only actively use 200GB and 500 IOPS on average. The remainder is essentially a "cloud waste" and 100% gross margin profit for the cloud provider.
We had an idea at simplyblock to create a tool that helps to provide visibility into actual EBS utilization on EKS. Provisioned vs effectively utilized. Based on many numbers floating on the internet and based on what we see ourselves, the effective utilization is usually at 20-30%, meaning that 70-80% of provisioned EBS volumes seat idle.
The tool runs in your EKS cluster and exports a CSV file with all volumes and their respective usage information. We also built a small calculator to provide a fast way to get insight. The calculator is a pure in-browser tool and does not upload information to our servers. More info on the github repo:
https://github.com/simplyblock-io/ebs-volume-usage-exporter/
Would love to get some feedback.
https://redd.it/1hhxt1p
@r_devops
Your suggestion for lambda triggers a function in our hosted app?(aggregation script mongo atlas)
I’m using event bridge+lambda to trigger a service inside my app.
It sends a POST request to an end point(secured with jwt token) to activate the daily service.
Now I have another service I need refresh, probably use same setup.
My question -
I tried to trigger something in mongodb atlas/cloud (aggregation script), which in turn requires me to whitelist my lambda ip.
Now lambda is serveless. It doesn’t have an ip. Gpt offered to connect it to a NAT. Not sure if that’s an overkill and too expensive.
So my solution is use an endpoint to trigger the aggregation script inside the app. And let lambda trigger it via endpoint.
Is that reasonable?
https://redd.it/1hhu6ib
@r_devops
Help with EXIN DevOps Professional certification training
Hello everyone, my company required me to get the EXIN DevOps Professional certification, but there is not much learning material laying around besides The DevOps Handbook by Gene Kim. I already work as a DevOps engineer so I have experience with CI/CD, deployment techniques and other topics covered by the certification.
Do you have any recommended websites/resources available to study and practice more?
https://redd.it/1hhssj8
@r_devops
Completely Private and Secure Profile Stats Generator for your GitHub README via GHA using Golang and GraphQL
I created a GitHub Action to get statistics for use in your special GitHub repository.
https://github.com/mahyarmirrashed/github-readme-stats
https://redd.it/1hithzk
@r_devops
Why Seamless Split Payments processing system
With e-commerce at the forefront nowadays, the need for innovative payment solutions is higher than ever. One such challenge is a dispersed checkout experience rasvihostings/seamless-split-payments-processing-system-d42200107ca7">when one has to split payments among multiple sellers in one transaction. How to handle this complexity is a challenge that every multi-vendor platform, marketplace, and collaborative service provider needs to address.
rasvihostings/seamless-split-payments-processing-system-d42200107ca7">rasvihostings/seamless-split-payments-processing-system-d42200107ca7" rel="nofollow">https://medium.com/@rasvihostings/seamless-split-payments-processing-system-d42200107ca7
https://redd.it/1hisa9l
@r_devops
Pratical roadmap to DevOps in 2025
"People aspiring to get into DevOps in 2025, here are some tips:
* Do not learn Jenkins, it is becoming a legacy tool, it's a pain to manage and it does not make any sense to deal with Jenkins and its plugin world when we have great, easy-to-learn and manage tools like GitHub Actions and GitLab CI. These tools even integrated great security tooling within their ecosystem.
* Do not need to learn Ansible as it's not used much these days except for baking up images. When you are just getting into DevOps, adding one more tool you can live without is not recommended.
Instead, focus on below tools:
* One cloud platform
* Linux and Docker
* Python
* Kubernetes
* Terraform
* GitHub Actions (or GitLab CI)
Also, learn about logging and monitoring along with Devsecops principles. GitHub and GitLab both have great integration of security tooling which you can use.
Learn about the DevOps culture, process, and what problems DevOps solves.
Don't just learn the basics but also use these tools to build and practice real-world projects. Create an end-to-end software development lifecycle to understand the bits about how a real-world environment works. Understand the troubleshooting techniques."
P.S. I know a lot of people will have a problem with my first point, feel free to bash me.
The point is to start small and get into DevOps by learning the most used tools. once you are in you can learn whatever you need to solve the problem. Those who are just getting into it should not get overwhelmed by the long list of tools most people suggest. the tools I mentioned are enough to get into DevOps.
Those who
If you are looking for AWS, DevOps projects to use, try these
https://github.com/akhileshmishrabiz/Devops-zero-to-hero/tree/main/AWS-Projects
https://github.com/akhileshmishrabiz/web-app-on-aws-ecs
https://github.com/akhileshmishrabiz/python-for-devops/tree/main/python-automations-projects
https://redd.it/1hipbvu
@r_devops
AI in devops
I am a DevOps architect and have around 15 years of industrial experience. I am interested in knowing where all and which AI based tools(opensource please) you guys are using in your workplace? Also, in general, which AI tools would you recommend to boost observability, diagnosis and overall productivity as a devops engineer or architect?
https://redd.it/1hin79p
@r_devops
Open curated Remote-friendly startups that are well-funded and growing
FYI this is not another spreadsheet. I created this database of 350+ remote-friendly, well-funded startups that are building really cool things. No gatekeeping, waitlisting, or "pay for access". Hope this helps folks land their next big role //startups.gallery/categories/work-type/remote
https://redd.it/1hij8ml
@r_devops
Help starting with terraform
Hello everyone ! How are you ?
We need to start doing some full restoration tests of some of our systems that fall into SOC2 compliance. Once a year we need to grab the backups of this systems and restore them from scratch. This systems are all in AWS, and I'd like to take the opportunity to start learning terraform.
My idea is to have a repository that you would have templates that you can use for EC2 instances, RDS databases and ECS clusters.
I've already started going through terraform docs and it doesn't seem that hard. For example, I have an EC2 instance running a web server that has the database on RDS.
I want to come up with a solution that you run through terraform, so it creates a new instance and a new db from the backups we have. Of course, I have to come up with a template and configure the vpc, subnet, types of instances, etc etc.
Is there a place that you guys would recommend to start ? Maybe I'm not on the right direction here.
Thank you ! I'm already having fun with this lol. Happy holidays !
https://redd.it/1hiio8r
@r_devops
Should I Accept a DevOps Engineer Title at a product company from Senior DevOps Engineer?
I’m currently working as a **Senior DevOps Engineer** at a relatively small company with **4 years of experience** in DevOps. My current role involves end-to-end responsibilities, from designing infrastructure.
Recently, I received an offer from a **big product-based company** that is well-known and established. However, they are offering me a **DevOps Engineer** title instead of a senior one. The compensation package and benefits are great, but the title feels like a step down on paper.
I’m torn because:
1. **Pros of accepting**:
* Opportunity to work for a renowned company.
* Exposure to large-scale systems and possibly more advanced DevOps practices.
* Potential for career growth in a bigger organization.
2. **Cons of accepting**:
* The title downgrade could affect future roles if recruiters filter based on titles.
**what’s your advice?**
* Does the title matter as much as the experience gained?
* Would taking this role hinder my career trajectory?
* Has anyone else made a similar move, and how did it work out for you?
https://redd.it/1hidk6n
@r_devops
GCP Security Blueprint for Small and Mid-Size Firms
As organizations increasingly adopt cloud platforms to drive their business forward, security becomes a top concern. rasvihostings/gcp-security-blueprint-for-small-and-mid-size-firms-f559aa6cc61e">For small and mid-size firms, securing workloads on Google Cloud Platform (GCP) requires a practical and scalable approach that balances cost-efficiency with robust defenses. This article outlines a GCP security setup blueprint tailored for such organizations, leveraging best practices, native tools, and proven principles.
rasvihostings/gcp-security-blueprint-for-small-and-mid-size-firms-f559aa6cc61e">rasvihostings/gcp-security-blueprint-for-small-and-mid-size-firms-f559aa6cc61e" rel="nofollow">https://medium.com/@rasvihostings/gcp-security-blueprint-for-small-and-mid-size-firms-f559aa6cc61e
https://redd.it/1hidamw
@r_devops
Transformers: The Engine of Modern AI
The world of artificial intelligence (AI) has witnessed a dramatic shift in recent years, powered by a groundbreaking neural network architecture known as the rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e">transformer. From chatbots like ChatGPT to image generators like DALL-E and Midjourney, transformers are at the heart of this AI revolution. This article aims to demystify these powerful models and explain, in simple terms, how they work.
rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e">rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e" rel="nofollow">https://medium.com/@rasvihostings/transformers-the-engine-of-modern-ai-04cebc28da0e
https://redd.it/1hibs6m
@r_devops
How do I monetize my tech blogs and contents
I typically receive around 2,000 views and 1,000 reads per month on Medium. My Reddit posts often reach between 100,000 to 200,000 views within 48 hours and receive many likes.
I write tech blogs, and I've recently been contacted by a blogging platform with a reported 10 million views on their blogs, and they've approved me to publish my posts there.
With a background in DevOps and SRE platform engineering, I’m looking for ways to monetize my content.
Is it possible to make money through newsletters?
How feasible is it to earn $2,000 per month with this kind of audience?
Most of my audience is based in North and South America. Just yesterday, one of my posts on Reddit almost went viral.
rasvihostings" rel="nofollow">https://medium.com/@rasvihostings
https://redd.it/1hi7hso
@r_devops
AWS IDC alternative for Google Cloud
I've looked into GCloud Identity but still don't think it offers everything that AWS IDC does specially controlling resource level access using usergroups and iam roles. Also need something like that start page that IDC offers. Maybe I'm not utilizing GCloud Identity fully ? Can anyone point me to what I may be missing.
https://redd.it/1hhxuoq
@r_devops
Setup a k3s environment on VPS
Hi.
I want to setup a k3s cluster on VPS for learning because it's cheaper than a cloud provider. We use EKS at my company but for learning purpose I want something cheaper.
I want a VPS for k3s, do I need another VPS for control plane or can just use same VPS for control plane and pod? Don't care about scalability or availability for this context.
I want a VPS for a database, so no install from a k8s/k3s, I don't think I need a kube cluster for that.
And I want a NATS server too so no need to be scalable.
Do you have some link
If I want something cheaper I can just have only one VPS and install everything as pod but by separate the db and nats server I will learn communication between multiple server.
Don't hesitate to share some links :)
Am I going in the right direction? You will tell me, if I install everything on the same server I can use minikube but I want to use CI/CD to deploy directly on the server(s).
https://redd.it/1hhy1lz
@r_devops
Helmtui: A terminal UI for Helm
# Hey everyone!
I wanted to share a small side project I’ve been working on: Helmtui. It’s a terminal-based UI for managing your Helm releases.
# What Is Helmtui?
Helmtui is a lightweight terminal UI that helps you:
* View information about your current Helm releases
* Install new charts with ease
* Check the packages and repos you’ve added
In short, it’s a handy tool for Helm users who prefer the terminal but want a bit more convenience.
# Why Did I Build It?
I’m a DevOps engineer, and I use Helm a lot. I often found myself typing the same Helm commands over and over again—it’s not hard, but it’s time-consuming. I wanted a faster, more streamlined way to handle Helm tasks without leaving the terminal.
On top of that, I’ve been wanting to learn Go, given how popular it is in the DevOps ecosystem.
While there is already a Helm UI plugin such as helm-dashboard, I personally find it overkill for most of my use cases.
# Why Am I Sharing This?
I'm quite new to Go, and I’d love to get some feedback on the code, the UI, or even just ideas on how to make it better. If you’re someone who works with Helm, I’d really appreciate it if you could give Helmtui a try and share your thoughts!
Thanks !
[https://github.com/pidanou/helmtui](https://github.com/pidanou/helmtui)
https://redd.it/1hhvo3u
@r_devops
Iceberg
Hi,
The developers are planning to use iceberg and i am looking for guidance (best practices, useful tools, etc). So far they are using popsql to connect to AWS Athena. Any recommendations are greatly appreciated.
https://redd.it/1hhsz7a
@r_devops
Any idea how to know istio well
I know that istio has some or the other new things to learn, I want to know the practical side of istio, more of maistra than istio, any suggestions on this
https://redd.it/1hhoqre
@r_devops