86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
Getting asked to essentially reinvent the wheel with a clients CICD, any opinions?
Hello, not sure if this is the place to ask but heres the scenario..
Have been brought in as a consultant at a large organization, I work mostly on CICD stuff in Github actions/Other DevOps stuff.
Client has 2 products, call them product A and product B.
Both of these products have some middleware in them that is helping to manage the logins, and uses some 3rd party software. The environments for both product A and B are very similar, and will be managed in almost exactly the same way.
Product A already has a great CI/CD pipeline built out for it, it works well save some small inefficiencies. Product B has nothing, but they have said that they want a CICD process built, and to mirror Product A as close as possible.
Thing is, I don't know what to do - the software that the CICD will be targeting will be the exact same, so if I build this out for Product B, it's going to be almost an exact 1;1 copy paste job of Product A, and I would feel like an idiot doing that and calling it a job well done. They are similar enough that I believe I could fully manage Product B Using the existing CICD for product A if I just changed enough env variables to point at product B - the main reason they want a new CICD pipeline is because the products are owned by different business units and require their own CICD.
Any opinions?
https://redd.it/1fzlhvy
@r_devops
Best Postgres operator for production use in Kubernetes
Hey Guys,
I am exploring on using postgres db in kubernetes and I have come across many open-source operators but couldn't really finalize on anything. Does anyone here know something on this ? I am trying to setup Highly Available Postgres cluster with below configurations -
* We use Azure as cloud so would want backups of db to be taken on Azure Storage Accounts
* Should support deployment through Helmcharts(Open Source Helmcharts if any)
* Should integrate well with Azure WorkLoad Identity to access storage account without having to use access keys.
Any suggestions on this ? Thanks in advance
https://redd.it/1fzk91l
@r_devops
A Song About DevOps?
I was in a meeting the other day. A colleague commented to me in Slack that she wanted to change the words to "Mother" by Pink Floyd:
>I really want to repurpose Pink Floyd's Mother
DevOps, do you think they'll block my code
Hush now developer, don't you cry
DevOps's gonna check out all your code for you
DevOps won't let anything dirty get through
Based on that, I knocked out some lyrics (with a little help from ChatGPT), and ended up with this:
https://youtu.be/-rOdt-23lU8?si=TPivx\_aL7OLTs2Q8
As a DevOps (the philosophy) advocate I have mixed feelings about my own work here, but thought I'd share it and see what others think. :-)
https://redd.it/1fzerp3
@r_devops
Thoughts on AI tool saturation
With the rise of AI chat bot companies, I am getting bombarded with ads for different AI tools that will supposedly make devops a piece of cake.
What are your thoughts on all these tools? All cash grabs? Or have you encountered any that are worth it?
https://redd.it/1fz708w
@r_devops
Need some guidance on CI/CD project with docker compose
Hi guys!
I'm doing a course at my University which has the final requirement of showing a simple app running on the cloud. We must use GitHub+GitHub Actions to build a docker image (using a dockerfile), and that image gets pushed into the DockerHub registry. I'm also using docker compose, so I can locally pull a postgres DB and initialize it with scripts.
That's going well. GitHub is pushing the images of my backend server (dev and prod images) to DockerHub. Then, I created an account in Render to pull the prod image and run it there. All good, that's working.
The thing is that the application works only if the postgres server is running along, something I can achieve locally. What do you recommend me to do in order to have the stack running online for the demo?
I can imagine this is not the proper way of setting up a DB server along with the API server, but I only need this setup for the project delivery and then I'll tear it down and build something better off of this.
https://redd.it/1fz9c22
@r_devops
How to improve with AWS
Hello Im working as DevOps lime for 3-4 years
Since last year i started doing stuff with AWS. I have some experience with Docker and Kubernetes. Also i trobleshoot network issues on premise so I was able to solve the problems i faced on ECS and EKS with a lot of tutorials and some questions to chatgpt to be honest
When they ask about my AWS experience I get kinda nervous because its something I learned working and I never been on a course or certificate .
Do you know what I could do to learn more about cloud? I think I can skip some basics as I already have experience on it
Thanks a lot
https://redd.it/1fz62mx
@r_devops
HashiCorp Vault - Dedicated vs K8s
Hello, I have a microservices-based (21 microservices) application running on Azure Kubernetes service. We have 4 clusters, one for each environment.
Now, we have to integrate the HashiCorp vault into the system. And please help me choose whether should I go for a dedicated VM for the vault or should I deploy it in Kubernetes (what should be the structure then?).
Highlight the pros and cons of each approach.
PS: In our use case, there won't be a lot of dynamic secret creation and heavy usage of the vault.
https://redd.it/1fyxlc7
@r_devops
Advice || JPMC vs Razorpay
I recently got offer from both of the above companies for the role of Devops.
To be more specific Jpmc is offering - Software Engineer 2 - Devops (Python) in their CIB unit while it’s just devops role in Razorpay.
Now, I am from a product based fintech company with approx 2.5 years of experience in devops.
My main concerns are :
1. Which one will be better as a learning opportunity and growth?
2. Will choosing one over another have any major impact on my resume?
3. What major difference in their work culture can I expect?
4. Compensation of JPMC is more compared to Razorpay(almost 10 - 12%) so should I be looking at this factor at this stage or not?
5. Also will esops of razorpay make any difference? They are offering almost 10 lacs worth of esops.
6. If you were faced with this situation which one would you choose and why?
https://redd.it/1fyxgo0
@r_devops
Consider study abroad (US, CA, UK, Germany, AU)
Hello guys,
I'm a bachelor in Vietnam and my job title is DevOps Engineer with about 2 YoE. I can code backend with Go, TS, Java and know some security stuff. At first glance, I thought to come to Canada for studying master degree. But lately I found that EU countries (Germany, UK,...) may have more chances to get a job. What do you think about these countries or do you have any recommendation? Instead of frontend (I can only do it basically), I can work as a backend engineer or devops engineer.
https://redd.it/1fyrkw2
@r_devops
mid devops interview capital one
Hi everyone, I'm preparing for Power Day but I'm unsure about where to focus my efforts. This is for a mid-level DevOps engineer position. Has anyone gone through this process as a DevOps engineer before? I was told the interview will have questions about docker, bash and cloud architecture. I’d appreciate any input or advice. Thank you!!
https://redd.it/1fyi1xi
@r_devops
In k8s exams (cka, cks, ckad) - is "vi" the only allowed text editor? Can I use nano?
Copying from docs seems to save precious time and the most common complaint I see with the test environment is that copying into vi in the test environment causes all hell to break loose.
Nano seems pretty reliable for these cases and im also a fan. Is it allowed?
https://redd.it/1fye3le
@r_devops
Migration from monolithic to microservices architecture
Hello,
I'm going to migrate a monolithic system to a microservice architecture. What resource you advice me to read to know the main challenges in this area? I'm a full stack developer with 6 year of experience, my management asked me to lead this project on the system I know well, but I've no experience with those migrations.
Our environment is .NET, we use .NET Framework 4.8, but want to upgrade to .NET 7/8. we use ASP.NET MVC to create our html pages, but we could swap to react or vue if needed.
https://redd.it/1fy8jx2
@r_devops
Easiest method to upgrade k8s to latest version?
Hey everyone,
I’ve been tasked with the somewhat tiresome job of upgrading our Kubernetes cluster from version 1.25 to the latest stable version. Our workloads and dependencies are quite sensitive, so I need to ensure everything runs smoothly during and after the upgrade.
Here’s my current setup:
- Running Kubernetes version 1.25 across our clusters.
- Using kubent to identify deprecated APIs, but it’s not showing anything significant.
- We have some complex workloads, and maintaining uptime is critical.
Now, I’m wondering what the best approach to handle this upgrade is:
- Should I use Terraform to manage the upgrade process, or is there a better tool for this?
- How can I easily manage the upgrade without breaking anything?
- If you’ve been through a similar upgrade, how did you handle it?
- Any specific recommendations for preparing before jumping from 1.25 to a more recent version (we’re thinking of going to 1.29 or 1.30)?
I appreciate any advice or tips on minimizing downtime and ensuring our workloads transition smoothly with the least risk. Thanks!
https://redd.it/1fy9kt9
@r_devops
System Engineer vs Cloud Engineer
Hello, I am a graduating senior studying CS who aspires to work as a DevOps/SRE one day. I am currently interviewing for a Jr Systems Engineer and a Jr Cloud Infrastructure Engineer this month and I’m want to get an opinion about what would better prepare me for/lead to a DevOps role. I don’t have many details on the job descriptions yet, but I just wanted to see what is a more common transition.
https://redd.it/1fy6jv7
@r_devops
Introducing docker-monitoring-stack: A Docker Compose Stack for Monitoring with Grafana, Prometheus, Loki, and more
I released a project called docker-monitoring-stack some time ago. It’s a Docker Compose stack that includes Grafana, Google cAdvisor (for container metrics), node-exporter (for node metrics), Grafana Loki (for logs), Prometheus, and Alertmanager.
Why is it useful?
This stack makes it super easy to set up monitoring for Docker environments. With one command using the Makefile, you get pre-populated dashboards and alerts to monitor your containers and nodes.
Features:
Grafana for metrics visualization
cAdvisor for container metrics
Prometheus for TSDB
Loki for log aggregation
Pre-configured dashboards & alerts
One-command setup with a Makefile
Please feel free to check it out and give it a try.
Repo: https://github.com/ruanbekker/docker-monitoring-stack-gpnc
https://redd.it/1fy4hy4
@r_devops
Build a Custom AWS CDK Construct for Automated Text Extraction Using Textract
Learn how to easily create reusable AWS infrastructure using CDK custom constructs: https://differ.blog/p/how-to-build-a-custom-aws-cdk-construct-for-automated-text-extraction-using-textract-lambda-and-39fe4e
https://redd.it/1fzkzm4
@r_devops
A Devops role requires much more than a Devops course/guide.
You can't learn Devops with a 1-12mo guide/course, the problem with learning through a guide is its a guide, in the real world you will have 1-n tools that can do x but you need to understand when to use tool #1 vs tool #2 vs ... The amount of successful Devops deployments I've seen by people that have transitioned to a Devops role without years to decades of experience is zero and is a liability to the organization. You might argue an org shouldn't put someone green into a position of power but Devops is like the wild west where non-technical orgs see "Azure", "AWS", "Devops", etc on a resume it means they can successfully transition an org to a cloud provider.
If this comes off as you need x years of experience to be successful in a Devops role for what most orgs want to do (transition to a cloud provider and modernize), you do as it's more than just Devops it's understanding the org technical ability and possibly implementing project management, etc.
https://redd.it/1fzbbtg
@r_devops
How can I find good examples of using Pulumi with Go?
As the titles says.
Good examples on how to manage Pulumi + Go.
I'm looking for OSS projects that actually deploy stuff, not just tutorials/examples.
https://redd.it/1fz8owa
@r_devops
Continuous Integration Pipelines (with appropriate testing patterns defined), design pattern guidelines
Hiya,
I am trying to come up with a new continuous pipeline design for a new team thats coming onboard. Their design need is different from what we usually have currently onboard.
I want to take opinions on how or what guidelines we usually need to keep in mind before coming up a proper continuous pipeline design setups?
I know it's a very vague ask, but I am honestly looking for a birds-eye view here to begin with. Never setup anything from scratch and its my first time here... So :-)
https://redd.it/1fz7zd4
@r_devops
Dynamic DevOps Roadmap website is out!
A few months ago, I posted about Fixing the broken DevOps learning roadmap! (aka how to be a DevOps Engineer in 2024!)
Which provides a FREE roadmap approach to the DevOps career that is a bit different.
By today, 70% of the roadmap was done, so I created the website to make the content easier to read.
I decided to go with the Docusaurus, which was the first time I used it in a personal project (I used it at work) ... I'm a big fan of static CMS, and I used Hugo a couple of times, but I totally loved Docusaurus for structured docs.
⭐ Visit the Dynamic DevOps Roadmap website ⭐
Feedback is appreciated.
Enjoy 🙌
https://redd.it/1fz71kl
@r_devops
A Cloud Guru vs. KodeKloud ?
What do you prefer and why?
https://redd.it/1fz4t4u
@r_devops
Please Review my resume guys! Hard to get interviews since LAYOFF
https://imgur.com/a/J3xuIz3
Kindly let me know where I am going wrong. Hardly get any interviews
https://redd.it/1fyygu3
@r_devops
What Are the Best DevOps Tools for a Beginner? Where Should I Start?
Hi,
I’m just getting started in DevOps and trying to figure out where to focus my learning. There are so many tools out there like Jenkins, Docker, Kubernetes, Terraform, and more.
For someone new to DevOps, which tools should I prioritize learning first? How did you approach getting familiar with these tools when you started? Are there any that are easier to grasp or more foundational than others?
I’d appreciate any advice or resources you can share to help me get started on the right foot!
Thanks!
https://redd.it/1fyvwlp
@r_devops
Server started on GCP VM only ocasionally acessible through domain
I have a py/flask/socketio/nginx app on the VM, connected to my external domain. Sometimes when starting the app, the domain is accessible fine, but upon trying again a few hours later its no longer accessible(Error: Page not found
The requested URL was not found on this server.), even if nothing changed. And vice-versa also happens (not working then randomly working again).
What could possibly be the problem?
https://redd.it/1fyo5wd
@r_devops
Hi Guys Good morning! Could you please review my resume and let me know if any changes are needed?
This is the Imgur URL: https://imgur.com/a/pPO7YXw
I am unable to post the photos here, so I would appreciate it if you could take a look at the URL and let me know if any changes are needed.
Thank you very much for your time and feedback!
https://redd.it/1fyfvsk
@r_devops
How well does your DevOps team get along with the IT team?
At one company I've seen the IT team work so closely with the DevOps team, they were almost one and the same. While at another the IT team was the finance blocker when the DevOps team wanted to buy products, which resulted in an all around adversarial relationship. If you have a good relationship, what has helped facilitate that between the DevOps and IT teams? At a high level, which teams own which components? Any advice to promote a more harmonious relationship is appreciated.
https://redd.it/1fycj15
@r_devops
Platform engineering tools
Good chances I will be tasked with implementing a service catalog - we have a recently formed platform engineering team. I’m not sure what I think of this (I was actually planning to move into something else in the org), and will be either asked to implement a microservice catalog (think backstage) or full internal developer portal, like port or configure8.
What tools has your organization used and why? How long did the set-up take and what did you like or dislike?
https://redd.it/1fybdff
@r_devops
free Kubernetes CKA & CKAD practice exams
check out these free practice exams for the Kubernetes administrator (CKA) and the Kubernetes application developer (CKAD) on medium
karani_ph/certified-kubernetes-application-developer-ckad-practice-exam-with-well-explained-answers-0e6191dfee78">karani" rel="nofollow">https://medium.com/@karani\_ph/certified-kubernetes-application-developer-ckad-practice-exam-with-well-explained-answers-0e6191dfee78
karani_ph/certified-kubernetes-administrator-cka-practice-exam-with-well-explained-answers-2aa1e56383bd">karani" rel="nofollow">https://medium.com/@karani\_ph/certified-kubernetes-administrator-cka-practice-exam-with-well-explained-answers-2aa1e56383bd
https://redd.it/1fy8tbb
@r_devops
Sample Json of cloudwatch - windows
Can anyone show me how does a sample json looks like for windows , probably located in - C:\\ProgramData\\Amazon\\AmazonCloudWatchAgent\\amazon-cloudwatch-agent.json for all metrics which is possible via cloudwatch.
https://redd.it/1fy68e7
@r_devops
My first CI/CD pipeline
Hi,
I'm working on my first CI/CD pipeline for a university project using GitLab, and I could use some guidance.
I’ve set up different stages and jobs as follows:
- test
- build
- development
- staging
- production
Test: Runs various Python script tests.
Build: Creates a Docker image and pushes it to my Docker Hub.
Development: Pulls the Docker image and deploys it to an AWS EC2 instance.
The part I’m unsure about is how to handle the staging and production stages.
For these, I’ve created two different EC2 instances and manually pushed to them using:
when: manual
script:
...
The deployments are working, but both stages use the same Docker image from Docker Hub. Here’s what I’m unclear about:
How should staging and production typically interact with the Docker image?
Is it common for the development stage to create the Docker image on EC2 and run tests there, or should the staging be a separate EC2 instance where changes are tested?
Once changes are made, should I push a new Docker image and then pull it to the production EC2 instance?
Thanks to anyone who can help clarify this process for me!
https://redd.it/1fy4brj
@r_devops