Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
Unpopular opinion: why do you hate GitHub actions ?
I know it’s a popular and robust tool but is there any reason you don’t like GitHub actions could be performance issues, debugging workflows or whatever reason.
https://redd.it/1cyo1xm
@r_devops
HashiCorp Terraform Associate Certification Rules
Hi guys.
I was just reading the exam platform rules listed on HashiCorp's website, and it seems, they require my entire full name registered on the exam platform as it is on my ID. Only realized this today, the exam day. Do you think the exam proctor will complain with the fact that only my first and last name are registered on the platform, and not the entire name?
Anyone out there already experienced this?
Any advices and tips regarding this issue, what can I do today, the exam day, to solve this issue and actually attend the exam?
Thanks in advance
https://redd.it/1cyoj4x
@r_devops
Coding or Devops?
Hii everyone, hope everyone is doing good.
I need some advice on my career path. So currently I have 2.5yrs of experience in IT field, from beginning i didn't like coding much, it gives me stress and pressure , adding to this my recent project is very new to me working on c# and .net mircroservices , which I don't know and not interested to work on. So I thought to opt out from coding side to devops side.
Is it good to choose devops field? I know it does need some coding knowledge which I think I can manage from my experience.
So can anyone please suggest me . Wheather should I go for devops or any other non coding jobs (please mention those jobs also based on my experience to which I can get into) or should I stay in coding side only(I really feel like I don't like coding, taking that much pressure)
Please help me. thank you
(If anyone is not having good day/days, I wish you will get your good days soon, stay strong)
https://redd.it/1cymnct
@r_devops
Blog about what is Devops
Hi all,
I wanted to share with you that I've written a blog about what DevOps is based on my experiences:
patrick.conte/what-is-devops-a5c43df9f367" rel="nofollow">https://medium.com/@patrick.conte/what-is-devops-a5c43df9f367
After having checked this sub for some time now, I have seen several posts about how to get into DevOps and what it is like to work in the space.
I'm hoping that this is able to help people on their journey if they are wanting to pursue this path.
Open to any feedback that you may have, or what you may want to see in the future.
https://redd.it/1cyebuu
@r_devops
Why people say Backstage is difficult?
Disclaimer, I’m a founder at Port, a Backstage alternative.
We keep hearing Backstage is difficult and don’t explain why. We took the first step and wrote an article one the root product-related causes that makes it hard to adopt and maintain. Would love to hear your thoughts and feedbacks.
https://www.getport.io/blog/what-are-the-technical-disadvantages-of-backstage
https://redd.it/1cy9x6o
@r_devops
What acc. to you is the most important quality for someone to succeed in Ops?
Basically, the question. Just curious about what qualities you think will help someone make progress really quick.
https://redd.it/1cy5qqa
@r_devops
Changelogs and tags for Bitnami Helm charts
Bitnami has recently rolled out several initiatives to enhance the user experience with Helm charts. These improvements focus on better traceability and smoother integrations.
+info: https://blog.bitnami.com/2024/05/enhancing-bitnami-helm-charts.html
https://redd.it/1cy312g
@r_devops
Is this udemy course good for senior sysadmin which want devops path?
https://www.udemy.com/course/decodingdevops/?couponCode=LEADERSALE24B
https://redd.it/1cxv8gk
@r_devops
What is a DevOps job like?
I'm a blind Ukrainian living in the UK and I'm looking for an IT profession where there won't be so much code.
Many times I was advised to consider becoming a DevOps.
I checked, and in my country (Ukraine) beginner DevOps earn $2,000!
I would like to know what their job is like? Do they spend all day fiddling with configs?
https://redd.it/1co4ocw
@r_devops
Need help for first technical test
So I am new in DevOps and this is gonna be my first job, I have technical test in few days and it is written that it will also have some ,,practical tasks with automation checks'' so probably they mean writing automation code, where can I practice it? probably it will be bash maybe python but I don't understand should I just go through some leetcode/codewars tasks or through some special tasks about automation? and if yes then where can I find them?
https://redd.it/1co1hz8
@r_devops
Step Functions vs something else
I follow this guy on YT, and he showed how chosing the wrong step function type (Regular vs Express) sent his cloud way too high... I like to build using Step Functions but I'm now wondering if there's another service that does achieves similar things without the huge bill
https://redd.it/1cnxklv
@r_devops
Best books/resources for understanding true scale and events
Hello I am a mid level engineer with a few years in the DevOps realm. I find myself still struggling to understand the consideration and challenges that goes into designing absolutely massive distributed system.
Any books/resources? In particular, I am interested in learning more about FinTech payment processing systems, and they deal with trillions of transactions per month.
My current understanding of scalability is simply observing and monitoring the CPU and other metrics of a server, make use of autoscaling groups and built-in features of EC2 etc...
I have an AWS solutions architect cert, and I still feel woefully unprepared to even begin to understand the problem at hand. I have been in some medium-sized companies so I have no experience with anything that comes close to the scale that I'm trying to describe here.
Questions:
What are the limitations and constraints that engineers need to know when designing solutions when the scale and events are so big?
Any books that can answer this question more comprehensively?
I know this is a broad question so ANY TIPS would be massively appreciated :)
Thank you all!
PS: Both kubernetes and AWS-native design patterns would be welcome!
https://redd.it/1cnvmu4
@r_devops
Salaries for Southern Europe
Fellow DevOps engineers, what are the (or your) salaries for Junior (if there can be a junior Devops engineer), Mid & Senior.
I know that there are a lot of factors to consider, such as skills, YOE, benefits , working situation (remote, office, hybrid), so let's say average.
Curious since I feel my company offers less the average market, although they claim it's normal for the Country.
https://redd.it/1cntjs1
@r_devops
Ahrefs claims saving 1 billion by not going Cloud
Link: https://tech.ahrefs.com/how-ahrefs-gets-a-billion-dollar-worth-infrastructure-with-a-90-discount-5edd473b2399
HN discussion: https://news.ycombinator.com/item?id=40304549
Excerpt:
> Choosing colocation for the infrastructure was the right decision for Ahrefs. Reflecting on the past six years, the data centers with our own servers and network cost us $122 million, a figure that would have ballooned to an astronomical $1.1 billion if we had opted for the cheapest AWS cloud offering. Our powerful on-prem servers enable our developers to focus on enhancing our products for clients, rather than getting caught in a never-ending cycle of trying to optimize cloud costs with little hope of success.
https://redd.it/1cnqi0x
@r_devops
Why do companies select Azure as their cloud service rather than aws?
As title say, anyone has clues?
https://redd.it/1cnkk96
@r_devops
DevOps engineers in a big corp, what CI do you use and why?
devops engineer in a big american corp.
tech stack is aws, ecs, lambdas, some eks(migrating).
ci/cd is jenkins.
we have a one in a time chance to refresh the stack,
The big elephant in the room is still using jenkins.
We are accostumed to it, but some of the comments we got were that new CI systems are easier to maintain in scale over EKS.
consider that we may use backstage for the UI and develop all of the missing support ourselves....what CI would you use? github actions, tekton? Maybe something else?
https://redd.it/1cyp26j
@r_devops
What is the most hipster place to deploy a Rust based application?
I am working on an open-source GraphQL project - Tailcall, that I wish to deploy on a cloud provider. The workflow that I have in mind is this —
1. Write a configuration that Tailcall can read.
2. Commit and push the configuration on github.
3. Integrate the Tailcall GH Action in your `ci.yml` that can automatically deploy on some cloud provider.
I have integrated it with AWS, but even with our automated pipeline using GH Actions, the complexity of using AWS seems like a bit too much for users (especially Frontend Engineers). What are the other cool cloud providers that developers love deploying their applications on?
https://redd.it/1cynm2n
@r_devops
Best way in getting Telemetry to the backend
My company is choosing OTel as the telemetry framework we are going to adopt. I've been reading about the Otel SDK and Grafana Alloy, and a bit about Prometheus and Loki and I'm trying to understand how these elements reasonably work without any practical experience with them and would appreciate any feedback you have.
Application w/ SDK --- Collector --- Data backend = This seems to be the recommended components.
Application w/ SDK - Can push to Collector which will transform the data to export to the data backend.
The recommended configuration for an Application w/ SDK is to host an agent, which is basically a Collector, on the same host as the application, to handle transmitting OTel to the Collector.
Q. How bad is it really to run the Application without the agent, and just push with the SDK?
Q: Is the push model much worse than the pull model? At what level of scale does pull make more sense?
Q. Does it make sense to mix and match pull metrics, and push traces and logs? The service discovery for pull seems like just another thing to deal with.
Collector - Can be configured to pull metrics , can it pull logs and traces too?
Q. Is it as simple as putting a load balancer in front of Collectors, and just have everything blast things to Collectors?
I would really appreciate any answers to this. Thank you
https://redd.it/1cyigio
@r_devops
What does DevOps pay look like 2024 (esp. compared to SWE)
I'd like to know what devops pay looks like in today's market, esp. compared to SWE.
https://redd.it/1cyanpx
@r_devops
SonarQube and GitLab-CE Integration in Podman
Currently pulling my hair out trying to work this out ...
I want to setup my dev environment for my Python project such that ...
Redhat running Podman
GitLab CE running in a container - got that working
SonarQube running in a container - got that working
Got OAUTH between GitLab and SonarQube so can setup repo's / Projects
Now the bit I can not work out ...
I want to get it so that when I do a commit in GitLab to my project repository that this triggers SonarQube / Sonar-Scanner-CLI docker instance to run a code check against the commited project code and produce the report on the SonarQube server.
I have worked out how I can use the Sonar-Scanner-CLI via CLI to scan a folder with my code in and show that in SonarQube, but I can not work out how GitLab CI/CD can trigger all of this ?!?
Not sure if what I am thinking can be done or where I am going wrong ?
https://redd.it/1cy8q1y
@r_devops
Blog post Distributing Global State to Serve over 1 Billion Daily Requests
Post is here: https://render.com/blog/distributing-global-state-to-serve-over-1-billion-daily-requests
It walks through the eras of Render's state distribution architecture for routing requests to different user services. Includes a move from pull- to push-based caching, along with expansion from a single cluster and region to multiple.
Disclosure: I work for Render
https://redd.it/1cy51yk
@r_devops
What is the best approach for managing dependency versions in an TS monorepo?
I have searched through various articles/docs, but I haven't seen a lot of consistency in approach.
I am setting up a monorepo with a mix of projects - some Node services, some libraries, and a front end. What I'm curious about is the best way to set up all of the package.json
files, so that common dependencies are shared or at least use a consistent version. I have some questions based on various approaches I've seen.
It seems common to put the core build tools, linters, and frameworks in the root package.json
, but I'm wondering as to whether or not they also need to be defined in the sub-projects. For example, core stuff like typescript
and eslint
, which I want to use the same version across all projects, should I also add them to each project's dependencies? It works fine if I don't, as it walks up to the root node_modules
to find them, but I'm wondering if this is a good practice or not, since omitting them feels like I'm leaving that project's package.json
"incomplete" and just counting on them being available at the root. On the other hand, if I do add them to each project, how do I keep the versions consistent across all projects?
https://redd.it/1cxyshu
@r_devops
Optimizing OpenSearch clusters for observability @ Chase UK
Hey everyone!
We're back with another edition of the Observability Engineering London meetup. This time, we'll discuss how to get the most out of AWS OpenSearch for observability.
Eugene Tolbakov will discuss the process undertaken by the Observability team at Chase UK to manage AWS OpenSearch clusters effectively. Utilizing Infrastructure as Code(Terraform), they have streamlined cluster management for efficiency and ease. He'll elaborate on their approach for defining index templates and patterns, configuring roles, and leveraging ingestion pipelines to streamline cluster management.
Also, Eugene will outline the enhancements they've implemented to ensure a stable platform and enhance the overall Observability experience and share key insights and learnings from their journey toward operational excellence with AWS OpenSearch management.
If you're in town on June 4th, I'd love to see you there :D
RSVP -> https://www.meetup.com/observability\_engineering/events/301012291/
https://redd.it/1cxsvvt
@r_devops
I want to get into DevOps after college. Is my experience enough to progress to a junior sysadmin or cloud engineering role that I can use as a pivot?
https://imgur.com/a/1B1AvLd
Graduating this upcoming Saturday and about to start applying. I've been doing helpdesk/some sysadmin tasks for my college IT department for about two years and will be finishing my last week today. I have an internship as a cloud engineer that gave me some extra hands-on experience as well as personal AWS lab projects involving popular devop tools (Kubernetes, jenkins, docker, etc). Got my SA-A and Network+ last year. Went through the DevOps roadmap and am familiar with majority of the concepts. Will all this be enough to at least be considered for the roles i'm going for? I know that Devops right out of school isn't likely, so I want to try pivoting in a few years.
https://redd.it/1co329x
@r_devops
How do you deal with the cost and maintenance of multiple different staging, dev and other environments?
I am wondering how people here manage the existence of additional environments in addition to production - staging, testing, dev environments.
In my experience these can be heavy compute cost wise and this can also add up maintenance wise. I've in the past merged a few of these environments to reduce maintenance cost.
How do you work around this?
https://redd.it/1co0hti
@r_devops
CI/CD Pipeline for Node.js Backend on Autoscaling Group
I'm currently in the process of deploying a Node.js backend application and creating a Jenkins CI/CD pipeline to streamline the process. With my existing pipeline, I can deploy to a single instance by SSHing into it via its IP.
Now, my goal is to extend this deployment to the autoscaling group. Since I can't SSH to every single instance that will be created by the autoscaling group when requests increase, how do I achieve this?
Sorry if this is a very basic/dumb question.
PS: If this isn't doable by Jenkins, please let me know if there's another way to accomplish it.
https://redd.it/1cnx5q3
@r_devops
Automatic Tagging in a multi-repo setup
So in this scenario , you have 2 repos A and B that have a pipeline to create an image that is uploaded and named after the specific commit on its respective main branch.We have a repo C that uses docker compose for example and utilises a repository to access the images of each repo A and B. So my question is what is the best method for updating C so it's aware of any new images from A and B and even better if it's aware of each environment that the image was designated to such as prod / dev.
https://redd.it/1cnuqdp
@r_devops
Beat Practice to in setting up Monitoring ECS tasks
Hello, Junior DevOps here. I would just like to ask what are the best possible solutions for monitoring ECS tasks where it would notify us if the containers reached maximum CPU or memory usage and if there are any failed tasks. I would want it to be cost efficient.
https://redd.it/1cns5z8
@r_devops
Understand AWS Public IPv4 Address Usage and Pricing
AWS charges for all public IPv4 addresses, including those associated with running instances and elastic IP addresses. learn more about AWS public IPV4 Address usage and its pricing.
https://vishalvyas.com/understand-aws-public-ipv4-address-usage-and-pricing
https://redd.it/1cnpguc
@r_devops
CI/CD Pipelines vs Deplyoment Pipelines
I watched a couple of introductory videos to CI/CD pipeline design from "Devops Journey". He described the process of creating a CI/CD pipeline first, and then moved on to a "Deployment Pipeline (+GitOps)". The CI/CD pipeline appeared to produce some artifact; so is this not just a CI pipeline and the Deployment Pipeline is the CD, which is triggered on a successful artifact. video: https://www.youtube.com/watch?v=pJ9f7w4AxtU
https://redd.it/1cnl2m3
@r_devops