86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
in the cka exam - do you get a remote desktop or just a terminal emulator?
If it's a remote desktop, what environment is it? I've read that you're only allowed one display, but does the environment support things like virtual-workspaces?
https://redd.it/1fmdk1k
@r_devops
i want to create a Kodekloud pro account with 3 friends.
What I like about kodekloud is the kodekloud engineer platform which necessits a kodekloud pro subscription that i can't afford alone( i can't wait 24 hours for just one task it will take a lifetime to reach my goal) . I saw when a task is finished you can't go back to it and redo it. Did someone shared a kodekloud account with his friends? and how they did the task?
https://redd.it/1fm4nn7
@r_devops
Highly available load balanced nfs server
Hello everyone
As the title suggests im trying to achieve a highly available load balanced nfs server setup.
My usecase is that im hosting on a single nfs server thousands of files that are accessed from multiple nginx servers.
This nfs server is currently my bottleneck and im trying to resolve that.
I have already tried to deploy a multinode glusterfs which after messing around with all of its settings brought me worse performance results than using 1 nfs server. Note i have done deep research on it and have already tried the suggested optimisations for small file performance increases. This did help a bit but I still get worse performance than my nfs server.
Due to that i have discarded it and now looking into making the 1 nfs server perform better.
How would you go with it to make it scale?
My thoughts so far are to somehow have each nfs server sync with each other, then mount randomly those instances from my web servers (maybe using a dns A record containing all the ips of all my nfs servers?
Thanks for your time i advance!
P.s. im running all of this on hetzner cloud instances where such managed service is not available
https://redd.it/1fm0l18
@r_devops
Docker
Hello guys!
Any tips to master docker for a beginner?
https://redd.it/1flyo6i
@r_devops
Landed a job after 6 months
https://old.reddit.com/r/devops/comments/1bgshxy/itshardthoughtsaboutmydevopsjourneysofar/
I landed a job after 6-8 months of studying. It’s an L1 Tech support role with Linux and AWS. The company has great benefits—they'll pay for my AWS certs and whatever else I want next.
For me, the hardest part of the journey is Linux. I’m comfortable with Terraform and Kubernetes, even though I help myself with GPT about half the time.
Now, I want to really get the best out of Linux and know what I’m doing. I also want to boost my resume and LinkedIn with more experience and certifications. They said that if I do well, the next step could be a DevOps position if any openings come up, but who knows how long that’ll take.
The money is average since it's entry-level position, and I’m 30, so I need to do my best to stay sane while working towards my dream.
https://redd.it/1flwx7d
@r_devops
Anyone using dagger.io?
Is anyone using dagger.io? I’m curios if helped you solve any problems with ci/cd? What is the advantage over using other approaches? Shell scripts etc…
https://redd.it/1flnx04
@r_devops
Seeking Career Advice & Job Opportunities in Monitoring and Observability (APM)
I’m currently exploring job opportunities in the field of enterprise monitoring, particularly focused on application performance management (APM) and server monitoring (not network monitoring). I’m curious to learn about the different types of roles that exist in this space, the key skills required, and the future career growth in this field.
What kinds of tools and technologies and languages are essential to know (Dynatrace, New Relic, AppDynamics, Grafana/Prometheus etc.)?
Additionally, what’s the career trajectory like. Any insights on the demand for these roles in the market and potential growth areas would be greatly appreciated!
9 YOE in ITSM Process consulting background. With knowledge of ITOM Event Management.
Thanks in advance for your insights and advice!
https://redd.it/1flmhb5
@r_devops
Implementing Karpenter using terraform
Hey guys, is there any documentation of implementing Karpenter using terraform? I found one for old version but cannt seem to find anything updated. Thanks!
https://redd.it/1fljk57
@r_devops
Infrastructure design advice
So... I got a position where I will be the sole devops/cloud engineer that will be architecting and building out the infrastructure for Gitlab CI/CD with AWS services. I've never done this before and I need advice when it comes to designing and architecting for scalability as well. I found these generic builds from aws and their youtube channel for bigger companies. I'm not sure where to start or if anyone has any advice.
Essentially, I need to take in 5 different sources of data and transform/manipulate it to one database in aws and to be able to present, export, or allow parsing of that data.
So something like
lambda scripts to parse the data from depending on the source to clean data > DB > Neptune > SES. Seems simple on paper but I know there are more intricacies.
https://redd.it/1flg6z6
@r_devops
Looking to get into DevOps
So I’ve been a systems administrator for a few years now, and have been lucky enough to be able to touch some Azure DevOps stuff. I’ve deployed and managed AKS clusters, troubleshooted issues with them, etc. I also update (but never wrote my own) yamls, troubleshoot/resolve issues with Azure pipelines, as well as any issues with the containers.
I enjoy this stuff and want to get a role more focused in this area (my company got bought and they’re keeping me on but I’ll be touching far less DevOps), but I feel like there’s still a ton I don’t know. Despite having a decent bit of familiarity, all the DevOps positions I see still seem very intimidating in terms of experience. I apply anyway, but no luck yet. I also have no experience with some of the more popular technologies like terraform or ansible, we use helm. I’m also not much of a programmer, I know a little but I feel like I have some knowledge gaps.
Do I just have imposter syndrome or is my experience potentially still not enough for a full time role in DevOps?
https://redd.it/1flcvpk
@r_devops
one step cluster build
I'm busy developing a cloud agnostic kubernetes cluster based around k3s, argocd, harbor, keycloak and a few other tools, currently I can seed the whole cluster using a single step, the problem is there is still lots of config that needs to happen before it's usable ie. setup single sign on, add user roles etc. I've setup minio in a remote location to store terraform state and was thinking of when it starts up use terraform as s job that deletes itself after completion to put all configs where they need to be. then future updates you push terraform to plan branch on git were it will run a terraform plan and do a pr for you to merge to apply. something like that, the rest is done with storing backups of db's on off site using valero so it can easily be restored when I build a new cluster. I'll be rebuilding it regularly so would really like the whol ething to eb automated. or is there a better way?
https://redd.it/1fl4jnc
@r_devops
Docker course
Hello Docker champs 🏆,
If you had to choose just one resource to learn Docker online, what's your top choice? Or to put it another way, whose videos or documentation did you follow to get where you are today, along with hands-on practice?
https://redd.it/1edxfht
@r_devops
Am I out of touch? (interview)
I had my first coderbyte challenge and it gave me 3 mediums and 1 hard to solve in 5 hours.
I also had long response questions like:
What is Docker? Kubernetes?
Which of these is not a service?
ALB, ELB, NLB, SWE
What command would you run to see pods running in kubernetes namespace main?
At what point is 4 leetcode problems necessary? Surely 2 would provide enough information if I should move to the next round..
Further, why am I asked 3 medium/ 1 hard leetcode questions, and then joke questions for anything related to devops/platform?
And no, I didn’t even attempt this because i’m fortunately happily employed.
https://redd.it/1ednhzh
@r_devops
I built an open-source tool to make on-call suck less
Hey y'all,
TL;DR
I am building an [open source platform](https://github.com/opslane/opslane) to make on-call better and less stressful for engineers. We are building a tool that can silence alerts and help with debugging and root cause analysis. We also want to automate tedious parts of being on-call (running runbooks manually, answering questions on Slack, dealing with Pagerduty).
Here is a quick video of how it works: [https://youtu.be/m\_K9Dq1kZDw](https://youtu.be/m_K9Dq1kZDw)
I hated being on-call for a couple of reasons:
**- Alert volume**: The number of alerts kept increasing over time. It was hard to maintain existing alerts. This would lead to a lot of noisy and unactionable alerts. I have lost count of the number of times I got woken up by alert that auto-resolved 5 minutes later.
**- Debugging**: Debugging an alert or a customer support ticket would need me to gain context on a service that I might not have worked on before. These companies used many observability tools that would make debugging challenging. There are always a time pressure to resolve issues quickly.
There were some more tangential issues that used to take up a lot of on-call time
**- Support**: Answering questions from other teams. A lot of times these questions were repetitive and have been answered before.
**- Dealing with PagerDuty**: These tools are hard to use. e.g. It was hard to schedule an override in PD or do holiday schedules.
I am building an on-call tool that is Slack-native since that has become the de-facto tool for on-call engineers.
To start off, Opslane integrates with Datadog and can classify alerts as actionable or noisy.
We analyze your alert history across various signals:
* Alert frequency
* How quickly the alerts have resolved in the past
* Alert priority
* Alert response history
Our classification is conservative and it can be tuned as teams get more confidence in the predictions. We want to make sure that you aren't accidentally missing a critical alert.
Additionally, we generate a weekly report based on all your alerts to give you a picture of your overall alert hygiene.
What’s next?
* Building more integrations (Prometheus, Splunk, Sentry, PagerDuty) to continue making on-call quality of life better
* Help make debugging and root cause analysis easier.
* Runbook automation
We’re still pretty early in development and we want to make on-call quality of life better. Any feedback would be much appreciated!
https://redd.it/1edhedn
@r_devops
DevOps without containers... madness?
My company wants to implement DevOps but introduce containers into the company only in a couple of years from now.
How do I convince them they are about to enter a world of pain?
Has anyone managed to do DevOps like this?
https://redd.it/1edbtiz
@r_devops
Securing code and devlopment pipelines?
Has anyone used something like Wiz Code? Our team is considering implementing it and I'm curious about the communities thoughts.
Seems like a new launch and I've not seen any chatter yet.
https://redd.it/1fmbep6
@r_devops
CI/CD strategies with Environment Specific branches in GitHub
Hi,
What are your opinions about a CI/CD workflow for a website which uses branch per environment?
for example main would contain changes you can see in a preview environment and qa branch would contain changes released to a qa branch
Even though this seems approach it felt bit unnatural for GitHub based CI/CD workflow and managing branches in long run seems a really boring task
Currently im using a tag based approach where i create a specific tag from main branch whenever i need to do a deployment. But this approach is also bit troublesome to deal with when we want to trigger a build from a CMS update. with tag based approach we want to know whats the last deployed tag to run the build with new CMS data
What are your workflows for this?
https://redd.it/1fm542y
@r_devops
Add telemetry to pipelines
Hi all, in my company we got several yamls with GitHub worklows, calling actions from many different repos and orgs, as well the typical docker actions. Has anyone done any telemetry on their pipelines? If yes can you point me to the proper direction please? Thanks.
https://redd.it/1fm0ajv
@r_devops
Anyone used Docker Swarm Mode?
TL;DR I’m looking for something declarative but simpler than Kubernetes but everything I read is about the old “docker swarm classic” (and not good), as opposed to “docker swarm mode”. Anyone used it and got stories to tell?
Background: I work for a tiny but fast growing company and I’m really a dev with limited ops knowledge.
Our system is relatively simple - load balancer and MySQL pair (managed by the hosting company), dual web/app-servers plus ancillary services (redis, memcached, open search). And an equivalent staging environment.
I cobbled together an automated test and deploy pipeline using GitHub actions and Dokku (a heroku clone) which does the job (although the pipeline rebuilds the containers multiple times - never got round to fixing that). But if we need to add new boxes in (say I want to add in a new app-server) I have to do a load of the configuration by hand. And now I want to stick an OpenTelemetry collector in the mix (getting prod issues that are user- and data-volume related) which is yet another configuration to maintain.
I really like the idea of the configuration being declarative - I state what I want the network to look like and the tool goes away, does it for me and keeps it that way. But, our system is pretty small and I don’t think I need to learn kubernetes for something this size.
So I looked at docker swarm mode. I’m already comfortable with docker compose, it seems to do all the stuff I’m looking for (declarative, auto-balancing, config and secrets management included and simple to set up).
However trying to find peoples experiences with it in the wild is difficult. Everything seems to be about “classic swarm” not “swarm mode” (who thought up that naming?)
Anyway, any experience of it? Does it sound like a good fit for our situation? Should I just learn kubernetes (or something like nomad)?
Thanks in advance.
https://redd.it/1flxmrf
@r_devops
Hey Folks. Looking for Guidance.
I'm am an AWS cloud engineer in the DC, Maryland, Virginia area with 3 years experience. Most familiarity is with designing solutions for operations. Triage automation, incident response, monitoring, break fix ect. I started out with an understanding of terraform/python, but have since moved to typescript/node. Even started developing typescript packages that act as guardrails for the company to use. I currently am at 110,000 and living paycheck to paycheck outside the DC area and am not sure if this is standard or I need to start looking for employment elsewhere. I know geography can be a huge factor, but just curious for veterans to chime in.
https://redd.it/1fltcm3
@r_devops
My cofounders and I put together a free 10 week (1hr/wk) workshop on OpenTofu
A few weeks back, I did a 4-hour live stream on OpenTofu, and people asked for a more broken-down, interactive version. So, we’re launching a FREE 10-week workshop, 1 hour a week, building a 3-tiered app with a caching layer, a database, and a service on EC2. Everything will be on the AWS free tier (or run localstack, whatevs).
It'll go from beginner to advanced, so if youre over9000 at OpenTofu, show up in week 3. :D Its also mostly Terraform friendly.
You can follow along, ask questions, rewatch sessions on YouTube, and chat with the cohort in Slack. Minimal time, but you'll learn a lot!
We’re still deciding on the app to run—so if you have any fun ideas, hit me up before we end up with something boring like Spree 😆.
Sign up here
https://redd.it/1flniaz
@r_devops
Amojisys: On-Demand DevOps Tools
Hi everyone,
I'm posting this is an advertisement for our platform Amojisys, but I would also like to know your feedback about what we created.
What is our platform offering?
In short, we offer tools to streamline development processes. These tools are fully under your control and what we focus on is deploying and maintaining them into our Kubernetes environment.
Currently we have 3 solutions, VS Code Server, Gitea Repository, and Jenkins Cluster.
How did we get the idea?
We are a team of DevOps engineers ourselves, and one of the main pain points of our customers was to buy a server, create a kubernetes cluster, install CICD tools, ingress setup, etc. just to run a Jenkins server.
So, we ended up creating this application that can automatically do all that and provide you with a URL to access your tool.
I've also created a Medium blog post on hat3cker/automate-your-development-with-on-demand-gitea-vs-code-jenkins-and-amojisys-part-1-dd2c1bfa7f48">how our app can be used to boost your development workflow.
Would you consider our solutions useful?
And if not, what would you like to see in our platform to make you reconsider?
https://redd.it/1flityr
@r_devops
How can I improve my understanding of Network Concepts, focusing on tooling and AWS?
Hey guys, so I'm someone that has been dabbing in DevOps for a while, mostly accidentally.
I started out as a Python Dev, moved into Data Engineering and eventually settled on Machine Learning Engineering and MLOps, most of my work over the last few years has been similar to a Platform Engineer, but focused on ML, so getting shit automated, faster and cleaner than a bunch of Data Scientists breaking shit inside of notebooks in production and getting those donkeys pretty far from any prod system and in their own happy worry free sandbox environment.
The thing is, lately I realized I've got a few gaps in knowledge as I was never responsible for those tasks, mainly networking, how to connect block A to block B and so on, I do know the basics of how to get an API Gateway going, how to setup VPCs, security groups and the basics to get stuff interacting, a bit of Kubernetes Networking, how to enable pods communicating to each others and some other simple stuff, I'm able to build this kind of crayon glued together infrastructure if need be, even from Terraform (got even a shiny cert!), Pulumi, CloudFormation and all that.
How can I basically start over and fill the gaps? Do you guys recommend a good place to get some hands on experience? Anyone has a good roadmap? I got hands on knowledge with most of the relevant tooling in AWS and Azure, but do lack the knowledge of how to build something myself without spending a fuckton of time debugging my initial shitty networking choices.
https://redd.it/1flh9bd
@r_devops
KodeKloud Udemy and Windows
I purchased "The Ultimate DevOps Bootcamp" on Udemy to give me a basis before my actual devops course. I have noticed that my devops course uses Powershell and Microsoft infrastructures, which the Udemy course doesn't cover. Are there any platforms to complete my knowledge that have simulations like KodeKloud? Also, will it be easier to learn Powershell if I know bash?
https://redd.it/1flfs3x
@r_devops
What are some Humanitec alternatives for platform engineering?
Basically the question.
I run facets.cloud, which does what Humanitec does, and much more to enable infra automation, dev self service, with Ops playing god setting the rules for infrastructure (might be a bit oversimplified but you get the point)
Wanted to see what other businesses/SaaS are working in this direction.
Maybe something you came across or already use in house?
https://redd.it/1fld8dy
@r_devops
Windows servers in a devops environment
I'm working very hard to create a devops culture around our dev workflows on linux, but we also have a largely manual windows environment that also needs to be dealt with.
We don't currently have a good tool to manage Windows servers, and I'm debating if we should try to use Ansiblle (or puppet) or if this would be just too weird and non-standard and if we should find something windows specific.
https://redd.it/1edyqsk
@r_devops
Roadmap Devops
Hi guys which are the best resources to study devops
Is it possible to study all self study?
https://redd.it/1edwebl
@r_devops
Hopium Looks like the market is coming back for mid-level engineers and seniors!!
Noticing tons of job postings, more recruiter DMs and a lot of anecdotal experiences of my friends job hopping to double their TC.
It's still not where it should be, but damn boiz... brings a tear to my eye.. we are slowly getting back there!!!
Even seeing some SDE 1 positions at a few FAANGs now for entry level folks
Keep on hustling. We're all going to make it.
https://redd.it/1edirof
@r_devops
Joining SRE Role in a Top Fintech Company: Is It Really Worth It?
I’m excited to share that I’m joining as an SRE (Site Reliability Engineer), even though my initial goal was to become a developer. Unfortunately, there weren't any available developer roles at the moment. I'll be working with OpenShift and Unix technologies.
I’m a bit concerned about my career progression with these technologies. Does anyone have experience with this and can share their thoughts on the career path for SREs? Also, are these technologies interesting to work with? And is it possible to transition to a developer role in the future?
Thanks for any advice!
https://redd.it/1edcw39
@r_devops
Which large companies have "devops engineers"?
Seems many large companies handle devops through their developers and it's more the medium and smaller companies that are hiring the recently minted devops engineer as we've come to know it.
https://redd.it/1ed9vcs
@r_devops