86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
Senior Devops salaries UK
Senior Devops Engineer on 65k London. Fully remote, however I go in maybe 4 times a year for certain events.
Maybe the markets getting better recently but it seems that Seniors around 70k+
https://redd.it/1ggkzlu
@r_devops
Using Postman without sharing any data?
Hi everyone,
Firstly, I come up to this thread in the forum if you wanna check: Does Postman collect and store sensitive data such as API keys?
In our company, they decided to not use the Postman (and insomnia) but the problem is I absolutely love Postman and all it's features for simple testing. Right now we are allowed to use Bruno but to be honest i come up to several bugs that effected my performance. I personally opened many issues in their github page after my problems and I definitely support them.
What I'm wondering, is it possible to use the Postman with no data share whatsoever?
https://redd.it/1ggicrp
@r_devops
KEDA: Using metrics from OTEL collector for scaling
Any fellow KEDA users here? 🙋 Jirka just dropped a blog on a new OTEL Scaler for KEDA, which lets you go straight to OTEL for scaling metrics—no Prometheus server required. Setup’s pretty easy, and it’s perfect for those of us dealing with workloads that need instant scaling (AI/ML, web traffic spikes, etc.).
Worth a read if you’re looking to optimize your setup: https://kedify.io/resources/blog/using-otel-collector-with-keda?utm\_source=reddit&utm\_medium=social&utm\_campaign=blog\_post
https://redd.it/1gggvnn
@r_devops
Are there any free GitHub Actions for security scanning in private repos?
We currently have Checkmarx integrated with Actions with SAST and SCA scanning, but I was looking for some other tools like OSSF Scorecard and harden-runner and both are requires licensing for private repos. Do you guys have any other recommendations?
https://redd.it/1ggehw8
@r_devops
Best static code analyzer for my android app's CI/CD pipeline?
Currently I'm using github actions ci/cd platform for: lint, ui/unit tests and packaging. I want to add static code analysis - SonarQube wa my first go-to but it turns out they are free only for public repositories. Looking for a good alternative
https://redd.it/1ggd9ck
@r_devops
Data Platform Strategy
So as part of our DevOps culture we moved to "Platform Engineering" we started to deploy tools for dev Teams and find ways for devs to easily deploy "directly" related infrastructure for their apps, etc.
However we are kinda struggling with the data scientists (and science people since we have a reseach branch in the company) They need tools such as juperhub, Argo Workflows, mlflow, etc
I understand this to be part of the company platform, however I wonder if there are other strategies with separate teams specifically for data engineering.
Until now we have considered data engineering as a separate responsibility, however there is no real ownership because of lack of resources, and even if it's not our strength I'm starting to think the only way is to integrate it with the Platform Team.
What do you think?
Which strategies you use in your companies?
Thanks
https://redd.it/1gg8pe5
@r_devops
Need help with ansible and drone ci pipeline
This is probably a low level issue for a lot of you but im kinda stuck on this.
Im using Drone as my CI/CD to deploy a binary to a server, I have a ansible repo for deployment. The process is as follows for now (this is just temporary since im building a deployment and goes only to staging):push to development > builds binary > names it binary_git_short_sha > deploy it to server with commandansible-playbook -i .ansible/inventory -e "binary_name=${BINARY} " --limit staging .ansible/playbook.yml
BINARY variable has the value of the binary name, but when i call it in drone pipeline in a step i get binary_name= in the -e variables. If i replaced the ${BINARY} with lets say ${DRONE_BRANCH} that is an environment variable set by drone at the start of the pipeline the value is there it would be binary_name=development but any time i define a variable by hand it does not work. Ive tried even running a bash script that would define the variables and pass them to the ansible command and run it all inside the script but the source would be the same and the result would be the same as well.
I tested it in the docker container itself on my machine, the entire process and it does work but in drone ci it does not. Feel like im losing my mind a bit.
edit: edited formatting a bit
https://redd.it/1gfzdi2
@r_devops
Need help with Google Oauth 2 for Argo Workflows DEX authentication using Argo CD Dex
I went through the documentation that argo provides for adding dex authentication using the dex server that argo cd has, it was a bit weird with many fields in the current values yaml file in the helm chart not matching position or even name. I got google's oauth2 working on argo cd with dex using the default config provided in the values file for the helm chart. The problem is when adding the same dex auth method to argo workflows isn't as simple as argo workflows requires a service account so I followed the documentation to map a service account to a group, this requires reinstalling argo workflows so I did that then instead asking me to choose an account I get
# Access blocked: authorisation errorAccess blocked: authorisation error
Some requested scopes were invalid. {valid=[openid\], invalid=[groups\]} Learn more about this errorIf you are a developer of invite automation, see error details.Error 400: invalid_scope
does anyone here know how to implement argo cd dex authentication on the argo server used by argo workflows?
https://redd.it/1gaanw3
@r_devops
Provision serverless service with Terraform or not? (Planning to use GCP Cloud Run)
Hi, I would like to deploy several services on GCP Cloud Run and a bit unsure about the recommended way to provision the services.
Should I create it through Terraform or just use the "gcloud run deploy" command?
https://redd.it/1ga8ohi
@r_devops
General question regarding AWS
I am new to devops world, I have an existing project in my organisation, I want to draw network architecture of the project. I want to visualise everything it contains in my VPC. Example, I want to know how rds are connected, nacls, security group rules including inbound out bound rules everything in an architectural diagram, is there a way?
https://redd.it/1ga91hv
@r_devops
Image Extraction Issue with WMF Format on Linux - Need Help Converting to PNG for OCR
Hi, everyone. I’ve built an app that processes PPT uploads by extracting text and images from the slides. The app also performs OCR on the images and saves them. It works perfectly on my development environment (Windows), but I hit a snag when I try to run it on an AWS Ubuntu instance. The issue is that when images are extracted from the PPT on Linux, they are in WMF format, and the system can't seem to work with these for further preprocessing (like OCR). This doesn't happen on Windows. I need to convert the extracted WMF images into PNG format before preprocessing, but I haven’t found a solid solution to handle WMF files on Linux. Has anyone dealt with this issue before? Any libraries or tools that could help with WMF to PNG conversion on Linux would be greatly appreciated! I appreciate any help you can provide.
https://redd.it/1ga5wq0
@r_devops
how can you tell ansible-pull has done anything?
You don't receive any feedback that it ran successfully in a central way. How can you be sure it really ran and that your machines are compliant?
https://redd.it/1ga2d7p
@r_devops
Most Critical Issue in Current Project and how you are dealing with it?
I am new to devops role and currently panicking.
https://redd.it/1ga3oc3
@r_devops
VSCode with cfn-lint and cfnnag on Windows
Can anyone give me a fairly decent step-by-step for installing cfn-lint and cfn\nag for use on Windows with VSCode and applicable extensions?
I found what appeared to be straight forward steps for using WSL to install both via Ubuntu, however the steps were outdated and did not work (from what I gather is due to recent Ubuntu security updates). From there I found numerous workarounds to get each to install, however then neither seemed to properly function with the appropriate extensions via Code.
At this point, given all the various things I had to attempt, I simply removed everything (VSCode extensions, installed packages, Ubuntu, and even WSL itself) and am starting fresh with hopes of getting something working fairly easily.
TIA for any advice you can provide. Appreciated.
https://redd.it/1g9z8so
@r_devops
DevOps panic
I'm in my mid-twenties and work as a Junior SysAdmin/Technical Lead for a support team that specializes in niche Microsoft technologies. I started in the IT world less than three years ago and have been job-hopping every year for new challenges. I've taken a couple of courses, but that's it—no bachelor's degree or anything. I haven't even created a Kubernetes lab or opened up the interface.
Recently, I entered the interview process for a DevOps position at my company (a large firm that works with different clients around the world). At first, I didn't think my application would even be considered, but then, on Monday, out of the blue, I had a phone screening. The interviewer liked me, and that same night, he told me I’d have a more technical interview the next day.
I studied that night and the morning before the interview, but it was a lot to process in such a short time: Kubernetes, Git, methodologies, Docker, etc. Honestly, I thought I was going to show up and get humbled by my lack of experience (If any) in DevOps.
When Tuesday arrived, I was a bundle of nerves, not wanting to make a fool of myself. Somehow, I passed the interview, and they want another technical interview on Wednesday or Friday at most. They provided me with some topics to study for the client screening, and that's it.
Now, fear sets in as they told me there would be no peers to ask for help, no documentation, and no training or ramp-up. I would be on my own, and I need to create SOPs, manuals, guides, processes, and document everything to "pave the way for future peers."
One friend who works at a DevSecOps team told me that this is a really great opportunity, and he thinks i'll make it (Though he warned me that it will be a really difficult, soul crushing and just plain hard process until i get a grip on everything)
I'm really scared. What if I mess up and can't make the cut on my own? At the same time, I think this situation could force me to learn and move forward, but I'm just really fucking scared. But, who the fuck with no bachelors, less than three years of experience, and some cookie cutter certs would get a chance like this?
I want this, its a great chance to get a better life and a job I think i'll love, but im just scared of failure.
Any tips on how to study for the interview? This will be the hardest one. Sorry for the long text, its been crazy at least for me.
https://redd.it/1g9vsv1
@r_devops
Struggling to Land DevOps Interviews - Any Tips on Improving My Resume , need help !
https://imgur.com/a/1aPCXgj
This is my current resume please guide me where it needs to be improved and what changes i have to make
https://redd.it/1ggmp0b
@r_devops
Bad back?
Anyone else here got a bad back from all this office work?
https://redd.it/1gghq4b
@r_devops
Organizing IaC by resource type
Does anyone else hate this and think it's an anti-pattern? For instance (assuming AWS Terraform):
- iam_roles.tf
- iam_policies.tf
- kms_keys.tf
- rds.tf
- database.tf
Which books ?
I'm a senior devOps eng and wondering how I could improve my skill set.
I know how to learn technical stuff when it needs, but as I'm over 45 now, I think about "manage" a team. Maybe just a tech lead role would be great.
In that purpose, do you know books that could help me ?
Thx 🙏
https://redd.it/1gge1fa
@r_devops
Is development important for a Mid-Senior DevOps Job position?
I am currently working as an Azure Cloud Engineer with one year of experience, and prior to that, I worked as a Network Engineer for two years. I would like to know if development knowledge is essential for landing a Senior DevOps role, and whether I should consider learning web development for this purpose. I am already familiar with common DevOps tools such as Docker, Kubernetes, Terraform, Git, basic CI/CD, Python scripting, and I have cloud experience.
I'm unsure if I should further strengthen my skills with these tools or focus on learning web development to enhance my chances for a DevOps position. Since I am already working as a Cloud Engineer, I am aiming for mid-to-senior DevOps roles rather than junior positions. Could someone advise accordingly?
https://redd.it/1gfo328
@r_devops
How to write a production ready code in Python " Clean Architecture focuses"
How to write a production ready code in Python
Clean Architecture focuses on separating the software system into layers with strict boundaries, enhancing maintainability and testability. The core idea is to keep the business logic (or domain logic) independent from the external factors like databases, UI, and frameworks.
I just published Clean Architecture exaplme python and PostgreSQL
rasvihostings/clean-architecture-exaplme-python-and-postgresql-59a95bcf8d56">rasvihostings/clean-architecture-exaplme-python-and-postgresql-59a95bcf8d56" rel="nofollow">https://medium.com/@rasvihostings/clean-architecture-exaplme-python-and-postgresql-59a95bcf8d56
This example illustrates how to implement Clean Architecture in a Python
\#Python \#fastapi \#cleancode \#CleanArchitecture
https://redd.it/1gg5ri3
@r_devops
Which job would you pick
I’m interested in hearing which job you would pick going off the compensation. Just for fun.
Job 1
Base: £50,000
Annual bonus: 9%
Pension: 4% employee 11% employer
Additional benefits: £120 per month benefit in kind for health and well-being
Company type: Corporate
Progression: level 2 of a possible 4.
Working pattern: fully remote
Job 2
Base £65,000
Annual bonus: 2-4%
Pension: 5% employee 5% employer
Additional benefits: None
Company type: Small to medium sized business
Progression: None
Working pattern: Hybrid 1 day every two weeks in office (20 mins drive)
Edit: Clarified Job 2 Hybrid working.
https://redd.it/1gfx2ab
@r_devops
Asking for advice
I'm computer science student, the job market in my country is hiring DevOps interns all the time for end of year internships, and I'm trying to get this opportunity since I'm really interested in a DevOps carrer. Can any of the Tech leads here, member of recruitment who is actively hiring DevOps engineers give me some advices on what makes someone a good candidate when it comes to DevOps.
I studied really hard for the last two years and I have good knowledge of DevOps practices and concepts. I've had so much hands on experience on different conepts (GitOps IaC Cloud) and technologies like Jenkins GitLab ArgoCD Ansible Terraform, also some CLI tools using Go and Python, projects on AWS GCP, and had some software engineering internships where I got the picture of how softwares are built and delivered.
I am really interested on what are the key skills that makes difference also the project you'd like to see in the resume.
I am ready to hear you feedback, also if possible I can share my resume with you so you can roast it.
Thank you 🙏🏻
https://redd.it/1gabhh3
@r_devops
?? what takes too much of your time at work that could be automated and for some reason isn't
follow up question: why haven't you automated it yet?
https://redd.it/1gaa7gj
@r_devops
Long or short on git submodules?
I have an opinion but a lot of folks seem to disagree. What do you think?
https://redd.it/1ga7akf
@r_devops
How do you guys use PowerShell remoting ?
I have been working with PowerShell for more than 10 years. When it became open sourced and cross platform, I started to manage linux (and at home my macOs ) with PowerShell.
I was wondering how the devops community is using PowerShell remoting for remote management of machines.
If so, I think it can be interesting to discuss how and for what type of machines (and how many?) this is done. To keep things clear and short, maybe each can include the following data:
\- How many servers
\- Which type of machine (Windows / Linux / MacOs?)
\- Which protocol is used (OpenSSH / WinRM over HTTPS etc..)
\-----------
I'll go first:
\- Servers: 3000
\- Mostly Windows
\- WinRM over HTTP at first, then over HTTPS.
Details:
I have been managing mostly Windows machines (around 3000) with raw Powershell remoting. We went and got a licence of Ansible Tower, and this migrated on that platform for our configuration management system.
We use WinRM over HTTPS, as our machines are not always in our main active directory. Ansible is quite cool, but for Windows Management it still uses classical WinRM, and actually works great.
Since I was evaluating OpenSSH as an alternative (since Powershell supports that now) I actually took A LOT of notes. regarding POwerShell in general. I kept having the quesiton: Is PowerShell remoting actually secure ? (And a LOT of people would say it is not - for some obscure reason...)
I have summarized my notes and answer most of the general questions (how to configure, how does it work, is it secure etc....) in the following video -> https://www.youtube.com/watch?v=sg\_9r0PHnnM
https://redd.it/1ga5oxa
@r_devops
⚙️ Automate Database Change with Jira
A tutorial guiding you to automate the database change workflow process with Jira and Bytebase by leveraging Jira and Bytebase Webhook and API. 🔌
https://www.bytebase.com/docs/tutorials/database-change-management-with-jira-automated/
https://redd.it/1ga428p
@r_devops
How should I approach logging when loading testing?
I'm working on setting up a locust+prometheus+grafana stack for a client. Up until this moment I only wrote unit tests so I dealt with failed requests on a singular, manual basis. Thus I am unaccustomed to the scale of handling the potential failure of thousands and tens of thousands of requests. (i'm a fullstack dev repurposed into a devops).
I'd appreciate if you could answer a couple questions
1. How should I catch a failed request? Right now I am making event hooks in locust and logging the response body when debugging why a certain request fails. I have a feeling this isn't scaleable, yet I lack a clear path in thinking about a better solution.
2. Should I even try to "catch" or "debug" failed requests? I feel I am approaching load-testing from a bias of project development (i.e. print statements or unit tests) and maybe need some tweak in how I think about debugging when doing load testing and telemetry.
3. Should I persist in any shape or form the result of locust runs, or is it better delegated to a prometheus exporter which scrapes locust?
4. What should be the "shelf life" of the load tesing outputs (i.e. logs, performance data, failed request CSVs etc)? Should everything I produce live forever?
5. After I get a tool/service working with my clients environment, when do I begin autiomation? Devops has many tedious tasks (which is why almost everything is automated) but I want to avoid spending time on overengineering too soon.
https://redd.it/1ga2mve
@r_devops
Freelancer client acquisition methods
So for all of you free lancers, what is the biggest client acquisition that a free lancer must do
https://redd.it/1g9wcql
@r_devops
KodeKloud exam lend
Hi, I'm a student currently preparing for the Certified Kubernetes Administrator exam, but I can't afford a KodeKloud subscription to access their mock exam series. I was wondering if anyone would be willing to lend me their KodeKloud account for a short time so I can practice with the mock exams and gauge my readiness. Your help would really mean a lot to me! Thanks in advance!
https://redd.it/1g9u59u
@r_devops