86
Reddit DevOps. #devops Thanks @reddit2telegram and @r_channels
Learning Terraform without cloud or using local resources
I am DevOps engineer, very curious about learning terraform and IaC in depth. I have already used all free trials. Are there any way to learn terraform end to end with local resources (Things which can be run in my localcomputer). Appreciate your attention. Thank you !
https://redd.it/1ed8vz6
@r_devops
Making unfashionable choices - Why Thinkst Canary Runs Isolated VMs instead of Multi-Tenanted SaaS
H/T to r/netsec & u/thinkst - https://www.reddit.com/r/netsec/comments/1ebq5ya/unfashionablysecurewhyweuseisolatedvms/
https://blog.thinkst.com/2024/07/unfashionably-secure-why-we-use-isolated-vms.html
https://redd.it/1ecykdu
@r_devops
How to deploy Azure ML batch endpoint from docker image?
Hi, I have my own deep learning task that requires 2-3 different ml models, I built the code and containerized it, i.e. the python env and code is in the docker image.
I am running fastapi servers inside docker to run code.
Deployed it in aws sagemaker async endpoint and it is working fine.
Now, I need to deploy it to azure ml batch endpoint, but there's no documentation as such to deploy it using custom docker container.
Can someone help me?
https://redd.it/1ecysgn
@r_devops
Anyone took the CourseCareers Devops Engineering specialization? Thoughts on it?
I'm looking to put some experience and projects on my resume and it looks like CourseCareers is offering a DevOps Engineering specialization in their software development course. I was wondering if anyone has taken it, and if so, would you recommend it for someone looking to break into the field of DevOps?
https://redd.it/1ecvgcm
@r_devops
Software Engineer looking to transition into DevOps/SRE, but I don't want to quit coding.
I'm a fullstack developer who got an offer for a DevOps/SRE role, employer is fine with training me despite my lack of experience with these roles, but I love coding, and I'm curious whether or not I'll still code in this job beyond Bash/Python scripts?
How much coding do DevOps/SRE really do? From my research about this on the web.. all I found are mostly people who WANT to work in DevOps/SRE/Cloud Engineers to run away from coding.. so this doesn't make me super enthusiastic about this, even though the idea of going deep in cloud provider services (AWS), networking, virtual machines, containers, k8s, databases, automating and writing scripts, etc. super intrigues me.
But I still want to code on the job, beyond coding at home or in the weekends, I don't want to be a button clicker at work after investing so much of my time in my life learning software engineering principles and concepts.
I keep reading that there's a lot of "Infrastructure as Code" (IaC) Python/Golang coding in some DevOps/SRE roles, what are these projects and what do they usually look like and how are they structured exactly? Are there any open source projects on Github that might give me an idea of what heavy-coding DevOps/SRE projects might look like?
Or should I just stick to software development?
https://redd.it/1ectrwe
@r_devops
Step Functions vs SSM runbooks
What’s the difference between them?!
Both are workflows ?!
https://redd.it/1ecotae
@r_devops
Mastering infrastructure for seamless product deployment
DevOps Fran Portillo writes here about how a robust and well-managed infrastructure, primarily relying on AWS, is the backbone of a successful digital product.
https://redd.it/1ecirhj
@r_devops
Chef server got replaced by ASG. Clients are unable to connect to new instance. Help.
Hello chef newbie here handling legacy chef setup done by previous team. Our chef server EC2 got replaced by ASG last week and the way its configured it doesnt pull from any code repo but from itself which doesnt work. So it was empty EC2 instance.
So we ran the tarball on the EC2 instance and brought up chef server and this contained both public and validator.pem.
However the clients are unable to connect to this server. When we run chef-client on the client-nodes, we get SSL exception.
Could someone point me to how to handle this scenario please. TIA.
https://redd.it/1ecesjp
@r_devops
Is there a way to run a different ESLint config on a project without modifying the existing one?
I want to improve my own code through a much more complex ESLint config without modifying the existing one. Is there a way to do this?
https://redd.it/1ecaq23
@r_devops
Questions for Jr. DevOps interview.
Hi everyone, I just got an interview for a DevOps Developer position, but I don't have much DevOps experience. As a result, the hiring manager said they will test me on Java questions. I have searched online, but I also wanted to know what type of Java question would this subreddit ask for a Jr DevOps interview?
https://redd.it/1ec5vqf
@r_devops
Thoughts on the job market in 2024
Hi guys,
I've lived abroad for a number of years and will be moving home to the US at some point in the near future. I am a devops/SRE engineer with around four years of experience. I do not consider myself a senior but feel decently confident at the mid level, although of course I will always have a lot to learn. In Europe, I have had zero issues finding work, in fact I consistently turn down offers and have significantly raised my salary in the past 5 years.
With that said, I've heard horror stories on here and elsewhere of people struggling to find Devops/SRE/cloud engineering positions in the US at the moment. Is the market really that bad? I talked to a recruiter friend of mine and he said not to feel discouraged if I apply to 100 different places and don't get a single reply... That's kind of the definition of discouraging to me. Ideally, I'd land a job before I moved, but I don't have an address nor American phone number so my applications are immediately discarded, I assume.
What do you guys think, am I overthinking it? Will I have to end up jobless under a bridge somewhere? Is the market really in such dire shape as people are saying?
Thanks guys! Have a pleasant day without any fires!
https://redd.it/1ebzgtm
@r_devops
Optimizing Azure DevOps: Agents Runtime Comparison
Did a small research on the Azure DevOps agents.
https://www.go-euc.com/optimizing-azure-devops-agents-runtime-comparison/
https://redd.it/1ec07hh
@r_devops
Multi-Tier Web Application Stack Setup Locally
🚀 Master Multi-Tier Web Apps with VM Virtual Box! 🖥️🔧
Unlock the power of multi-tier web applications with our step-by-step guide! 🏆 Learn how to set up and configure your environment using VM Virtual Box. From initial setup to deployment, we cover all the essentials to get your web app up and running seamlessly. Perfect for developers aiming to enhance their skills and create robust web applications. 🌐💡
Dive into the details and start building today! 🔥
🔗 Read the full article on Hashnode : https://cloudzguru.hashnode.dev/multi-tier-web-application-stack-setup-locally
#WebDevelopment 🌐 #Virtualization 🖥️ #VMVirtualBox 📦 #TechTutorials 📚 #MultiTierApplications 🚀 #CodingLife 💻 #DevOps ⚙️ #CloudComputing ☁️ #ITSkills 🛠️ #Hashnode 📝
https://redd.it/1ebweaj
@r_devops
GCP GKE - Kube-DNS - Custom rewrite rules ?
Hi,
I cannot find a way to define custom dns config in my gke cluster. Im curious whether its simply me missing something or its not possible.
I want to add a rewrite for custom domain based on name regex, while I can very easily do that on EKS by changing the CoreDNS configmap, I cannot find anything like that on GKE?
Help appreciated.
ps. ChatGPT is like "Yea just update coredns configmap on GKE".. + /r/kubernetes seems dead
https://redd.it/1ebpu3n
@r_devops
Has anyone ever used Googles OpenDLP software as their main DLP solution?
Has anyone ever used Googles OpenDLP software as their main DLP solution? How is it nowdays? If we do not have much of a budget for a DLP solution, can I use that or you can suggest some other free software?
https://redd.it/1eboqky
@r_devops
Docker and kubernetes
Certainly! Here's a polite way to ask your question:
---
Hello,
I have 5 years of experience in IT operations, particularly in system administration. I'm now interested in transitioning my career to focus on Docker and Kubernetes. Is it feasible to jump directly into learning Docker and Kubernetes from scratch and secure a job in this field?
If so, could you recommend the best way to learn Docker? Are there any live classes or schools that offer live sessions, as opposed to just YouTube videos? Alternatively, if you recommend purchasing an online course, which channel or course would you consider the best?
Thank you!
https://redd.it/1ed8cp6
@r_devops
New grad places in devops team
Hey all,
I just graduated and accepted a swe role at a relatively big fintech company. I requested being placed on a full stack team, but I was placed on a devops team.
I'm really open minded about what type of work I do, so I'm excited to begin working, but I was worried about this preventing me from learning enterprise level development. I brought this up to my manager and mentor and they said they would give me opportunities to do dev work and that devops is super epic.
My mentor told me I would be working with terraform and gitlab in addition to other AWS lambda functions and mini dev work.
I'm in training right now so I just wanted to ask if my concerns were valid at all, and what working with terraform and gitlab is like. I also wanted to ask if there is anything I should focus on learning prior to the end of my training.
Thanks 👍
https://redd.it/1ed0v3k
@r_devops
Terraform, google cloud function, and application default credentials
Hey all, I'm trying to parse the google and terraform docs on how to use ADC and not lean on use of json keys for ensuring my cloud function's python code can authenticate and use the google bigquery API.
What does the terraform really need to look like to set this up? I already set up the federated identity thing with github, so my actions are able to deploy resources to my project, but I'm trying to move our team away from json keys and use ADC.
It almost looks like you just define the provider and it "just works". Although, I see other code snippets that makes it seem you need to point to the default (or a generated) service account's email in the terraform block somewhere, so it knows which one to use.
Sorry I know this is really basic stuff, but I'm pretty much working on my own on this and could use some advice from folks with more expertise than myself.
Thanks!
https://redd.it/1ecyzp1
@r_devops
Require status checks to pass before merging
I already have lint check in my workflow yml file, I did not turn on Require status checks to pass before merging, but the lint check are already running under branch protection rules
I want to experiment with turn on theRequire status checks to pass before merging, but it said require at least one Status checks, how do I add one?
I guess the easiest to add a marketplace one, like some linting checks, what if I want to add my own, can I add some files in the current repo as some kind of Status checks?
Thank you!
https://redd.it/1ecwa8q
@r_devops
Most important part of the SDLC?
Ok so this piece: https://devops.com/4-reasons-why-tech-leaders-should-prioritize-the-testing-mocking-phase-for-better-development/, makes the case that testing/mocking is the most important part of the SDLC. I've also heard people making the case for the design phase being the most critical part.
I'd love to get y'all thoughts. Is it testing? Is it design? Something else entirely? I don't think there's '1 right answer' but I'd love to see what others are thinking.
https://redd.it/1ecrvet
@r_devops
What are the different ways to save env variables on ec2 instance?
Hello,
I have one project in which client has given access to aws. I checked the dockerfile and found below variables. I am not able to figure out from where the values are coming for this variables. I checked the Parameter Store and found nothing there. I need to access the db for that i need these values. Can any one help me to give some idea how i can find it? Or what are the different ways the values can be stored?
ENV DB_USR=$DB_USR
ENV DB_PWD=$DB_PWD
ENV DB_NAME=$DB_NAME
https://redd.it/1eck0vc
@r_devops
A Comparative Overview of Jsonnet and KCL
xpf6677/a-comparative-overview-of-jsonnet-and-kcl-387c0b0a9d7d">xpf6677/a-comparative-overview-of-jsonnet-and-kcl-387c0b0a9d7d" rel="nofollow">https://medium.com/@xpf6677/a-comparative-overview-of-jsonnet-and-kcl-387c0b0a9d7d
Hello everyone, in order to help understand KCL and its positioning, we are updating a series of introductory articles from a comparative perspective. Welcome to read and provide feedback. ❤️
https://redd.it/1echmpr
@r_devops
SRE/ DevOps related podcasts in Apple Music
Hey Folks, it is a weird request but do you guys have known podcasts to listen 🎧 about DevOps related tools.
I know they have bunch of stuff in Spotify but trying find some good ones 🍎 music.
Please share the links 🔗
Thank you!!
https://redd.it/1ecf5uj
@r_devops
Question: is an experience in a cloud provider primordial for a devops engineer?
I work for a company as devops engineer, more on the dev side and within the dev team. We own our servers and use gitlab CI/CD and I manage both of those. I never used a cloud provider and it shows on my cv. Most of the jobs I find and apply for ask for a min of 2+ years of experience in AWS (or at least one of the big 3)
am I at a disadvantage bc of the company's choices? and do you really have to work with AWS to actually land a job in this domain? Will getting a certificate help solve this or do I have to have professional experience?
https://redd.it/1ec4rsb
@r_devops
Cloud Architecture diagrams
Working on creating some architecture diagrams, i dont have a lot of experience doing so. I am working on creating one from scratch, and I am curious - besides making the AWS account diagram, the region, the VPC, and availability zones/subnets, and then the tools which go in the respective zones. How granular do you get with these charts? Are you linking up the EC2s with the databases and including the ports, as well as the size of the DB, the size of the EC2, etc. Are you including the ENIs which are attached to the EC2, etc.
This document will live only internally, which devs and us 3 folk on the Devops team will reference. What level of granularity is usually expected or acceptable. I know this can get really into the weeds, but i dont want to do that. Want to maintain it at a high level but at the same time, provide some deeper things on the architecture diagram.
https://redd.it/1ec4dg3
@r_devops
Looking for feedback - We built a Python SDK to automate GCP / AWS infrastructure
Hey everyone, we just released a new version of LaunchFlow, our Infrastructure as Code Python SDK that builds on top of OpenTofu to provide features like ~multi-environment support~, ~autoconfigured infrastructure clients~, and ~API release management~. With this new release, everything now runs on your local machine with no account required - this is the first big step towards us moving to an OSS model.
Our goal is to provide a simple toolkit (Python SDK + CLI) for automating Python apps on GCP / AWS. At the moment it only works with our preconfigured OpenTofu modules, but we’re working on exposing the underlying workflow engine so you can bring your own modules.
Would love to hear your thoughts on using a tool like this! Is this something you think would be helpful for you or any Python teams you work with?
https://redd.it/1ec1vca
@r_devops
Mysql LoadBalancer or Statefulnes?Help?
Anyone can help me with just the general idea or instruct me with this. im a beginner in K8s i know the general idea. But there is somone that wants a website with kubernets and wants it like this. The website on one server(i know how to do this) and the database mysql in another server(they gave ne two servers i can use for the databse. They want it so when a lot of requests are being made to the database it doesnt fail or it delayes them. I created one in my home lab with a ubuntu server joined it to the cluster and deployed a mysql instance with two pods replicas the problem is they share different databases
root@worker1:/mnt/data/mysql# ls
auto.cnf binlog.000002 binlog.index ca.pem client-key.pem '#ib_16384_1.dblwr' ibdata1 '#innodb_redo' mysql mysql.sock private_key.pem server-cert.pem sys undo_001
binlog.000001 binlog.000003 ca-key.pem client-cert.pem '#ib_16384_0.dblwr' ib_buffer_pool ibtmp1 '#innodb_temp' mysql.ibd performance_schema public_key.pem server-key.pem test undo_002
root@worker1:/mnt/data/mysql# cd ..
root@worker1:/mnt/data# cd mysql-1/
root@worker1:/mnt/data/mysql-1# ls
auto.cnf binlog.000003 ca.pem gaia_test ib_buffer_pool '#innodb_redo' mobiread_test2 mysql.sock public_key.pem sys undo_002
binlog.000001 binlog.index client-cert.pem '#ib_16384_0.dblwr' ibdata1 '#innodb_temp' mysql performance_schema server-cert.pem sysdb_mobiread_test2
binlog.000002 ca-key.pem client-key.pem '#ib_16384_1.dblwr' ibtmp1 mobiread_shared_test2 mysql.ibd private_key.pem server-key.pem undo_001
root@worker1:/mnt/data/mysql-1#
so when i login to mysql from one place it shows other databases when i login from another place it shows the other. Can someone please instruct me with the general idea how to do this
THANKS
https://redd.it/1ebyfw2
@r_devops
When to consider myself a SSR DevOps
Hi everyone! I hope y'all alright!
I was having this question about when should I consider myself to be a SSR Devops in terms of knowledge, because when I get to an interview I get a lot of theorical questions that I do not know the answer, but when I'm given a task I'll do it even without the necessary knowledge (yeah I'm talking about you AWS)
Thank you!
https://redd.it/1ebtbyk
@r_devops
Malware scanning suggestions?
Had a few Wordpress sites get compromised recently. I've got all the things you'd expect (closed ports / 2FA / Wordfence security).
I'm looking into something like https://sandflysecurity.com/ - has anyone got any experience with this?
https://redd.it/1ebqc4p
@r_devops
Any good way to migrate a wiki from Github to Azure DevOps?
Where I work they are switching from Github to Azure Repos, the code part was super easy. The issue is we had a pretty nice and very useful wiki setup on Github, and would like to migrate it to Azure Wiki if possible. I don't have much familiarity with DevOps other than configuring a simple pipeline, so I would like to know if there is a simple way to do that migration other than copying article by article
https://redd.it/1ebi7u4
@r_devops