Required Skills & Experience
-Strong DevOps and Platform Engineering experience supporting production Kubernetes environments. -Strong expertise with Apache Airflow, including platform administration, operations, deployments, troubleshooting, and high-availability architecture. -Hands-on experience with Kubernetes (AKS), Docker, and containerized application platforms. -Deep knowledge of Azure infrastructure, including networking, private endpoints, DNS, TLS certificates, NSGs, Key Vault, and hybrid connectivity. -Strong Linux administration skills including shell scripting (Bash/KSH), and Python automation. -Experience building and maintaining CI/CD pipelines using GitHub Actions, Azure DevOps, and JFrog Artifactory/Xray. -Strong PostgreSQL experience, including performance tuning, backup and recovery, retention management, replication, and high-availability configurations. -Proficiency with Terraform and Infrastructure as Code (IaC) for scalable, repeatable platform deployments. -Experience supporting Redis and message broker technologies, including authentication, scaling, monitoring, and queue health management. -Hands-on experience with monitoring and observability tools such as Prometheus and Grafana, including alerting, dashboarding, and operational runbooks. -Strong troubleshooting and root-cause analysis skills across infrastructure, networking, databases, operating systems, and distributed applications.
Nice to Have Skills & Experience
-Airflow certification and/or extensive experience operating Airflow 3.x environments. -Mainframe integration experience, including z/OSMF, Connect: Direct, SFTP, or related enterprise technologies.
Job Description
We are seeking a Senior Platform DevOps Engineer to lead the design, deployment, and operational support of a mission-critical Apache Airflow 3 platform running on Azure Kubernetes Service (AKS). This individual will own the Airflow control plane, release packaging, fleet-scale worker deployments, platform networking and security, observability, and L2 operational support while ensuring high availability, resiliency, and scalability across distributed environments. The ideal candidate brings deep expertise in Kubernetes, Azure infrastructure, Linux, Terraform, GitHub Actions, Azure DevOps, JFrog, PostgreSQL, Redis, and cloud security, along with proven experience automating large-scale deployments across multiple hosts and sites through repeatable, self-validating processes. Responsibilities include tuning and supporting PostgreSQL, managing message broker health and scaling, implementing disaster recovery and failover strategies, driving vulnerability remediation and compliance initiatives, and developing robust monitoring and alerting capabilities using Prometheus and Grafana. Experience with Apache Airflow 3.x operations, enterprise networking and firewall processes, hybrid on-prem connectivity, and mainframe integrations is highly preferred. This role requires a hands-on, automation-first engineer who excels at root-cause analysis across infrastructure, networking, databases, and application layers and can help establish both production and lab-based Airflow environments, including creating a local Airflow 3.3 cluster replica for testing and validation.