The DevOps Engineer builds and standardizes Azure DevOps automation, implementing CI/CD for Databricks and Azure services, ensuring deployment reliability and creating documentation.
Job Title
Dev Ops EngineerJob Description Summary
Job Description
Job Description and Purpose We’re seeking a hands-on DevOps Engineer to build and standardize Azure DevOps automation for data/analytics delivery—primarily focused on Databricks, while also supporting deployments across other Azure components. You’ll create repeatable CI/CD patterns, improve deployment reliability, and enable teams to ship changes safely across environments. KEY ACCOUNTABILITIES · Design, build, and maintain Azure DevOps CI/CD pipelines (YAML-first) for Databricks and Azure platform components. · Implement automated deployments for Databricks assets, including notebooks, repos, jobs/workflows, libraries, and configuration across dev/test/prod. · Develop reusable pipeline templates, shared task groups, and standardized “golden path” patterns for engineering teams. · Implement Infrastructure as Code (IaC) for Azure and Databricks resources (e.g., Terraform and/or Bicep/ARM), including environment promotion strategies. · Establish release practices: branching strategy, artifact/versioning, approvals, change control, and rollback/restore patterns. · Integrate secure authentication and secret management with Azure Key Vault, service connections, managed identities/service principals, and least-privilege RBAC. · Automate deployments/integration for related Azure services as needed (commonly including): · ADLS Gen2, Key Vault, Azure Monitor/Log Analytics · Azure Data Factory (if in use), Event Hubs/Service Bus · Azure Functions/Logic Apps (where applicable) · Improve reliability through quality gates: automated tests, linting, policy checks, and deployment validations. · Implement monitoring/alerting for pipeline health and Databricks job outcomes using Azure Monitor, Log Analytics, and pipeline telemetry. · Produce clear documentation: runbooks, pipeline guides, onboarding material, and operational procedures. JOB REQUIREMENTS & QUALIFICATIONS • 3–7+ years of experience in DevOps / Platform Engineering / SRE with strong delivery ownership. • Demonstrated expertise building Azure DevOps Pipelines (YAML), including multi-stage pipelines, variable groups, approvals, environments, and artifacts. • Experience automating deployments for Databricks using one or more of: o Databricks CLI and/or REST APIs o Terraform Databricks provider o Packaging/release patterns for notebooks/jobs/libraries • Strong knowledge of Azure fundamentals: networking, RBAC, Key Vault, storage, and monitoring. • Proficiency with scripting/automation (Python, PowerShell, Bash) and Git workflows. • Hands-on experience with IaC (Terraform preferred; Bicep/ARM acceptable).INCO: “Cushman & Wakefield”
Similar Jobs
Fintech • Financial Services
The Dev Ops Engineer - Vice President designs and develops scalable software solutions, manages cross-functional collaboration, leads teams, and supports technology strategy alignment with business goals.
Top Skills:
AnsibleAppdynamicsAWSAws CloudformationAzure DevopsBashChefCi/CdDevOpsDockerElkGitlab CiGrafanaJavaJenkinsJIRAKubernetesMongoDBMs Sql ServerOpenshiftPostgresPrisma ScanPrometheusPythonSonarqubeTeamcityTerraformVeracode
Industrial • Manufacturing
The DevOps/Platform Engineer transforms architectural designs into secure and scalable cloud infrastructure using Terraform, managing CI/CD pipelines and collaborating with various teams to ensure reliability and compliance.
Top Skills:
Arm TemplatesAzure DevopsAzure Resource ManagerBicepCheckovGithub ActionsTerraformTerratestTflint
Fintech • Financial Services
Lead and manage engineering teams to deliver high-quality software solutions, driving technical excellence and collaborating with cross-functional teams to meet business objectives.
Top Skills:
AWSAws CloudwatchBashChefCloudFormationDockerGitlab Ci/CdKubernetesPowershellSonarqubeTerraformVeracode
What you need to know about the Mumbai Tech Scene
From haggling for the best price at Chor Bazaar to the bustle of Crawford Market, the energy of Mumbai's traditional markets is a key part of the city's charm. And while these markets will always have their place, the city also boasts a thriving e-commerce scene, ranking among the largest in the region. Driven by online sales in everything from snacks to licensed sports merchandise to children's apparel, the local industry is worth billions, with companies actively recruiting to meet the demands of continued growth.
