Platform Engineer (Azure DevOps & Databricks Focus

Bitsoft International, Inc.
St. Louis, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

St. Louis, United States of America

Tech stack

Airflow
Azure
Bash
Big Data
Software as a Service
Cloud Computing
Cloud Computing Security
Cloud Engineering
Continuous Delivery
Continuous Integration
Information Engineering
Data Governance
ETL
DevOps
Github
Monitoring of Systems
Identity and Access Management
Python
Key Management
Operational Databases
Powershell
Role-Based Access Control
Azure
Azure
Datadog
Scripting (Bash/Python/Go/Ruby)
Cloud Platform System
Azure
Multi-Cloud
HybridCloud
Containerization
Kubernetes
Infrastructure Automation Frameworks
Collibra
Bicep
Terraform
Data Pipelines
Dynatrace
Docker
Jenkins
Databricks

Job description

Seeking an experienced Cloud Platform Engineer to design, implement, and enhance a secure, scalable, and highly automated data platform built on Azure. This role emphasizes Infrastructure as Code, continuous deployment, robust data workflows, and cloud security/governance, specializing in Azure and Databricks ecosystems., Architect, automate, and support the end-to-end delivery of infrastructure and applications across multiple environments (dev/test/prod) using IaC and CI/CD pipelines.

  • Deploy and manage containerized applications at scale, ensuring best practices for availability, cost, and security.
  • Oversee Databricks platform administration, cluster and workspace management, and orchestrate robust production data pipelines.
  • Implement and enforce least-privilege access models, secrets rotation, and audit-ready governance for all cloud resources.
  • Design and tune monitoring systems for actionable alerting, fast incident response, and root cause analysis.
  • Contribute to documentation, architecture patterns, and continuous improvement of DevOps and data engineering practices.
  • Collaborate closely with Security, Data Engineering, and Operations teams to align on cloud architecture standards.

Requirements

6-9 years of experience in cloud infrastructure engineering, DevOps, or platform engineering.

  • Direct hands-on expertise in Azure DevOps or a comparable CI/CD ecosystem (e.g., GitHub Actions, Jenkins).
  • Strong proficiency managing containerized workloads with Kubernetes; Docker image creation and lifecycle management.
  • Solid background in Infrastructure as Code (IaC) tools (Terraform, Bicep, or ARM templates); Helm chart development and deployment.
  • Experience with large-scale data platforms: Azure Databricks (administration, security, orchestration), Azure Data Factory and/or Apache Airflow, Azure Data Lake or equivalent.
  • Proven capabilities in cloud security, especially RBAC/IAM design and implementation on Azure and/or other major clouds; Azure Active Directory group-based access management.
  • Familiarity with enterprise-grade secrets management using Azure Key Vault or similar solutions.
  • Exposure to monitoring/observability platforms (preferably Dynatrace; other tools such as Azure Monitor, App Insights, Datadog also considered).
  • Advanced scripting in at least one language: Python, PowerShell, Bash.
  • Experience in data governance frameworks, including cataloging and permissions management (e.g., Databricks Unity Catalog or Azure Purview).
  • Deep understanding of cloud networking, automation, and security controls., Experience with multi-cloud or hybrid cloud deployments.
  • Familiarity with other data orchestration and ETL frameworks.
  • Relevant certifications (e.g., Azure Solutions Architect, Certified Kubernetes Administrator, Terraform Associate).
  • Background with financial, healthcare, or other regulated environments.

Preferred Background:

  • Previous roles with leading cloud platform, SaaS, data engineering, or Fortune 500 organizations are highly valued.
  • Proven track record in implementing enterprise-scale automation and governance for cloud platforms.

Apply for this position