Remote Databricks Infrastructure Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+22 more
Job description
Responsibilities: of the Databricks Infrastructure Engineer include: Design, configure, administer, and maintain Databricks platform infrastructure supporting enterprise data engineering, analytics, and forecasting workloads Manage Databricks workspaces, clusters, SQL warehouses, jobs, workflows, Unity Catalog, and access controls Develop and maintain Infrastructure as Code (IaC) solutions using Terraform and cloud automation technologies Implement CI/CD pipelines for Databricks notebooks, workflows, data pipelines, and platform deployments Support cloud-based data ingestion, transformation, feature engineering, and machine learning workloads Monitor platform performance, pipeline reliability, compute utilization, and cloud infrastructure costs Optimize Databricks clusters, workload scheduling, storage configurations, and resource allocation Implement security controls, including identity and access management, network security, secrets management, and data governance Troubleshoot
Requirements
GitHub, Machine Learning, Resource Management, Inventory Management, Team Player, Microsoft Windows Azure, Disaster Recovery, Amazon Web Services (AWS), Data Quality, Supply Chain, infrastructure issues, pipeline failures, and performance bottlenecks across Databricks environments Collaborate with Data Engineers, Data Scientists, DevOps Engineers, and Enterprise Architecture teams to support scalable data solutions Support incident response, root-cause analysis, disaster recovery, and business continuity initiatives Develop technical documentation, operational procedures, and platform engineering best practices Qualifications: for the Databricks Infrastructure Engineer include: Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent professional experience 3+ years of experience in cloud data platform engineering, infrastructure administration, or Databricks platform management Strong hands-on experience administering Databricks environments, including clusters, jobs, workflows, SQL warehouses, and workspace configurations Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform Experience implementing Infrastructure as Code using Terraform or similar technologies Hands-on experience with CI/CD pipelines, Git-based source control, and automated deployment workflows Proficiency with Python, SQL, and scripting for infrastructure automation and platform management Understanding of data engineering concepts, including ETL/ELT pipelines, batch and streaming data processing, Delta Lake, and data quality Experience with cloud networking, identity and access management, security controls, monitoring, and logging Strong troubleshooting, technical documentation, communication, and cross-functional collaboration skills Preferred Qualifications: Experience with Databricks Unity Catalog, MLflow, Delta Live Tables, Databricks Asset Bundles, and model serving Experience supporting forecasting, machine learning, supply chain, demand planning, or enterprise analytics environments Databricks Certified Data Engineer, Databricks Certified Platform Administrator, or relevant, cloud
Benefits & conditions
infrastructure certifications, Experience with cloud cost optimization, FinOps practices, and Databricks compute optimization Familiarity with SAP, ERP systems, supply chain data, inventory management, or sales forecasting integrations Experience with Azure DevOps, GitHub Actions, and automated Databricks deployment frameworks Compensation: for the Databricks Infrastructure Engineer includes: Salary: $115,000 - $130,000 Comprehensive Benefits Package including Medical, Dental, Vision, 401(k), PTO, and Paid Holidays #LI-MM1 #LI-REMOTE
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…