DevOps Engineer

We are looking for a talented DevOps Engineer to join the team of our exceptional client. This role is focused on supporting and enhancing a modern data and AI platform environment, enabling data engineering, machine learning, and analytics teams to efficiently build, deploy, and operate data-driven solutions., * Support the day-to-day administration of enterprise Databricks environments, including workspace operations, Unity Catalog, cluster management, and platform maintenance

• Provide technical support to data engineering, machine learning, and analytics teams utilizing Databricks notebooks, jobs, SQL warehouses, and asset bundles

• Develop and maintain infrastructure-as-code solutions using Terraform and Databricks CLI

• Support CI/CD pipelines and deployment processes for Databricks assets, workflows, and applications

• Assist development teams in implementing best practices for Databricks development, deployment, and operations

• Contribute to cloud cost optimization and FinOps initiatives through resource management, autoscaling strategies, and cost attribution practices

• Build and maintain monitoring, alerting, and operational dashboards to improve platform reliability and performance

• Troubleshoot platform and infrastructure issues while contributing to operational runbooks and incident resolution processes

• Support AWS cloud infrastructure, including IAM, S3, networking, security, and access management

• Collaborate closely with data engineers, machine learning engineers, and data scientists to improve platform capabilities and operational efficiency

• Maintain platform documentation and communicate project status, risks, and progress to stakeholders

This position requires hands-on experience with Databricks, AWS cloud services, infrastructure automation, and CI/CD practices. The ideal candidate is a strong problem solver who enjoys working across DevOps, MLOps, cloud infrastructure, and platform engineering initiatives while helping teams maximize the value of enterprise data and AI platforms., * 4-7 years of experience in DevOps, MLOps, platform engineering, or cloud infrastructure engineering

• Hands-on experience administering and supporting Databricks, including Unity Catalog, workspace management, cluster policies, service principals, and permissions

• Strong AWS experience, including IAM, S3, EC2, and VPC networking

• Experience with Terraform and infrastructure automation

• Proficiency in Python and/or Bash scripting

• Experience building and maintaining CI/CD pipelines using tools such as GitHub Actions or Jenkins

• Strong troubleshooting and problem-solving skills within cloud and data platform environments

• Experience supporting development teams in modern software delivery and deployment practices

• Excellent communication skills and the ability to collaborate effectively within cross-functional teams, * Experience with the Databricks SDK (Python) and Databricks REST APIs

• Familiarity with FinOps and cloud cost optimization practices

• Experience supporting MLOps, machine learning, or data science workloads

• Knowledge of monitoring and observability tools such as CloudWatch, Grafana, or Datadog

• Experience implementing Unity Catalog governance and enterprise data governance frameworks

• Bachelor''s degree in Computer Science, Engineering, or a related technical field

Market Street Talent is a specialized staffing and consulting firm focused on IT and technology positions. Our deep industry knowledge allows us to match exceptional candidates with organizations where they can thrive and make an immediate impact. Our Vision: To promote and foster the growth of information technology (IT) in our world-one candidate, one client, one community at a time. Our Goal: To guide clients and candidates through the placement process and build long-term, successful relationships. Our Culture: At MST, we value excellence, respect, and empathy in everything we do.