Databricks Platforms Engineer / Admin

Quadrant, Inc.
Washington, DC, United States
3 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$130,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Domain Name System (DNS) Identity and Access Management Subnetting Python (Programming Language) Linux System Administration Amazon Virtual Private Cloud (VPC) Information Technology Deployment Automation
+3 more
Cloudwatch Terraform Databricks

Job description

Experienced Databricks Platform Engineer, Deploy and administer Databricks workspaces from scratch using Terraform and Databricks SRA on AWS GovCloud/Commercial environments. Design and implement AWS networking, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS. Administer Unity Catalog, including metastores, catalogs, schemas, external locations, grants, and row/column-level security. Build and maintain CI/CD pipelines for infrastructure and Databricks Asset Bundles (DABs) deployments. Establish platform governance, security standards, workspace guardrails, tagging, and naming conventions. Automate provisioning of cluster policies, secrets, service principals, and SSO/SCIM integrations. Monitor platform health, utilization, and costs and provide FinOps/right-sizing recommendations. Serve as an escalation point for Databricks platform incidents and perform root-cause analysis. Quadrant is an affirmative action/equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, status as a protected veteran, or status as an individual with a disability. ā€œHealthcare benefits are offered to all eligible employees according to compliance mandated by the Affordable Care Actā€., AI Engineer 5 (GenAI Platform Services, Agentic Platform) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has…

  • 16 hours ago +

Requirements

6+ years of experience administering/engineering Databricks platforms, ideally within AWS environments. Strong hands-on Terraform experience across networking, IAM, compute, and storage. Strong knowledge of Databricks SRA and Unity Catalog administration. Experience with Databricks Asset Bundles (DABs) or equivalent deployment automation. Experience with Python and Linux systems administration. Strong AWS experience, including VPC, IAM, S3, KMS, EC2, and CloudWatch. AWS GovCloud experience is a plus. Experience operating in regulated/compliance-heavy environments; FISMA High/FedRAMP High experience is a plus. Bachelor’s degree in Computer Science, Engineering, or related field highly preferred.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou Ā· Coffee With Developers

4:30 min

Navigating preview bugs in Azure Container Apps

Matthias Falkenberg +1 Ā· World Congress 2022

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis Ā· LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 Ā· LIVE

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo Ā· LIVE

2:26 min

Key benefits of layer seven network portability

Alex Soto Alex Soto Ā· World Congress 2024

Videos

See all

Related articles

See all