Senior Databricks Data Engineer (AWS) - Remote Opportunity

Booker DiMaio, LLC
United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Amazon S3 Business Analytics Applications Big Data Cloud Database Cloud Engineering Information Systems Data Architecture Data Governance Data Infrastructure Extract Transform Load (ETL) Data Retention
+26 more
Data Security Data Warehousing Identity and Access Management Python (Programming Language) Machine Learning Meta-Data Management Performance Tuning Query Optimization Standard Sql Data Streaming Enterprise Data Management Cloud Platform System Data Ingestion Software Troubleshooting Caching Data Layers Event Driven Architecture Data Lakes Information Technology Data Lineage Data Analytics AWS Data Analytics Tools for Reporting Cloudwatch Data Pipelines Databricks

Job description

We are seeking two Senior Databricks Data Engineers to support a large-scale federal Enterprise Data Platform (EDP) modernization initiative. This role will focus on designing, developing, optimizing, and governing cloud-native data solutions utilizing Databricks Lakehouse technologies and Amazon Web Services (AWS).

The ideal candidate possesses extensive experience building enterprise-scale data pipelines, implementing data governance controls, optimizing large-scale data processing workloads, and enabling secure analytics capabilities in cloud environments. This position offers the opportunity to support a mission-critical federal data platform supporting trusted data intake, governed access, and advanced analytics capabilities., * Design, develop, and maintain scalable data ingestion, transformation, and publishing pipelines utilizing Databricks and AWS services.

  • Implement and optimize Databricks Lakehouse capabilities including Unity Catalog, Delta Live Tables, Auto Loader, Databricks SQL, and Delta Sharing.
  • Build and maintain governed data products supporting operational, analytical, reporting, and machine learning workloads.
  • Develop and support medallion architecture data pipelines and enterprise data quality frameworks.
  • Implement data governance controls, metadata management, lineage tracking, and data retention policies.
  • Collaborate with cloud engineers, architects, cybersecurity specialists, and business stakeholders to deliver secure, production-ready solutions.
  • Optimize platform performance through partitioning, clustering, caching, workload tuning, and query optimization techniques.
  • Support analytics enablement through semantic layers, dashboards, reporting solutions, and self-service data access capabilities.
  • Participate in architecture reviews, operational readiness activities, platform modernization initiatives, and continuous improvement efforts.
  • Create and maintain technical documentation, design artifacts, operational procedures, and engineering standards.

Requirements

Do you have experience in Technical troubleshooting support?, Previous experience with a government client is required., * Bachelor’s degree in Computer Science, Information Systems, Engineering, Mathematics, or a related discipline.

  • Minimum eight (8) years of experience in cloud-based data engineering, platform development, or data architecture.
  • Minimum three (3) years of hands-on Databricks experience in production environments.
  • Experience designing, developing, and supporting large-scale ETL/ELT solutions.
  • Strong experience with AWS services including S3, IAM, Glue, Athena, Lambda, Redshift, and CloudWatch.
  • Experience implementing enterprise data governance and security controls.
  • Strong SQL and Python development skills.
  • Experience working with data lakes, data warehouses, and cloud-native analytics platforms.
  • Strong troubleshooting, performance tuning, and optimization experience., * Databricks Certified Data Engineer Associate or Professional certification.
  • AWS Data Analytics Specialty certification.
  • Experience supporting federal government or highly regulated environments.
  • Experience with real-time streaming, CDC solutions, and event-driven architectures.
  • Familiarity with FedRAMP, FISMA, and NIST security frameworks.
  • Experience supporting large-scale enterprise data platforms.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:15 min

Reversing the caching model for artifact delivery

Thijs Feryn Thijs Feryn · WWC Europe 2026

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:33 min

Maintaining prompt structures for prefix caching

Douglas Reiser Douglas Reiser · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all