Lead Data Platform Engineer

DIGITAL STRATEGIES, LLC
United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$150,000.0 - $165,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Data Analysis Cloud Engineering Continuous Delivery Continuous Integration Data Architecture Information Engineering Data Infrastructure Data Systems Apache Hive Python (Programming Language)
+14 more
Microsoft SQL Server Standard Sql SQL Server Integration Services Enterprise Data Management Cloud Platform System Data Ingestion Large Language Models Snowflake Microsoft Fabric Data Lakes Pyspark Data Analytics Data Pipelines Databricks

Job description

  • Lead and mentor a team of data engineers across architecture, development, testing, and delivery
  • Design and implement scalable data pipelines and medallion architecture data models within Databricks
  • Build cloud-native ingestion, transformation, orchestration, and analytical workflows
  • Migrate legacy SQL Server and SSIS workloads to modern Lakehouse architecture
  • Develop AI-enabled data products, dashboards, and conversational analytics capabilities
  • Partner with architects, analysts, and federal stakeholders to deliver high-impact data solutions
  • Implement data quality, governance, security, CI/CD, and operational monitoring best practices
  • Support the full lifecycle of enterprise data products from development through production operations
  • Help drive innovation using modern AI, automation, and cloud platform capabilities

Requirements

Do you have experience in Technical solutions implementation?, Do you have a Bachelor’s degree?, * 8+ years of professional data engineering experience

  • 3+ years working with modern cloud-based enterprise data platforms
  • Strong hands-on experience with Databricks, Snowflake, Microsoft Fabric, or similar platforms
  • Strong SQL and Python development experience
  • Experience building production-grade ingestion and transformation pipelines
  • Experience designing analytical data models and medallion architecture solutions
  • Experience leading engineering teams or technical workstreams
  • Experience implementing CI/CD, testing, governance, and security controls within enterprise data environments
  • Ability to communicate effectively with both technical and non-technical stakeholders
  • U.S. Citizenship required, * Deep Databricks expertise including Unity Catalog, Delta Lake, Spark SQL, PySpark, and Databricks Workflows
  • Experience with AI/ML-enabled data products, LLM integrations, or conversational analytics
  • Experience with streaming or near real-time ingestion pipelines
  • Experience modernizing SQL Server and SSIS environments
  • Experience with AWS services supporting Databricks deployments
  • Experience working in federal government or regulated environments
  • DOE experience strongly preferred, * Bachelor’s (Required), * Databricks Hosted on AWS: 3 years (Required)
  • Data Engineering: 8 years (Required)
  • Modern cloud-based enterprise data platforms: 3 years (Required)

Benefits & conditions

$150,000 - $165,000 a year - Permanent, Full-time, Pulled from the full job description

  • 401(k)
  • Health insurance
  • Retirement plan
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance, Work Environment
  • Fully remote within the United States
  • Candidates should generally support Eastern or Central Time business hours
  • Occasional travel for client meetings or team collaboration events

Pay: $150,000.00 - $165,000.00 per year, * 401(k)

  • 401(k) matching
  • Dental insurance
  • Health insurance
  • Life insurance
  • Paid time off
  • Retirement plan
  • Vision insurance

About the company

Digital Strategy LLC is seeking a Lead Data Platform Engineer to support a major U.S. Department of Energy modernization initiative focused on migrating legacy SQL Server and SSIS environments to a modern AWS-hosted Databricks enterprise data platform. This is a hands-on technical leadership role for someone who can lead engineering teams while actively building scalable cloud-native data products, AI-enabled analytics capabilities, and modern data platform solutions. You will help shape the next generation of enterprise data delivery for mission-critical federal programs while working alongside experienced architects, engineers, analysts, and federal stakeholders.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · WWC Europe 2026

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:46 min

Transforming data architecture from on-premise to cloud

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all