Lead Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
- Lead and mentor a team of data engineers across architecture, development, testing, and delivery
- Design and implement scalable data pipelines and medallion architecture data models within Databricks
- Build cloud-native ingestion, transformation, orchestration, and analytical workflows
- Migrate legacy SQL Server and SSIS workloads to modern Lakehouse architecture
- Develop AI-enabled data products, dashboards, and conversational analytics capabilities
- Partner with architects, analysts, and federal stakeholders to deliver high-impact data solutions
- Implement data quality, governance, security, CI/CD, and operational monitoring best practices
- Support the full lifecycle of enterprise data products from development through production operations
- Help drive innovation using modern AI, automation, and cloud platform capabilities
Requirements
Do you have experience in Technical solutions implementation?, Do you have a Bachelor’s degree?, * 8+ years of professional data engineering experience
- 3+ years working with modern cloud-based enterprise data platforms
- Strong hands-on experience with Databricks, Snowflake, Microsoft Fabric, or similar platforms
- Strong SQL and Python development experience
- Experience building production-grade ingestion and transformation pipelines
- Experience designing analytical data models and medallion architecture solutions
- Experience leading engineering teams or technical workstreams
- Experience implementing CI/CD, testing, governance, and security controls within enterprise data environments
- Ability to communicate effectively with both technical and non-technical stakeholders
- U.S. Citizenship required, * Deep Databricks expertise including Unity Catalog, Delta Lake, Spark SQL, PySpark, and Databricks Workflows
- Experience with AI/ML-enabled data products, LLM integrations, or conversational analytics
- Experience with streaming or near real-time ingestion pipelines
- Experience modernizing SQL Server and SSIS environments
- Experience with AWS services supporting Databricks deployments
- Experience working in federal government or regulated environments
- DOE experience strongly preferred, * Bachelor’s (Required), * Databricks Hosted on AWS: 3 years (Required)
- Data Engineering: 8 years (Required)
- Modern cloud-based enterprise data platforms: 3 years (Required)
Benefits & conditions
$150,000 - $165,000 a year - Permanent, Full-time, Pulled from the full job description
- 401(k)
- Health insurance
- Retirement plan
- 401(k) matching
- Paid time off
- Vision insurance
- Dental insurance, Work Environment
- Fully remote within the United States
- Candidates should generally support Eastern or Central Time business hours
- Occasional travel for client meetings or team collaboration events
Pay: $150,000.00 - $165,000.00 per year, * 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Life insurance
- Paid time off
- Retirement plan
- Vision insurance
About the company
Digital Strategy LLC is seeking a Lead Data Platform Engineer to support a major U.S. Department of Energy modernization initiative focused on migrating legacy SQL Server and SSIS environments to a modern AWS-hosted Databricks enterprise data platform. This is a hands-on technical leadership role for someone who can lead engineering teams while actively building scalable cloud-native data products, AI-enabled analytics capabilities, and modern data platform solutions. You will help shape the next generation of enterprise data delivery for mission-critical federal programs while working alongside experienced architects, engineers, analysts, and federal stakeholders.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Making Data Warehouses Fast: A Developer’s Story
Data Engineer Salary UK
How to Become an AI Engineer
Highest Paying Tech Companies for Developers