Principal Data Engineer

CareerCircle
San Diego, CA, United States
about 1 month ago
Apply on www.careercircle.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience required
0 years minimum
Compensation
$124,800.0 - $208,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Cloud Computing Cloud Database Data Architecture Information Engineering Data Governance Data Infrastructure Data Security Dataspaces Data Systems Digital Architecture
+19 more
Distributed Computing Environment Distributed Data Store Distributed Systems Python (Programming Language) Machine Learning Meta-Data Management DataOps Enterprise Data Management Data Processing Cloud Platform System High Performance Computing Apache Spark Data Strategy Data Lakes Information Technology Data Management Machine Learning Operations Data Pipelines Databricks

Job description

The Principal Data Engineer leads the design, development, and evolution of an enterprise data architecture and data platform strategy that powers advanced research, simulation, testing, and engineering environments. This role builds and maintains scalable, cloud-based data pipelines and infrastructure that provide scientists, engineers, and machine learning teams with reliable, high-quality data for analytics, modeling, and technology development. The Principal Data Engineer establishes robust data governance standards, optimizes platform performance and cost, and serves as a hands-on technical leader who drives innovation, scalability, and continuous improvement across the data ecosystem while partnering closely with research, engineering, IT, and business stakeholders., * Lead the design, implementation, and roadmap of the enterprise data architecture and data platform strategy to support research, simulation, testing, and engineering environments.

  • Build, maintain, and optimize scalable data pipelines that integrate data from multiple scientific, engineering, and operational sources.
  • Develop and manage cloud-based data infrastructure that supports analytics, modeling, and technology development for scientists, engineers, and machine learning teams.
  • Establish and maintain data governance standards, including data security, lineage, metadata management, data quality, and lifecycle controls across complex data environments.
  • Optimize the performance, reliability, scalability, and cost efficiency of cloud-based data systems and distributed data processing platforms.
  • Partner with research, engineering, IT, and business stakeholders to align data architecture and platform capabilities with organizational objectives.
  • Support the integration of AI and machine learning workflows, high-performance computing environments, simulation platforms, and advanced research systems into the data platform.
  • Define and enforce architecture standards, best practices, and patterns for data engineering and data platform development.
  • Document architecture decisions, data models, and technical designs, and communicate complex concepts clearly to both technical and non-technical audiences.
  • Serve as a hands-on technical leader by contributing to code, reviewing implementations, and mentoring other engineers in data engineering best practices.
  • Drive continuous improvement initiatives across the data ecosystem, including automation, observability, and reliability enhancements.
  • Collaborate with cross-functional teams to design and support large-scale, data-intensive engineering and scientific environments.
  • Enable AI/ML data pipelines and MLOps practices that support machine learning experimentation, training, and deployment.
  • Ensure data platforms effectively support machine learning, simulation, modeling, experimental research, and high-performance computing workflows.
  • Influence technical strategy and lead cross-functional initiatives that shape the future of the research data ecosystem and data strategy.

Requirements

Automation Mentorship Innovation Data Lakes Mathematics Scalability Reliability Data Quality Data Science Apache Spark Communication Observability Data Security Data Modeling Data Pipelines Access Controls Data Governance Data Processing Computer Science Azure Databricks Machine Learning Data Engineering Data Architecture Distributed Cloud Influencing Skills Technical Strategy Workflow Management Data Infrastructure Metadata Management Distributed Data Store Artificial Intelligence Engineering Design Process Python (Programming Language) Influencing Without Authority Continuous Improvement Process MLOps (Machine Learning Operations), * Strong hands-on development experience using Python to build, maintain, and optimize enterprise-scale data solutions.

  • Proven experience designing and implementing scalable data pipelines that integrate data from multiple scientific, engineering, and operational sources.
  • Expertise with Azure Databricks, Apache Spark, and distributed cloud-based data processing environments.
  • Deep understanding of data architecture, including data lakes, data modeling, metadata management, and platform scalability.
  • Experience establishing and managing data governance, including data quality, lineage, security, and access control standards within complex data environments.
  • Strong expertise in cloud-based data platforms and distributed systems, with practical experience in modern data technologies.
  • Experience designing and supporting large-scale, data-intensive engineering or scientific environments.
  • Experience working with research, simulation, instrumentation, sensor, or high-performance computing generated data.
  • Familiarity with AI and machine learning data pipelines, MLOps practices, or machine learning enablement.
  • Deep knowledge of data governance, security, metadata management, lineage, and data quality frameworks.
  • Ability to lead cross-functional initiatives and influence technical strategy across multiple stakeholder groups.
  • Strong communication skills with the ability to translate complex technical concepts into clear business value.
  • Bachelor’s degree in Computer Science, Data Engineering, Data Science, Mathematics, or a related technical field.
  • 10+ years of experience in data engineering, data architecture, or enterprise data platform development., Research Visionary Automation Mentorship Innovation Data Lakes Mathematics Scalability Reliability Data Quality Data Science Apache Spark Communication Observability Data Security Data Modeling Data Pipelines Access Controls Data Governance Data Processing Computer Science Azure Databricks Machine Learning Data Engineering Data Architecture Distributed Cloud Influencing Skills Technical Strategy Workflow Management Data Infrastructure Metadata Management Distributed Data Store Artificial Intelligence Engineering Design Process Python (Programming Language) Influencing Without Authority Continuous Improvement Process MLOps (Machine Learning Operations) +0

Benefits & conditions

This is a Contract position based out of San Diego, CA. Pay and Benefits

The pay range for this position is $60.00 - $100.00/hr.

Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following: * Medical, dental & vision * Critical Illness, Accident, and Hospital * 401(k) Retirement Plan - Pre-tax and Roth post-tax contributions available * Life Insurance (Voluntary Life & AD&D for the employee and dependents) * Short and long-term disability * Health Spending Account (HSA) * Transportation benefits * Employee Assistance Program * Time Off/Leave (PTO, Vacation or Sick Leave) Workplace Type

About the company

Actalent is a global leader in engineering and sciences services and talent solutions. We help visionary companies advance their engineering and science initiatives through access to specialized experts who drive scale, innovation and speed to market. With a network of almost 20,000 consultants and 5,000 clients across the U.S., Canada, Asia and Europe, Actalent serves many of the Fortune 500. We are proud to be an Engineering News-Record (ENR) Top 500 Design Firm for our engineering design services and a ClearlyRated Best of Staffing® winner for both client and talent service.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careercircle.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all