Principal Data Engineer

Data Inc
Irving, TX, United States
23 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$144,195.0 - $173,654.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Airflow Amazon Web Services Big Data BigQuery Business Software Cloud Computing Computer Programming Databases Data Architecture Data Infrastructure Data Integration
+28 more
Data Mart Data Systems Data Warehousing DevOps Distributed Computing Environment Elasticsearch Data Flow Control Graph Database Apache Hadoop Python (Programming Language) Neo4j NoSQL Pair Programming Systems Development Life Cycle Software Engineering SQL Databases Data Streaming Systems Integration Workflow Management Systems Data Processing Google Cloud Apache Spark Pyspark Information Technology Data Management Api Design Apache Beam Microservices

Job description

In this role, you will serve as a lead (anchor) engineer, driving the design and delivery of reusable, enterprise-grade data capabilities leveraged across Cotality. You will play a key role in building robust, scalable, and efficient data processing frameworks that support a wide range of business applications and strategic initiatives., * Design and implement scalable, high-performance data solutions using industry best practices and modern technologies, ensuring optimal integration, reliability, scalability, flexibility, and maintainability

  • Translate business requirements and processes into well-architected technical solutions, aligning with enterprise architecture standards and long-term technology strategy
  • Define and document solution architecture, technical designs, and requirements to support business objectives while balancing practical implementation and strategic vision
  • Provide technical leadership and guidance to engineering and support teams, ensuring alignment with business and IT strategies
  • Develop and present architecture and design artifacts to both technical and non-technical stakeholders
  • Proactively identify challenges, assess downstream impacts across business domains, and drive solution design through research, validation, and stakeholder consensus
  • Apply industry and domain best practices, offering architectural guidance and strategic input to business and technology leadership
  • Evaluate the impact of new solutions on existing architecture, ensuring compliance with enterprise standards and governance frameworks
  • Contribute to enterprise-wide technology initiatives and support critical issue resolution when needed
  • Actively participate in team ceremonies, provide status updates, and support overall project governance and execution

Requirements

We are seeking a highly motivated and self-driven Data Engineer with a strong background in building scalable batch and streaming data pipelines. The ideal candidate brings deep expertise in Google Cloud Platform (GCP), with hands-on experience in Dataflow, BigQuery, Python, and graph databases such as Neo4j and Google Spanner. Familiarity with orchestration tools like Apache Airflow is essential., * Bachelor’s degree in Computer Science, Engineering, or a related discipline (or equivalent work experience)

  • 7+ years of experience in IT, with strong expertise in data architecture, integrating and analyzing disparate data sources, and driving data quality improvements-preferably within the mortgage, real estate, or insurance domains
  • Deep understanding of data modeling techniques to support technology optimization, data consolidation, and strategic architecture planning
  • Strong knowledge of the full lifecycle of database, data warehouse, and data mart design and development
  • Proven experience in enterprise data architecture, including governance, standards, and strategy development
  • Demonstrated ability to resolve complex enterprise-wide data architecture challenges
  • Expertise in designing data management solutions aligned with strategic technology roadmaps and emerging industry trends
  • Proficiency with data modeling tools and strong experience across SQL and NoSQL technologies

Technical Skills & Experience

  • Hands-on experience with cloud platforms such as AWS and Google Cloud Platform (GCP)
  • Strong programming skills in Python and PySpark
  • Experience with AI development frameworks and lifecycle methodologies (e.g., BMAD, Spec Kit)
  • Experience with big data and distributed processing technologies such as Hadoop, Spark, and Elasticsearch
  • Working knowledge of modern data platforms, including graph databases (e.g., Neo4j, Google Spanner)
  • Experience with data processing and orchestration tools such as Google Cloud Dataflow, Apache Beam, and Apache Airflow
  • Ability to develop and document detailed technical designs and specifications

Leadership & Soft Skills

  • Proven ability to mentor and guide engineering teams on architectural best practices and technical approaches
  • Strong communication skills, with a collaborative mindset and interest in pair programming environments
  • Ability to manage multiple projects and priorities in a fast-paced environment
  • Excellent organizational, time management, and problem-solving skills
  • Strong interpersonal and stakeholder management abilities
  • Preferred Qualifications
  • Domain experience in Real Estate, Mortgage, or Insurance industries is highly desirable, Agile Methodology, API Design, Architectural Specifications, Cloud Computing, DevOps, Engineering Leadership, Mentorship, Microservices Architecture, Software Agent, Software Development, Solution Architecture

Benefits & conditions

4.44.4 out of 5 stars Irvine, CA 92618 Hybrid work $144,194.66 - $173,653.78 a year - Full-time, Pulled from the full job description

  • Parental leave
  • 401(k)
  • Health insurance
  • Retirement plan
  • Dental insurance
  • Flexible schedule, * 401(k)
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Parental leave
  • Retirement plan

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:24 min

Comparing Neo4j and GraphQL conceptual models

William Lyon · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · WWC Europe 2026

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all

Related articles

See all