Principal Data Engineer

Data Inc
Irving, United States of America
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 174K

Job location

Irving, United States of America

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
Big Data
Google BigQuery
Business Software
Cloud Computing
Computer Programming
Databases
Data Architecture
Data Infrastructure
Data Integration
Data Mart
Data Systems
Data Warehousing
DevOps
Distributed Computing Environment
Elasticsearch
Data Flow Control
Graph Database
Hadoop
Python
Neo4j
NoSQL
Pair Programming
Systems Development Life Cycle
Software Engineering
SQL Databases
Data Streaming
Systems Integration
Workflow Management Systems
Data Processing
Google Cloud Platform
Spark
PySpark
Information Technology
Data Management
Api Design
Apache Beam
Microservices

Job description

In this role, you will serve as a lead (anchor) engineer, driving the design and delivery of reusable, enterprise-grade data capabilities leveraged across Cotality. You will play a key role in building robust, scalable, and efficient data processing frameworks that support a wide range of business applications and strategic initiatives., * Design and implement scalable, high-performance data solutions using industry best practices and modern technologies, ensuring optimal integration, reliability, scalability, flexibility, and maintainability

  • Translate business requirements and processes into well-architected technical solutions, aligning with enterprise architecture standards and long-term technology strategy
  • Define and document solution architecture, technical designs, and requirements to support business objectives while balancing practical implementation and strategic vision
  • Provide technical leadership and guidance to engineering and support teams, ensuring alignment with business and IT strategies
  • Develop and present architecture and design artifacts to both technical and non-technical stakeholders
  • Proactively identify challenges, assess downstream impacts across business domains, and drive solution design through research, validation, and stakeholder consensus
  • Apply industry and domain best practices, offering architectural guidance and strategic input to business and technology leadership
  • Evaluate the impact of new solutions on existing architecture, ensuring compliance with enterprise standards and governance frameworks
  • Contribute to enterprise-wide technology initiatives and support critical issue resolution when needed
  • Actively participate in team ceremonies, provide status updates, and support overall project governance and execution

Requirements

We are seeking a highly motivated and self-driven Data Engineer with a strong background in building scalable batch and streaming data pipelines. The ideal candidate brings deep expertise in Google Cloud Platform (GCP), with hands-on experience in Dataflow, BigQuery, Python, and graph databases such as Neo4j and Google Spanner. Familiarity with orchestration tools like Apache Airflow is essential., * Bachelor's degree in Computer Science, Engineering, or a related discipline (or equivalent work experience)

  • 7+ years of experience in IT, with strong expertise in data architecture, integrating and analyzing disparate data sources, and driving data quality improvements-preferably within the mortgage, real estate, or insurance domains
  • Deep understanding of data modeling techniques to support technology optimization, data consolidation, and strategic architecture planning
  • Strong knowledge of the full lifecycle of database, data warehouse, and data mart design and development
  • Proven experience in enterprise data architecture, including governance, standards, and strategy development
  • Demonstrated ability to resolve complex enterprise-wide data architecture challenges
  • Expertise in designing data management solutions aligned with strategic technology roadmaps and emerging industry trends
  • Proficiency with data modeling tools and strong experience across SQL and NoSQL technologies

Technical Skills & Experience

  • Hands-on experience with cloud platforms such as AWS and Google Cloud Platform (GCP)
  • Strong programming skills in Python and PySpark
  • Experience with AI development frameworks and lifecycle methodologies (e.g., BMAD, Spec Kit)
  • Experience with big data and distributed processing technologies such as Hadoop, Spark, and Elasticsearch
  • Working knowledge of modern data platforms, including graph databases (e.g., Neo4j, Google Spanner)
  • Experience with data processing and orchestration tools such as Google Cloud Dataflow, Apache Beam, and Apache Airflow
  • Ability to develop and document detailed technical designs and specifications

Leadership & Soft Skills

  • Proven ability to mentor and guide engineering teams on architectural best practices and technical approaches
  • Strong communication skills, with a collaborative mindset and interest in pair programming environments
  • Ability to manage multiple projects and priorities in a fast-paced environment
  • Excellent organizational, time management, and problem-solving skills
  • Strong interpersonal and stakeholder management abilities
  • Preferred Qualifications
  • Domain experience in Real Estate, Mortgage, or Insurance industries is highly desirable, Agile Methodology, API Design, Architectural Specifications, Cloud Computing, DevOps, Engineering Leadership, Mentorship, Microservices Architecture, Software Agent, Software Development, Solution Architecture

Benefits & conditions

4.44.4 out of 5 stars Irvine, CA 92618 Hybrid work $144,194.66 - $173,653.78 a year - Full-time, Pulled from the full job description

  • Parental leave
  • 401(k)
  • Health insurance
  • Retirement plan
  • Dental insurance
  • Flexible schedule, * 401(k)
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Parental leave
  • Retirement plan

Apply for this position