Principal Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+41 more
Job description
Are you passionate about data, architecture, software development, and analytics? Do you bring deep experience with cloud technologies, data warehousing, data integration, data modeling, and API development? Do you believe in modern engineering practices, collaboration, and innovation to build the next generation of enterprise data and AI platforms? If so, we’d like to talk with you. Ally is seeking a Principal Data Engineer to help design, build, and evolve modern data solutions within our Enterprise Data and AI organization. This role is ideal for a strong technical leader with hands-on experience delivering cloud-based data platforms, scalable data pipelines, and enterprise data solutions that support analytics, reporting, data science, and AI use cases. The ideal candidate will bring experience implementing data lakes, cloud data warehouses, and modern data engineering solutions, including data ingestion, transformation, standardization, preparation, data quality management, and structured and unstructured data processing. This role also requires experience with relational and NoSQL data technologies, large-scale data integration, API development, and enterprise data modeling, including Data Vault. Experience with modern cloud data platform technologies, data architecture, and software engineering practices is essential. Knowledge of AI/ML, data science, and LLM-related use cases is also a plus. Knowledge of the insurance business data domain is a significant advantage, particularly in supporting solutions that enable Insurance Data and Analytics capabilities. This role will be responsible for creating, maintaining, and optimizing enterprise data pipelines and related processes that support strategic analytics, machine learning, and AI-driven business capabilities across Insurance lines of business. The selected candidate will help build and advance critical platform capabilities, including Insurance Data and Analytics solutions, data ingestion and transformation frameworks, governance-aligned data engineering processes, and trusted data foundations for analytics and AI. The ideal candidate will bring proven experience leading cloud data engineering initiatives, driving scalable solution design, and establishing strong engineering standards across complex enterprise environments. The Work Itself Design, build, and optimize modern data pipelines and enterprise data solutions that support analytics, reporting, data science, and AI use cases. Develop and implement cloud-based data engineering solutions, including data lakes, cloud data warehouses, and enterprise data platforms. Design scalable data structures and support enterprise data storage using Data Vault modeling to enable flexible, auditable, and resilient data solutions. Build and support data ingestion, transformation, preparation, and quality processes across structured and unstructured data sources. Develop robust solutions for large-scale data integration, relational and NoSQL data processing, and API-based data services. Enable trusted, high-quality, and accessible data for analytics, machine learning, and AI-driven business capabilities. Partner with business and technology teams to define data requirements, transformation rules, integration needs, and solution designs that align to enterprise and line-of-business priorities. Help advance Insurance Data and Analytics platform capabilities through scalable engineering, strong data foundations, and governance-aligned practices. Establish and maintain data quality, validation, monitoring, metadata, and lineage processes to support reliable and well-managed enterprise data assets. Apply modern software engineering methods and Agile practices to deliver scalable, reliable, and maintainable data solutions. Promote engineering, operational, and design standards across data platforms and services. Evaluate and recommend tools, technologies, and approaches that improve performance, delivery, and long-term supportability. Collaborate across business and IT teams to solve complex technical challenges and deliver practical, scalable solutions. Support enterprise data governance, data management, and data security requirements. Provide technical leadership, mentor team members, and contribute to strong delivery outcomes through effective collaboration and sound engineering practices., AWS (S3, AWS CLI, Lambda, DynamoDB) dbt Qlik Replicate InfoSphere DataStage CP4D Data Vault modeling Python Git DevOps API Development Data Governance Metadata & Lineage Data Security Insurance Data Domain (preferred) Enterprise Data Pipelines Cloud Data Warehousing Data Integration & Migration AI/ML and Analytics platforms (preferred), Description We are seeking a Senior Transmission Line Engineer who will work as a member of a dynamic team working in a fast paced environment, solving challenging problems invol…
Requirements
This is a potential contract to hire position - all candidates submitted must be legally authorized to work in the US without sponsorship and local to metro Detroit; able to work a hybrid schedule - 3 days a week at ADC., Bachelor’s degree in Computer Science, Information Systems, or a related field; advanced degree preferred. 10+ years of progressive experience in data engineering, including deep expertise in analytics-focused data warehouse environments such as Snowflake. Extensive hands-on experience designing and delivering cloud-based data solutions on AWS, including services such as S3, AWS CLI, Lambda, and DynamoDB. Strong experience with modern data engineering and integration tools such as dbt, Qlik Replicate, InfoSphere DataStage, and CP4D. Deep expertise in data modeling, including Data Vault, and in designing scalable, auditable, and resilient data structures that support enterprise analytics, reporting, and AI use cases. Proven experience architecting and optimizing large-scale data ingestion, transformation, cleansing, standardization, and deduplication processes across complex data environments. Strong programming and automation skills in Python and other scripting languages used to support enterprise data engineering solutions. Demonstrated experience leading the design and implementation of enterprise data pipelines using Git, DevOps practices, and modern software engineering approaches. Strong background in large-scale data integration, API development, and data migration across distributed systems and platforms. Deep understanding of data governance, data management, metadata, lineage, and data security, with the ability to embed these practices into engineering solutions. Proven ability to lead end-to-end solution delivery, working independently while providing technical direction across multiple initiatives and technologies. Demonstrated success establishing and enforcing engineering, design, and operational standards across teams and platforms. Ability to evaluate emerging tools, technologies, and architectural approaches, and recommend scalable solutions that improve performance, maintainability, and long-term supportability. Proven ability to influence, advise, and partner effectively with senior business and technology stakeholders to identify strategic challenges, assess options, and recommend solutions. Strong track record of mentoring engineers, promoting engineering excellence, and contributing to high-performing teams. Extensive experience across the full software development lifecycle, including architecture, design, implementation, testing, deployment, and operational support. Knowledge of the insurance business data domain is a major plus, including familiarity with insurance data concepts, business processes, and analytics use cases. Ability to design trusted, high-quality data foundations that enable advanced analytics, machine learning, and AI-driven business capabilities. Strong problem-solving, communication, and leadership skills, with the ability to translate complex technical concepts into practical business solutions. Insurance Business data domain knowledge. Mandatory Skills / Desired Skills Bachelor’s degree in Computer Science, Information Systems, or related field (advanced degree preferred) 10+ years of Data Engineering experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
What Industries Outside of AI Are Hiring The Most AI Experts?