Principal Data Engineer

Caterpillar
Peoria, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 209K

Job location

Peoria, United States of America

Tech stack

Adobe InDesign
Artificial Intelligence
ARM
Cloud Computing
Cloud Engineering
Program Optimization
Profiling
Computer Programming
Databases
Computer Engineering
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
Data Integration
ETL
Data Security
Data Structures
Software Debugging
DevOps
Github
Python
Machine Learning
Query Optimization
Power BI
SQL Databases
Snowflake
Change Data Capture
Indexer
Data Lake
Information Technology
Code Testing
Data Programming
Virtual Agents
Dataiku
Data Delivery
Streamlit Framework
Software Version Control
Data Pipelines
Powerapps
Amazon Web Services (AWS)
Programming Languages

Job description

  • Design, build, and maintain scalable Snowflake-based data platform supporting analytics, reporting, and AI/ML workloads
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing data pipelines for greater scalability
  • Perform debugging, troubleshooting, modification and testing of integration solutions
  • Operationalize developed jobs, processes and models
  • Create solutions and methods to monitor systems and solutions
  • Review and optimize code. Automate code testing and pipelines
  • Design, develop, and maintain efficient and scalable AI and ML solutions
  • Put in place systems and processes to support data governance capabilities
  • Engage with business partners to participate in design and development of data integration/transformation solutions per functional requirements
  • Engage and actively seek industry perspectives through, continuous learning, peer groups, etc.

Requirements

  • Data Programming - BS in Computer Science, Computer Engineering, Data Engineering, Data Science, or related field. 5+ years development experience with modern development languages and frameworks, preferably Python, SQL, etc. Understanding of data structures, algorithms, profiling & optimization.
  • Data Governance, Quality, & Security - Understanding and appreciation for the data governance standards, the dimensions of data quality, and data security. Familiarity with tools and frameworks to support these standards.
  • Database/Data Lake Administration - Experience managing a Snowflake database/environment. Understanding of SQL, ETL/ELT design, data modeling techniques, change data capture techniques. Familiarity with indexing, partitioning, and query optimization.
  • Cloud Platforms - Experience building ETL/ELT pipelines using industry platforms (Snowflake, EMR, Glue, Snap Logic or similar). Experience building medallion, data lake, or lake house architectures.
  • DevOps - Experience with version control in Github and devops practices, like continuous integration and continuous delivery (CI/CD)
  • Communication - Good communication, interpersonal, and collaboration skills. Ability to communicate difficult or technical concepts in a relatable manner. Ability to collaborate and prioritize cross functionally to achieve results.
  • Coaching - Ability to guide and mentor other in coding and design best practice.

What Will Set You Apart:

  • Advanced Programming - MS in Computer Science, Computer/Data Engineering, Data Science, or related fields. Experience in agent assisted programming.
  • Machine Learning & Artificial Intelligence - Experience building and deploying machine learning (ML), artificial intelligence (AI) and/or agentic AI solutions in a business context.
  • Advanced Database Development - Deep Snowflake expertise including Cortex, Snowpipe, Snowpark, Snowsight, etc.
  • Advanced Cloud Development - Deep experience in AWS EMR, Glue, Lambda, or similar.
  • Agentic AI - Experience with modern agentic AI platforms (Cortex, Bedrock/Agent core, Dataiku, etc.)
  • Trade & Compliance Data - Experience with trade and/or compliance data.
  • Visualization & Apps - Experience in PowerBI, Power Apps, streamlit, or similar tools.

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Parental leave
  • 401(k)
  • Health insurance
  • Paid time off
  • Employee discount
  • Vision insurance, Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

About the company

Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. This position will be responsible for building scalable, high performance data pipelines and data driven predictive analytics applications using automation, artificial intelligence (AI) and machine learning (ML) models to provide actionable recommendations and insights. The position will be part of Caterpillar's Legal, Security and Public Policy team, tackling challenges and problems that are critical to realizing business value and mitigating high impact enterprise risks. This position will work with data scientists, business analysts, and others as part of a team that assembles large, complex data sets, automates processes and pipelines, builds models and provides insight to key stakeholders.

Apply for this position