> Markdown version of [/jobs/ext/3534324-senior-data-engineer-consultant](https://www.wearedevelopers.com/jobs/ext/3534324-senior-data-engineer-consultant). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer Consultant - **Company:** RGP - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Airflow, Data Analysis, Bash Shell, BigQuery, Cloud Computing, Cloud Database, Continuous Integration, Data Architecture, Data Validation, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Data Warehousing, Dimensional Modeling, Oracle Exadata, Data Flow Control, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Machine Learning, Oracle (Applications), Performance Tuning, PL-SQL, SQL Databases, Data Streaming, Unstructured Data, Parquet, Data Processing, Google Cloud, Cloud Platform System, GitHub Copilot, Claude Code, Sap Business Objects, Git, Pyspark, Qlikview, Apache Kafka, Data Management, Video Streaming, Teamcity, OpenAI Codex, Stream Processing, Looker Analytics, Data Pipelines, Service Stack - **Published:** October 1, 2026 - **Apply:** https://dejobs.org/x/x/84E9731A5C3E46B4A380777C3BA4E81B/job/ ## About the Role The ideal candidate brings 10+ years of data engineering experience, strong hands-on expertise with Python, SQL, GCP, BigQuery, PySpark, Airflow, and streaming technologies, along with experience leading data engineering teams and complex projects from requirements through implementation and open to onsite project work., 10+ years of experience in Data Engineering, Data Warehousing, or related disciplines. Strong hands-on experience with Python and SQL. Strong experience with GCP and BigQuery. Experience with PySpark, Apache Airflow/GCP Composer, Dataflow, Pub/Sub, or Kafka. Strong understanding of dimensional modeling, data warehousing, ETL/ELT, and data architecture. Experience working with high-volume data environments and performance optimization. Experience gathering requirements and delivering data solutions end-to-end. Experience leading technical projects or small-to-medium-sized engineering teams. Strong communication skills with the ability to work with both technical and business stakeholders. Preferred Qualifications Google Cloud Professional Data Engineer certification. Experience supporting AI/ML data products or AI-enabled workflows. Experience with Looker, QlikView, SAP BusinessObjects, or other BI platforms. Experience with Oracle/Exadata and legacy data warehouse modernization. Experience with CI/CD tools such as Git, TeamCity, or similar platforms. Experience working in Agile/Scrum environments. Experience developing automated data quality, observability, or pipeline governance frameworks. Core Technology Stack Cloud: GCP, BigQuery, GCS Programming: Python, SQL, PL/SQL, Shell Data Engineering: PySpark, Dataflow, Airflow/GCP Composer Streaming: Kafka, Pub/Sub Data Platforms: Hive, HDFS, Parquet, Oracle Exadata BI: Looker, QlikView, SAP BusinessObjects AI: Claude Code, OpenAI Codex, GitHub Copilot ## Description RGP is seeking a highly experienced Senior Data Engineer Consultant to design, build, and optimize scalable data platforms and pipelines supporting analytics, business intelligence, and AI initiatives. This role will work across data engineering, cloud platforms, data architecture, and AI-enabled workflows, partnering closely with technical and business stakeholders to deliver reliable, high-performing data solutions., Data Engineering & Architecture Design and develop scalable, enterprise-grade data pipelines and data platforms. Build batch and real-time data processing solutions using PySpark, Dataflow, Kafka, Pub/Sub, and Apache Airflow/GCP Composer. Develop data models, dimensional models, and analytical data layers to support reporting, BI, and AI use cases. Design solutions across structured and unstructured data environments, including BigQuery, GCS, Hive, HDFS, and Parquet. Gather technical requirements and translate business needs into scalable data solutions. Cloud & Data Platform Develop and optimize cloud-based data solutions within Google Cloud Platform (GCP). Build and maintain BigQuery data environments and migrate legacy data platforms into cloud architectures. Optimize data processing, storage, and query performance for high-volume datasets. Develop solutions capable of processing millions or billions of records while maintaining reliability and scalability. AI & Data Engineering Integrate modern AI tooling into data engineering workflows to improve development, automation, data quality, and pipeline management. Support data products and analytical solutions that enable AI/ML model measurement and business insights. Identify opportunities to use AI to improve engineering productivity, pipeline monitoring, data quality, and remediation processes. Experience with tools such as OpenAI Codex, Claude Code, GitHub Copilot, or similar AI development technologies is highly desirable. Data Quality, Performance & Reliability Identify and resolve pipeline performance, scalability, and data quality issues. Implement best practices around data validation, observability, resiliency, and monitoring. Optimize ETL/ELT processes and analytical queries to improve processing time and system performance. Establish standards for data architecture, modeling, performance, and pipeline development. Leadership & Project Delivery Lead small to medium-sized data engineering projects and technical initiatives. Provide technical leadership and mentorship to other data engineers. Partner with business stakeholders, architects, analysts, data scientists, and engineering teams. Participate in requirements gathering, solution design, technical documentation, development, testing, and deployment. Develop project plans and provide technical guidance to ensure successful delivery. ## Related Videos - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)