Sr. Data Engineer IV

Robert Half
Philadelphia, PA, United States
5 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Data Analysis Cloud Database Code Review Information Engineering Extract Transform Load (ETL) Digital Assets Github Python (Programming Language) SQL Databases
+16 more
Tableau (Software) Snowflake Software Troubleshooting Technical Debt Concourse Pyspark Core Data Infrastructure Automation Frameworks Apache Kafka Data Management Cloud Migration Terraform Looker Analytics Data Pipelines Legacy Systems Databricks

Job description

We are seeking a Senior Data Engineer to support enterprise data modernization initiatives focused on inventory, supply, and yield analytics. This role will be responsible for designing, building, and enhancing scalable data pipelines within a modern cloud-based data ecosystem. The ideal candidate brings strong hands-on expertise in Databricks, Python, PySpark, and AWS, along with experience supporting migration efforts, modernizing legacy platforms, and delivering reliable data assets for analytics and reporting environments., * Design, develop, test, and maintain scalable ETL processes and data pipelines using Databricks, Python, PySpark, AWS, and Snowflake.

  • Build and enhance data engineering solutions supporting inventory, supply, and yield analytics initiatives.
  • Develop core data assets and pipelines that support enterprise reporting and analytics platforms, including Tableau.
  • Modernize legacy data engineering jobs and contribute to cloud migration and technical debt reduction efforts.
  • Create and maintain technical documentation, specifications, testing artifacts, and quality assurance processes.
  • Provide post-deployment support, troubleshoot production issues, and ensure reliable pipeline operations.
  • Identify and mitigate risks, including single points of failure (SPOF), to improve platform stability and resiliency.
  • Develop and manage infrastructure using Terraform.
  • Implement and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
  • Collaborate with engineering teams, stakeholders, and Agile Release Train (ART) members to define requirements and deliver scalable solutions.
  • Participate in code reviews, knowledge sharing, and continuous improvement initiatives.

Requirements

  • Strong Data Engineering experience with a focus on ETL development and data pipeline engineering.
  • Hands-on experience with Databricks, Python, PySpark, and SQL.
  • Strong AWS experience, including S3, EMR, Lambda, and EventBridge.
  • Experience building, testing, and maintaining cloud-based data pipelines and data platforms.
  • Experience supporting cloud migration and modernization initiatives.
  • Experience with Snowflake.
  • Experience using Terraform for infrastructure provisioning and management.
  • Experience implementing and supporting CI/CD pipelines using GitHub Actions or Concourse.
  • Strong troubleshooting, testing, and production support experience.
  • Ability to work collaboratively in an Agile development environment.

Preferred Qualifications:

  • Approximately 8+ years of Data Engineering experience.
  • Experience with Kafka.
  • Familiarity with Tableau and/or Looker environments.
  • Experience supporting analytics and reporting data platforms. Technology Doesn’t Change the World, People Do.®

Benefits & conditions

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.

About the company

Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

4:21 min

Challenges of traditional mobile data synchronization

Timothy Marland · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all