Sr. Data Engineer IV
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
We are seeking a Senior Data Engineer to support enterprise data modernization initiatives focused on inventory, supply, and yield analytics. This role will be responsible for designing, building, and enhancing scalable data pipelines within a modern cloud-based data ecosystem. The ideal candidate brings strong hands-on expertise in Databricks, Python, PySpark, and AWS, along with experience supporting migration efforts, modernizing legacy platforms, and delivering reliable data assets for analytics and reporting environments., * Design, develop, test, and maintain scalable ETL processes and data pipelines using Databricks, Python, PySpark, AWS, and Snowflake.
- Build and enhance data engineering solutions supporting inventory, supply, and yield analytics initiatives.
- Develop core data assets and pipelines that support enterprise reporting and analytics platforms, including Tableau.
- Modernize legacy data engineering jobs and contribute to cloud migration and technical debt reduction efforts.
- Create and maintain technical documentation, specifications, testing artifacts, and quality assurance processes.
- Provide post-deployment support, troubleshoot production issues, and ensure reliable pipeline operations.
- Identify and mitigate risks, including single points of failure (SPOF), to improve platform stability and resiliency.
- Develop and manage infrastructure using Terraform.
- Implement and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
- Collaborate with engineering teams, stakeholders, and Agile Release Train (ART) members to define requirements and deliver scalable solutions.
- Participate in code reviews, knowledge sharing, and continuous improvement initiatives.
Requirements
- Strong Data Engineering experience with a focus on ETL development and data pipeline engineering.
- Hands-on experience with Databricks, Python, PySpark, and SQL.
- Strong AWS experience, including S3, EMR, Lambda, and EventBridge.
- Experience building, testing, and maintaining cloud-based data pipelines and data platforms.
- Experience supporting cloud migration and modernization initiatives.
- Experience with Snowflake.
- Experience using Terraform for infrastructure provisioning and management.
- Experience implementing and supporting CI/CD pipelines using GitHub Actions or Concourse.
- Strong troubleshooting, testing, and production support experience.
- Ability to work collaboratively in an Agile development environment.
Preferred Qualifications:
- Approximately 8+ years of Data Engineering experience.
- Experience with Kafka.
- Familiarity with Tableau and/or Looker environments.
- Experience supporting analytics and reporting data platforms. Technology Doesn’t Change the World, People Do.®
Benefits & conditions
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.
About the company
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Making Data Warehouses Fast: A Developer’s Story
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again