DEX Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+4 more
Job description
- Build and optimize large-scale data pipelines using Python and Apache Spark to support reliable data processing.
- Develop ETL workflows that collect, transform, and deliver data from multiple source systems into analytical platforms.
- Work with Hadoop-based environments to manage distributed data processing and storage effectively.
- Implement and support Kafka-driven streaming solutions for near real-time data ingestion and integration.
- Monitor pipeline performance, troubleshoot data issues, and improve processing efficiency across engineering workflows.
- Collaborate with technical teams to understand data needs and translate them into scalable engineering solutions.
- Maintain data quality standards by validating outputs, resolving inconsistencies, and supporting dependable data availability.
- Contribute to ongoing enhancements of data architecture, including updates to existing platforms and operational processes. Requirements - Hands-on experience with Apache Spark for large-volume data processing.
Requirements
- Strong programming ability in Python for data engineering and automation tasks.
- Working knowledge of Apache Hadoop and distributed data ecosystems.
- Experience using Apache Kafka for event-driven or streaming data solutions.
- Proven background in ETL design, development, and support.
- Ability to troubleshoot data pipeline issues and improve performance in complex environments.
- Strong collaboration and communication skills in cross-functional technical settings. Technology Doesn’t Change the World, People Do., All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.
Benefits & conditions
Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.
About the company
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top-Paying Tech Jobs (with Salaries)
Top Big Data Technologies That You Need to Know
The Most Popular IT Jobs on the Market
Fully Remote Software Engineer Jobs