Data Engineer - Python
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
We are seeking an experienced Python Data Engineer to join our growing data team. This role will focus on building and supporting scalable data solutions that ingest, process, and deliver real-time and near real-time data across the organization. The ideal candidate will have experience working in financial services, energy, or oil & gas environments, where timely, accurate data is critical to business operations and decision-making.
You will partner closely with business leaders, analysts, data scientists, and application teams to develop robust data pipelines, integrate external and internal data sources, and enhance enterprise data capabilities.
Responsibilities
- Design, develop, and maintain scalable Python-based ETL and data integration solutions.
- Build reusable data acquisition components to consume APIs, market feeds, operational systems, IoT devices, and third-party data sources.
- Develop and support real-time and near real-time data pipelines for business-critical reporting and analytics.
- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
- Enhance and maintain enterprise data engineering frameworks and standards.
- Ensure data quality, reliability, performance, and governance across the data ecosystem.
- Support Oracle databases, PL/SQL development, and data warehouse integrations.
- Partner with global teams to deliver high-quality data solutions and support ongoing business initiatives.
- Participate in architecture discussions and contribute to best practices around data engineering and software development.
Requirements
- Experience in financial services, banking, asset management, energy, commodities, or oil & gas industries.
- Experience supporting operational, market, production, pricing, risk, or financial data platforms.
- Knowledge of cloud-based data platforms and modern data architecture.
- Experience with data warehousing, data lakes, and enterprise reporting solutions.
Technical Environment
Python, Oracle, PL/SQL, Pandas, NumPy, Selenium, BeautifulSoup, REST APIs, ETL, Data Pipelines, Real-Time Data Processing, Data Warehousing, Git, Agile, Cloud Technologies
Ideal Candidate: A hands-on Data Engineer with strong Python development skills, experience working with real-time business data, and a background supporting data platforms in financial services, energy, or oil & gas organizations., * Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
- 6+ years of professional Python development experience in enterprise environments.
- Strong experience building and maintaining ETL processes and data pipelines.
- Experience handling real-time or high-volume data processing environments.
- Advanced Python skills including Pandas, NumPy, and related data libraries.
- Experience with web scraping and data collection tools such as Requests, BeautifulSoup, and Selenium.
- Strong Oracle and PL/SQL experience, including stored procedures and performance optimization.
- Solid understanding of object-oriented programming, design patterns, and service-oriented architectures.
- Experience with Git, Agile/Scrum methodologies, and modern software development practices.
- Excellent communication and stakeholder management skills. Technology Doesn’t Change the World, People Do.®
About the company
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on dejobs.orgGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
The 13 Best Python Libraries for Developers in 2025
The Most Popular IT Jobs on the Market