Data Engineer - Python
Role details
Job location
Tech stack
Job description
We are seeking an experienced Python Data Engineer to join our growing data team. This role will focus on building and supporting scalable data solutions that ingest, process, and deliver real-time and near real-time data across the organization. The ideal candidate will have experience working in financial services, energy, or oil & gas environments, where timely, accurate data is critical to business operations and decision-making.
You will partner closely with business leaders, analysts, data scientists, and application teams to develop robust data pipelines, integrate external and internal data sources, and enhance enterprise data capabilities.
Responsibilities
- Design, develop, and maintain scalable Python-based ETL and data integration solutions.
- Build reusable data acquisition components to consume APIs, market feeds, operational systems, IoT devices, and third-party data sources.
- Develop and support real-time and near real-time data pipelines for business-critical reporting and analytics.
- Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
- Enhance and maintain enterprise data engineering frameworks and standards.
- Ensure data quality, reliability, performance, and governance across the data ecosystem.
- Support Oracle databases, PL/SQL development, and data warehouse integrations.
- Partner with global teams to deliver high-quality data solutions and support ongoing business initiatives.
- Participate in architecture discussions and contribute to best practices around data engineering and software development.
Requirements
- Experience in financial services, banking, asset management, energy, commodities, or oil & gas industries.
- Experience supporting operational, market, production, pricing, risk, or financial data platforms.
- Knowledge of cloud-based data platforms and modern data architecture.
- Experience with data warehousing, data lakes, and enterprise reporting solutions.
Technical Environment
Python, Oracle, PL/SQL, Pandas, NumPy, Selenium, BeautifulSoup, REST APIs, ETL, Data Pipelines, Real-Time Data Processing, Data Warehousing, Git, Agile, Cloud Technologies
Ideal Candidate: A hands-on Data Engineer with strong Python development skills, experience working with real-time business data, and a background supporting data platforms in financial services, energy, or oil & gas organizations., * Bachelor's degree in Computer Science, MIS, Engineering, or a related technical field.
- 6+ years of professional Python development experience in enterprise environments.
- Strong experience building and maintaining ETL processes and data pipelines.
- Experience handling real-time or high-volume data processing environments.
- Advanced Python skills including Pandas, NumPy, and related data libraries.
- Experience with web scraping and data collection tools such as Requests, BeautifulSoup, and Selenium.
- Strong Oracle and PL/SQL experience, including stored procedures and performance optimization.
- Solid understanding of object-oriented programming, design patterns, and service-oriented architectures.
- Experience with Git, Agile/Scrum methodologies, and modern software development practices.
- Excellent communication and stakeholder management skills. Technology Doesn't Change the World, People Do.®