Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
Experteer Overview In this role you will design, develop, and optimize large-scale ETL data integrations using Ab Initio, Python, and related technologies. You will contribute to enterprise data processing and support production deployments while collaborating with business and technical stakeholders in an Agile setting. You’ll build reusable components, graphs, and automated data workflows to improve data quality and performance. This position offers impact through shaping data pipelines that enable analytics and decision-making across the organization. Compensation / Benefits * Design and develop ETL solutions with Ab Initio * Develop Python-based automation and data processing scripts * Build and maintain Graphs, PDs and reusable components * Perform data analysis, transformation, and validation * Optimize ETL job performance and scalability * Support production deployments and issue resolution * Collaborate with stakeholders in Agile environments Tasks * Proficiency in Ab Initio GDE, Graph Development, MFS, PDL, Control Center * Strong Python and SQL skills * Experience with Unix/Linux and shell scripting * ETL/data warehousing concepts and performance tuning * Familiarity with cloud and big data tools (AWS, Azure, PySpark, Hadoop) * Experience with CI/CD tools (Jenkins, GitHub, GitLab) and job schedulers (Autosys, ControlM) * Refinement of data pipelines in enterprise environments * Ability to work with cross-functional teams in Agile settings Key requirements *
Requirements
Experteer Overview In this role you will design, develop, and optimize large-scale ETL data integrations using Ab Initio, Python, and related technologies. You will contribute to enterprise data processing and support production deployments while collaborating with business and technical stakeholders in an Agile setting. You’ll build reusable components, graphs, and automated data workflows to improve data quality and performance. This position offers impact through shaping data pipelines that enable analytics and decision-making across the organization. Compensation / Benefits * Design and develop ETL solutions with Ab Initio * Develop Python-based automation and data processing scripts * Build and maintain Graphs, PDs and reusable components * Perform data analysis, transformation, and validation * Optimize ETL job performance and scalability * Support production deployments and issue resolution * Collaborate with stakeholders in Agile environments Tasks * Proficiency in Ab Initio GDE, Graph Development, MFS, PDL, Control Center * Strong Python and SQL skills * Experience with Unix/Linux and shell scripting * ETL/data warehousing concepts and performance tuning * Familiarity with cloud and big data tools (AWS, Azure, PySpark, Hadoop) * Experience with CI/CD tools (Jenkins, GitHub, GitLab) and job schedulers (Autosys, ControlM) * Refinement of data pipelines in enterprise environments * Ability to work with cross-functional teams in Agile settings Key requirements *
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on us.experteer.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Top Big Data Technologies That You Need to Know
Top-Paying Tech Jobs (with Salaries)
Data Engineer Salary UK