Data Engineer
Role details
Job location
Tech stack
Job description
To advance this work, DECDG seeks an experienced Data Engineer and Architect to lead the design and implementation of the Data360 data production and dissemination system., Duties will include, but not be limited to, the following:
- Develop and implement robust technical and business processes for ingestion, production, management, and dissemination of statistical and geospatial data, ensuring alignment with the WBG Development Data Quality Policy.
- Architect and implement the Data360 framework for "self-service" production and publishing of development indicators across the organization at scale, including integration with existing platforms such as .Stat Suite, World Bank Data Catalog and Metadata Editor.
- Design and implement reusable functions, packages and libraries to support robust, automated data pipelines that extract, transform, validate and load information in multiple information systems using Python or R.
- Develop CI/CD processes and policies for managing code repositories, issue tracking and pipeline orchestration for DECDG-managed data processes.
- Assess, recommend, and implement capabilities related to metadata, data lineage, data management and data quality improvement efforts.
- Provide guidance and mentoring to other team members on good data engineering practices in Python and R, metadata and data management techniques and methodologies.
- Actively collaborate with business data stewards and task teams to implement various data projects and initiatives including leading data management efforts for key data platforms, such as the Global Food & Nutrition Security Dashboard, and their alignment with Data360 frameworks.
- Serve as a liaison between Business and Information Technology departments to ensure that data related business requirements for governing data are clearly defined, communicated, well understood and considered as part of solution planning and implementation.
- Stay updated with and transfer knowledge and practice around the latest data management methods and best practices in data governance.
Requirements
Do you have experience in Version control systems?, Do you have a Master's degree?, * Master's degree in computer or data science, statistics, mathematics, or a related field.
- At least, five years of relevant professional experience in data engineering, with demonstrated experience architecting and leading development of large-scale end-to-end data solutions, including data extraction, production, and dissemination of statistical datasets and indicators and geospatial data.
- Hands-on experience building production-grade ETL pipelines using Databricks, Azure data lake, Unity Catalog and similar technologies.
- Extensive familiarity with the WBG Data360 framework, platform and solutions and proven experience working within the World Bank Group's ITS ecosystem, with an understanding of development workflows, environment constraints, and challenges related to CI/CD.
- Solid experience working with data governance and data management concepts within a development data/statistical data context including demonstrated familiarity with SDMX and international metadata standards such as DDI, ISO19139/19115 and WBG time series metadata schemas.
- Strong knowledge and experience in Agile Project Management methodologies and practical experience developing production-grade products using CI/CD workflows including utilization of version control frameworks such as Git and GitHub for managing projects and CI/CD.
- Demonstrated expertise in Python and R, including development and publication of production-ready, reusable R and/or Python packages.
- Excellent communication skills including the ability to understand and convey stakeholder requirements to inform technical solutions; and expertise in documenting solutions for technical audiences.
- Advanced analytical, problem-solving, negotiation, and organizational skills with demonstrated ability to multi-task, organize, prioritize, and meet deadlines.
- Collaborative team player who is quality- and detail-oriented, solution focused and able to work independently with some level of ambiguity while juggling multiple demands.
Benefits & conditions
Pulled from the full job description
- Parental leave
- Health insurance
- Retirement plan
- Disability insurance, 1. Sense of urgency: Anticipate and quickly respond to the needs of internal and external stakeholders.
- Thoughtful risk-taking: Challenge the status quo and push boundaries to achieve greater impact.
- Empowerment and accountability: Empower yourself and others to act and hold each other accountable for results.
World Bank Group Core Competencies
The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.
We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.
Learn more about working at the World Bank and IFC including our values and inspiring stories.