Data Engineer/Sr. Data Engineer -ITDDP (Contractual)

Under the direction of the Deputy Division Chief (Data Platforms Division) in the IT Department at the IMF, the Data Engineer/Sr. Data Engineer supports the Corporate Data team by operating and improving the enterprise data platform and delivering analytics solutions. The role partners with platform owners to design and run data warehouse solutions, reports, and dashboards, and coordinates service provider resources for effective delivery.

This role blends cloud platform engineering, data pipeline development, and data governance enablement to deliver scalable, secure, business-aligned capabilities. It requires proven delivery of complex analytics solutions, strong Azure/cloud and data warehousing skills, and experience implementing and supporting data governance tools.

The ideal candidate should demonstrate expertise and capability to:

• Manage Azure cloud platform: provision resources, enforce RBAC and policies, secure networking, monitor health, ensure backup/DR, and control costs.
• Engineer data pipelines: build and maintain scalable ETL/ELT workflows for batch and real-time data ingestion and transformation.
• Operate data storage platforms: manage data lakes, warehouses, and lakehouse environments with performance optimization.
• Enable data governance: enforce access controls, data classification, quality checks, lineage, and compliance standards.
• Implement DevOps and automation: use CI/CD and Infrastructure as Code to automate deployments and platform operations.
• Support self-service analytics: deliver curated datasets, optimize semantic models, and enable governed BI usage.
• Monitor and optimize performance: track pipeline reliability, data latency, and query performance with alerting and tuning.
• Drive cost efficiency: optimize compute/storage usage and implement cost management strategies.

Major Duties and Responsibilities

1. Design and manage a multi-layered data architecture through collaboration with the enterprise architects, source platform teams and other integrated team members, specifically:

• Build and orchestrate pipelines using Azure Data Factory.
• Enforce data quality and schema evolution controls across layers.
• Optimize storage and compute for high-throughput batch and streaming ingestion.
• Implement partitioning, indexing, and Delta optimization strategies.

2. Lead efforts to develop self-service analytics, utilizing Azure Analysis Services (or Fabric semantic models) with a focus on Semantic Layer-First Architecture. Specifically:

• Design and manage enterprise semantic models:
• Enable self-service analytics through governed datasets.
• Optimize data models for performance and usability through Star schemas, aggregations, and coaching strategies.
• Integrate semantic layer with upstream pipelines:
• Ensure consistency between physical and logical models.

3. Conduct Azure Cloud Administration, specifically:

• Production deployments
• Manage the corporate data azure infrastructure in collaboration with the enterprise Azure platform support to ensure optimal networking, storage, compute, and identity functions.
• Monitor platform health using Azure-native observability tools.
• Ensure compliance with enterprise security and regulatory requirements.

4. Support data governance enablement by using our metadata management tools (Collibra and Purview) through the use of their data catalog, data governance, and data lineage capabilities. Enforce data classification, access controls, and data quality standards.

5. Analyzes requests, designs methodology and develops programs and modules for advanced data modeling visualization.

6. Ability to lead transform Managed Service Providers ensuring delivery of data driven solutions.

Do you have experience in PL/SQL?, Do you have a Bachelor's degree?, Advanced degree in Computer Science, Physics, and Engineering plus a minimum of four (4) years of post-graduation professional experience, or a bachelor's degree plus a minimum of ten (10) years of post-graduation professional experience is required., * Azure certifications (Administrator, Data Engineer, or Architect tracks).

• 5 to 6 years in Azure cloud and data engineering roles.
• Experience with Azure Purview or equivalent data governance tools.

Hands-on experience with at least one target architecture:

• Medallion.
• Data Mesh.
• Semantic Layer-First.

Familiarity with:

• Event-driven architectures.
• API-based data sharing.
• Real-time analytics.

Experience with:

• CI/CD pipelines (Azure DevOps, GitHub Actions).
• Infrastructure as Code.
• 5 to 6 years of technical architect experience directly related to Azure Cloud development and administration.
• Demonstrated technical expertise of working with tools/services such as Power BI, Oracle PL/SQL (among others) and Azure Functions.
• Strong oral and written communication skills and ability to convey higher level technical concepts to non-experts.

This is a one-year contractual appointment. Contractual appointments at the IMF are renewable for up to four years of cumulative contractual service, pending incumbent's performance, budget availability and continuous business need.