Associate Principal - Data Engineering
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+27 more
Job description
Experteer Overview In this role you leverage Azure data platforms to design scalable, high-performance database and data-pipeline solutions. You collaborate across teams to model data, optimize queries, and secure data access, while integrating LLM-based and agentic workflows for intelligent automation. You will shape modern data architectures, from data lakes to warehouses, and build robust data services with Python and microservices. This position offers high-impact work at scale, bridging traditional data engineering with AI-driven automation. Compensation / Benefits * Design, develop and maintain scalable, high-performance database solutions * Lead data modeling, database design and performance tuning initiatives * Optimize complex SQL/T-SQL queries, stored procedures, UDFs, and triggers * Implement RBAC and ensure database security compliance * Improve database internals, indexing strategies, and execution plans * Build end-to-end data pipelines using Azure Data Factory * Design data architectures including data warehouses and data lakes with Azure Synapse and Microsoft Fabric * Collaborate with cross-functional teams to deliver scalable data engineering and analytics solutions * Develop Python-based data services, APIs and microservices * Leverage frameworks such as DBT, FastAPI or Django for data transformation and service exposure * Integrate data platforms with LLM-based systems and agentic workflows for automation * Contribute to agentic AI solution design, orchestration tool usage and API interaction patterns Tasks * Database Engineering expertise with 8-10 years of experience * Strong data modeling and database design * Performance tuning and optimization experience * Advanced SQL and T-SQL proficiency * Experience writing complex stored procedures, UDFs and triggers * Solid knowledge of database internals, indexing and execution plans * Security models and RBAC knowledge * 5 years Azure data platform experience including ADF, Synapse, Data Lakes and Data Warehouses * Good understanding of Azure ecosystem and networking fundamentals in Azure VNets * Strong Python hands-on experience including API integrations and data processing * Experience building microservices architectures * Familiarity with DBT and workflow orchestration tools * Experience with FastAPI or Django * Experience with AI/LLM interfaces and agentic workflows (preferred) * Hands-on exposure to Claude or similar agentic coding frameworks (preferred) * Experience implementing data solutions powered by AI (preferred) * Exposure to MLOps or AI lifecycle management (preferred) * Familiarity with distributed and event-driven architectures (preferred) * Strong problem-solving and analytical skills * Excellent communication and stakeholder management skills * Ability to work in a fast-paced, collaborative environment Key requirements *
Requirements
data architectures, including data warehouses and data lakes with Azure Synapse and Microsoft Fabric * Collaborate with cross-functional teams to deliver scalable data engineering and analytics solutions * Develop Python-based data services, APIs and microservices * Leverage frameworks such as DBT, FastAPI or Django for data transformation and service exposure * Integrate data platforms with LLM-based systems and agentic workflows for automation * Contribute to agentic AI solution design, orchestration tool usage and API interaction patterns Tasks * Database Engineering expertise with 8-10 years of experience * Strong data modeling and database design * Performance tuning and optimization experience * Advanced SQL and T-SQL proficiency * Experience writing complex stored procedures, UDFs and triggers * Solid knowledge of database internals, indexing and execution plans * Security models and RBAC knowledge * 5 years Azure data platform experience including ADF, Synapse, Data Lakes and a and Warehouses * Good understanding of Azure ecosystem and networking fundamentals in Azure VNets * Strong Python hands-on experience including API integrations and data processing * Experience building microservices architectures * Familiarity with DBT and workflow orchestration tools * Experience with FastAPI or Django * Experience with AI/LLM interfaces and agentic workflows (preferred) * Hands-on exposure to Claude or similar agentic coding frameworks (preferred) * Experience implementing data solutions powered by AI (preferred) * Exposure to MLOps or AI lifecycle management (preferred) * Familiarity with distributed and event-driven architectures (preferred) * Strong problem-solving and analytical skills * Excellent communication and stakeholder management skills * Ability to work in a fast-paced, collaborative environment Key requirements *
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on us.experteer.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
What Are Large Language Models?
MLOps And AI Driven Development
The Most Popular IT Jobs on the Market