> Markdown version of [/jobs/ext/4354008-it-technology-lead-cloud-integration-azure-data-factory-adf](https://www.wearedevelopers.com/jobs/ext/4354008-it-technology-lead-cloud-integration-azure-data-factory-adf). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# IT - Technology Lead | Cloud Integration | Azure Data Factory (ADF)

- **Company:** Ipolarity LLC
- **Location:** Minnetonka, MN, United States
- **Experience:** Expert
- **Salary:** $10,400.0
- **Contract:** Permanent contract
- **Skills:** .NET Framework, Artificial Intelligence, Data Analysis, Microsoft Azure, Big Data, Business Software, Software Quality, Information Engineering, Python (Programming Language), Machine Learning, Software Systems, Data Streaming, Enterprise Software Applications, Azure Data Factory, GitHub Copilot, Office365, Retrieval-Augmented Generation, Delivery Pipeline, Large Language Models, Prompt Engineering, Generative AI, Agentic-AI, Pyspark, Core Data, Data Management, Cloud Integration, Azure AI, Databricks
- **Published:** October 26, 2026
- **Apply:** https://www.careerjet.com/jobad/usa2964461cc03d70e6bdc2054e72ec709

## About the Role

Azure Databricks, with good knowledge of Generative AI technologies, including LLMs, RAG, AI Agents, Vector Databases, and Prompt Engineering, 1+ year of experience working with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, Vector Databases, and Prompt Engineering.
Experience developing AI-driven solutions using GitHub Copilot, Microsoft 365 Copilot, Azure AI Studio, and enterprise GenAI platforms.
Experience with healthcare domain

## Description

Design, build, and maintain scalable, secure, and high performance batch and streaming data pipelines using modern data engineering practices
Lead the modernization and migration of on premise data platforms to cloud native architectures, owning infrastructure, networking, security, and deployment pipelines
Develop and maintain core data platform components that support reliable ingestion, transformation, enrichment, and consumption of enterprise data assets
Collaborate with data domain experts across Operations, Product, Finance, Value Analytics, and other domains to understand data sources and design efficient, connected data models
Ensure data accuracy, quality, relevance, and governance by implementing validation, monitoring, documentation, and security controls
Analyze large datasets to identify trends, patterns, and actionable insights; perform data analysis to support analytics, AI use cases, and business strategy
Enable reporting and analytics by making curated, trusted datasets available to BI and downstream consumers
Partner with AI/ML Engineers and Leads to design, build, and improve machine learning models from scratch or enhance existing models
Contribute to experimentation with novel ML and Generative AI architectures
Help design and implement AI powered enterprise applications
Analyzes and investigates, Design, develop, and maintain scalable enterprise applications and AI-powered solutions using .NET, Azure, and Generative AI technologies.
Build and integrate AI capabilities such as conversational assistants, intelligent search, summarization, content generation, and workflow automation into business applications.
Implement secure, reliable, and high-performing software solutions while adhering to enterprise architecture, compliance, and governance standards.
Drive continuous improvement through automation, AI-assisted development practices, code quality enhancements, and operational excellence initiatives
Minimum Years of Experience:
6 to 8 years
Certifications Needed:
None
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
Azure Databricks
PySpark
Python
Interview Process (Is face to face required?)
Virtual
Any additional information you would like to share about the project specs/nature of work:
Project Code: DNA Project code for HT entity and Hyd s