> Markdown version of [/jobs/ext/3552176-data-engineer](https://www.wearedevelopers.com/jobs/ext/3552176-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Insight Global
- **Location:** Redmond, WA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Cloud Computing, Information Systems, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Systems, Data Warehousing, Python (Programming Language), Knowledge Management, Machine Learning, Microsoft Servers, OpenAI, Azure Data Lake, Software Engineering, SQL Databases, Unstructured Data, Enterprise Search, Data Processing, Azure Data Factory, Retrieval-Augmented Generation, Large Language Models, Apache Spark, Generative AI, Indexer, Microsoft Fabric, Data Lakes, AI Platforms, Information Technology, Data Management, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** October 2, 2026
- **Apply:** https://dejobs.org/x/x/AF8345D5C9D648DC8F07D1AF6C6AC51C/job/

## About the Role

Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or related field; equivalent experience considered. 5+ years of experience in Data Engineering or related data platform roles. Advanced proficiency in SQL and Python. Experience building large-scale ETL/ELT pipelines and data integration solutions. Hands-on experience with Azure data technologies including: Azure Databricks Azure Data Factory (ADF) Microsoft Fabric Azure Synapse Analytics Azure Data Lake Storage (ADLS) Experience working with structured, semi-structured, and unstructured data sources. Strong understanding of data modeling, data warehousing, and lakehouse architectures. Experience implementing data governance, data quality, and lineage frameworks. Experience supporting analytics, machine learning, or AI solutions through scalable data infrastructure. Strong communication skills and ability to work across technical and non-technical teams. Experience supporting Generative AI,
RAG, LLM, or enterprise search solutions. Experience building document ingestion and knowledge management platforms. Familiarity with vector databases, embeddings, and retrieval architectures. Knowledge of Azure AI Search, Azure OpenAI, or similar AI services. Experience working with legal, compliance, regulatory, governance, or risk-focused organizations. Experience in a large enterprise or Microsoft environment. Experience with Spark, Delta Lake, and modern cloud-native data platforms.

## Description

Design, develop, and maintain scalable ETL/ELT pipelines that ingest, transform, and serve structured and unstructured data from enterprise systems, documents, communications, and regulatory sources. Build and optimize data architectures, lakehouse solutions, and curated data models to support analytics, machine learning, and generative AI applications. Create document ingestion, metadata extraction, indexing, and retrieval pipelines that enable enterprise search, knowledge management, and RAG-based solutions. Partner with Data Scientists and Applied Scientists to operationalize AI and machine learning solutions through reliable, high-quality data infrastructure. Develop data solutions supporting regulatory intelligence, compliance reporting, requirements extraction, and impact assessment workflows. Implement data quality, governance, lineage, monitoring, and security controls to ensure trusted and auditable enterprise data assets. Optimize data processing performance, scalability, and
reliability across cloud-based environments. Collaborate with cross-functional stakeholders to translate business requirements into scalable technical solutions. Drive engineering best practices around testing, CI/CD, observability, documentation, and operational excellence.


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Develop AI-powered Applications with OpenAI Embeddings and Azure Search](https://www.wearedevelopers.com/videos/828-develop-ai-powered-applications-with-openai-embeddings-and-azure-search)
- [Dynamic Entities in .NET: Building Low-Code Systems on Top of Entity Framework Core](https://www.wearedevelopers.com/videos/100218-dynamic-entities-in-net-building-low-code-systems-on-top-of-entity-framework-core)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)