> Markdown version of [/jobs/ext/3569905-data-engineer-spark-scala](https://www.wearedevelopers.com/jobs/ext/3569905-data-engineer-spark-scala). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer (Spark, Scala)

- **Company:** Diverse Lynx LLC
- **Location:** Eden Prairie, MN, United States
- **Experience:** Expert
- **Salary:** $110,000.0 - $120,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Big Data, Continuous Integration, Data Governance, Extract Transform Load (ETL), Github, Python (Programming Language), Performance Tuning, Cloud Services, Azure Data Lake, SQL Databases, Azure Data Factory, Large Language Models, Apache Spark, Software Security, Agentic-AI, Data Lakes, Pyspark, Kubernetes, Graphql, Claude, Data Pipelines, Databricks
- **Published:** October 3, 2026
- **Apply:** https://www.careerjet.com/job/usc537afe5b19ac6497abbf489294e5624/eaa

## About the Role

We are seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and Eligible to workimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work Consultantly, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders
Expertise in:

 * Azure Databricks, PySpark, Delta Lake
 * Azure Data Factory (ADF) and ADLS Gen2
 * Experience working on large-scale, cloud-native data platforms (Azure preferred)
 * Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
 * Strong experience building REST or GraphQL APIs
 * Experience with Kubernetes (AKS preferred) for API deployment
 * Understanding of API security, contracts, error handling, and performance
 * Strong understanding of data governance, security, and CI/CD practices
 * Primary skill for the API Role with AI Builder

## Description

Position Title: Sr. Data Engineer (SQL / Databricks) Work Mode: Hybrid 3 days WFO (Tuesday, Wednesday and Thursday) Client Office Location: Irving, TX Interview: Face-to-Face…

 + 14 hours ago
 + Apply easily


## Related Videos

- [Claude, MCP and n8n, or: How to Automate Your Day with AI-powered Workflows](https://www.wearedevelopers.com/videos/2043-claude-mcp-and-n8n-or-how-to-automate-your-day-with-ai-powered-workflows)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Putting the Graph In GraphQL With The Neo4j GraphQL Library](https://www.wearedevelopers.com/videos/257-putting-the-graph-in-graphql-with-the-neo4j-graphql-library)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Fake or News - Claude's DNA Discovery, Quick Cloning & Crime on Insta](https://www.wearedevelopers.com/videos/100364-fake-or-news-claude-s-dna-discovery-quick-cloning-crime-on-insta)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)