> Markdown version of [/jobs/ext/3550708-data-engineer-databricks-adf-sql-technical-lead](https://www.wearedevelopers.com/jobs/ext/3550708-data-engineer-databricks-adf-sql-technical-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - Databricks, ADF, SQL - Technical Lead

- **Company:** INSYSTECH, INC.
- **Location:** St. Louis, MO, United States
- **Experience:** Expert
- **Salary:** $140,000.0 - $160,000.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Business Analytics Applications, Microsoft Azure, Cloud Computing, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Security, Data Systems, Data Warehousing, Distributed Systems, Python (Programming Language), Meta-Data Management, Scrum Methodology, SQL Databases, Data Streaming, Cloud Platform System, Feature Engineering, Snowflake, Apache Spark, Git, Data Lakes, Pyspark, Data Lineage, Machine Learning Operations, Data Pipelines, Databricks
- **Published:** September 30, 2026
- **Apply:** https://www.careerjet.com/jobad/us71c44c925a33155493be2c1984f16f1a

## About the Role

* Visa Independent: Green Card holder or US Citizen
 * 5+ years of enterprise-scale data engineering experience
 * Hands-on implementation experience (not just theoretical knowledge)
 * Ability to work hybrid model in St. Louis, MO (or relocation to secondary locations)
 * Strong problem-solving and analytical skills
 * Experience with both batch and streaming data processing
 * Strong communication and collaboration skills, * 5+ years of hands-on Databricks and/or Apache Spark development/implementation experience
 * Strong proficiency with PySpark and Scala (or Python)
 * Deep understanding of Delta Lake and ACID transactions
 * Experience designing and implementing data lakehouses
 * Proficiency with SQL and data transformation logic
 * Cloud platform expertise: AWS or Azure (hands-on implementation)
 * Snowflake experience: Integration, optimization, and ETL pipeline development
 * Understanding of distributed computing and optimization
 * Git and CI/CD pipeline experience

Nice-to-Have

 * Healthcare or insurance industry experience
 * Databricks certification or advanced training
 * AWS or Azure cloud certifications
 * Data governance and metadata management experience
 * Experience with ML pipelines and feature engineering
 * Agile/Scrum experience
 * Experience with data quality frameworks

## Description

* Design and implement data engineering solutions using Databricks, Delta Lake, Spark, and cloud platforms (AWS/Azure)
 * Hands-on expertise in Snowflake integration and data warehouse optimization for the Health Insurance account, * Design and architect data solutions using Databricks and Delta Lake
 * Develop scalable data pipelines using Apache Spark and PySpark
 * Integrate Snowflake data warehouse solutions with Databricks platforms
 * Optimize cloud platform performance on AWS or Azure
 * Implement data governance and quality frameworks
 * Optimize Databricks cluster configurations and performance
 * Build and maintain data lakehouses and analytics solutions
 * Ensure data security, lineage tracking, and compliance
 * Collaborate with data scientists and analytics teams
 * Support cloud migrations and modernization initiatives, Role: Lead Data Engineer with Databricks & AWS or if you find any Architects do not hold them please share it Location: St. Louis, MO Work type: 3 days onsite per week Skill …


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)