> Markdown version of [/jobs/ext/2986661-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/2986661-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Engineer

- **Company:** BURGEON IT SERVICES LLC
- **Location:** Austin, TX, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Unity 3d, Microsoft Azure, Big Data, Continuous Integration, Data Validation, Extract Transform Load (ETL), Data Warehousing, DevOps, R (Programming Language), Apache Hive, Python (Programming Language), Meta-Data Management, Tensorflow, Azure Data Lake, SQL Databases, Azure Data Factory, Apache Spark, Software Troubleshooting, Data Lakes, Scikit Learn, Deployment Automation, Machine Learning Operations, Data Pipelines, Databricks
- **Published:** September 18, 2026
- **Apply:** https://www.dice.com/job-detail/3e85fd1b-6af0-466b-b8f5-5fe34d897df0

## About the Role

* 4+ years with ETL/ELT, Python, R, SQL, Azure, CI/CD, DevOps, data modeling, data lakes, and data warehouses.
 * 3+ years with Databricks, Apache Spark, Spark SQL, Delta Lake, Azure Data Factory, and Unity Catalog.
 * Strong understanding of Spark architecture, RDDs, DataFrames, clusters, notebooks, and jobs.
 * Experience implementing data validation, metadata management, lineage, cataloging, encryption, access controls, and auditing.
 * Strong troubleshooting, Agile delivery, and cross-functional collaboration skills.

Preferred

 * MLflow, Scikit-learn, or TensorFlow experience.
 * Databricks Certified Associate Developer for Apache Spark.
 * Microsoft Azure Data Engineer Associate certification.

## Description

Seeking a Big Data Engineer to develop, maintain, and optimize scalable data solutions using Databricks, Apache Spark, Azure Data Factory, Delta Lake, and Azure Data Lake Storage. The consultant will build ETL/ELT pipelines, optimize Spark workloads, automate deployments, and maintain data quality, governance, and security., Selected candidates must pick up equipment in Austin on the first day and may be required to attend onsite meetings with minimal notice.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)