> Markdown version of [/jobs/ext/76328-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/76328-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** IDR, Inc.
- **Location:** Austin, TX, United States
- **Experience:** Expert
- **Salary:** $156,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Microsoft Azure, Cloud Storage, Continuous Integration, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Python (Programming Language), Key Management, Log Analysis, SQL Azure, Power BI, Azure Data Lake, SQL Databases, Azure Data Factory, Snowflake, Apache Spark, Data Lakes, Pyspark, Information Technology, Azure Synapse Analytics, Data Pipelines, Serverless Computing, Databricks
- **Published:** May 16, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=33d178b06eb66d25

## About the Role

Do you have experience in Spark?, * 10+ years of IT experience, including a minimum of 5 years as a Data Engineer.

 * 5+ years of experience with the Azure cloud platform and Azure data services.
 * Proven experience with Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions.
 * Experience with Databricks, Power BI, SQL, Python, API, and PySpark.
 * Proficiency in optimizing ETL processes, data warehousing, and managing data lakes.

## Description

* Design and implement scalable data solutions utilizing Azure services such as Synapse Analytics, Databricks, Snowflake, Azure SQL, and more.
 * Develop robust data pipelines and transformations (ETL/ELT) to support business needs.
 * Collaborate with stakeholders to gather data requirements and deliver tailored solutions.
 * Ensure all data solutions are reliable, scalable, and secure, following best practices.
 * Implement CI/CD and DevOps practices to streamline development workflows.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)