Senior Data Engineer

IDR, Inc.
Austin, TX, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$156,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Cloud Storage Continuous Integration Extract Transform Load (ETL) Data Systems Data Warehousing DevOps Python (Programming Language) Key Management Log Analysis SQL Azure
+13 more
Power BI Azure Data Lake SQL Databases Azure Data Factory Snowflake Apache Spark Data Lakes Pyspark Information Technology Azure Synapse Analytics Data Pipelines Serverless Computing Databricks

Job description

  • Design and implement scalable data solutions utilizing Azure services such as Synapse Analytics, Databricks, Snowflake, Azure SQL, and more.
  • Develop robust data pipelines and transformations (ETL/ELT) to support business needs.
  • Collaborate with stakeholders to gather data requirements and deliver tailored solutions.
  • Ensure all data solutions are reliable, scalable, and secure, following best practices.
  • Implement CI/CD and DevOps practices to streamline development workflows.

Requirements

Do you have experience in Spark?, * 10+ years of IT experience, including a minimum of 5 years as a Data Engineer.

  • 5+ years of experience with the Azure cloud platform and Azure data services.
  • Proven experience with Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions.
  • Experience with Databricks, Power BI, SQL, Python, API, and PySpark.
  • Proficiency in optimizing ETL processes, data warehousing, and managing data lakes.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • Vision insurance
  • Dental insurance, * Competitive compensation package
  • Full Benefits; Medical, Vision, Dental, and more!
  • Opportunity to get in with an industry leading organization.

Why IDR?

  • 25+ Years of Proven Industry Experience in 4 major markets
  • Employee Stock Ownership Program
  • Dedicated Engagement Manager who is committed to you and your success.
  • Medical, Dental, Vision, and Life Insurance
  • ClearlyRated’s Best of Staffing® Client and Talent Award winner 12 years in a row.

LI-hybrid

About the company

IDR is seeking a Senior Data Engineer to join one of our top clients for an opportunity in Austin, TX. This role involves designing and implementing complex data solutions within a collaborative, technology-driven environment. It offers the chance to work with cutting-edge cloud data services and contribute to high-impact projects across the organization.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · WWC Europe 2026

Videos

See all

Related articles

See all