Senior Data Engineer

IDR, Inc.
Austin, United States of America
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 156K

Job location

Austin, United States of America

Tech stack

API
Azure
Cloud Storage
Continuous Integration
ETL
Data Systems
Data Warehousing
DevOps
Python
Key Management
Log Analysis
SQL Azure
Power BI
Azure
SQL Databases
Azure
Snowflake
Spark
Data Lake
PySpark
Information Technology
Azure
Data Pipelines
Serverless Computing
Databricks

Job description

  • Design and implement scalable data solutions utilizing Azure services such as Synapse Analytics, Databricks, Snowflake, Azure SQL, and more.
  • Develop robust data pipelines and transformations (ETL/ELT) to support business needs.
  • Collaborate with stakeholders to gather data requirements and deliver tailored solutions.
  • Ensure all data solutions are reliable, scalable, and secure, following best practices.
  • Implement CI/CD and DevOps practices to streamline development workflows.

Requirements

Do you have experience in Spark?, * 10+ years of IT experience, including a minimum of 5 years as a Data Engineer.

  • 5+ years of experience with the Azure cloud platform and Azure data services.
  • Proven experience with Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions.
  • Experience with Databricks, Power BI, SQL, Python, API, and PySpark.
  • Proficiency in optimizing ETL processes, data warehousing, and managing data lakes.

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • Vision insurance
  • Dental insurance, * Competitive compensation package
  • Full Benefits; Medical, Vision, Dental, and more!
  • Opportunity to get in with an industry leading organization.

Why IDR?

  • 25+ Years of Proven Industry Experience in 4 major markets
  • Employee Stock Ownership Program
  • Dedicated Engagement Manager who is committed to you and your success.
  • Medical, Dental, Vision, and Life Insurance
  • ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.

#LI-hybrid

About the company

IDR is seeking a Senior Data Engineer to join one of our top clients for an opportunity in Austin, TX. This role involves designing and implementing complex data solutions within a collaborative, technology-driven environment. It offers the chance to work with cutting-edge cloud data services and contribute to high-impact projects across the organization.

Apply for this position