Senior Data Engineer
IDR, Inc.
Austin, United States of America
10 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 156KJob location
Austin, United States of America
Tech stack
API
Azure
Cloud Storage
Continuous Integration
ETL
Data Systems
Data Warehousing
DevOps
Python
Key Management
Log Analysis
SQL Azure
Power BI
Azure
SQL Databases
Azure
Snowflake
Spark
Data Lake
PySpark
Information Technology
Azure
Data Pipelines
Serverless Computing
Databricks
Job description
- Design and implement scalable data solutions utilizing Azure services such as Synapse Analytics, Databricks, Snowflake, Azure SQL, and more.
- Develop robust data pipelines and transformations (ETL/ELT) to support business needs.
- Collaborate with stakeholders to gather data requirements and deliver tailored solutions.
- Ensure all data solutions are reliable, scalable, and secure, following best practices.
- Implement CI/CD and DevOps practices to streamline development workflows.
Requirements
Do you have experience in Spark?, * 10+ years of IT experience, including a minimum of 5 years as a Data Engineer.
- 5+ years of experience with the Azure cloud platform and Azure data services.
- Proven experience with Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions.
- Experience with Databricks, Power BI, SQL, Python, API, and PySpark.
- Proficiency in optimizing ETL processes, data warehousing, and managing data lakes.
Benefits & conditions
Pulled from the full job description
- Health insurance
- Vision insurance
- Dental insurance, * Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25+ Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.
#LI-hybrid
About the company
IDR is seeking a Senior Data Engineer to join one of our top clients for an opportunity in Austin, TX. This role involves designing and implementing complex data solutions within a collaborative, technology-driven environment. It offers the chance to work with cutting-edge cloud data services and contribute to high-impact projects across the organization.