Senior Data Engineer
IDR, Inc.
Austin, TX, United States
3 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$156,000.0
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Microsoft Azure
Cloud Storage
Continuous Integration
Extract Transform Load (ETL)
Data Systems
Data Warehousing
DevOps
Python (Programming Language)
Key Management
Log Analysis
SQL Azure
+13 more
Power BI
Azure Data Lake
SQL Databases
Azure Data Factory
Snowflake
Apache Spark
Data Lakes
Pyspark
Information Technology
Azure Synapse Analytics
Data Pipelines
Serverless Computing
Databricks
Job description
- Design and implement scalable data solutions utilizing Azure services such as Synapse Analytics, Databricks, Snowflake, Azure SQL, and more.
- Develop robust data pipelines and transformations (ETL/ELT) to support business needs.
- Collaborate with stakeholders to gather data requirements and deliver tailored solutions.
- Ensure all data solutions are reliable, scalable, and secure, following best practices.
- Implement CI/CD and DevOps practices to streamline development workflows.
Requirements
Do you have experience in Spark?, * 10+ years of IT experience, including a minimum of 5 years as a Data Engineer.
- 5+ years of experience with the Azure cloud platform and Azure data services.
- Proven experience with Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions.
- Experience with Databricks, Power BI, SQL, Python, API, and PySpark.
- Proficiency in optimizing ETL processes, data warehousing, and managing data lakes.
Benefits & conditions
Pulled from the full job description
- Health insurance
- Vision insurance
- Dental insurance, * Competitive compensation package
- Full Benefits; Medical, Vision, Dental, and more!
- Opportunity to get in with an industry leading organization.
Why IDR?
- 25+ Years of Proven Industry Experience in 4 major markets
- Employee Stock Ownership Program
- Dedicated Engagement Manager who is committed to you and your success.
- Medical, Dental, Vision, and Life Insurance
- ClearlyRated’s Best of Staffing® Client and Talent Award winner 12 years in a row.
LI-hybrid
About the company
IDR is seeking a Senior Data Engineer to join one of our top clients for an opportunity in Austin, TX. This role involves designing and implementing complex data solutions within a collaborative, technology-driven environment. It offers the chance to work with cutting-edge cloud data services and contribute to high-impact projects across the organization.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago