Data Platform Engineer (Azure / Databricks)
Cornerstone Barricades
San Antonio, TX, United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on zipstaff.betterteam.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$91,520 - $93,600
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Airflow
Microsoft Azure
Software Quality
Continuous Integration
Data Governance
Extract Transform Load (ETL)
Data Systems
DevOps
Distributed Computing Environment
Python (Programming Language)
DataOps
+11 more
SQL Databases
Data Ingestion
Snowflake
Apache Spark
Data Lakes
Codebase
Data Management
Code Restructuring
Software Version Control
Data Pipelines
Databricks
Job description
- Assess and improve an existing data platform: refactor pipelines, optimize performance, and improve code quality, or design new end-to-end solutions.
- Design, build, and maintain scalable data pipelines for downstream application and analytics use cases.
- Implement data ingestion, transformation, and storage patterns using Databricks and Snowflake.
- Partner with architects and stakeholders to define data models and schemas.
- Ensure data quality, reliability, observability, and governance across the data lifecycle.
- Optimize workloads for cost, performance, and scalability in a cloud-native Azure environment.
- Enforce engineering standards, including documentation, testing, version control, and CI/CD.
Requirements
- Strong experience as a Data Engineer building and maintaining production-grade data platforms.
- Proficiency with Databricks (Spark, Delta Lake, notebooks), Airflow, and Snowflake.
- Experience building data solutions in Microsoft Azure.
- Proficiency in SQL and Python.
- Solid understanding of data modeling, ETL/ELT patterns, and distributed data processing.
- Experience refactoring, standardizing, and optimizing existing codebases.
- Strong collaboration and communication skills across architecture and development teams.
- Experience using AI-assisted automation tools to improve productivity., * Data governance, metadata management, or data quality frameworks.
- Application-centric data use cases, not just analytics.
- DevOps or DataOps practices (CI/CD, infrastructure as code, monitoring).
- Large, regulated, enterprise-scale environments, including data containing PHI.
Benefits & conditions
- Health Insurance.
- Dental Insurance.
- Vision Insurance.
- 401(k) + matching.
- Paid time off.
- Referral Program.
About ZipStaff: ZipStaff connects skilled technology professionals with leading organizations across the United States, matching top talent with impactful contract and full-time opportunities. To apply, submit your resume through this posting. Qualified candidates will be contacted by a ZipStaff recruiter.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on zipstaff.betterteam.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦