DataBrick Engineer
TechDigital Corporation
Irving, TX, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source
Tech stack
Data Analysis
Cloud Computing
Databases
Information Engineering
Extract Transform Load (ETL)
Performance Tuning
Systems Development Life Cycle
Cloudera
SQL Databases
Data Logging
Data Lakes
Pyspark
+2 more
Data Pipelines
Databricks
Job description
1.Administration
- Lead the installation and configuration of Databricks on GCP cloud platforms.
- Monitor platform health, performance, and cost optimization.
- Implement governance, logging, and auditing mechanisms.
2.Development / Enhancements
- Design and develop scalable ETL/ELT pipelines using PySpark, SQL, and Delta Lake.
- Collaborate with data engineers and analysts to enhance data workflows and models.
- Optimize existing notebooks and jobs for performance and reliability.
3.Operations, Support & Troubleshooting
- Provide L2/L3 support for Databricks-related issues and incidents.
- Troubleshoot cluster failures, job errors, and performance bottlenecks.
- Maintain technical documentation for platform setup, operations, and development standards
Requirements
SQL (Structured Query Language), GCP (Good Clinical Practices), Cloud Computing, Cost Control, Performance Tuning/Optimization, Auditing, Scalable System Development, Database Extract Transform and Load (ETL), Data Analysis, Data Modeling, Mandatory Skills: Databricks Developer, and DataBric Admin ,and Databricks Support.
8+ years of experience in data engineering, with at least 3 years on Databricks.
- Strong proficiency in PySpark, SQL, and Delta Lake.
- Hands-on experience with GCP Dataproc.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦