Databricks Engineer AWS_Dallas, TX-Locals
Keylent Inc.
Dallas, TX, United States
9 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Continuous Integration
Data Validation
Information Engineering
Data Integration
Extract Transform Load (ETL)
Data Transformation
Data Warehousing
Database Queries
Distributed Computing Environment
Python (Programming Language)
+12 more
Performance Tuning
SQL Databases
Apache Spark
Git
Data Lakes
Pyspark
AWS Glue
Apache Kafka
Stream Processing
Data Pipelines
Amazon Redshift
Databricks
Requirements
- 10+ years of strong hands-on experience with AWS services
- Strong expertise in Python and PySpark development
- Strong hands-on experience with Databricks
- Experience developing Databricks notebooks, workflows, and ETL pipelines
- Strong knowledge of Apache Spark / PySpark and distributed data processing
- Experience with Databricks Delta Lake / Delta tables
- Hands-on experience with Databricks SQL and data transformation
- Experience building and optimizing Databricks ETL/data engineering pipelines
- Experience with AWS Glue and ETL process development
- Strong SQL skills for data transformation, analysis, and optimization
- Hands-on experience with Kafka for real-time data processing
- Experience with Amazon Redshift
- Experience integrating Databricks with AWS services, including S3, Glue, and Redshift
- Knowledge of Git pipelines and CI/CD processes
- Experience deploying and managing Databricks jobs/workflows through CI/CD
- Strong understanding of ETL workflows and data integration
- Experience in ETL testing, validation, and data quality checks
- Expertise in ETL automation frameworks and process optimization
- Experience with data pipeline performance tuning and Spark optimization
- Strong understanding of batch and real-time data processing
- Experience troubleshooting and optimizing Spark/Databricks jobs
- Strong knowledge of data lake / data warehouse concepts
- Experience working with large-volume datasets and distributed processing
Must Have: AWS + Python + PySpark + Databricks + AWS Glue + SQL + Kafka + Redshift + ETL
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦