Data Engineering Lead (Databricks + AWS) Dallas, TX Onsite as needed

OpenKyber LLC
Dallas, TX, United States
22 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Information Engineering Data Integration Extract Transform Load (ETL) Python (Programming Language) Microsoft SQL Server Oracle (Applications) Query Optimization Data Ingestion Sql Optimization
+8 more
Apache Spark Change Data Capture Indexer Data Lakes Pyspark Stream Processing Data Pipelines Databricks

Requirements

Candidate Must Have: 4+ years Python/Spark/PySpark, 3+ years AWS, and strong hands-on Databricks production experience. Mandatory Skills:

  • Databricks real-time/production experience is mandatory
  • Python
  • Apache Spark / PySpark
  • AWS 3+ years
  • AWS S3, Glue, Lambda, Kinesis, EMR, Redshift
  • Data Pipeline design & development
  • ETL / Data Ingestion & Transformation
  • Advanced SQL, query optimization & indexing
  • CDC (Change Data Capture)
  • MS SQL / SQL Server and Oracle
  • Aurora & Redshift
  • Real-time data processing
  • Data Lake architecture & data integration
  • Agile methodology

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…