Databricks Data Engineer - AWS

TalentOla View all jobs
Wilmington, DE, United States
21 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Extract Transform Load (ETL) Elasticsearch Identity and Access Management MongoDB Networking Basics Query Optimization Data Streaming Istio Apache Spark
+14 more
Software Troubleshooting Indexer Amazon Virtual Private Cloud (VPC) Backend Event Driven Architecture Data Lakes Pyspark AWS Data Analytics Machine Learning Operations Cloudwatch Api Gateway Amazon Simple Queue Service (SQS) Serverless Computing Databricks

Job description

  • AWS backend engineering ( IAM, VPC/networking basics, CloudWatch, S3, ALB/API Gateway, ECS/EKS or Lambda, and RDS/Aurora, MongoDB etc)
  • Python Backend API engineering
  • Amazon DocumentDB expertise (Data modeling for documents, indexing/query tuning, connection management, performance troubleshooting, backup/restore, and understanding MongoDB-compatibility constraints)
  • Container platform (EKS/ECS scaling, service mesh basics, blue/green or canary deployments)
  • Nice to have
  • Data/analytics & search (OpenSearch/Elasticsearch, streaming ingestion, and building read models for search/reporting)
  • Serverless-first expertise (Advanced Lambda patterns, Step Functions,)
  • Event-driven + orchestration patterns (SQS/SNS/event-driven architecture and designing resilient async workflow)

  • Experience
  • AWS Full stack developer with Document DB experience

Requirements

  • Deep knowledge in Databricks & AWS eco-systems
  • Delta Lake + Lake house architecture (Lake flow, Lake Base)
  • PySpark/Scala Spark
  • High volume Production-grade Databricks ELT/ETL engineering
  • Nice to have
  • Streaming/DLT experience
  • ML Ops on Databricks
  • Data Mesh architecture knowledge
  • Advance cost/performance engineering
  • Experience
  • Databricks & AWS data engineer

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…