TELECOMMUTE Databricks Developer

Ark Infotech Spectrum
Plano, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Plano, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Big Data
Cloud Database
Continuous Integration
Information Engineering
Data Warehousing
DevOps
Distributed Systems
Python
Performance Tuning
Azure
SQL Databases
Google Cloud Platform
Spark
Data Lake
PySpark
Data Pipelines
Databricks

Job description

Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks.

Requirements

  • Extensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experience
  • Proficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experience
  • Strong understanding of cloud data architectures (Azure Data Lake, AWS S3, Google Cloud Platform Storage) and related ecosystem - 5+ years of experience
  • Experience with CI/CD tools and DevOps practices for data engineering - 5+ years of experience
  • Familiarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experience
  • Solid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experience
  • Excellent communication and problem-solving skills - 5+ years of experience

Apply for this position