Databricks Architect

Vidha IT Solutions LLC
United States
29 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$120,000.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Cloud Computing Data Architecture Data Integrity Extract Transform Load (ETL) Job Scheduling Python (Programming Language) Cloud Services Standard Sql Data Ingestion System Availability
+7 more
Apache Spark Data Lakes Pyspark Data Analytics Data Pipelines Databricks Programming Languages

Job description

  • Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
  • Build and optimize ETL/ELT workflows to support data ingestion, transformation, and delivery
  • Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions
  • Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency
  • Implement Delta Lake architecture and best practices for data reliability and governance
  • Integrate Databricks with cloud platforms such as AWS, Azure, or GCP and enterprise data sources
  • Troubleshoot and resolve data pipeline issues, ensuring high availability and data quality

Requirements

  • Proven experience as a Databricks Engineer or Data Engineer with hands-on Databricks platform expertise
  • Strong proficiency in Apache Spark, PySpark, and SQL
  • Experience with Delta Lake, Lakehouse architecture, and data modeling
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and cloud-native data services
  • Experience building and managing ETL/ELT pipelines at scale
  • Knowledge of Python, Scala, or other relevant programming languages
  • Strong problem-solving skills and ability to work in a collaborative, fast-paced environment

About the company

Vidha IT Solutions LLC is looking for a talented Databricks Architect to join our growing team. This is an exciting opportunity to work at the forefront of data engineering, building and optimizing scalable data solutions that drive real business impact. If you’re passionate about big data, cloud platforms, and cutting-edge analytics, we want to hear from you!, Vidha IT Solutions LLC is a dynamic technology services company dedicated to delivering innovative IT and data solutions to clients across industries. Our team thrives on solving complex challenges with modern technology, and we take pride in fostering a collaborative and growth-oriented workplace. At Vidha IT Solutions, employees are empowered to make an impact and grow their careers alongside a passionate, forward-thinking team.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…