Senior Databricks Developer / Engineer

We are seeking an experienced Senior Databricks Developer / Data Engineer for an enterprise financial-services technology environment., The ideal candidate will have strong hands-on experience developing and supporting enterprise-scale data engineering solutions using Databricks, Apache Spark, PySpark, Python, SQL, cloud platforms, and modern data architecture., * Design, develop, test, and maintain enterprise Databricks data pipelines.

• Develop scalable ETL/ELT solutions using Python, PySpark, SQL, and Delta Lake.
• Integrate data from multiple enterprise sources.
• Optimize Spark jobs, SQL queries, and Databricks workloads.
• Implement data quality, validation, and reconciliation controls.
• Support data governance, security, access controls, and lineage.
• Support production monitoring, troubleshooting, and root-cause analysis.
• Collaborate with architecture, analytics, business, and technology teams.

Additional Preferred Skills

• AWS S3, Glue, Lambda, and IAM.
• Unity Catalog and metadata management.
• Batch and streaming data processing.
• Apache Airflow or equivalent workflow orchestration.
• CI/CD, Git, Jenkins, or Bitbucket.
• Production monitoring and performance tuning.
• Financial services, banking, payments, risk, or compliance experience.

Required skill

Minimum experience

Overall IT Experience

8 years

Databricks

5 years

Apache Spark / PySpark

5 years

Cloud Platform (AWS / Azure / Google Cloud Platform)

5 years

ETL / ELT Development

6 years

Data Pipeline Development

6 years

Python Programming

5 years

SQL

6 years

Delta Lake / Delta Tables

4 years

Data Modeling

5 years

Additional preferred skills

Preferred skill

Suggested experience

AWS S3 / Glue / Lambda

3+ years

Unity Catalog

2+ years

CI/CD and Git

3+ years

Apache Airflow / Workflow Orchestration

2+ years

Production Support / Performance Tuning

3+ years

Banking / Financial Services

2+ years, Candidates must provide their current location, total IT experience, individual years of experience across required technologies, W2 availability, and confirmation of the five-day onsite requirement.