Databricks Engineer
Role details
Job location
Tech stack
Job description
We are seeking a highly skilled Databricks Engineer with AWS expertise to support Data Services portfolio The role will be responsible for designing developing optimizing and supporting enterprise scale data platforms data pipelines and analytics solutions leveraging Databricks Lakehouse AWS Cloud and modern data engineering practices The candidate will work closely with data architects application teams business stakeholders and platform engineering teams to deliver scalable secure and high performance data solutions, * Design develop and maintain scalable data pipelines using Databricks Py Spark, Spark SQL and Delta Lake
- Build and support enterprise data lake and lake house solutions on AWS
- Develop batch and real time ingestion frameworks from multiple source systems
- Implement data transformation enrichment cleansing and validation processes
- Optimize Spark workloads for performance scalability and cost efficiency
- Design and implement data models supporting reporting analytics and downstream applications
- Integrate Databricks with AWS services including S3 Glue Lambda Redshift Event Bridge and IAM
- Support data migration and modernization initiatives from traditional data warehouses to Databricks Lakehouse
- Implement CICD pipelines and Infrastructure as Code IaC using Terraform and Git based repositories
- Collaborate with security teams to ensure compliance with governance risk and data security standards
- Troubleshoot production incidents and provide L3 operational support
- Participate in architecture reviews code reviews and technical governance activities
Requirements
- Bachelors or Masters degree in Computer Science Engineering Information Systems or related discipline
- Databricks Certified Data Engineer Preferred
- AWS Certified Data Analytics or AWS Solution Architect Preferred
Mandatory Technical Skills
- Databricks
- Databricks Lakehouse Architecture
- Databricks Workflows
- Delta Lake
- Unity Catalog
- Databricks SQL
- Data Vault Modeling
- Dimensional Data Modeling
- Banking Domain Experience
- Strong experience within Banking and Financial Services
- Understanding of enterprise data governance regulatory reporting risk compliance and audit requirements
- Experience working in large global organizations with stringent security and operational standards.
Benefits & conditions
Benefits and Perks:
- Medical Plan Covering Medical, Dental, Vision
- Term and Long-Term Disability Coverage
- Plan with Company match.
- Insurance
- Time, Sick Leave, Paid Holidays
- Paternity and Maternity Leave
The range displayed on each job posting reflects the minimum and maximum salary target for the position across all US locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.