Databricks Architect- AWS Background

LTIMindtree Limited
Tampa, FL, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 Business Analytics Applications BigQuery Code Review Information Systems Computer Engineering Continuous Integration Data as a Services Data Architecture Information Engineering
+34 more
Data Governance Data Transformation Data Migration Data Systems Data Vault Modeling Data Warehousing Apache Hive Identity and Access Management Python (Programming Language) OpenShift Performance Tuning Standard Sql Data Streaming Google Cloud Snowflake Apache Spark AWS Lambda Microsoft Fabric Data Lakes Pyspark Kubernetes Infrastructure Automation Frameworks Collibra AWS Glue Data Analytics Apache Kafka Data Management Cloudwatch Amazon Simple Queue Service (SQS) Terraform Data Pipelines Docker Amazon Redshift Databricks

Job description

  • We are seeking a highly skilled Databricks Engineer with AWS expertise to support Data Services portfolio
  • The role will be responsible for designing developing optimizing and supporting enterprise scale data platforms data pipelines and analytics solutions leveraging Databricks Lakehouse AWS Cloud and modern data engineering practices
  • The candidate will work closely with data architects application teams business stakeholders and platform engineering teams to deliver scalable secure and high-performance data solutions, * Design develop and maintain scalable data pipelines using Databricks PySpark Spark SQL and Delta Lake
  • Build and support enterprise data lake and Lakehouse solutions on AWS
  • Develop batch and Realtime ingestion frameworks from multiple source systems
  • Implement data transformation enrichment cleansing and validation processes
  • Optimize Spark workloads for performance scalability and cost efficiency
  • Design and implement data models supporting reporting analytics and downstream applications
  • Integrate Databricks with AWS services including S3 Glue Lambda Redshift EventBridge and IAM
  • Support data migration and modernization initiatives from traditional data warehouses to Databricks Lakehouse
  • Implement CICD pipelines and Infrastructure as Code IaC using Terraform and Gitbased repositories
  • Collaborate with security teams to ensure compliance with client governance risk and data security standards
  • Troubleshoot production incidents and provide L3 operational support
  • Participate in architecture reviews code reviews and technical governance activities

Mandatory Technical Skills

  • Databricks
  • Databricks Lakehouse Architecture
  • Databricks Workflows
  • Delta Lake
  • Unity Catalog
  • Databricks SQL
  • Auto Loader
  • Structured Streaming
  • Databricks Performance Tuning
  • Medallion Architecture
  • AWS
  • Amazon S3
  • AWS Glue
  • AWS Lambda
  • AWS IAM
  • Amazon Redshift
  • AWS CloudWatch
  • SNS SQS
  • EventBridge
  • KMS
  • Secrets Manager
  • Data Engineering
  • PySpark
  • Apache Spark
  • Python
  • SQL
  • Data Warehousing Concepts
  • ETLELT Design
  • Data Modeling
  • Data Quality Frameworks
  • Batch RealTime Processing

Requirements

  • Snowflake
  • Microsoft Fabric
  • Google Cloud Platform BigQuery
  • Kafka
  • Airflow
  • dbt
  • Terraform
  • Docker
  • Kubernetes OpenShift
  • Informatica
  • Collibra
  • Data Vault Modeling
  • Dimensional Data Modeling
  • Banking Domain Experience
  • Strong experience within Banking and Financial Services
  • Understanding of enterprise data governance regulatory reporting risk compliance and audit requirements
  • Experience working in large global organizations with stringent security and operational standards, * Bachelors or Masters degree in Computer Science Engineering Information Systems or related discipline
  • Databricks Certified Data Engineer Preferred
  • AWS Certified Data Analytics or AWS Solution Architect Preferred

Benefits & conditions

Comprehensive Medical Plan Covering Medical, Dental, Vision

Short Term and Long-Term Disability Coverage

401(k) Plan with Company match

Life Insurance

Vacation Time, Sick Leave, Paid Holidays

Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

About the company

LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 750 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by nearly 90,000 talented and entrepreneurial professionals across more than 30 countries, LTIMindtree a Larsen & Toubro Group company combines the industry-acclaimed strengths of erstwhile Larsen and Toubro Infotech and Mindtree in solving the most complex business challenges and delivering transformation at scale. For more information, please visit

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:43 min

AWS infrastructure stack and data flow pipeline overview

Artem Volk Artem Volk +1 · WWC 2024

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all