Senior Databricks Data Engineer
Tata Consultancy Services Limited
Boynton Beach, FL, United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$100,000.0 - $130,000.0
Working hours
Regular working hours
Job source
Tech stack
Adaptable Database Systems
Amazon Web Services
Amazon S3
Data Analysis
Apache HTTP Server
Big Data
Cloud Engineering
Code Review
Continuous Integration
Data Architecture
Information Engineering
Extract Transform Load (ETL)
+23 more
Data Systems
Data Warehousing
Software Design Documents
DevOps
Distributed Computing Environment
Distributed Systems
Apache Hive
Identity and Access Management
Performance Tuning
Software Deployment
PL-SQL
SQL Databases
Data Ingestion
Sql Optimization
Apache Spark
Git
Data Lakes
Pyspark
Deployment Automation
Real Time Data
Physical Data Models
Data Pipelines
Databricks
Job description
| Role: Senior EngineerRequired Skills: Data Warehouse | SQL | Apache SparkExperience: 8 - 10 YearsFunction: TECHNOLOGYApply By: 2026-12-07Must Have Technical/Functional Skills8+ years of experience in Data Engineering, ETL/ELT, and Data Warehousing.5+ years of hands-on experience with Databricks, PySpark, and Apache Spark.Strong expertise in Delta Lake, Lakehouse Architecture, and large-scale data processing.Advanced SQL and PL/SQL development skills.Experience designing and implementing scalable batch and real-time data pipelines.Strong knowledge of dimensional, relational, and analytical data modeling.Experience with Spark SQL, DataFrames, Hive, and distributed computing frameworks.Hands-on experience with AWS services, including S3, IAM, Glue, Lambda, and Redshift.Strong understanding of Databricks-AWS integrations and cloud-native architectures.Experience with data quality, performance tuning, optimization, and troubleshooting.Knowledge of CI/CD, Git, DevOps practices, and deployment automation.Excellent analytical, problem-solving, communication, and stakeholder management skills.Prior experience leading technical teams and mentoring junior engineers.Roles & ResponsibilitiesGather and analyze business and technical requirements from stakeholders and clients.Design end-to-end data solutions, architectures, and scalable data models.Develop and optimize data ingestion, transformation, and analytics pipelines using Databricks and PySpark.Create and maintain conceptual, logical, and physical data models.Lead solution design activities, including High-Level and Low-Level Design documentation.Implement data quality, monitoring, governance, and performance optimization best practices.Collaborate with Product Owners, Architects, and Business Analysts to define project scope and delivery plans.Provide technical leadership, mentoring, and guidance to onshore and offshore teams.Conduct design reviews, code reviews, and troubleshooting sessions to ensure solution quality.Drive continuous improvements in platform performance, scalability, reliability, and cost optimization.Support production deployments, issue resolution, and root cause analysis activities.Contribute to technology roadmaps and recommend innovative solutions aligned with business goals.TCS Employee Benefits Summary:Discretionary Annual Incentive.Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.Family Support: Maternal & Parental Leaves.Insurance Options: Aut& Home Insurance, Identity Theft Protection.Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.Time Off: Vacation, Time Off, Sick Leave & Holidays.Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.#LI-KR3Salary Range-$100,000-$130,000 a year |
Requirements
| Required Skills: Data Warehouse | SQL | Apache Spark |
Experience: 8 - 10 Years, * 8+ years of experience in Data Engineering, ETL/ELT, and Data Warehousing.
- 5+ years of hands-on experience with Databricks, PySpark, and Apache Spark.
- Strong expertise in Delta Lake, Lakehouse Architecture, and large-scale data processing.
- Advanced SQL and PL/SQL development skills.
- Experience designing and implementing scalable batch and real-time data pipelines.
- Strong knowledge of dimensional, relational, and analytical data modeling.
- Experience with Spark SQL, DataFrames, Hive, and distributed computing frameworks.
- Hands-on experience with AWS services, including S3, IAM, Glue, Lambda, and Redshift.
- Strong understanding of Databricks-AWS integrations and cloud-native architectures.
- Experience with data quality, performance tuning, optimization, and troubleshooting.
- Knowledge of CI/CD, Git, DevOps practices, and deployment automation.
- Excellent analytical, problem-solving, communication, and stakeholder management skills.
- Prior experience leading technical teams and mentoring junior engineers.
Benefits & conditions
- Discretionary Annual Incentive.
- Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
- Family Support: Maternal & Parental Leaves.
- Insurance Options: Aut& Home Insurance, Identity Theft Protection.
- Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
- Time Off: Vacation, Time Off, Sick Leave & Holidays.
- Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
LI-KR3
Salary Range-$100,000-$130,000 a year
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦