Senior Data Engineer

Tata Consultancy Services Limited
Atlanta, GA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$120,000.0 - $140,000.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Data Integration Data Warehousing Distributed Systems MongoDB NoSQL Data Streaming Systems Integration Enterprise Data Management Event Driven Architecture Information Technology Real Time Data
+3 more
Apache Kafka Stream Processing Data Pipelines

Requirements

Do you have experience in Real-time data processing implementation?, Do you have a Bachelor’s degree?, We are seeking a Senior Data Engineer with strong expertise in real-time data streaming and system integration. The role focuses on building event-driven architectures, implementing CDC pipelines, and ensuring seamless data flow across enterprise data platforms. Key Skills Strong hands-on experience with Apache Kafka (MSK) and event-driven architecture Expertise in CDC pipelines using AWS DMS Experience integrating mainframe and heterogeneous data sources Knowledge of data consistency patterns across distributed systems Strong understanding of schema evolution and data contract management Preferred Skills Experience with Lakehouse architectures and data warehousing (Redshift) Familiarity with MongoDB and NoSQL data integration Exposure to real-time data processing and streaming frameworks Roles & Responsibilities Design and implement event-driven data pipelines using Apache Kafka (AWS MSK). Build and manage CDC pipelines using AWS DMS for near real-time data ingestion. Ingest and integrate data from mainframe systems and external data sources. Ensure data consistency and synchronization across Lakehouse, Redshift, and MongoDB platforms. Manage schema evolution and enforce data contracts across streaming and downstream systems., Qualifications : BACHELOR OF COMPUTER SCIENCE

Benefits & conditions

Pulled from the full job description

  • Pet insurance
  • Health insurance
  • Vision insurance
  • Dental insurance
  • Commuter assistance, Salary Range: $120,000-$140,000 a year TCS Employee Benefits Summary: Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. Family Support: Maternal & Parental Leaves. Insurance Options: Auto & Home Insurance, Identity Theft Protection. Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement. Time Off: Vacation, Time Off, Sick Leave & Holidays.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:01 min

Migrating existing applications from MongoDB to Postgres

Nikita Shamgunov Nikita Shamgunov · WWC 2024

1:37 min

Introduction to Apache Kafka benchmarking and performance analysis

Kirill Kulikov · LIVE

4:30 min

Introducing data management and the shift to streaming

Mary Grygleski Mary Grygleski · LIVE

1:39 min

Defining Apache Kafka and its primary real-time use cases

Lucia Cerchie · LIVE

3:55 min

Infrastructure challenges when combining Kafka with Apache Flink

Bobur Umurzokov · LIVE

Videos

See all

Related articles

See all