> Markdown version of [/jobs/ext/1320162-data-engineer](https://www.wearedevelopers.com/jobs/ext/1320162-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Tata Consultancy Services Limited - **Location:** Malvern, PA, United States - **Salary:** $120,000.0 - $130,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Big Data, Code Review, Continuous Integration, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Systems, Identity and Access Management, Python (Programming Language), Data Processing, Cloud Platform System, AWS Lambda, Cloudformation, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Information Technology, AWS Glue, Database Replication, Functional Programming, Data Pipelines, Serverless Computing - **Published:** July 17, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=1b655bc69a409b42 ## About the Role Qualifications : BACHELOR OF COMPUTER SCIENCE ## Description Python, Glue ETL, Attunity, Pyspark, AWS (S3, IAM, Lambda, Cloud Formation) Roles & Responsibilities * Design, develop, and maintain scalable ETL/data integration pipelines using AWS Glue, PySpark, and Python. * Develop and optimize data transformation workflows to process large datasets from multiple source systems. * Utilize Attunity for real-time and batch data replication between on-premises and cloud environments. * Build and manage data lakes and storage solutions using Amazon S3, ensuring data quality, security, and governance. * Implement serverless data processing solutions using AWS Lambda and integrate with other AWS services. * Configure and manage IAM roles, policies, and permissions to ensure secure access to AWS resources. * Automate infrastructure provisioning and deployment using AWS CloudFormation. * Monitor, troubleshoot, and optimize ETL jobs, data pipelines, and cloud resources for performance and reliability. * Collaborate with business, analytics, and application teams to gather requirements and deliver data solutions. * Support CI/CD processes, perform code reviews, and maintain technical documentation following best practices. Generic Managerial Skills, If any * Planning & Execution - Effectively prioritize tasks, estimate effort, and ensure timely delivery of project milestones while balancing multiple commitments. * Stakeholder Management - Build strong relationships with business teams, clients, and leadership through proactive communication and expectation management. * Communication - Convey technical and non-technical information clearly through meetings, presentations, documentation, and status updates. * Collaboration - Foster teamwork across cross-functional groups, encourage knowledge sharing, and contribute to a positive team environment. * Decision Making - Analyze options, assess risks, and make informed decisions that align with both technical and business objectives. * Leadership & Ownership - Take accountability for deliverables, drive initiatives proactively, and lead by example to achieve team goals. * Risk & Issue Management - Identify potential risks early, address blockers proactively, and implement mitigation strategies to ensure smooth project execution. * Customer & Business Focus - Understand customer needs and business priorities, ensuring technical solutions deliver measurable value. * Mentoring & Coaching - Support team growth through guidance, code reviews, knowledge sharing, and skill development initiatives. * Project & Change Management - Adapt effectively to evolving requirements, manage priorities during change, and ensure successful delivery outcomes. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)