> Markdown version of [/jobs/ext/2787851-data-engineer](https://www.wearedevelopers.com/jobs/ext/2787851-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Tata Consultancy Services Limited - **Location:** Charlotte, NC, United States - **Experience:** Expert - **Salary:** $95,000.0 - $115,000.0 - **Contract:** Permanent contract - **Skills:** Test Suite, Agile Methodology, Amazon Web Services, Automation of Tests, CA Workload Automation Ae, Microsoft Azure, Unix, Cloud Computing, Configuration Management, Cyber Security, Databases, Continuous Delivery, Continuous Integration, Information Engineering, Data Files, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Security, Distributed Computing Environment, Distributed Data Store, Apache Hadoop, Apache Hive, Python (Programming Language), Metadata, Microsoft SQL Server, MongoDB, Oracle (Applications), Performance Tuning, Software Engineering, SQL Databases, Data Streaming, Teradata SQL, Data Processing, Scripting, Google Cloud, Cloud Platform System, Test-Driven Development (TDD), Data Ingestion, Delivery Pipeline, Snowflake, Apache Spark, Git, Pyspark, Data Lineage, Deployment Automation, Star Schema, Data Management, Software Version Control, Data Pipelines, Databricks - **Published:** September 8, 2026 - **Apply:** https://www.careerbuilder.com/job-details/data-engineer-charlotte-nc--eafac583-3627-4b51-8b1a-a005e51d7849 ## About the Role Primary Skill: PySpark, Hive, Python, SQL, Hadoop Secondary: Unix, Agile, Base support Experience: 5 to 10 years Roles & Responsibilities 5 to 10 years of experience in Data Engineering, Software Engineering, or related technical discipline. Strong proficiency in Python, and SQL for advanced data transformations. Hands-on experience designing and building ETL/ELT pipelines, data ingestion processes, and distributed data processing jobs. Practical experience working with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems. Experience building and managing datasets in relational and/or cloud based data platforms (Teradata, Snowflake, SQL Server, Azure/AWS/GCP). Solid understanding of data modeling, metadata, data quality controls, data lineage, and secure data management. Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development. Knowledge of CI/CD pipelines, version control (Git), and automated deployment practices. Experience adhering to enterprise data governance, compliance, and operational risk frameworks. Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies. Strong communication skills and ability to collaborate across engineering, product, and business teams. Experience implementing monitoring and observability for data pipelines (logs, metrics, health checks). Advanced experience with performance tuning of SQL, Spark, or distributed data workflows. Knowledge of data security practices (encryption, masking, PII handling). Experience supporting analytical workloads, BI tools, or data science teams. Prior experience in a financial institution or other regulated industry A Data Engineer is essential to implement efficient data flows, enforce data management standards, enhance data quality, and support continuous delivery and release cycles. Without this role, the project risks delays in data readiness, gaps in data compliance, reduced quality of analytical outputs, and inability to support downstream systems effectively. Client is mainly looking for Production support ole to be able to root cause analysis of prod issues across different tech stack that we have(Hadoop, Oracle and MongoDB).Autosys knowledge, Analyze and fix performance issues, Dev work related to App Gov and other mandates., Agile Programming Methodologies, Amazon Web Services (AWS), Analysis Skills, Apache Hadoop, Apache Hive, Apache Spark, Business Intelligence Software, CA Workload Automation AE (AutoSys Edition), Cloud Computing, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Cryptography, Data Management, Data Modeling, Data Processing, Data Quality, Data Science, Data Sets, Database Extract Transform and Load (ETL), Ecosystems, Failure Analysis, GCP (Good Clinical Practices), Git, Identify Issues, Information/Data Security (InfoSec), Metadata, Metrics, Microsoft SQL Server, Microsoft Windows Azure, MongoDB, NCR Teradata, OLE (fka Object Linking and Embedding), Oracle, Performance Analysis, Performance Tuning/Optimization, Problem Solving Skills, Product Support, Production Support, Python Programming/Scripting Language, Risk, Root Cause Analysis, SQL (Structured Query Language), Snowflake Schema, Software Engineering, Source Code/Configuration Management (SCM), Team Player, Test Automation, Test Driven Development (TDD), Test Suite, Unix Operating Systems ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools)