> Markdown version of [/jobs/ext/242637-senior-developer](https://www.wearedevelopers.com/jobs/ext/242637-senior-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Developer

- **Company:** Tata Consultancy Services Limited
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Salary:** $110,000.0 - $120,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Airflow, Architectural Patterns, Cloudera Impala, Information Engineering, Data Governance, Extract Transform Load (ETL), Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Apache Oozie, Performance Tuning, Systems Development Life Cycle, Standard Sql, Scala (Programming Language), Workflow Management Systems, Apache Yarn, Apache Spark, Technical Debt, Data Lakes, Pyspark, Information Technology, Apache Kafka, Spark Streaming, Data Management, Stream Processing, Control M
- **Published:** May 23, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=08ce5092cd224c52

## About the Role

Do you have experience in System tuning?, Do you have a Master's degree?, Primary Skill: Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.
Experience: 10+ yrs
Roles & Responsibilities
Bachelor's or master's degree in computer science or related field.

 * Required Hard and Soft Skills / Experience

 * Deep Expertise in PySpark, including performance tuning and optimization

 * Strong python development experience in large-scale distributed environment

 * Solid knowledge of Hadoop ecosystem (HDFS,Hive/Impala, YARN)

 * Proven experience designing and governing enterprise, regulatory facing data platforms.

 * Expertise in designing data lakes, ELT/ETL pipelines, batch and real time data processing solution

 * Proficiency in programming languages such as Java, Scala and SQL

 * Strong understanding of non-functional requirements and production support models

 * Clear written and verbal communication skills with ability to influence across organizations

 * Preferred Skills / Experience

 * Financial services experience, particularly in Market Surveillance, AML, Fraud, Or Risk Technology

 * Experience supporting regulatory or audit facing platforms

 * Kafka and Spark Structured streaming exposure

 * Familiarity with Orchestration tools(Airflow,Control-M,Oozie)

 * Knowledge of data governance, lineage, and data quality controls

 * Daily Responsibilities/Priorities, Qualifications : BACHELOR OF COMPUTER SCIENCE

## Description

* Define target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop,Spark, Pyspark and Python

 * Establish standard architectural patterns for alert generation, enrichment, aggregation and reporting pipelines.

 * Ensure architecture aligns with enterprise technology standards and Surveillance control expectation

 * Solution Design and Delivery Support

 * Translate surveillance business requirements(e.g, market misconduct detection, regulatory coverage) into scalable technical designs

 * Review and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards.

 * Provide hands-on architectural guidance to engineering teams during development, testing and implementation

 * Design and standardization of Spark/Pyspark frameworks supporting surveillance alert generation and enrichment

 * Modernization and Optimization of large-scale Hadoop surveillance workloads to improve performance, stability and control coverage

 * Implementation of enterprise-consistent architecture patterns enabling audit readiness, lineage, and regulatory traceability

 * Support end-to-end delivery across the SDLC, minimizing rework and technical debt

 * Architecture Governance & Leadership

 * Participate in and lead architecture review forums and design walkthroughs

 * Mentor senior engineers and promote adoption of Standard framework and best practices

 * Influence enterprise surveillance platform strategy through architecture governance

 * Documentation & Communication

 * Maintain high-quality documentation, including business requirement, data definitions and process flows

 * Proactively communicate risks, dependencies and potential timeline impact to stakeholders


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Brewing Tea over the Internet](https://www.wearedevelopers.com/videos/697-brewing-tea-over-the-internet)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)
- [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer)