> Markdown version of [/jobs/ext/3871338-engineer-software-design](https://www.wearedevelopers.com/jobs/ext/3871338-engineer-software-design). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Engineer Software Design

- **Company:** Tata Consultancy Services Limited
- **Location:** Herndon, VA, United States
- **Experience:** Expert
- **Salary:** $100,000.0 - $120,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Airflow, Cloud Computing, Databases, Extract Transform Load (ETL), Apache Hive, Python (Programming Language), Performance Tuning, Systems Development Life Cycle, Software Tools, Software Engineering, Data Streaming, Data Processing, Scripting, Google Cloud, Data Ingestion, Apache Spark, Pyspark, Integration Frameworks, Apache Kafka, Data Management, Data Pipelines
- **Published:** October 22, 2026
- **Apply:** https://www.careerbuilder.com/job-details/engineer-software-design-herndon-va--84ceef5f-c0c8-4862-b2b0-1a52038eae18

## About the Role

Engineering Software, Software Design, GCP (Good Clinical Practices), Cloud Computing, Python Programming/Scripting Language, Apiary/Beekeeping, Data Management, Database Extract Transform and Load (ETL), Scalable System Development, Data Processing, Required Skills: Kafka | Python | ETL Testing | Hive

Experience: 8 - 12 Years, * Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.

 * Strong experience with large-scale GCP Data Engineering solutions.
 * Hands-on experience with Airflow DAG development and support
 * Experience building and optimizing Spark/PySpark data pipelines.
 * Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
 * Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable

## Description

* Google Cloud Platform (GCP)
 * PySpark
 * Python
 * Airflow
 * Hive
 * Kafka

Data Pipeline Development, Enhancement & Maintenance

 * Design, build, and maintain scalable ETL/ELT pipelines.
 * Automate data ingestion from multiple data sources.
 * Ensure reliable, high-performance, and scalable data movement.
 * Develop and optimize PySpark-based data processing frameworks.
 * Build and manage Airflow workflows and orchestration pipelines.
 * Work with Hive and Kafka-based batch and streaming data solutions.
 * Implement data quality, monitoring, governance, and operational controls.
 * Support production incidents, performance tuning, and continuous improvement initiatives

Roles & Responsibilities

 * The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.