> Markdown version of [/jobs/ext/3899338-2160-sr-engineer-software-development-amp-architecture](https://www.wearedevelopers.com/jobs/ext/3899338-2160-sr-engineer-software-development-amp-architecture). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # 2160-Sr. Engineer Software Development amp Architecture - **Company:** Comcast Corporation - **Location:** Philadelphia, PA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Unit Testing, Big Data, Extract Transform Load (ETL), Software Debugging, Middleware, Python (Programming Language), NoSQL, Scrum Methodology, Regression Testing, Software Engineering, SQL Databases, Systems Integration, Apache Spark, Parallel Computation, Electronic Medical Records, Pyspark, Information Technology, AWS Glue - **Published:** October 23, 2026 - **Apply:** https://www.employmentcrossing.com/job/id-741af3feae7b75e7315d4438a67d7af7 ## About the Role REQUIREMENTS: Bachelor's degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and two (2) years of experience using Apache Spark and PySpark; developing and documenting Unit Tests and integrating regression testing suite in CI/CD pipelines; using SQL and NoSQL to analyze, debug, and create reports; developing solutions using AWS Glue, EMR, Spark, and Python. ## Description DUTIES: Contribute to a team responsible for developing data driven solutions for big data within on-premise, private and public cloud environments; apply AI and Machine Learning methodologies to perform high volume data transformations on large datasets using massive parallel processing techniques; create data centric applications using AWS Glue, EMR, Spark and Python; use SQL and NoSQL to analyze debug and create reports; deliver high throughput using various in-memory computing and storage solutions; modernize traditional ETL processes using in-memory computing frameworks: Apache Spark and PySpark); deliver highly performant and reliable metadata driven, configurable solutions and workflows; develop and document Unit Tests and integrate regression testing suite in CI/CD pipelines; manage and optimize various complex compute and ETL workflows to ensure reliable operations in production and non-production environments; work with middleware services team, scrum team and other technical and non-technical teams to ensure the developed solutions align with the overall product design and requirements; and optimize the existing compute and ETL processes for efficiency and cost savings.