> Markdown version of [/jobs/ext/2880857-lead-software-engineer-data](https://www.wearedevelopers.com/jobs/ext/2880857-lead-software-engineer-data). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Software Engineer (Data) - **Company:** Xfinity - **Location:** Reston, VA, United States (Remote available) - **Experience:** Expert - **Salary:** $175,427.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Bash Shell, Unix, Extract Transform Load (ETL), Data Stores, Apache HBase, Identity and Access Management, Linux Commands, Data Streaming, Data Processing, Apache Spark, Information Technology, Apache Flink, Apache Kafka, Cloudwatch, Data Pipelines, Amazon Elastic Mapreduce (EMR) - **Published:** September 13, 2026 - **Apply:** https://www.careerjet.com/job/us58c79594ac677b937b59b8f4676155e3/eaa ## About the Role REQUIREMENTS: Bachelor's degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software using Apache Flink; of which five (5) years of experience include designing extract transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; storing structured data using Hbase; and developing business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; of which three (3) years include developing streaming data pipelines using Apache Kafka; storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; and automating tasks in a Unix environment using Linux Command Line Interface ("CLI") and Bash scripting. SALARY: $175,427.00 to $200,000.00 per year, Apache Kafka; HBase; Apache Flink ## Description DUTIES: Provide technical leadership to a team responsible for developing data processing software using Apache Flink; design extract transform-load (ETL) data pipelines based on company's proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; store structured data using Hbase; develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; develop streaming data pipelines using Apache Kafka; store data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; automate tasks in a Unix environment using Linux Command Line Interface ("CLI") and Bash scripting; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [WeAreDevelopers LIVE - Node and Package Security](https://www.wearedevelopers.com/videos/2138-wearedevelopers-live-node-and-package-security) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Hate organising your photos? Try it with 5 Terabytes](https://www.wearedevelopers.com/videos/79-hate-organising-your-photos-try-it-with-5-terabytes) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [How Much Does a Software Engineer Make? Realistic Software Engineering Salaries](https://www.wearedevelopers.com/magazine/425-how-much-does-a-software-engineer-make-realistic-software-engineering-salaries) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)