Lead Software Engineer (Data)

Xfinity
Reston, VA, United States
10 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$175,427.0 - $200,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Bash Shell Unix Extract Transform Load (ETL) Data Stores Apache HBase Identity and Access Management Linux Commands Data Streaming
+8 more
Data Processing Apache Spark Information Technology Apache Flink Apache Kafka Cloudwatch Data Pipelines Amazon Elastic Mapreduce (EMR)

Job description

DUTIES: Provide technical leadership to a team responsible for developing data processing software using Apache Flink; design extract transform-load (ETL) data pipelines based on company’s proprietary ETL development library, using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; store structured data using Hbase; develop business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; develop streaming data pipelines using Apache Kafka; store data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; automate tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy.

Requirements

REQUIREMENTS: Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software using Apache Flink; of which five (5) years of experience include designing extract transform-load (ETL) data pipelines using Flink, Spark, Kafka, AWS EMR, Azkaban and Airflow; storing structured data using Hbase; and developing business-level online video advertising technologies, including ad serving platforms, ad decisioning systems, and audience targeting; of which three (3) years include developing streaming data pipelines using Apache Kafka; storing data, running services, monitoring logs, and managing permissions using AWS services including S3, EC2, CloudWatch, and IAM; and automating tasks in a Unix environment using Linux Command Line Interface (“CLI”) and Bash scripting. SALARY: $175,427.00 to $200,000.00 per year, Apache Kafka; HBase; Apache Flink

Benefits & conditions

Base Pay: $175,427.00 The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later. Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality - to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the on our careers site for more details.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:09 min

Evaluating mature stream processing frameworks for production systems

Soroosh Khodami Soroosh Khodami · World Congress 2024

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

2:03 min

Microsoft integrating native Unix coreutils into Windows environments

Chris Heilmann +2 · LIVE

3:44 min

Automating storage savings with S3 intelligent tiering

Sébastien Stormacq · World Congress 2021

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all