Senior Software Engineer - Spark & Airflow Data Pipelines

CTRL, LLC
Fort Meade, MD, United States
7 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$257,150 - $283,941
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Airflow Bash Shell Distributed Computing Environment JSON Job Scheduling Python (Programming Language) PostgreSQL Linux Commands MariaDB MySQL NumPy
+12 more
SQL Databases Unstructured Data Extensible Markup Language (XML) Parquet Apache Spark Jupyter Git Pandas Information Technology Atlassian Tools Slurm Data Pipelines

Job description

Design the data pathways that keep analytics moving. Build reliable ingest and egress flows powered by Spark and Airflow.

The mission

Support distributed data processing and analytics workloads that help mission teams work with large, varied datasets.

What you’ll do

  • Design and optimize data ingress and egress pathways
  • Build and tune Apache Spark distributed processing jobs
  • Orchestrate and monitor workflows with Apache Airflow
  • Wrangle structured, semi-structured and unstructured data
  • Apply data quality, validation and anomaly detection practices

Requirements

Applicants must currently hold an active TS/SCI with polygraph. Ctrl+ does not sponsor new security clearances or clearance upgrades. Applicants who do not meet this requirement cannot be considered., * 7 years of relevant experience with a Bachelor’s degree in Computer Science or a related discipline (5 years with a Master’s, or 9 years without a degree).

  • Linux command-line tools
  • Bash scripting
  • Recent Python and Java development
  • Apache Airflow DAG design, scheduling, operators and sensors
  • Apache Spark or similar distributed processing engines
  • SQL with MySQL, MariaDB or PostgreSQL
  • Jupyter, pandas and NumPy
  • Parquet, JSON, CSV and XML data
  • Git

Preferred qualifications

  • Slurm or other HPC job schedulers
  • Jira and Confluence

Benefits & conditions

$123.63-$136.51 per hour in approximate pay; employer 401(k) contribution is additional.

Compensation: The listed range reflects approximate hourly pay across our compensation models and excludes Ctrl+’s employer 401(k) contribution. Your hourly pay will vary based on qualifications, experience, and the compensation model you select. The lower end reflects a no-bonus option with five weeks of PTO; the upper end reflects the Max Rate option without bonus or PTO.

Choose from three compensation models: Max Rate, With Bonus, or With Bonus and PTO. Offers include a projected five-year compensation comparison and a package comparison sheet. PTO and bonuses depend on the selected model and role eligibility., * 10% employer 401(k) non-elective contribution

  • Employer-paid life insurance and short- and long-term disability insurance
  • Medical, dental and vision coverage options
  • Employee Assistance Program
  • Professional development and certification reimbursement
  • Technology and ergonomic equipment reimbursement, subject to eligibility
  • Referral and retention bonus programs, subject to eligibility
  • Paid social and team events

About the company

Ctrl+ is a software engineering and staffing firm based in Elkridge, Maryland, supporting Department of Defense missions in the Fort Meade area and other listed locations. Founded by two college roommates, Brad and Bhavin, Ctrl+ brings a close-knit team approach, with founders who work on contracts alongside employees.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…