Senior Software Engineer - Spark & Airflow Data Pipelines
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
Design the data pathways that keep analytics moving. Build reliable ingest and egress flows powered by Spark and Airflow.
The mission
Support distributed data processing and analytics workloads that help mission teams work with large, varied datasets.
What youβll do
- Design and optimize data ingress and egress pathways
- Build and tune Apache Spark distributed processing jobs
- Orchestrate and monitor workflows with Apache Airflow
- Wrangle structured, semi-structured and unstructured data
- Apply data quality, validation and anomaly detection practices
Requirements
Applicants must currently hold an active TS/SCI with polygraph. Ctrl+ does not sponsor new security clearances or clearance upgrades. Applicants who do not meet this requirement cannot be considered., * 7 years of relevant experience with a Bachelorβs degree in Computer Science or a related discipline (5 years with a Masterβs, or 9 years without a degree).
- Linux command-line tools
- Bash scripting
- Recent Python and Java development
- Apache Airflow DAG design, scheduling, operators and sensors
- Apache Spark or similar distributed processing engines
- SQL with MySQL, MariaDB or PostgreSQL
- Jupyter, pandas and NumPy
- Parquet, JSON, CSV and XML data
- Git
Preferred qualifications
- Slurm or other HPC job schedulers
- Jira and Confluence
Benefits & conditions
$123.63-$136.51 per hour in approximate pay; employer 401(k) contribution is additional.
Compensation: The listed range reflects approximate hourly pay across our compensation models and excludes Ctrl+βs employer 401(k) contribution. Your hourly pay will vary based on qualifications, experience, and the compensation model you select. The lower end reflects a no-bonus option with five weeks of PTO; the upper end reflects the Max Rate option without bonus or PTO.
Choose from three compensation models: Max Rate, With Bonus, or With Bonus and PTO. Offers include a projected five-year compensation comparison and a package comparison sheet. PTO and bonuses depend on the selected model and role eligibility., * 10% employer 401(k) non-elective contribution
- Employer-paid life insurance and short- and long-term disability insurance
- Medical, dental and vision coverage options
- Employee Assistance Program
- Professional development and certification reimbursement
- Technology and ergonomic equipment reimbursement, subject to eligibility
- Referral and retention bonus programs, subject to eligibility
- Paid social and team events
About the company
Ctrl+ is a software engineering and staffing firm based in Elkridge, Maryland, supporting Department of Defense missions in the Fort Meade area and other listed locations. Founded by two college roommates, Brad and Bhavin, Ctrl+ brings a close-knit team approach, with founders who work on contracts alongside employees.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦