Senior Data Platform Engineer

Deep Consulting Solutions
Jessup, United States of America
17 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 215K

Job location

Remote
Jessup, United States of America

Tech stack

Java
Airflow
Amazon Web Services (AWS)
Confluence
JIRA
Bash
Big Data
Information Engineering
Data Infrastructure
Linux
Python
Software Engineering
Delivery Pipeline
Spark
GIT
Containerization
Atlassian Tools
Software Version Control
Docker

Job description

  • The Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow.
  • This role focuses on building reliable, scalable, and observable workflow orchestration solutions that support data engineering, analytics, and operational use cases.
  • The engineer will collaborate closely with data engineers, platform teams, and stakeholders to ensure workflows are efficient, secure, and production ready.

Requirements

  • 5 years of experience as a software engineer
  • Bachelor's degree in a technical discipline
  • 2 additional years of experience as a software engineer may be substituted for a degree, * Experience using the Linux CLI and Linux tools
  • Experience developing Bash scripts to automate manual processes
  • Recent software development experience using Python and Java
  • Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
  • Experience using Distributed Big Data processing engines including Apache Spark
  • Experience with containerization technologies such as Docker, containerd, and Podman
  • Experience with Git Source Control System

Desired Experience:

  • Experience using the Atlassian Tool Suite (JIRA, Confluence)
  • Familiar with AWS Cloud Services and Infrastructure

Benefits & conditions

Salary: $205,000 - $215,000 annually


Excellent benefits package including 25 days PTO, 11 paid holidays, 100% employer-paid healthcare for employees and dependents - available day 1, 8% 401(k) employer match - immediate vesting.

Disclaimer: The salary range provided is an estimate based on current market conditions and may be adjusted based on factors such as experience, skills, and qualifications. The final salary offer will be determined after a thorough review of the candidate's background and alignment with the role. Please note that this range is subject to change and should be considered as a guideline rather than a definitive figure.

Shield Consulting Solutions is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law. This is a full time position

Apply for this position