Data Engineer
Role details
Job location
Tech stack
Job description
Data Engineer provides technical leadership, analytical expertise, and program oversight in the areas of data engineering, modeling and simulation (M&S), and systems analysis. This position is responsible for managing the technical execution of technical data modeling efforts in direct support of Navy and Department of Defense (DoD) programs. Integrates multidisciplinary engineering methodologies to ensure that model development, data management, and analytical outputs align with program objectives, technical standards, and customer requirements. The ideal candidate has 2 to 5 years of experience using Orchestration tools (Apache Airflow) and data processing tools (Apache Spark) with a demonstrated ability to collaborate with cross-functional teams., * Collaborate with software developers, data scientists, and product managers to understand requirements, gather specifications and align on project goals.
- Contribute technical expertise in data engineering to design and implement data solutions that support software development initiatives.
- Participate in planning sessions to develop data pipeline architecture that align with project requirements.
- Design data ingestion, transformation, and storage workflows that are scalable and meet software performance requirements.
- Implement data quality checks and validation procedures to ensure data accuracy and integrity within software products.
- Conduct comprehensive testing, including unit, integration, and system testing ensuring application quality and functionality stay in specifications.
- Debug and resolve complex software defects and issues.
- Document data engineering processes, pipeline configurations, and data flows to ensure consistency and future support.
- Ensure accuracy and completeness of all documentation.
- Foster effective collaboration with cross-functional teams to achieve project objectives.
- Communicate complex technical information clearly and effectively.
- Utilize advanced software development tools and methodologies to support project requirements.
- Integrate software development tools and methodologies into the workflow to improve efficiency and accuracy.
- Manage projects, including planning, execution, and delivery.
- Coordinate with cross-functional teams to ensure project objectives are met on time and within budget.
- Performs other duties as assigned.
Requirements
Do you have experience in Spark implementation?, * Bachelor's degree in Computer Science, Engineering, or a related technical field required; advanced degree, relevant internship experience, or equivalent hands-on industry experience may be considered in lieu of traditional qualifications.
- Proficient with Orchestration tools (Apache Airflow) and data processing tools (Apache Spark)
- Advanced knowledge of object storage and management of unstructured data
- Experience utilizing cross-domain solutions in a secure environment
- Advanced knowledge of containerization technologies supporting enterprise software deployment (Kubernetes, Docker, Helm, etc.)
- Proficient knowledge of data engineering workflows such as extract, transform, load (ETL) processes and data warehousing
- Advanced level knowledge of software development processes including Agile methodologies.
- Conversant with object-oriented programming languages
- Excellent written and oral communication.
- Currently holds an active U.S. national security clearance or be able to receive and maintain one., * Current CompTIA Security + Certification
- Experience with Typescript/Express and FastAPI frameworks
- Experience with PostgreSQL
- Experience with a modern JavaScript framework (Angular, React, etc.)
- Experience with software development frameworks and libraries.
- In-depth understanding of the aerospace and defense industry.
- Knowledge of DoD software development policies and requirements
Physical Requirements
- Prolonged periods sitting at a desk and working on a computer.
- Must be able to lift up to 15 pounds at times.
- This position is hybrid located in St. Paul, MN.
- Fully remote candidates may be considered with increased expectation for travel.
- This position may require the ability to travel up to 5%., Some positions will require access to U.S. National Security information. Positions that require this access will be required to receive and maintain a U.S. government personnel security clearance (PCL). In order to qualify for this position, the candidate must be a US Citizen and either currently possess this National Security eligibility or be able to complete the investigation application process with a favorable determination and maintain that eligibility throughout their employment.
Benefits & conditions
Pulled from the full job description
- Health insurance
- 401(k) matching
- Paid time off
- Vision insurance
- Health savings account
- Dental insurance
- Flexible spending account, The listed pay scale reflects the broad, minimum to maximum, pay scale for this position for the location for which it has been posted and is not a guarantee of compensation or salary. Other compensation considerations may include, but are not limited to, job responsibilities, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, or other applicable factors.
Benefits include…
Paid Time Off
Paid Company Holidays
Medical, Dental & Vision Insurance
Optional HSA and FSA
Base and Voluntary Life Insurance
Short Term & Long-Term Disability Insurance
401k Matching
Employee Assistance Program
The pay range for this role is: 101,998 - 130,630 USD per year(Remote (United States))