Data/Software Engineer
NS2 Mission
McLean, United States of America
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
McLean, United States of America
Tech stack
Geographic Information Systems
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Apache HTTP Server
Bash
Big Data
Information Engineering
Data Governance
ETL
Data Systems
Database Design
Amazon DynamoDB
Python
PostgreSQL
Machine Learning
MySQL
NoSQL
NumPy
Operational Databases
Performance Tuning
PostGIS
Query Optimization
SQL Databases
Workflow Management Systems
Data Processing
Cloud Platform System
Spark
GIT
Cloudformation
Pandas
Containerization
PySpark
Terraform
Software Version Control
Data Pipelines
Docker
Job description
- Design, develop, and maintain scalable end-to-end data pipelines using Python and modern data engineering frameworks.
- Build and optimize ETL workflows that process structured, unstructured, and geospatial data at scale.
- Deploy and manage containerized applications within AWS cloud environments.
- Develop and optimize SQL and NoSQL data solutions, including database design, performance tuning, and query optimization.
- Integrate AI/ML models and services into production data workflows.
- Utilize orchestration tools to automate data pipelines and manage Spark jobs.
- Maintain data governance, lineage, cataloging, and compliance best practices across enterprise datasets.
- Collaborate with stakeholders to gather requirements, design technical solutions, and support platform modernization initiatives.
- Troubleshoot pipeline failures, performance bottlenecks, and data quality issues while contributing to engineering best practices and technical documentation.
Requirements
- 5+ years of experience building production data pipelines and scalable ETL solutions.
- Advanced Python development experience, including Pandas and NumPy.
- Experience developing with Apache Spark and PySpark.
- Experience deploying containerized applications using Docker or Podman.
- Experience working with AWS services including S3, Lambda, and Step Functions.
- Strong SQL experience, including Trino, MySQL, and PostgreSQL with performance tuning and schema design.
- Experience working with NoSQL technologies such as DynamoDB.
- Experience with workflow orchestration tools including Apache Airflow and Apache Iceberg.
- Familiarity with Infrastructure as Code using Terraform or CloudFormation.
- Experience using Git and modern source control practices.
- Experience with Bash scripting for automation and data processing.
- Understanding of data governance, security, privacy, lineage, and compliance principles.
Preferred Qualifications
- Experience with Unity Catalog OSS, Apache Polaris, and OpenLineage.
- Experience with Apache Superset or similar data visualization platforms.
- Experience working with geospatial data technologies including H3 and PostGIS.
- Experience supporting AI/ML model deployment and production data workflows.
- Experience supporting large-scale data migration or platform modernization initiatives.
Position Clearance Requirement:
TS/SCI with an FSP
Please be aware, many of our positions require the ability to obtain or maintain a U.S security clearance which requires U.S citizenship
About the company
Build modern data solutions that drive mission-critical decision making. NS2 Mission is seeking a Data & Software Engineer to support the team in McLean, VA. In this role, you'll work as part of a small, highly collaborative engineering team to design, develop, and maintain scalable data pipelines and software solutions supporting mission operations. You'll leverage modern cloud technologies, big data frameworks, and AI/ML capabilities to build high-performance applications and data workflows that transform complex data into actionable intelligence., NS2 Mission's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best. At NS2 Mission, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.