Data Engineer

M9 Solutions
Vienna, VA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$60,000.0 - $180,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Airflow Amazon Web Services Amazon S3 Big Data Collaborative Software Databases Data Dictionary Information Engineering Data Infrastructure Data Integration
+36 more
Extract Transform Load (ETL) Data Stores DevOps Distributed Computing Environment Amazon DynamoDB Elasticsearch Push Technology Java Message Service (JMS) Python (Programming Language) PostgreSQL MongoDB Object-Oriented Software Development Open Source Technology Raw Data Redis Software Tools Amazon Simple Notification Service (SNS) SQL Databases Data Streaming Scripting Cloud Platform System AWS Lambda Pandas Pyspark Kubernetes Atlassian Tools Apache Kafka Apache Nifi Data Management 3-tier Architectures Data Delivery Amazon Simple Queue Service (SQS) Data Pipelines Docker Server Operating Systems & Platforms Amazon Redshift

Job description

  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Develop and design data pipelines to support an end-to-end solution.
  • Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes).
  • Integrate data pipelines with AWS cloud services to extract meaningful insights.
  • Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues.
  • Design and develop robust and functional data flows to support raw data and expected data.
  • Provide Tier 3 technical support for deployed applications and dataflows.
  • Define and communicate a clear product vision for the client’s software products, aligning with user needs and business objectives.
  • Create and manage product roadmaps that reflect both innovation and growth strategies.
  • Partner with a government product owner and a product team of 7 - 8 full-time employees.
  • Collaborate with the rest of the data engineering team to design and launch new features.
  • Coordinate and document dataflows, capabilities, etc.
  • Occasionally (as needed) support for off-hours deployment, such as evenings or weekends.

Requirements

  • Top Secret SCI security clearance.
  • Bachelor’s degree or equivalent practical experience.
  • Expertise in distributed computing frameworks to handle large-scale data processing.
  • Familiarity with working with Amazon Web Services (AWS) or any other cloud environments.
  • Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL.
  • Proficient in utilizing Python with key libraries like pandas and PySpark, NiFi, Airflow, AWS Lambda, or similar technologies.
  • Working knowledge of software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, and Kafka.
  • Familiar with Linux/Unix server environments.
  • Experience with Agile development methodology.
  • Publishing and/or presenting design reports.
  • Coordinating with other team members to reach project milestones and deadlines.
  • Working knowledge of Collaboration tools, such as Jira and Confluence., * Master’s degree or equivalent experience in a related field.
  • Familiarity and experience with the Intelligence Community and the intel cycle.
  • Experience with cloud message APIs and usage of push notifications.
  • Keen interest in learning and using the latest software tools, methods, and technologies to solve real-world problem sets vital to national security.
  • Working knowledge of public keys and digital certificates.
  • Experience with DevOps environments.
  • Expertise in various COTS, GOTS, and open source tools that support the development of data integration and visualization applications.
  • Experience with cloud message APIs and usage of push notifications.
  • Specialization in object-oriented programming languages, scripting, and databases.

Benefits & conditions

With 15+ years of proven delivery andgrowth, M9 Solutions is a unique small business with credible past performance and key capabilities offering project management services, solution architects, business analysts, program managers, technical architects, and technical consultants. M9 was recognized as an Inc. 5000 Fastest-Growing Private Companies in 2021, 2020, 2019, 2018, 2017, 2016, and 2012. M9 Solutions believes that work should be fun, rewarding, and something everyone can be excited about. We offer a competitive compensation package and valuediverse perspectivesin driving the vision of the company.

About the company

M9 Solutions is dedicated to providing IT services and solutions to the Federal Government by mobilizing the right people, skills, clearance levels, and technologies to help organizations that desire improved performance and modern, sustainable change. M9 has provided quality IT services and support to more than 30 Federal Agencies and multiple commercial customers nationwide. Our capabilities include IT Talent Solutions, Data Delivery & Analytics, Cyber Security, Cloud Migration, Applications and Infrastructure, Software Development, and Finance & Accounting., M9 Solutions is a proud participant in the Virginia Values Veterans (V3) program and supports the Military Medics and Corpsmen (MMAC) initiative, demonstrating our commitment to hiring and supporting veterans, transitioning service members, military spouses, and dependents.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on diversityjobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · WWC 2024

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:42 min

Comparing in-memory and Redis storage for cache scalability

Simone Sanfratello · WWC 2022

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all