Data Engineer

M9 Solutions
Bethesda, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 180K

Job location

Bethesda, United States of America

Tech stack

API
Agile Methodologies
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Collaborative Software
Databases
Data Dictionary
Information Engineering
Data Infrastructure
Data Integration
ETL
Data Stores
DevOps
Distributed Computing Environment
Amazon DynamoDB
Elasticsearch
Push Technology
Java Message Service (JMS)
Python
PostgreSQL
MongoDB
Object-Oriented Software Development
Open Source Technology
Raw Data
Redis
Software Tools
Amazon Web Services (AWS)
SQL Databases
Data Streaming
Scripting (Bash/Python/Go/Ruby)
Cloud Platform System
AWS Lambda
Pandas
PySpark
Kubernetes
Atlassian Tools
Kafka
Apache Nifi
Data Management
3-tier Architectures
Data Delivery
Amazon Web Services (AWS)
Data Pipelines
Docker
Server Operating Systems & Platforms
Redshift

Job description

  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Develop and design data pipelines to support an end-to-end solution.
  • Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes).
  • Integrate data pipelines with AWS cloud services to extract meaningful insights.
  • Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues.
  • Design and develop robust and functional data flows to support raw data and expected data.
  • Provide Tier 3 technical support for deployed applications and dataflows.
  • Define and communicate a clear product vision for the client's software products, aligning with user needs and business objectives.
  • Create and manage product roadmaps that reflect both innovation and growth strategies.
  • Partner with a government product owner and a product team of 7 - 8 full-time employees.
  • Collaborate with the rest of the data engineering team to design and launch new features.
  • Coordinate and document dataflows, capabilities, etc.
  • Occasionally (as needed) support for off-hours deployment, such as evenings or weekends.

Requirements

  • Top Secret SCI security clearance.
  • Bachelor's degree or equivalent practical experience.
  • Expertise in distributed computing frameworks to handle large-scale data processing.
  • Familiarity with working with Amazon Web Services (AWS) or any other cloud environments.
  • Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL.
  • Proficient in utilizing Python with key libraries like pandas and PySpark, NiFi, Airflow, AWS Lambda, or similar technologies.
  • Working knowledge of software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS, and Kafka.
  • Familiar with Linux/Unix server environments.
  • Experience with Agile development methodology.
  • Publishing and/or presenting design reports.
  • Coordinating with other team members to reach project milestones and deadlines.
  • Working knowledge of Collaboration tools, such as Jira and Confluence., * Master's degree or equivalent experience in a related field.
  • Familiarity and experience with the Intelligence Community and the intel cycle.
  • Experience with cloud message APIs and usage of push notifications.
  • Keen interest in learning and using the latest software tools, methods, and technologies to solve real-world problem sets vital to national security.
  • Working knowledge of public keys and digital certificates.
  • Experience with DevOps environments.
  • Expertise in various COTS, GOTS, and open source tools that support the development of data integration and visualization applications.
  • Experience with cloud message APIs and usage of push notifications.
  • Specialization in object-oriented programming languages, scripting, and databases.

Benefits & conditions

With 15+ years of proven delivery and growth, M9 Solutions is a unique small business with credible past performance and key capabilities offering project management services, solution architects, business analysts, program managers, technical architects, and technical consultants. M9 was recognized as an Inc. 5000 Fastest-Growing Private Companies in 2021, 2020, 2019, 2018, 2017, 2016, and 2012. M9 Solutions believes that work should be fun, rewarding, and something everyone can be excited about. We offer a competitive compensation package and value diverse perspectives in driving the vision of the company.

About the company

M9 Solutions is dedicated to providing IT services and solutions to the Federal Government by mobilizing the right people, skills, clearance levels, and technologies to help organizations that desire improved performance and modern, sustainable change. M9 has provided quality IT services and support to more than 30 Federal Agencies and multiple commercial customers nationwide. Our capabilities include IT Talent Solutions, Data Delivery & Analytics, Cyber Security, Cloud Migration, Applications and Infrastructure, Software Development, and Finance & Accounting., M9 Solutions is a proud participant in the Virginia Values Veterans (V3) program and supports the Military Medics and Corpsmen (MMAC) initiative, demonstrating our commitment to hiring and supporting veterans, transitioning service members, military spouses, and dependents.

Apply for this position