Data Integration Software Developer

MarineTraffic
Reston, United States of America
9 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote
Reston, United States of America

Tech stack

HTML
Java
JavaScript
Agile Methodologies
Amazon Web Services (AWS)
Business Analytics Applications
Application Integration Architecture
Automation of Tests
Cloud Computing
Software Documentation
Computer Programming
Computer Engineering
Continuous Integration
Data Architecture
Information Engineering
Data Integration
Data Transformation
DevOps
Elasticsearch
Python
Network Security
Named Entity Recognition
Scrum
Cloud Services
Logstash
Software Deployment
Software Engineering
Software Systems
SQL Databases
Data Streaming
Systems Architecture
Text Mining
Unix Commands
Data Logging
Data Processing
Cloud Platform System
Power Platform Integration
Delivery Pipeline
GIT
Containerization
Kubernetes
Information Technology
Atlassian Tools
Production Code
Enterprise Integration
Kafka
Apache Nifi
Bitbucket
Kibana
REST
Software Version Control
Docker
ELK
Confluent
Databricks
Vulnerability Analysis

Job description

Integration Solutions: Develop and implement integration solutions for the GAINS project using Kafka and Elastic as the primary data architecture platforms, with expanded integration to other technologies, including but not limited to Databricks.

  • Data Integration: Integrate data sources into Confluent (Kafka), and Elastic and Databricks platforms. Develop Kafka system integrations between Elasticsearch/Logstash and other systems.

  • Kafka Integration & Development: Develop Kafka system integrations, custom connectors, and work with ksqlDB and Kafka Streams for data processing based on the design solution.

Kafka Cluster Management: Deploy and manage Kafka clusters on Kubernetes in multi-site environments (both on-premise and cloud).

  • Software Lifecycle Automation: Automate the full software lifecycle, from design and development to testing and deployment, including production environments.
  • DevOps Pipelines: Design and build application deployment pipelines, including containerized environments using Kubernetes and Docker, and automated testing pipelines.

Requirements

Education: Bachelor's degree in Computer Science, Mathematics, Physics, Electrical Engineering, Computer Engineering, or related discipline, with 4 years of prior relevant experience; or master's with 2 years with prior relevant experience Experience: 4+ years of combined experience in Kafka, Java, RESTful services, AWS, and full stack development

Programming Background: Software development experience with Python, Java and SQL. Working knowledge of HTML and JavaScript.

Search & Analytics Applications: Experience with BI tools like Kibana, and technologies like Elasticsearch, Logstash, Kafka, NiFi, and Databricks. Event Streaming & Integration: Advanced understanding of event streaming and Kafka integration. Application Integration: Experience in application integration design and strong communication skills for collaboration with virtual teams.

Software Design: Experience in developing software detailed designs, particularly in ksql or kstreams. Software Development Lifecycle:

Proficiency in following a software development lifecycle and maintaining production-quality code.

Experience with distributed version control software such as Git and Bitbucket.

Knowledge of and ability to apply principles, theories, and concepts of Software Engineering.

Experience developing software on a UNIX command line platform.

Software Documentation & Requirements: Develop DoD requirements, traceability, and detailed plans/schedules. Write software systems engineering documents and interface documents (IDDs/ICDs). Security Clearance: Active Secret, Interim Secret or higher DOD security clearance. Certifications: Ability to obtain Security+ certification or equivalent DoD 8570 IAT II certification within 30 days of the start date.

Must be able to report into work site (Preferred: Ft. Meade, with possibility for it to be Scott AFB). There is a possibility that this role may have remote work potential., Text Mining & ELK Stack: Experience with text mining tools and techniques, including ELK Stack for summarization, search, and entity extraction. CI/CD & DevOps: Familiarity with CI/CD techniques, containerized pipelines, and DevOps practices. Kubernetes & Agile: Familiarity with Kubernetes deployment, Agile methodologies, and tools. Cloud Expertise: Familiarity with AWS GovCloud and cloud infrastructure, including networking and security policies.

Cloud Platform Expertise: Utilize expert knowledge of cloud-integrated platforms for integration and deployment tasks.

Cross-Team Collaboration: Work within a matrixed organization, collaborating with project leadership and core Client teams to combine software and integration practices with data engineering. System Architecture & Operational Stability: Apply knowledge of system architecture, networks, and Centralized Logging (ELK) to support data transformation initiatives.

Cloud & DoD Environments: Experience developing and deploying software in a DoD environment (DISA experience is a plus), including experience building and deploying software applications that meet DoD security standards, including updating applications and code to meet security scans and meeting security implementation guidelines (e.g. STIGs).

Agile Processes: Experience with Agile methodologies and related tools. Experience with Atlassian tools, including JIRA and Confluence.

Certifications: Certified Confluent Developer and Certified Elastic Engineer.

Remote Teamwork: Experience working remotely with a geographically dispersed team.

Agile: Strong understanding of Agile methodologies, including Scrum and SAFe.

Communication: Excellent communication and collaboration skills, with the ability to engage with customers, stakeholders, team members.

About the company

Marathon TS is committed to the development of a creative, diverse and inclusive work environment. In order to provide equal employment and advancement opportunities to all individuals, employment decisions at Marathon TS will be based on merit, qualifications, and abilities. Marathon TS does not discriminate against any person because of race, color, creed, religion, sex, national origin, disability, age or any other characteristic protected by law (referred to as "protected status").

Apply for this position