Data Integration Engineer

Novul Solutions
United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

HTML Java (Programming Language) JavaScript (Programming Language) Agile Methodology Artificial Intelligence Amazon Web Services Data Analysis Systems Engineering Automation of Tests Command-Line Interface Cloud Computing Computer Networks
+46 more
Continuous Integration Data Cleansing Information Engineering Data Infrastructure Data Integration Extract Transform Load (ETL) DevOps Distributed Systems Elasticsearch Revision Control Systems Network Topologies Internet Protocol Apache JMeter Junit Python (Programming Language) Machine Learning Operational Data Store Scrum Methodology Release Management Power BI Logstash Ansible Selenium Software Deployment Software Engineering Software Systems SQL Databases Data Streaming Systems Integration Tableau (Software) Cloud Platform System Delivery Pipeline Apache Spark Git Kubernetes Atlassian Tools Enterprise Integration Integration Frameworks Apache Kafka Apache Nifi Bitbucket Kibana Stream Processing Data Pipelines Docker Confluent

Job description

We are seeking a Data Integration Engineer to support data engineering, system integration, and analytics efforts for DISN network topology and operational data. This role focuses on building and maintaining data pipelines, integrating distributed data sources, supporting Kafka and Elastic platform workflows, and enabling advanced data correlation and visualization., * Support the integration, enrichment, and correlation of DISN network topology data for advanced analytics and operational insight.

  • Develop, test, and deploy data pipelines and integration solutions across distributed systems and cloud environments.
  • Build and maintain solutions using Python, Java, JavaScript, SQL, and related technologies.
  • Gather requirements and collaborate with stakeholders to design data enrichment pipelines.
  • Integrate diverse data sources into Confluent Kafka and Elastic platforms.
  • Develop and maintain Kibana visualizations, dashboards, and analytics views.
  • Support Kafka integrations between Elasticsearch, Logstash, and other systems.
  • Participate in technical discussions with internal teams, external stakeholders, and mission partners.
  • Work within Agile/Scrum teams to support sprint deliverables, peer collaboration, and project objectives.
  • Communicate effectively with geographically distributed team members.
  • Troubleshoot installation, infrastructure, integration, and system issues.
  • Identify, report, and help mitigate technical risks.
  • Develop and maintain technical documentation, including DoD requirements, interface documents, security artifacts, and system engineering documentation.
  • Ensure solutions align with DoD security standards, guidelines, and platform sustainment requirements.
  • Support operational reliability by helping resolve platform and integration challenges.

Requirements

The ideal candidate will have experience in software or data engineering, ETL pipeline development, Kafka or Elastic integrations, Kibana dashboarding, and Agile team collaboration. This position supports a DoD mission environment and requires strong technical documentation, communication, and security compliance awareness., * Bachelor’s degree with 4-8 years of related experience, or master’s degree with 2-6 years; equivalent experience may be considered.

  • 4+ years of experience in software engineering, data engineering, business analysis, or data analysis.
  • Hands-on experience with Python, Java, SQL, and working knowledge of JavaScript/HTML.
  • Experience with Agile/Scrum teams and tools such as JIRA and Confluence.
  • Experience with Git, Bitbucket, or similar version control tools.
  • Experience with data analytics and visualization tools such as Kibana, Power BI, Tableau, or ELK.
  • Experience designing, developing, and optimizing ETL processes, data pipelines, and data integrations.
  • Experience with Kafka, Elastic, Elasticsearch, Logstash, or similar integration platforms.
  • Background in data modeling, data enrichment, data unification, or analytics.
  • Understanding of networking concepts, internet protocols, and network-centric environments.
  • Experience developing and deploying software on UNIX/Linux command line platforms.
  • Strong communication, coordination, and cross-functional collaboration skills.

Preferred Qualifications:

  • Experience with CI/CD, DevOps, automated delivery, and containerized deployment pipelines.
  • Experience with Kafka, Elastic, Spark, NiFi, ksqlDB, or Kafka Streams.
  • Hands-on experience with Kafka connectors and Kafka integrations with Elasticsearch/Logstash.
  • Experience designing streaming data applications and real-time data processing solutions.
  • Experience with Docker, Kubernetes, AWS, or GovCloud environments.
  • Experience configuring cloud infrastructure, networking, and security policies.
  • Experience with full software lifecycle automation, including design, testing, deployment, and production release.
  • Experience building automated testing pipelines using Ansible, Selenium, JMeter, JUnit, or similar tools.
  • Experience developing software in DoD or DISA environments.
  • Familiarity with DoD security standards, STIGs, and security compliance requirements.
  • Ability to support DoD requirements, traceability matrices, project plans, software systems engineering documents, and interface documents.
  • Familiarity with AI/ML concepts and data platform integration.
  • Ability to work effectively in remote and geographically dispersed teams.

Benefits & conditions

Core Benefits:

  • Paid Time OffPTO):TEN (10) Paid days off & FIVE (5) Floating days off.
  • Holidays: 11 Paid Holidays. Flex time can be utilized instead of holiday time usage.
  • Payroll: Paid Bi-Monthly.
  • 401(k): Partnered with the SECOND LARGEST Retirement plan provider in the U.S. Guaranteed 3% match. Eligibility - 21 years of age or older, after 3 months of employment
  • Individual or company-wide performance and recognition awards (Quarterly

Health Benefits:

  • UNITED HEALTHCARE PPO, extensive national coverage.
  • INCLUDES: Medical/Dental/Vision/HSA.
  • Eligible on the first of the month, immediately after the start date.
  • Submit the enrollment form within 30 days of your start date otherwise, you will have to wait until October for the new year enrollment.

Quality of Life Benefits:

  • Training & Career Development Reimbursement of Tuition and training needed to support career development.
  • $150 monthly reimbursement contribution paid monthly towards parking expenses.
  • Receipts must be submitted by the close of business on the 25th of each month.
  • Reimbursements will be paid on the first payroll AFTER reimbursements are submitted each month.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

4:15 min

Refactoring test code dependencies with Maven and JUnit

Benjamin Bischoff Benjamin Bischoff · Europe 2026 Virtual

2:21 min

Projecting external HTML content using default and named slots

Rowdy Rabouw Rowdy Rabouw · WWC 2022

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

1:48 min

Structuring and naming conventions for unit test methods

Annelore Egger Annelore Egger · WWC 2025

Videos

See all

Related articles

See all