Senior Data Engineer (ETL/Cloud)

Linchpin Software LLC
Chantilly, VA, United States
6 days ago
Apply on www.clearancejobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Business Analytics Applications Cloud Computing Continuous Integration Information Engineering Extract Transform Load (ETL) Data Security Data Systems Data Warehousing Relational Databases Database Design Software Debugging
+28 more
Python (Programming Language) PostgreSQL Open Source Technology Operational Databases Performance Tuning Software Engineering SQL Databases Data Streaming Unstructured Data Visual Analytics Data Processing High Performance Computing Flask (Web Framework) Claude Code Gitlab Vue.js Gitlab-ci Semi-structured Data Kubernetes Data Lineage Apache Kafka Apache Nifi Front End Software Development Terraform Splunk Data Pipelines Elixir Artifactory

Job description

Linchpin Software is growing, and we’re looking for a Senior Data Engineer to build and scale the custom data pipeline behind an enterprise visual analytics platform. You’ll move high volumes of structured and unstructured data through Kafka, NiFi, Cribl, and Python into Postgres and Splunk, and you’ll own it end to end: ingest, parsing, normalization, lineage, and the performance of everything downstream.

This is a full-stack data role on a modern cloud platform. The pipeline runs on AWS and Kubernetes, ships through GitLab CI/CD and Terraform, and feeds analytic UIs that mission users depend on every day. If you want to work across open-source, COTS, and GOTS technologies instead of one vendor stack, this is that job.

We build software differently. Our engineers use AI-assisted development tools (Claude Code, Codex, GitLab Duo) every day to design, code, test, and debug faster. You’ll spend your time solving hard data problems, not writing boilerplate.

What You’ll Do:

  • Build and optimize secure data ingest pipelines using open-source, COTS, and GOTS technologies
  • Engineer ETL in Python with Apache Kafka, Apache NiFi, Cribl, Splunk, and PostgreSQL
  • Handle complex data parsing, schema-aligned ingestion, and normalization of diverse structured and unstructured data
  • Implement provenance and end-to-end data lineage tracking across the pipeline
  • Design and optimize enterprise relational databases and set standards for operations, performance, and security
  • Deploy and run the platform on AWS and Kubernetes with Terraform, GitLab CI/CD, and JFrog Artifactory
  • Develop data processing workflows and analytics feeding desktop and web-based visual analytic tools
  • Integrate new data systems with existing data warehouses and improve performance and functionality
  • Mentor junior engineers and contribute to cross-team data standards

Requirements

  • Active Top Secret clearance
  • Bachelor’s degree
  • 8+ years of experience in data engineering, database design, or a related field
  • Strong relational database design, SQL, and ETL/ELT skills
  • Strong Python skills and experience building production data pipelines
  • Experience with streaming and ingest technologies such as Kafka, NiFi, Cribl, or Splunk
  • Experience working with structured and semi-structured data and visualization technologies
  • Experience improving data workflows, performance, and security
  • Ability to work full-time, on-site in Chantilly, VA (20151)

Preferred:

  • AWS cloud services and Kubernetes in production
  • Infrastructure as code and CI/CD (Terraform, GitLab CI/CD, JFrog Artifactory)
  • Front-end or full-stack exposure (Vue.js, Flask, Elixir, Phoenix LiveView, Daisy UI)
  • High-performance computing and mixed-technology environments
  • Federal or secure multi-enclave environments
  • Advanced visualization platforms or high-volume data processing
  • Data modeling, warehousing, and performance tuning

Benefits & conditions

  • A pipeline you build and own, across the full stack from ingest to analytic UI
  • Broad modern tooling: AWS, Kubernetes, Kafka, NiFi, Terraform, and more
  • Daily practice with AI-accelerated engineering, a skill every employer wants
  • A small, collaborative team on a stable, long-term mission program
  • Competitive compensation and benefits

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…