> Markdown version of [/jobs/ext/1315043-apache-kafka-nifi-data-engineer](https://www.wearedevelopers.com/jobs/ext/1315043-apache-kafka-nifi-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Apache Kafka/Nifi - Data Engineer - **Company:** Atlas Technologies - **Location:** Charleston, SC, United States (Remote available) - **Experience:** Experienced - **Salary:** $115,000.0 - $125,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Data Analysis, Apache HTTP Server, Microsoft Azure, Bash Shell, Configuration Management, Computer Programming, Databases, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Visualization, Data Warehousing, DevOps, Github, Python (Programming Language), PostgreSQL, Automation of Marketing, Nginx, Open Source Technology, Windows PowerShell, Redis, Ansible, Swagger, Computer Networking Systems, Grafana, Kubernetes Helm Charts, Caching, Containerization, Data Lakes, Gitlab-ci, Debezium, Kubernetes, Information Technology, Deployment Automation, Apache Kafka, Apache Nifi, Puppet, Software Version Control, Data Pipelines, Serverless Computing, Docker, Jenkins, Golang, Microservices - **Published:** July 17, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9036426/apache-kafkanifi-data-engineer ## About the Role * U.S. Citizenship * Possession of and the ability to maintain a Department of Defense (DoD) Secret Level Security Clearance. * 3-5 years' experience supporting data engineering efforts and initiatives * Experience with containerization technologies (Docker, Kubernetes) is highly valued * Experience with helm charts and deploying managing and scaling applications * Working knowledge of Agile methodology and DevOps practices * Experience with open-source, distributed event streaming platform used to collect, process, store, and analyze data feeds (Apache Kafka) * Experience with data orchestration tools (Apache Nifi) * Experience with open-source monitoring and observability architectures to include Grafana LGTM+ Stack and Elastic (ELK) Stack * Experience with high-performance, open-source networking infrastructure tools (Nginx, Apache APISIX) * Experience with open-source, distributed event streaming platform used to collect, process, store, and analyze data feeds (Apache Kafka, Debezium) * Experience with data orchestration tools (Apache Nifi) * Experience with open-source data storage and caching services (Postgres, Redis, MinIO) * Strong documentation and communication skills to work effectively across technical teams * Collaborative mindset with ability to work in fast-paced environments * Self-motivated with strong problem-solving skills and attention to detail * Ability to manage multiple projects and priorities simultaneously * Bachelor's degree preferred or equivalent experience We'd be Impressed if You Had: * Bachelor's degree in Computer Science, Engineering, or related field * 5+ years' experience in data engineering roles * Experience with CI/CD tools (Jenkins, GitLab CI, Azure DevOps, GitHub Actions) * Proficiency with version control systems and collaborative development tools * Experience with configuration management and automation platforms (Ansible, Chef, Puppet) * Programming/scripting experience (Python, PowerShell, Bash, Go) * Experience with data engineering design and visualization tools (Swagger) * Knowledge of microservices architecture and serverless computing ## Description Atlas Technologies, Inc., a rapidly expanding company supporting the U.S. Military and other Government entities, is seeking a fast-learning and self-motivated Data Engineer with Apache Kafka/Nifi experience to design, build, and maintain the systems and infrastructure that collect, store, and transform data for the Department of Defense (DoD) and the Naval Information Warfare Center (NIWC). This effort is primarily centered around Data Engineering support for PMW160 Tactical Networks. This is a Hybrid role in North Charleston, SC. You Will: * Support designing and building ETL (Extract, Transform, Load) processes and pipelines to move data from disparate sources into centralized repositories * Develop automated deployment pipelines and Infrastructure-as-Code templates using scripts and orchestration tools to automate repetitive data tasks, reducing manual intervention and error * Design and optimize data architectures to improve performance, cost-efficiency, security, and scalability * Design and implement large-scale processing systems and database architecture solutions (e.g., Data Lakes, Data Warehouses) * Provide recommendations for data engineering best practices and process improvements * Contribute to team objectives and support data engineering initiatives * Prepare technical documentation and present architecture proposals to engineering teams * Partner with other engineering groups to understand their data requirements and with leadership to align technical infrastructure with mission objectives ## Related Videos - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Post-Quantum Cryptography: Preparing for Q-Day](https://www.wearedevelopers.com/videos/100179-post-quantum-cryptography-preparing-for-q-day) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Streaming AI Responses in Real-Time with SSE in Next.js & NestJS](https://www.wearedevelopers.com/videos/1630-streaming-ai-responses-in-real-time-with-sse-in-next-js-nestjs) - [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)