> Markdown version of [/jobs/ext/1782614-senior-data-pipeline-engineer](https://www.wearedevelopers.com/jobs/ext/1782614-senior-data-pipeline-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Pipeline Engineer - **Company:** CACI International Inc. - **Location:** Linthicum Heights, MD, United States - **Experience:** Expert - **Salary:** $113,200.0 - $237,800.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Amazon S3, JIRA, Microsoft Azure, Bash Shell, Cloud Computing, Continuous Integration, Data Integration, Elasticsearch, Data Flow Control, Groovy, Python (Programming Language), Linux System Administration, MongoDB, Performance Tuning, Data Processing, Scripting, Google Cloud, Cloud Platform System, Apache Spark, Containerization, Apache Nifi, Cloud Integration, Terraform, Data Pipelines, Docker - **Published:** July 7, 2026 - **Apply:** https://www.juju.com/job/00000000gehvz5 ## About the Role Join our dynamic team as we revolutionize enterprise security with our Secure the Enterprise initiative. We are seeking a skilled professional to help us transition from a manual system security evaluation and authorization process to a cutting-edge model that leverages automation, streamlined processes, continuous monitoring, and comprehensive network data gathering. This role offers an exciting opportunity to make a significant impact on our organization's security posture and operational efficiency., + Active TS/SCI w/ Polygraph + Education and Experience + 12 years minimum experience with a high school diploma/GED. + 10 years minimum experience with an Associate's Degree. + 8 years minimum experience with a Bachelor's degree. + 6 years minimum experience with a Master's degree. + 4 years minimum experience with a Doctorate's degree. + All experience and education must be in a technical field directly related to the labor category and obtained from accredited institutions. + Linux System Administration: Experience with Centos7 or RedHat8. + NiFi Cluster Administration: Proven experience administering a NiFi cluster. + Containerization: Experience with Docker. + Infrastructure as Code: Experience with Terraform. + Apache NiFi Proficiency: Hands-on experience designing, implementing, and troubleshooting dataflows using Apache NiFi. + NiFi Expression Language: Strong understanding of leveraging NiFi Expression Language for dynamic dataflows. + Data Integration: Experience with tools like Amazon S3, MongoDB, Apache Spark, and Elasticsearch. + Performance Optimization: Knowledge of NiFi cluster architecture and performance tuning strategies. + Cloud Integration: Expertise in deploying and managing NiFi in cloud environments. + Scripting and Automation: Proficiency in scripting languages like Python, Groovy, or Bash. Desired Qualifications + Cloud Hosting and Automation: Experience in cloud hosting and automation. + Agile Environment: Experience working in an Agile environment. ## Description + Data Integration: Seamlessly integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch. + NiFi Cluster Optimization: Enhance NiFi cluster architecture, performance tuning, and data pipeline strategies. + Dataflow Design: Design, implement, and troubleshoot dataflows using Apache NiFi, including processors, connections, and templates. + Cloud Deployment: Deploy and manage NiFi in cloud environments (AWS, Azure, GCP) and utilize cloud-native tools for data processing. + Infrastructure Management: Oversee continuous integration, environment configuration, and deployment while supporting project compliance and security. + Automation Delivery: Focus on delivering automation solutions that enable other teams to operate more efficiently. + Workflow Tracking: Experience tracking work through JIRA workflows. ## Related Videos - [Give your build some love, it will give it back!](https://www.wearedevelopers.com/videos/514-give-your-build-some-love-it-will-give-it-back) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) - [Securing Your Web Application Pipeline From Intruders](https://www.wearedevelopers.com/videos/53-securing-your-web-application-pipeline-from-intruders) - [AI-Native Enterprise Platforms: Interpreting Logic, Not Compiling Code](https://www.wearedevelopers.com/videos/1975-ai-native-enterprise-platforms-interpreting-logic-not-compiling-code) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Best Paying Jobs in Technology](https://www.wearedevelopers.com/magazine/256-best-paying-jobs-in-technology) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers)