> Markdown version of [/jobs/ext/2294238-senior-data-engineer-usasoc-cdao](https://www.wearedevelopers.com/jobs/ext/2294238-senior-data-engineer-usasoc-cdao). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer (USASOC-CDAO) - **Company:** Kentro LLC - **Location:** Fayetteville, NC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Data Analysis, Microsoft Azure, Cloud Computing, Cloud Database, Cyber Security, Databases, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Profiling, Data Security, Database Design, Distributed Computing Environment, Data Flow Control, Python (Programming Language), Meta-Data Management, Scrum Methodology, Software Engineering, SQL Databases, Technical Data Management Systems, Unstructured Data, Enterprise Data Management, Data Processing, Enterprise Software Applications, Cloud Platform System, Data Ingestion, Azure Data Factory, Snowflake, Apache Spark, Git, Microsoft Fabric, Containerization, Pyspark, Information Technology, Data Lineage, Data Analytics, Apache Kafka, Non-relational Database, Data Management, Video Streaming, Api Design, Restful APIs, Stream Processing, Data Pipelines, Devsecops, Docker, Databricks, Microservices - **Published:** August 29, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9120198/senior-data-engineer-usasoc-cdao ## About the Role The ideal candidate will bring strong hands-on experience with modern data engineering technologies, distributed data processing, cloud platforms, databases, APIs, and data integration, along with the ability to independently solve complex technical problems in a DoD environment., * Education: Bachelor's degree in Computer Science, Data Engineering, Software Engineering, Information Technology, Mathematics, or a related technical discipline; equivalent experience may be considered. * Experience: 7+ years of experience in data engineering, software engineering, data architecture, or a related technical discipline. * Technical Skills: + AIT II or higher Certification required + Strong hands-on experience developing enterprise data pipelines and data integration solutions. + Advanced proficiency with Python and SQL. + Experience with distributed data processing technologies such as Apache Spark/PySpark. + Experience with relational and non-relational databases. + Experience developing ETL/ELT processes and data transformations. + Experience working with APIs and integrating data from multiple systems. + Experience with data modeling, data architecture, and database design. + Experience troubleshooting complex data and application issues. + Experience working in Agile software development environments. + Experience with Git and modern software-development practices. + Strong understanding of data quality, validation, governance, security, and lifecycle management. + Ability to independently analyze complex technical requirements and develop appropriate solutions. + Strong written and verbal communication skills., * Experience supporting USSOCOM, USASOC, DoD, or other federal government organizations. * Experience working with Palantir Foundry or other enterprise data platforms. * Experience with Palantir Ontology, Foundry data pipelines, Workshop, Contour, or Code Workbooks. * Experience with AWS, Microsoft Azure, or other cloud environments. * Experience with Databricks, Snowflake, Microsoft Fabric, Azure Data Factory, or similar data platforms. * Experience with Kafka or other event-streaming technologies. * Experience developing RESTful APIs and microservices. * Experience with containerization technologies such as Docker and Kubernetes. * Experience with CI/CD pipelines and DevSecOps practices. * Experience implementing data governance, metadata management, data lineage, and enterprise data catalogs. * Experience supporting AI/ML data pipelines and model operationalization. * Experience working with classified or highly sensitive mission data. * Knowledge of DoD cybersecurity and Risk Management Framework (RMF) requirements. * Experience mentoring technical personnel and providing engineering-level technical leadership. * Industry certifications in cloud, data engineering, cybersecurity, or related technical disciplines. Clearance Requirement: * Minimum active Top Secret clearance required * US Citizen or Lawful Permanent Resident (Green Card) ## Description Kentro is hiring for Senior Data Engineer to support the United States Army Special Operations Command (USASOC) Chief Data and Analytics Office (CDAO) under the EDAT program in Fayetteville, NC. The Senior Data Engineer will design, develop, integrate, and maintain enterprise data solutions supporting USASOC's data analytics, operational decision-making, and mission objectives. This position will work across data engineering, analytics, software development, cloud, and enterprise technology teams to build reliable and scalable data pipelines and data products., * Design, develop, and maintain scalable enterprise data pipelines and data processing solutions. * Develop ETL/ELT processes to ingest, transform, validate, and deliver data from diverse sources. * Integrate structured and unstructured data from enterprise, operational, cloud, and mission systems. * Develop data models, schemas, transformations, and data architectures that support CDAO requirements. * Build and optimize data pipelines using Python, SQL, Spark, PySpark, or other appropriate technologies. * Develop solutions for batch and near-real-time data processing and integration. * Design and implement data ingestion and integration patterns for databases, APIs, applications, files, and other data sources. * Perform data profiling, cleansing, normalization, validation, and quality control. * Develop automated processes to monitor data pipelines and identify failures or data-quality issues. * Troubleshoot complex data engineering, integration, performance, and system issues. * Collaborate with data scientists, analysts, software engineers, architects, Palantir Foundry engineers, cybersecurity personnel, and government stakeholders. * Support integration and operationalization of analytical models and data products. * Develop and maintain data documentation, data-flow diagrams, technical specifications, and architecture documentation. * Implement appropriate data security, access controls, governance, and protection mechanisms. * Support data governance, metadata management, lineage, and data-quality initiatives. * Optimize data pipelines and processing environments for scalability, reliability, and performance. * Participate in Agile ceremonies, sprint planning, technical reviews, demonstrations, and requirements discussions. * Translate mission and business requirements into technical data-engineering solutions. * Support cloud-based data engineering capabilities and enterprise data platforms. * Participate in development, testing, deployment, and sustainment activities. * Apply DevSecOps and CI/CD practices to data engineering workflows where applicable. * Provide technical mentorship and guidance to junior and journeyman-level data engineers. * Support technical planning and provide recommendations to government and program leadership. * Identify technical risks, dependencies, and opportunities for improvement. * Perform other engineering and technical duties as assigned. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 134 - Where pixels sing?](https://www.wearedevelopers.com/magazine/477-dev-digest-134-where-pixels-sing) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)