> Markdown version of [/jobs/ext/1150738-data-engineer-ii](https://www.wearedevelopers.com/jobs/ext/1150738-data-engineer-ii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer II - **Company:** Primary Talent Partners - **Location:** Charlotte, NC, United States - **Salary:** $114,400.0 - $135,200.0 - **Contract:** Temporary to permanent - **Skills:** Amazon Web Services, Antivirus Softwares, Audit Trail, User Authentication, Microsoft Azure, Big Data, Cloud Computing, Cloud Engineering, Cyber Security, Databases, Data Files, Data Normalization, Query Languages, Github, Identity and Access Management, Security Information and Event Management, Software Engineering, SQL Databases, Scripting, Firewalls (Computer Science), Data Lakes, Information Technology, Data Management, Data Delivery, Terraform, Splunk, Data Pipelines, Programming Languages - **Published:** July 2, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e403461a1fb63b3b ## About the Role * Knowledge of code and various SIEM query languages. * Experience with security toolsets [firewall, SQL Databases, audit logs, authentication, anti-virus, etc.] , Azure or AWS environments. * Knowledge of building and optimizing 'big data' data pipelines, architectures and data sets. * Knowledge of data normalization. * Experience in developing and communicating requirements and finding data to meet those requirements within existing or new datasets. * Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. * Excellent verbal and written communication skills * Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets * Strong analytical mind to help take on complicated problems * Desire to resolve issues and drive into potential issues * Strong analytic skills related to working with unstructured datasets. * Experience supporting and working with cross-functional teams in a dynamic environment. ## Description * Strong AWS engineering experience with cloud architecture, configuration, and application development. * This position is responsible for development, consulting and validating of security logs analytics from various security and IT services. The CW will be working within the Cyber Security Operations Center to assist in maturing and enriching cyber investigations. * Support or collaborate with cloud technical SMEs, database architects, Cyber Security engineers to ensure optimal data delivery architecture throughout ongoing projects/operations. * Design data pipelines from third party toolsets into AWS accounts * Understanding IAM roles and configuration settings within AWS * Utilize Github for code, terraform and construction of security applications * Design, build, and manage analytics framework that can be utilized by CSOC analysts, which enables correction, automation, and normalization of security logs. * Design requirements, execute validation test, and build/monitor optimization opportunities. * Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools - within Cloud and on-premise services. * Learn the investigation process in order to understand and represent the CSOC on different data engagements. You will need to perform investigations regularly to stay up to date on the toolsets and needs to be the team. * Research opportunities for data acquisition and new uses for existing data * Employ a variety of languages and tools (e.g. scripting languages) for integration - Splunk, AWS, Azure, or other large SIEM/Data Lake environments. * Develop techniques supporting trending and analytic decision making processes ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)