Azure Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
A financial services firm in North Carolina is seeking a new Azure Data Engineer to join their team in Charlotte, supporting the onboarding, validation, and maintenance of security data pipelines across cloud and on-premises environments., * Design, build, and maintain scalable data ingestion pipelines for security log sources across cloud and on-premises environments * Parse, normalize, transform, and enrich structured and unstructured telemetry using regex, JSON parsing, schema mapping, and data validation techniques * Partner with application, infrastructure, cloud, vendor, and security teams to onboard new log sources and confirm end-to-end data flow * Validate log integrity, completeness, timeliness, and quality to support monitoring, detection, response, and reporting use cases * Troubleshoot ingestion, parsing, transformation, and pipeline issues while improving reliability, scalability, and operational efficiency
Requirements
Minimum of 3 years of relevant experience in cybersecurity, data engineering, log management, security operations, or a related technology discipline * Hands-on experience onboarding, managing, and validating log sources in SIEM, cloud data platforms, or security analytics environments * Strong understanding of data parsing, normalization, transformation, and validation techniques, including regex, JSON, XML, CSV, and structured and unstructured data handling * Familiarity with common security telemetry sources, including network, endpoint, identity, application, cloud, and infrastructure logs * Experience with cloud platforms and associated logging, monitoring, and analytics services * Strong troubleshooting and problem-solving skills related to data pipelines, ingestion flows, schema issues, and data quality defects * Understanding of compliance and regulatory expectations related to logging, retention, auditability, and data integrity * Ability to plan, coordinate, and execute onboarding efforts across multiple internal teams, vendors, and stakeholders * Ability to balance operational support responsibilities with project-based delivery and continuous improvement efforts * Strong attention to detail, commitment to data quality, and ownership of outcomes * Ability to work effectively and collaboratively in a global team environment * Strong communication skills, sound judgment, and a high degree of accountability
Desired Skills: * Experience with scripting or automation tools such as Python, PowerShell, or similar technologies * Familiarity with query languages used to validate, investigate, and analyze ingested data * Experience in broader cybersecurity disciplines, including threat detection, incident response, vulnerability management, or cloud security
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Highest Paying Tech Companies for Developers
Top-Paying Tech Jobs (with Salaries)
The Most Popular IT Jobs on the Market