Senior Data Engineer - Cyber Governance & Data Platform

Insight Global
New York, United States of America
7 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

New York, United States of America

Tech stack

API
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Big Data
Cloud Engineering
Code Review
Computer Security
Computer Programming
Continuous Integration
Data Validation
Information Engineering
Data Governance
Data Infrastructure
Amazon DynamoDB
Github
Graph Database
Python
Node.js
Azure
Secure Coding
Tableau
Data Ingestion
React
Large Language Models
Software Security
AWS Lambda
Backend
FastAPI
Git Flow
Tools for Reporting
Front End Software Development
Data Pipelines
Api Management

Job description

We are seeking a Senior Data Engineer to support and expand a custom-built Cyber Governance and Data Platform. This individual will help scale a centralized data ecosystem that powers cybersecurity operations, governance reporting, automation, and analytics across the organization.

The ideal candidate is a hands-on engineer with strong AWS and Python experience who can build API integrations, normalize complex datasets, create scalable data pipelines, and enable reporting through Athena and Tableau. This person will partner closely with senior engineering leadership and be expected to independently own projects from design through deployment.

Day-to-Day Responsibilities:

Design, build, and maintain data ingestion pipelines that integrate data from internal and external systems through APIs.

Normalize and transform data from multiple sources into a centralized AWS-based data platform.

Develop and support Python applications, AWS Lambda functions, and backend services that process and validate cybersecurity and governance data.

Create Athena views and optimized datasets for Tableau reporting and stakeholder dashboards.

Monitor and improve data quality, integrity, synchronization, and platform performance.

Troubleshoot failed loads, stale data, schema issues, and integration failures across the data ecosystem.

Support the onboarding of new data sources into the Governance, Risk, and Compliance (GRC) platform.

Collaborate with engineering leadership to design scalable data models and reporting structures.

Participate in code reviews, pull request workflows, and secure software development practices.

Contribute to automation initiatives, including AI-driven monitoring and self-healing platform capabilities.

Make occasional enhancements to React-based user interfaces and reporting dashboards as needed.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

  • 5+ years of experience in Data Engineering, Data Platform Engineering, or Cloud Engineering roles.
  • Strong programming experience with Python.

Experience developing and maintaining data pipelines in AWS.

  • Hands-on experience with: AWS Lambda, S3, DynamoDB, Athena, API Integrations
  • Experience ingesting, transforming, and normalizing data from multiple sources.

Experience building datasets and views that support business intelligence and reporting tools such as Tableau.

  • Understanding of data quality, data governance, and data validation principles.
  • Experience using GitHub, pull requests, branching strategies, and CI/CD processes.
  • Strong understanding of secure coding practices and application security fundamentals. Experience with AWS Bedrock or AI/ML services.

Experience working with Large Language Models (LLMs).

Understanding of AI security concepts, including prompt injection risks.

Experience with Node.js development.

Experience with React or modern front-end frameworks.

Data Science background.

Experience building knowledge graphs, intelligent automation solutions, or AI-driven workflows.

Apply for this position