Senior Data Engineer - Cyber Governance & Data Platform

Insight Global
New York, NY, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon S3 Data Analysis Big Data Cloud Engineering Code Review Cyber Security Computer Programming Continuous Integration Data Validation
+23 more
Information Engineering Data Governance Data Infrastructure Amazon DynamoDB Github Graph Database Python (Programming Language) Node.Js Azure Machine Learning Secure Coding Tableau (Software) Data Ingestion ReactJS Large Language Models Software Security AWS Lambda Backend Fastapi Git Flow Tools for Reporting Front End Software Development Data Pipelines Api Management

Job description

We are seeking a Senior Data Engineer to support and expand a custom-built Cyber Governance and Data Platform. This individual will help scale a centralized data ecosystem that powers cybersecurity operations, governance reporting, automation, and analytics across the organization.

The ideal candidate is a hands-on engineer with strong AWS and Python experience who can build API integrations, normalize complex datasets, create scalable data pipelines, and enable reporting through Athena and Tableau. This person will partner closely with senior engineering leadership and be expected to independently own projects from design through deployment.

Day-to-Day Responsibilities:

Design, build, and maintain data ingestion pipelines that integrate data from internal and external systems through APIs.

Normalize and transform data from multiple sources into a centralized AWS-based data platform.

Develop and support Python applications, AWS Lambda functions, and backend services that process and validate cybersecurity and governance data.

Create Athena views and optimized datasets for Tableau reporting and stakeholder dashboards.

Monitor and improve data quality, integrity, synchronization, and platform performance.

Troubleshoot failed loads, stale data, schema issues, and integration failures across the data ecosystem.

Support the onboarding of new data sources into the Governance, Risk, and Compliance (GRC) platform.

Collaborate with engineering leadership to design scalable data models and reporting structures.

Participate in code reviews, pull request workflows, and secure software development practices.

Contribute to automation initiatives, including AI-driven monitoring and self-healing platform capabilities.

Make occasional enhancements to React-based user interfaces and reporting dashboards as needed.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global’s Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

  • 5+ years of experience in Data Engineering, Data Platform Engineering, or Cloud Engineering roles.
  • Strong programming experience with Python.

Experience developing and maintaining data pipelines in AWS.

  • Hands-on experience with: AWS Lambda, S3, DynamoDB, Athena, API Integrations
  • Experience ingesting, transforming, and normalizing data from multiple sources.

Experience building datasets and views that support business intelligence and reporting tools such as Tableau.

  • Understanding of data quality, data governance, and data validation principles.
  • Experience using GitHub, pull requests, branching strategies, and CI/CD processes.
  • Strong understanding of secure coding practices and application security fundamentals. Experience with AWS Bedrock or AI/ML services.

Experience working with Large Language Models (LLMs).

Understanding of AI security concepts, including prompt injection risks.

Experience with Node.js development.

Experience with React or modern front-end frameworks.

Data Science background.

Experience building knowledge graphs, intelligent automation solutions, or AI-driven workflows.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:33 min

Connecting frontends via a FastAPI proxy backend layer

Saoussen Chaabnia Saoussen Chaabnia · Europe 2026 Virtual

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

Videos

See all

Related articles

See all