Sr Software Engineer (Data Platform Infrastructure)

Insight Global
Cary, NC, United States
2 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Cloud Computing Cyber Security Continuous Integration Data Governance Data Infrastructure Programming Tools Github Identity and Access Management Python (Programming Language)
+11 more
Key Management Octopus Deploy Open Source Technology Reliability Engineering Software Engineering Delivery Pipeline AI Coding Agents Agentic-AI Kubernetes Terraform Data Pipelines

Job description

What you’ll work on: * Build and operate the automation that integrates data sources with DataHub at scale. * Develop and maintain infrastructure for DataHub integration related systems such as Remote Executors, cross-account IAM access patterns, and credential management across a large multi-account AWS environment. * Partner with Cloud Governance, Substrate/Platform teams and Information Security to resolve infrastructure dependencies (networking, IAM, secrets, deployment pipelines). * Contribute to reliability and observability of the metadata catalog and related data pipelines. * Design and develop DataHub automations, e.g. for asset tagging, notifications and policy enforcement.

Requirements

  • 2-3 years of relevant software engineering experience (Python/Java), with significant time in cloud infrastructure/reliability engineering roles. * Demonstrated experience with AI-assisted software development, including coding assistants, agentic AI systems and developer tools, with the ability to evaluate and integrate new AI capabilities into engineering workflows. * Deep hands-on experience with AWS (IAM, cross-account access patterns, secrets management, networking). * Experience with Kubernetes and container-based deployment (e.g., scheduled jobs, service deployment pipelines). * Comfortable working independently across ambiguous, evolving infrastructure decisions and multiple stakeholder teams. * Strong communication skills: this role works cross-functionally with platform, security and governance teams. . * Direct experience with DataHub (Acryl Data or open source) or comparable metadata/catalog platforms. * Experience with infrastructure-as-code (Terraform) and CI/CD tooling (GitHub Actions, Argo CD). * Prior experience in an Information Security, Data Governance or Compliance-adjacent engineering role.

About the company

Insight Global’s client, a leading company in the gaming industry, is building DataHub Cloud into a single metadata catalog for the company’s first-party data assets. We’re looking for a senior infrastructure engineer to build and scale DataHub -related integrations and automations.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…