Data Engineer (DevOps)

Insight Global
Santa Clara, United States of America
1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 220K

Job location

Santa Clara, United States of America

Tech stack

Artificial Intelligence
Big Data
Cloud Computing
Computer Programming
Databases
Information Engineering
Data Infrastructure
Data Systems
Software Debugging
DevOps
Python
Machine Learning
NoSQL
Ansible
Software Engineering
SQL Databases
Data Streaming
Wide Area Networks
Data Logging
Delivery Pipeline
Spark
Kubernetes
Infrastructure Automation Frameworks
Information Technology
Kafka
Terraform
Data Pipelines
Jenkins

Job description

Insight Global is looking for a Sr. Data Engineer (DevOps) to work 4 days on-site in Santa Clara, CA for a fast-growing technology company specializing in secure networking solutions-including SD-WAN, SASE, and SSE-that is helping global enterprises modernize their IT infrastructure for the cloud era. Led by industry veterans and backed by top-tier investors, the company is focused on innovation, scalability, and preparing for a future IPO.

The Data DevOps Engineer will join the Machine Learning and AI team to build and maintain scalable data infrastructure supporting intelligent systems and analytics. This role involves close collaboration with DevOps, Data Science, and Software Engineering teams.

  • Design, build, and maintain robust data pipelines for ML/AI products.

  • Integrate infrastructure automation and deployment workflows with DevOps teams.

  • Implement new features and optimize data flow in collaboration with Data Scientists and Engineers.

  • Enhance monitoring, logging, and debugging capabilities across data systems.

Ensure scalability, reliability, and performance of data infrastructure.

Requirements

  • 8+ years of experience in Data Engineering, DevOps, or related fields.

  • Experience setting up and managing multitenant Apache Spark and Kafka clusters.

  • Strong experience in Kubernetes

  • Strong programming skills in Python

  • Expertise in processing, cleaning, managing, and analyzing large-scale datasets.

  • Familiarity with database technologies and the ability to choose between NoSQL, SQL, and cloud-based solutions based on use case.

  • Ability to manage multiple projects simultaneously and collaborate effectively in a team environment.

Strong problem-solving and communication skills. * Proficiency with infrastructure automation tools such as Jenkins, Ansible, Terraform, or similar.

Apply for this position