Data Engineer (DevOps)

Insight Global is looking for a Sr. Data Engineer (DevOps) to work 4 days on-site in Santa Clara, CA for a fast-growing technology company specializing in secure networking solutions-including SD-WAN, SASE, and SSE-that is helping global enterprises modernize their IT infrastructure for the cloud era. Led by industry veterans and backed by top-tier investors, the company is focused on innovation, scalability, and preparing for a future IPO.

The Data DevOps Engineer will join the Machine Learning and AI team to build and maintain scalable data infrastructure supporting intelligent systems and analytics. This role involves close collaboration with DevOps, Data Science, and Software Engineering teams.

• Design, build, and maintain robust data pipelines for ML/AI products.

• Integrate infrastructure automation and deployment workflows with DevOps teams.

• Implement new features and optimize data flow in collaboration with Data Scientists and Engineers.

• Enhance monitoring, logging, and debugging capabilities across data systems.

Ensure scalability, reliability, and performance of data infrastructure.

• 8+ years of experience in Data Engineering, DevOps, or related fields.

• Experience setting up and managing multitenant Apache Spark and Kafka clusters.

• Strong experience in Kubernetes

• Strong programming skills in Python

• Expertise in processing, cleaning, managing, and analyzing large-scale datasets.

• Familiarity with database technologies and the ability to choose between NoSQL, SQL, and cloud-based solutions based on use case.

• Ability to manage multiple projects simultaneously and collaborate effectively in a team environment.

Strong problem-solving and communication skills. * Proficiency with infrastructure automation tools such as Jenkins, Ansible, Terraform, or similar.