Manager of Data & AI Engineering

Apar Technologies
San Jose, CA, United States
about 1 month ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Query Performance Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Cloud Engineering Information Systems Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL)
+21 more
Data Vault Modeling Web Development Identity and Access Management Data Intelligence Software Engineering Web Applications Large Language Models Multi-Agent Systems Apache Spark Generative AI Build Management Data Lakes Pyspark Information Technology Star Schema Apache Kafka Front End Software Development Virtual Agents Functional Programming Api Gateway Databricks

Job description

We are looking for a Senior Manager of Data & AI Engineering who combines deep technical expertise with strong delivery leadership and people management. This role will drive the build-out of our next-generation autonomous data intelligence platform for Supply Chain Operations - from identifying high-impact opportunities to architecture, building, and productionizing solutions that deliver measurable business value. The ideal candidate brings hands-on experience in data and AI architecture and engineering while demonstrating the ability to manage a high-performing team. This person will be partnering with business stakeholders, translating operational challenges into data and AI solutions, and delivering at pace. What you’ll be doing:

  • Design and build scalable data and AI platforms using Databricks, AWS, and modern cloud-native engineering patterns.

  • Deliver robust ETL/ELT, streaming, and CDC pipelines using technologies such as Spark, Kafka, Delta Lake, and AWS-native services.

  • Enable AI-powered use cases with RAG applications, agent frameworks, multi-agent orchestration, APIs and web apps.

  • Design data models using Star Schema, Snowflake Schema, and Data Vault patterns appropriate to the use case - optimizing for analytical query performance, data governance, and extensibility.

  • Implement data quality frameworks, observability, alerting, and monitoring to ensure pipeline integrity and production reliability.

  • Partner with product, business, analytics, and AI stakeholders to translate requirements into secure, scalable, and production-ready solutions.

  • Oversee resource planning, prioritization, project execution, and delivery across multiple concurrent initiatives.

  • Mentor engineers, grow technical capability across the team, and foster a culture of accountability, innovation, and continuous improvement.

  • Provide hands-on technical leadership across architecture, design reviews, implementation guidance, and production readiness.

  • Manage the full lifecycle of data engineering projects - from discovery and planning through execution and production rollout. What We Are Looking For

Requirements

  • Education: Master’s or Bachelor’s degree in Computer Science or Information Systems, or equivalent experience

  • Experience: 15+ years in Data Engineering, Software Engineering, or web application development, with at least 3+ years specifically in a leadership or engineering management role.

  • Willingness to Code: You are still a builder at heart. You are excited to spend your time writing code, prototyping, and building production systems alongside your team.

  • AWS Proficiency: Intimate knowledge of the AWS ecosystem, including Amazon S3, EC2, IAM, Lambda, and API Gateway.

  • Agentic AI & LLM Mastery: Proven experience operationalizing Large Language Models (LLMs) into autonomous agents that can plan, use tools, and execute multi-step workflows.

  • Databricks Mastery: Proven deep expertise in Apache Spark, PySpark, Delta Lake, and Databricks Workflows. Hands-on experience scaling Unity Catalog is highly preferred. Ways to stand out from the crowd

  • Active Databricks Certifications (e.g., Data Engineer Professional, Generative AI Engineer Associate).

  • Active AWS Certifications (e.g., Certified Data Engineer - Associate or Solutions Architect - Professional).

  • Background in managing cross-functional teams that blend data engineers with frontend and back-end software developers.
  • Knowledge of supply chain business processes for Plan, Make, Deliver & Services

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…