Software AI Engineer
Role details
Job location
Tech stack
Job description
-
Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.
-
Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to pro duction.
-
Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements.
-
Mentor senior engineers and raise the technical bar for agentic AI development through example and influence.
Requirements
Do you have experience in gRPC?, Do you have a Bachelor's degree?, * 10+ years of experience building large-scale distributed systems + strong experience with LLM systems, agentic workflows or advanced ML infrastructure
-
Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products.
-
Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.
-
Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.
-
Fluency with AI-assisted and agentic development workflows.
-
Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.
-
Ability to influence technical direction and align teams without formal authority.
-
Experience in workflow engines, async processing, queues, and streaming systems.
-
Languages: Python, Go, TypeScript
-
APIs and services: REST, gRPC
-
Cloud and infrastructure: AWS and/or GCP, Kubernetes
-
Distributed systems: event-driven architectures, including Kafka
-
Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc
-
Integration of commercial and open-source LLMs into agentic workflows
-
Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI, with strong judgment about when to use frameworks versus building lighter-weight primitives
-
Model-level work using PyTorch and the Hugging Face ecosystem (embeddings, fine-tuning, inference tooling), with some exposure to TensorFlow
-
Strong schema, validation, and state management practices using tools such as Pydantic (Python) and Zod (TypeScript)
-
Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.
-
Design, build, and operate production-grade agentic AI systems used across multiple products., Qualifications : BACHELOR OF COMPUTER SCIENCE
Benefits & conditions
(part of Tata group) 3.93.9 out of 5 stars New York, NY $100,000 - $120,000 a year