Software AI Engineer

Tata Consultancy Services Limited
New York, United States of America
30 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 120K

Job location

New York, United States of America

Tech stack

API
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Cloud Computing
Distributed Systems
Python
Open Source Technology
TensorFlow
Data Streaming
TypeScript
PyTorch
Large Language Models
Backend
Kubernetes
Information Technology
HuggingFace
Kafka
Data Pipelines
Go

Job description

  • Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.

  • Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to pro duction.

  • Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements.

  • Mentor senior engineers and raise the technical bar for agentic AI development through example and influence.

Requirements

Do you have experience in gRPC?, Do you have a Bachelor's degree?, * 10+ years of experience building large-scale distributed systems + strong experience with LLM systems, agentic workflows or advanced ML infrastructure

  • Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products.

  • Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.

  • Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.

  • Fluency with AI-assisted and agentic development workflows.

  • Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.

  • Ability to influence technical direction and align teams without formal authority.

  • Experience in workflow engines, async processing, queues, and streaming systems.

  • Languages: Python, Go, TypeScript

  • APIs and services: REST, gRPC

  • Cloud and infrastructure: AWS and/or GCP, Kubernetes

  • Distributed systems: event-driven architectures, including Kafka

  • Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc

  • Integration of commercial and open-source LLMs into agentic workflows

  • Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI, with strong judgment about when to use frameworks versus building lighter-weight primitives

  • Model-level work using PyTorch and the Hugging Face ecosystem (embeddings, fine-tuning, inference tooling), with some exposure to TensorFlow

  • Strong schema, validation, and state management practices using tools such as Pydantic (Python) and Zod (TypeScript)

  • Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.

  • Design, build, and operate production-grade agentic AI systems used across multiple products., Qualifications : BACHELOR OF COMPUTER SCIENCE

Benefits & conditions

(part of Tata group) 3.93.9 out of 5 stars New York, NY $100,000 - $120,000 a year

Apply for this position