Distinguished AI Engineer
United Software Group, Inc.
Jersey City, NJ, United States
4 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Artificial Intelligence
Computing Platforms
Cloud Computing
Cloud Engineering
Continuous Integration
Distributed Systems
Identity and Access Management
Key Management
Inference Optimization
Search Technologies
Software Engineering
+9 more
Data Logging
Retrieval-Augmented Generation
Large Language Models
Multi-Agent Systems
Agentic-AI
AI Platforms
Kubernetes
Machine Learning Operations
Terraform
Job description
We’re looking for a Distinguished AI Engineer to provide top-tier individual-contributor technical leadership for a large enterprise AI platform. You’ll solve complex platform engineering problems and drive reusable, secure, reliable, observable, and cost-efficient capabilities that let teams deliver AI and GenAI solutions at scale. You lead through technical judgment, working engineering assets, and influence, not people management. Key Responsibilities
- Lead the design and evolution of platform services for model access, routing, serving, RAG, agents, orchestration, evaluation, and observability
- Solve hard trade-offs across capability, latency, throughput, resiliency, security, data isolation, portability, and cost
- Lead critical technical spikes, prototypes, reference implementations, deep design reviews, and major production issue resolution
- Set measurable expectations for availability, recovery, performance, capacity, telemetry, release safety, evaluation coverage, and inference cost
- Build reusable engineering assets: APIs, SDKs, Terraform/IaC modules, deployment patterns, CI/CD templates, dashboards, and evaluation tooling
- Drive production excellence through observability, controlled releases, rollback, incident learning, capacity planning, and cost optimization
- Build security and AI controls into the platform: identity and access, authorization-aware retrieval, secure tool execution, prompt-injection defenses, data protection, logging, and audit evidence
- Work with cybersecurity, risk, compliance, legal, audit, architecture, product, and business teams to turn enterprise requirements into technical controls
- Evaluate emerging AI technologies and recommend adoption based on value, maturity, risk, and total cost of ownership
- Mentor senior engineers and drive adoption of platform patterns across teams
Requirements
- 10+ years of progressive experience in software engineering, distributed systems, cloud/platform engineering, or AI/ML infrastructure, including leading complex systems across multiple teams
- Proven record of building, scaling, transforming, or rescuing production platforms used by multiple teams or business domains
- Deep hands-on expertise in several of: LLM platforms, model serving, inference optimization, AI gateways, model routing, RAG, embeddings/vector search, agent frameworks, tool execution, AI orchestration, LLMOps/MLOps, evaluation systems, AI observability, or AI security controls
- Strong foundation in distributed systems, API and platform design, cloud-native architecture, containers/Kubernetes, networking, IAM, and secrets management
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerjet.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…