> Markdown version of [/jobs/ext/3143274-distinguished-ai-engineer-enterprise-ai-platform](https://www.wearedevelopers.com/jobs/ext/3143274-distinguished-ai-engineer-enterprise-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Distinguished AI Engineer - Enterprise AI Platform - **Company:** Kasmo Inc - **Location:** Jersey City, NJ, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computing Platforms, Audit Trail, Cloud Computing, Cloud Engineering, Cyber Security, Continuous Integration, Programming Tools, Distributed Systems, Identity and Access Management, Key Management, Search Technologies, Software Engineering, Data Logging, Large Language Models, Multi-Agent Systems, Generative AI, AI Platforms, Kubernetes, Low Latency, Machine Learning Operations, Virtual Agents, Terraform - **Published:** September 29, 2026 - **Apply:** https://www.dice.com/job-detail/a5f9705d-4f1b-4719-a7b6-311a3b6634bf ## About the Role * 10+ years of progressive experience in software engineering, distributed systems, cloud/platform engineering, AI/ML infrastructure, or related technical domains. * Proven experience building, scaling, transforming, or troubleshooting production platforms used by multiple engineering teams, products, or business domains. * Strong hands-on experience in several of the following: + LLM / Generative AI platforms + Model serving and inference + Inference optimization + AI gateways + Model routing + RAG + Embeddings / Vector Search + AI Agent frameworks + Tool execution / MCP + AI orchestration + LLMOps / MLOps + AI evaluation frameworks + AI observability + AI security / guardrails * Strong foundation in distributed systems, API/platform design, cloud-native architecture, containers, Kubernetes, networking, IAM, and secrets management. * Experience developing reusable engineering patterns, frameworks, APIs, infrastructure modules, CI/CD pipelines, or developer platforms. * Demonstrated ability to provide technical leadership across multiple teams without direct reporting responsibility. Important: Candidates must be able to work onsite in Jersey City 4 days per week and attend a mandatory F2F interview at the client location. ## Description We are seeking a Distinguished AI Engineer to provide top-tier individual-contributor technical leadership for an enterprise AI platform. This role will solve complex AI platform engineering challenges and build reusable, secure, reliable, observable, and cost-efficient capabilities that enable enterprise AI and GenAI solutions at scale., * Lead the design and engineering evolution of enterprise AI platform capabilities including AI gateways, model access and serving, model routing, RAG, AI agents, tool execution, orchestration, evaluation, observability, and LLMOps/MLOps. * Solve complex engineering trade-offs involving latency, throughput, resiliency, scalability, security, data isolation, portability, and cost. * Lead technical spikes, prototypes, reference implementations, deep design reviews, performance analysis, and production troubleshooting. * Establish engineering standards for availability, recovery, performance, capacity, telemetry, release safety, evaluation coverage, and inference cost. * Build reusable platform assets such as APIs, SDKs, Terraform/IaC modules, deployment patterns, CI/CD templates, dashboards, evaluation frameworks, and developer tooling. * Drive production excellence through observability, traceability, controlled releases, rollback strategies, incident learning, capacity planning, and cost optimization. * Implement AI security controls including IAM, authorization-aware retrieval, secure tool execution, prompt-injection defenses, data protection, logging, and auditability. * Partner with Cybersecurity, Risk, Compliance, Legal, Audit, Architecture, Product, and Business teams to translate enterprise requirements into practical technical controls. * Evaluate emerging AI technologies through hands-on technical assessments and determine adoption based on value, maturity, risk, operational fit, and total cost of ownership. * Mentor senior engineers and drive adoption of enterprise AI platform patterns across multiple engineering teams. ## Related Videos - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [Swapping Low Latency Data Storage Under High Load](https://www.wearedevelopers.com/videos/746-swapping-low-latency-data-storage-under-high-load) - [Agentic AI Systems for Critical Workloads](https://www.wearedevelopers.com/videos/1592-agentic-ai-systems-for-critical-workloads) - [Implementing Feature Environments with AWS and Terraform](https://www.wearedevelopers.com/videos/531-implementing-feature-environments-with-aws-and-terraform) - [Supercharge your cloud-native applications with Generative AI](https://www.wearedevelopers.com/videos/950-supercharge-your-cloud-native-applications-with-generative-ai) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)