AI Gateway Engineer

Mindlance
Jersey City, NJ, United States
5 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services ARM Architecture Microsoft Azure Cloud Computing Cloud Engineering Cyber Security Identity and Access Management Azure Machine Learning Large Language Models Snowflake
+5 more
Multi-Cloud Generative AI AI Platforms Information Technology Deployment Automation

Job description

We are seeking an experienced Senior AI Gateway Engineer to lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform with a primary focus on Kong AI Gateway. This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs), AI Agents, Retrieval Augmented Generation (RAG) services, Model Context Protocol (MCP) services, and Agent-to-Agent (A2A) communications across the enterprise. The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, identity and access management (IAM), resiliency engineering, and enterprise governance to deliver a highly available AI platform that meets the demands of a regulated financial services environment., AI Gateway Architecture & Engineering Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise. Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI. Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and internal and external AI services. Implement intelligent model routing, failover, traffic shaping, and provider abstraction. Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements. Define scalable control plane and data plane deployment architectures across hybrid and multi-cloud environments.

Requirements

Bachelor’s degree in Computer Science, Cyber Security, Information Technology, Engineering, or related discipline. Master’s degree preferred. Experience 8+ years of experience designing and operating enterprise API, application, or cloud platforms. 5+ years of experience in cloud architecture and security. 3+ years working with AI/ML platform technologies or enterprise AI deployments. Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions. Experience within regulated industries such as financial services, banking, insurance, or capital markets strongly preferred. Preferred Qualifications Kong Certified Professional certification. AWS Solutions Architect certification.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:59 min

Designing governed and AI-native API platforms

Gbadebo Bello Gbadebo Bello · Europe 2026 Virtual

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · World Congress 2026 Europe

1:22 min

Overcoming developer challenges in multi-cloud environments

Sandeep Pal Sandeep Pal · Coffee With Developers

2:36 min

Choosing between managed AI platforms and custom governance

Péter Farkas Péter Farkas · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:48 min

Integrating generative AI capabilities via cloud-based API endpoints

juarezjunior juarezjunior · World Congress 2024

Videos

See all

Related articles

See all