> Markdown version of [/jobs/ext/3627946-backend-engineer-with-ai-experience](https://www.wearedevelopers.com/jobs/ext/3627946-backend-engineer-with-ai-experience). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Backend Engineer with AI Experience

- **Company:** SimilarWeb LTD
- **Location:** United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** LangGraph Framework, Artificial Intelligence, Amazon Web Services, Audit Trail, Continuous Integration, Memory Management, Python (Programming Language), Machine Learning, Software Engineering, Datadog, Cloud Platform System, Retrieval-Augmented Generation, Large Language Models, Prompt Engineering, Agentic-AI, Kubernetes, Machine Learning Operations, Prompt Injection, Virtual Agents, Restful APIs
- **Published:** October 8, 2026
- **Apply:** https://job-boards.greenhouse.io/similarweb/jobs/8264129

## About the Role

* 5+ years of experience in software engineering, with strong proficiency in Python.
 * Hands-on experience with LangGraph, LangChain, or similar frameworks for building AI agents.
 * Strong understanding of LLMs, prompt engineering, and AI agent architectures.
 * Solid grounding in production engineering: REST APIs, asynchronous services, integrating external data sources, containers, and CI/CD.
 * Strong collaboration and communication skills, including with non-engineering stakeholders across the business.

Preferred Skills:

 * Familiarity with the AI Agents ecosystem, including different LLM providers, vector store solutions, MCPs, and more.
 * Experience with evaluating LLM performance and quality, and with LLM observability tooling
 * LLMOps experience: cost and latency optimization, semantic caching, model routing, and capacity planning.
 * Experience designing RAG systems over large or heterogeneous data sources.
 * Awareness of AI-specific security and safety concerns, and how to mitigate them in a multi-tenant internal platform. * Familiarity with cloud environments, especially AWS, and with Kubernetes and infrastructure-as-code.

**At Similarweb, collaborating with our colleagues in-office creates a more connected, unified culture. Our best work is a product of our face-to-face collaboration, with the ability to work partially from home.**

## Description

* Design and build the core agent platform - runtime, orchestration, state and memory management, and a shared agent SDK that teams across the company use instead of rebuilding foundations.
 * Build and operate the tool and connector layer, including MCP servers that expose Similarweb data, internal systems, and third-party services to agents in a consistent, safe way.
 * Develop LLM-based agents for high-value internal workflows, and turn the reusable parts of each one back into platform capabilities.
 * Implement integrations that let agents take automated actions on behalf of users, streamlining workflows and reducing manual overhead. Model gateway and governance
 * Establish secure-by-default patterns: permissioning and data-access boundaries, PII handling, prompt injection defenses, and audit logging, in line with Similarweb's security and privacy standards.
 * Continuously evaluate and improve the performance of AI models and agents to ensure high-quality, data driven results.