> Markdown version of [/jobs/ext/1170934-technical-architect](https://www.wearedevelopers.com/jobs/ext/1170934-technical-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Technical Architect

- **Company:** CloudSufi Inc.
- **Location:** United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Continuous Integration, Machine Learning, Software Engineering, Google Cloud, Large Language Models, Prompt Engineering, Virtual Agents
- **Published:** July 3, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=7cfde81d06dad5f2

## About the Role

8+ years in software engineering or machine learning, including 3+ years building LLM or AI agent systems.

 * Hands-on expertise with the Google Cloud AI stack (Vertex AI, Gemini, Agent Development Kit, Dialogflow CX) or close equivalents.
 * Strong understanding of LLM evaluation, prompt engineering, and agent architectures.
 * Proven ability to lead client-facing technical engagements and set architectural direction., Experience with LLM-as-judge evaluation, RAG systems, and agent observability.
 * Background delivering production AI systems in a regulated or large-scale consumer environment.

## Description

CloudSufi is hiring a Senior AI Architect to lead the design of an AI agent testing and evaluation platform for a large enterprise client. You will
define how the client's fleet of AI agents is tested before and after deployment, set the technical standard for evaluation, and act as the senior
technical lead working directly with client stakeholders. This is a client-facing, on-site role for someone who can both architect the system and lead
the room.
Responsibilities
*
Own the end-to-end technical design of an agent testing framework covering deterministic checks, statistical (LLM-based) evaluation, and adversarial testing.

 * Define the methodology for evaluation datasets, safety rules, and judge calibration.
 * Design integration with the client's CI/CD pipeline and cloud environment so quality gates block unsafe deployments.
 * Lead technical discussions with client architects and engineering leadership, and set standards other teams follow.
 * Guide and review the work of a distributed delivery team.


## Related Videos

- [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills)
- [Guiding Agentic AI with Vue](https://www.wearedevelopers.com/videos/2033-guiding-agentic-ai-with-vue)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [Beyond Chatbots: How to build Agentic AI systems](https://www.wearedevelopers.com/videos/1629-beyond-chatbots-how-to-build-agentic-ai-systems)
- [AI Agents & Agentic AI](https://www.wearedevelopers.com/videos/2017-ai-agents-agentic-ai)
- [Cloud Run- the rise of serverless and containerization](https://www.wearedevelopers.com/videos/106-cloud-run-the-rise-of-serverless-and-containerization)

## Related Articles

- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)