> Markdown version of [/jobs/ext/2120074-generative-ai-cloud-operations-engineer-evinova](https://www.wearedevelopers.com/jobs/ext/2120074-generative-ai-cloud-operations-engineer-evinova). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Generative AI Cloud Operations Engineer - Evinova - **Company:** AstraZeneca plc - **Location:** Gaithersburg, MD, United States - **Experience:** Experienced - **Salary:** $145,000.0 - $185,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Data Analysis, Microsoft Azure, Software as a Service, Cloud Computing, Cloud Engineering, Interoperability, Python (Programming Language), Machine Learning, Prometheus, Software Deployment, Software Engineering, TypeScript, AWS Cdk, Network Routers, Large Language Models, Grafana, Multi-Agent Systems, Generative AI, Data Strategy, Low Latency, Operational Systems, Machine Learning Operations, Virtual Agents, Splunk, Docker - **Published:** August 19, 2026 - **Apply:** https://www.jofdav.com/jobs/59314006-generative-ai-cloud-operations-engineer-evinova ## About the Role * Customer-obsessed and passionate about building products that solve real-world problems. * Highly organized and detail-oriented, with the ability to manage multiple initiatives and deadlines. * Collaborative and inclusive, fostering a positive team culture where creativity and innovation thrive. * Know when to ask for help and when to help others proactively. Essential Skills/Experience: * High school diploma or GED required. * Minimum of 2 years of hands-on experience deploying, operating, and maintaining Generative AI agents, workflows, or applications in production environments. * Strong understanding of the challenges associated with production GenAI systems, including reliability, scalability, latency, cost optimization, observability, evaluation, and model performance. * Hands-on experience deploying agentic AI solutions using frameworks such as LangChain, LangGraph, LlamaIndex, Google ADK, Strands Agents, or similar. * Strong experience with LLM evaluation and observability, using platforms such as Arize Phoenix, Langfuse, Braintrust, Freeplay, or comparable tools. * Strong software engineering skills in Python and/or TypeScript, with experience building production-quality systems. * Deep expertise with AWS cloud services, including deploying and operating cloud-native AI/ML workloads. * Strong experience with infrastructure as code, including AWS CDK using Python and/or TypeScript. * Experience with containerization and orchestration technologies, including Docker and Kubernetes. * Strong understanding of the data science and machine learning lifecycle, with demonstrated experience moving models and AI capabilities from experimentation through production deployment and ongoing operations. * Experience operationalizing RAG pipelines, LLM applications, or multi-agent systems in production is strongly preferred. * Demonstrated ability to stay current with rapidly evolving Generative AI models, frameworks, tooling, evaluation techniques, and engineering practices. * Proven ability to partner effectively with AI/ML engineers, data scientists, software engineers, product teams, and other cross-functional stakeholders. * Strong written and verbal communication skills, with the ability to clearly document technical solutions, operational processes, and system performance. ## Description The Machine Learning and Artificial Intelligence Operations team (ML/AI Ops) is a newly formed platform team that will spearhead the design, creation, and operational excellence of our LLM-based agent deployments, multi-agent orchestration, and conversational AI systems pipelines to catalyze and accelerate science led innovations. This team is responsible and accountable for the design, implementation, deployment, health and performance of all LLM-based applications. We manage ML/AI and broader cloud resources, automating operations through infrastructure-as-code and CI/CD pipelines, and ensure best-in-class operations - striving to push even beyond mere compliance with industry standards such as Good Clinical Practices (GCP) and Good Machine Learning Practice (GMLP). As a Generative AI Cloud Operations Engineer for clinical trial design, planning, and operational optimization on our team, you will lead the development and management of AI operations systems for our trial management and optimization SaaS product. You will collaborate closely with our AI Engineers to transition projects from embryonic research into production-grade AI capabilities, utilizing advanced tools and frameworks to optimize model deployment, governance, and infrastructure performance. This position requires a deep understanding of cloud-native agentic Generative AI deployment methodologies and technologies, AWS infrastructure, and the unique demands of regulated industries, making it a cornerstone of our success in delivering impactful solutions to the pharmaceutical industry. Accountabilities: Operational Excellence * Drive the creation of proactive capability and process enhancements that ensures enduring value creation and analytic compounding interest. * Design and implement resilient cloud Genereative AI agent operational capabilities to maximize our system A-bilities (Learnability, Flexibility, Extendibility, Interoperability, Scalability). * Drive precision and systemic cost efficiency, optimized system performance, and risk mitigation with a data-driven strategy, comprehensive analytics, and predictive capabilities at the tree-and-forest level of our Generative AI-based systems, workloads and processes. ML/AI Cloud Operations and Engineering * Develop and manage GenAI Ops systems for clinical trial design, planning and operational optimization. * Integrate LLM proxies/routers including LiteLLM Proxy/Router or other solutions * Ensure proper RAG pipeline optimization and scaling * Integration of token usage, latency, response quality, and hallucination detection tools at a platform level. * Partner closely with AI Engineers and data scientists to shepherd projects from embryonic research stages into production-grade agentic Generative AI capabilities. * Leverage and teach modern tools, libraries, frameworks and best practices to design, validate, deploy and monitor Generative AI agents in production (including LangChain, LangGraph, Google ADK, Langfuse, DSPy, Arize Phoenix, Pinecone, Weaviate, Splunk, Grafana, Prometheus, Xray, and more) * Enhance system scalability, reliability, and performance through effective infrastructure and process management. * Ensure that any prediction we make is backed by deep exploratory data analysis and evidence, interpretable, explainable, safe, and actionable. * Leverage Vertex AI, Azure Foundry, OpenAI, Anthropic, and other foundation model platforms to provide reliable and stable access to LLMs ## Related Videos - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai) - [All your telemetry data from any source in one place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place) - [Should we build Generative AI into our existing software?](https://www.wearedevelopers.com/videos/1129-should-we-build-generative-ai-into-our-existing-software) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)