> Markdown version of [/jobs/ext/4811006-senior-generative-ai-engineer-google-cloud-vertex-ai-gemini](https://www.wearedevelopers.com/jobs/ext/4811006-senior-generative-ai-engineer-google-cloud-vertex-ai-gemini). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Generative AI Engineer (Google Cloud Vertex AI / Gemini) - **Company:** Google LLC - **Location:** Columbus, OH, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** AI Evaluation, Application Programming Interfaces (APIs), Artificial Intelligence, Automated Storage and Retrieval Systems, Automation of Tests, Databases, Continuous Integration, Database Search Engine, Software Debugging, Python (Programming Language), Productivity Software, Cloud Services, Software Engineering, Google Cloud, Enterprise Software Applications, Cloud Platform System, GitHub Copilot, Retrieval-Augmented Generation, System Availability, Large Language Models, Prompt Engineering, Hallucination Detection, Generative AI, Agentic-AI, Containerization, AI Platforms, Kubernetes, Information Technology, Low Latency, Structured Output Generation, Machine Learning Operations, Evaluation of Large Language Models, Google Gemini - **Published:** November 21, 2026 - **Apply:** https://www.dice.com/job-detail/87114377-8bd9-4079-9506-4f5042823a18 ## About the Role * Bachelor's degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, or a related technical field (or equivalent progressive experience). * 5+ years of hands-on software engineering experience building and deploying production enterprise applications. * 2+ years of recent, hands-on experience designing, developing, deploying, and maintaining Generative AI / LLM solutions in enterprise cloud environments. Technical Competencies * AI Platforms & Models: Practical experience working with enterprise AI platforms and foundation models-specifically Google Cloud Vertex AI and Gemini models (experience with GitHub Copilot in enterprise engineering workflows is a strong plus). * RAG & Retrieval Systems: Deep proficiency in embeddings, vector databases, semantic/hybrid search, chunking strategies, and context window management. * LLM Engineering & Orchestration: Hands-on expertise in prompt engineering, model routing/orchestration frameworks, agent-based workflows, and structured output generation. * Evaluation, Guardrails & Observability: Proven experience implementing automated LLM evaluation/benchmarking, telemetry/observability, hallucination reduction, and AI security/privacy guardrails. * Software Engineering & MLOps: Strong proficiency in Python and modern software engineering practices, REST/event-driven APIs, cloud-native infrastructure, containerization, and CI/CD pipelines for AI lifecycle management. Core Competencies * Strong independent technical judgment capable of balancing solution accuracy, response quality, latency, security, and operational cost. * Analytical problem-solving skills to diagnose non-deterministic model behavior and complex distributed-system bottlenecks in production. * Clear communication skills to translate complex AI capabilities, trade-offs, and risk mitigation strategies for both technical teams and agency leadership. ## Description * Design, build, deploy, and maintain scalable, secure, and production-ready AI applications, intelligent automation workflows, document intelligence solutions, and advanced analytics capabilities. * Architect and optimize end-to-end Retrieval Augmented Generation (RAG) systems, including context management, document chunking strategies, embedding generation, and vector database search implementations. * Design and orchestrate intelligent agent-based architectures and multi-step workflows that integrate seamlessly with enterprise applications, APIs, databases, and cloud services. * Engineer and manage structured prompts using modern prompt engineering and prompt management frameworks to ensure reliable, deterministic, and high-accuracy outputs. Model Strategy, Optimization & Evaluation * Implement dynamic model selection and routing strategies to match workloads with the optimal model based on task complexity, accuracy, latency, and cost constraints. * Apply token optimization and resource utilization techniques to minimize operational spend and inference latency while preserving response quality. * Build and execute rigorous AI evaluation frameworks, automated benchmarking pipelines, and response quality metrics to validate model performance prior to and following production release. AI Governance, Security & Production Operations (LLMOps) * Implement Responsible AI controls, security guardrails, data privacy protections (including PII/PHI safeguards), and hallucination mitigation techniques tailored to healthcare and public-sector compliance standards. * Establish and maintain CI/CD and MLOps/LLMOps pipelines supporting automated testing, deployment, monitoring, observability, and lifecycle management of AI services. * Troubleshoot, debug, and optimize complex AI applications operating in production environments to ensure high availability and sustained accuracy. Technical Leadership & Standards * Exercise independent technical judgment to evaluate emerging AI technologies, frameworks, and tools, determining their practical applicability and ROI for ODM business needs. * Establish agency-wide AI engineering standards, reusable framework components, and architectural best practices. * Provide technical leadership, code/design reviews, and mentorship to engineering teams adopting AI capabilities and developer productivity tools (such as GitHub Copilot).