Senior Generative AI Engineer (Google Cloud Vertex AI / Gemini)

Google LLC
Columbus, OH, United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source

Tech stack

AI Evaluation Application Programming Interfaces (APIs) Artificial Intelligence Automated Storage and Retrieval Systems Automation of Tests Databases Continuous Integration Database Search Engine Software Debugging Python (Programming Language) Productivity Software Cloud Services
+21 more
Software Engineering Google Cloud Enterprise Software Applications Cloud Platform System GitHub Copilot Retrieval-Augmented Generation System Availability Large Language Models Prompt Engineering Hallucination Detection Generative AI Agentic-AI Containerization AI Platforms Kubernetes Information Technology Low Latency Structured Output Generation Machine Learning Operations Evaluation of Large Language Models Google Gemini

Job description

  • Design, build, deploy, and maintain scalable, secure, and production-ready AI applications, intelligent automation workflows, document intelligence solutions, and advanced analytics capabilities.
  • Architect and optimize end-to-end Retrieval Augmented Generation (RAG) systems, including context management, document chunking strategies, embedding generation, and vector database search implementations.
  • Design and orchestrate intelligent agent-based architectures and multi-step workflows that integrate seamlessly with enterprise applications, APIs, databases, and cloud services.
  • Engineer and manage structured prompts using modern prompt engineering and prompt management frameworks to ensure reliable, deterministic, and high-accuracy outputs.

Model Strategy, Optimization & Evaluation

  • Implement dynamic model selection and routing strategies to match workloads with the optimal model based on task complexity, accuracy, latency, and cost constraints.
  • Apply token optimization and resource utilization techniques to minimize operational spend and inference latency while preserving response quality.
  • Build and execute rigorous AI evaluation frameworks, automated benchmarking pipelines, and response quality metrics to validate model performance prior to and following production release.

AI Governance, Security & Production Operations (LLMOps)

  • Implement Responsible AI controls, security guardrails, data privacy protections (including PII/PHI safeguards), and hallucination mitigation techniques tailored to healthcare and public-sector compliance standards.
  • Establish and maintain CI/CD and MLOps/LLMOps pipelines supporting automated testing, deployment, monitoring, observability, and lifecycle management of AI services.
  • Troubleshoot, debug, and optimize complex AI applications operating in production environments to ensure high availability and sustained accuracy.

Technical Leadership & Standards

  • Exercise independent technical judgment to evaluate emerging AI technologies, frameworks, and tools, determining their practical applicability and ROI for ODM business needs.
  • Establish agency-wide AI engineering standards, reusable framework components, and architectural best practices.
  • Provide technical leadership, code/design reviews, and mentorship to engineering teams adopting AI capabilities and developer productivity tools (such as GitHub Copilot).

Requirements

  • Bachelor’s degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, or a related technical field (or equivalent progressive experience).
  • 5+ years of hands-on software engineering experience building and deploying production enterprise applications.
  • 2+ years of recent, hands-on experience designing, developing, deploying, and maintaining Generative AI / LLM solutions in enterprise cloud environments.

Technical Competencies

  • AI Platforms & Models: Practical experience working with enterprise AI platforms and foundation models-specifically Google Cloud Vertex AI and Gemini models (experience with GitHub Copilot in enterprise engineering workflows is a strong plus).
  • RAG & Retrieval Systems: Deep proficiency in embeddings, vector databases, semantic/hybrid search, chunking strategies, and context window management.
  • LLM Engineering & Orchestration: Hands-on expertise in prompt engineering, model routing/orchestration frameworks, agent-based workflows, and structured output generation.
  • Evaluation, Guardrails & Observability: Proven experience implementing automated LLM evaluation/benchmarking, telemetry/observability, hallucination reduction, and AI security/privacy guardrails.
  • Software Engineering & MLOps: Strong proficiency in Python and modern software engineering practices, REST/event-driven APIs, cloud-native infrastructure, containerization, and CI/CD pipelines for AI lifecycle management.

Core Competencies

  • Strong independent technical judgment capable of balancing solution accuracy, response quality, latency, security, and operational cost.
  • Analytical problem-solving skills to diagnose non-deterministic model behavior and complex distributed-system bottlenecks in production.
  • Clear communication skills to translate complex AI capabilities, trade-offs, and risk mitigation strategies for both technical teams and agency leadership.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…