Senior Generative AI Engineer (Google Cloud Vertex AI / Gemini)
Google LLC
Columbus, OH, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours
Job source
Tech stack
AI Evaluation
Application Programming Interfaces (APIs)
Artificial Intelligence
Automated Storage and Retrieval Systems
Automation of Tests
Databases
Continuous Integration
Database Search Engine
Software Debugging
Python (Programming Language)
Productivity Software
Cloud Services
+21 more
Software Engineering
Google Cloud
Enterprise Software Applications
Cloud Platform System
GitHub Copilot
Retrieval-Augmented Generation
System Availability
Large Language Models
Prompt Engineering
Hallucination Detection
Generative AI
Agentic-AI
Containerization
AI Platforms
Kubernetes
Information Technology
Low Latency
Structured Output Generation
Machine Learning Operations
Evaluation of Large Language Models
Google Gemini
Job description
- Design, build, deploy, and maintain scalable, secure, and production-ready AI applications, intelligent automation workflows, document intelligence solutions, and advanced analytics capabilities.
- Architect and optimize end-to-end Retrieval Augmented Generation (RAG) systems, including context management, document chunking strategies, embedding generation, and vector database search implementations.
- Design and orchestrate intelligent agent-based architectures and multi-step workflows that integrate seamlessly with enterprise applications, APIs, databases, and cloud services.
- Engineer and manage structured prompts using modern prompt engineering and prompt management frameworks to ensure reliable, deterministic, and high-accuracy outputs.
Model Strategy, Optimization & Evaluation
- Implement dynamic model selection and routing strategies to match workloads with the optimal model based on task complexity, accuracy, latency, and cost constraints.
- Apply token optimization and resource utilization techniques to minimize operational spend and inference latency while preserving response quality.
- Build and execute rigorous AI evaluation frameworks, automated benchmarking pipelines, and response quality metrics to validate model performance prior to and following production release.
AI Governance, Security & Production Operations (LLMOps)
- Implement Responsible AI controls, security guardrails, data privacy protections (including PII/PHI safeguards), and hallucination mitigation techniques tailored to healthcare and public-sector compliance standards.
- Establish and maintain CI/CD and MLOps/LLMOps pipelines supporting automated testing, deployment, monitoring, observability, and lifecycle management of AI services.
- Troubleshoot, debug, and optimize complex AI applications operating in production environments to ensure high availability and sustained accuracy.
Technical Leadership & Standards
- Exercise independent technical judgment to evaluate emerging AI technologies, frameworks, and tools, determining their practical applicability and ROI for ODM business needs.
- Establish agency-wide AI engineering standards, reusable framework components, and architectural best practices.
- Provide technical leadership, code/design reviews, and mentorship to engineering teams adopting AI capabilities and developer productivity tools (such as GitHub Copilot).
Requirements
- Bachelorβs degree in Computer Science, Artificial Intelligence, Data Science, Software Engineering, or a related technical field (or equivalent progressive experience).
- 5+ years of hands-on software engineering experience building and deploying production enterprise applications.
- 2+ years of recent, hands-on experience designing, developing, deploying, and maintaining Generative AI / LLM solutions in enterprise cloud environments.
Technical Competencies
- AI Platforms & Models: Practical experience working with enterprise AI platforms and foundation models-specifically Google Cloud Vertex AI and Gemini models (experience with GitHub Copilot in enterprise engineering workflows is a strong plus).
- RAG & Retrieval Systems: Deep proficiency in embeddings, vector databases, semantic/hybrid search, chunking strategies, and context window management.
- LLM Engineering & Orchestration: Hands-on expertise in prompt engineering, model routing/orchestration frameworks, agent-based workflows, and structured output generation.
- Evaluation, Guardrails & Observability: Proven experience implementing automated LLM evaluation/benchmarking, telemetry/observability, hallucination reduction, and AI security/privacy guardrails.
- Software Engineering & MLOps: Strong proficiency in Python and modern software engineering practices, REST/event-driven APIs, cloud-native infrastructure, containerization, and CI/CD pipelines for AI lifecycle management.
Core Competencies
- Strong independent technical judgment capable of balancing solution accuracy, response quality, latency, security, and operational cost.
- Analytical problem-solving skills to diagnose non-deterministic model behavior and complex distributed-system bottlenecks in production.
- Clear communication skills to translate complex AI capabilities, trade-offs, and risk mitigation strategies for both technical teams and agency leadership.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦