Senior Machine Learning Engineer, AI Agent Platform

GEICO
New York, NY, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$105,000.0 - $230,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Airflow Computing Platforms Audit Trail C Sharp (Programming Language) C++ (Programming Language) Code Review Continuous Integration Data Validation Data Warehousing Relational Databases
+26 more
Distributed Computing Environment Memory Management Python (Programming Language) PostgreSQL Machine Learning NoSQL Open Source Technology Redis Azure Machine Learning Software Engineering Data Streaming Systems Integration Management of Software Versions Large Language Models Snowflake Multi-Agent Systems Apache Spark Generative AI Kubernetes Information Technology Cassandra Apache Kafka Search Engines Virtual Agents Software Version Control Vulnerability Analysis

Job description

GEICO is seeking an experienced Sr. ML Engineer to join our AI organization. You will play a key role in the development of GEICO’s virtual assistant platform that elevates productivity for 30K+ internal associates and the customer experience for millions of policyholders. You will collaborate with a dynamic team of AI and software engineers to design, develop, and deploy systems that ensure productivity, scalability, and usability of GenAI workflows across GEICO.

AI Agent Platform Engineers are responsible for building key multi-tenant services that power the building, testing, simulation, deployment, and hosting of LLM-based AI agents. This includes contributing to AI agent skill ecosystems, harness and context engineering infrastructure, interoperability layers (MCP, Skills), and guardrail systems- working closely with Staff and Sr. Staff engineers who set the broader architectural direction. The ideal candidate should demonstrate a proven track record of building high-performance Generative AI Systems and platforms., * Contribute to building an enterprise AI agent skill ecosystem - developing services that support authoring, publishing, discovering, and versioning reusable skill packages (SKILL.md standard). Implement skill marketplace features including search/discovery, security vetting pipelines, and progressive disclosure loading.

  • Build and maintain AI agent harness components - the non-model infrastructure (tool dispatch, context management, error recovery, session state) that makes AI agents reliable for long-running workflows. Implement feedforward guides and feedback sensors mixing computational and inferential controls.
  • Contribute to context engineering systems that manage the LLM context window - memory management, RAG pipelines, context compaction/summarization, scratchpads, and dynamic skill/tool loading - ensuring AI agents receive the right information at the right time.
  • Implement guardrail components including input validation, prompt injection defense, PII detection, output verification, and skill-level security scanning. Contribute to bounded autonomy systems, human-in-the-loop escalation paths, and audit trail infrastructure.
  • Contribute to experimentation of software platforms, tools, and frameworks, balancing build vs. buy, speed to market, maintainability, etc.
  • Collaborate with cross-functional teams including data scientists, ML engineers, software engineers, product managers, and designers to gather requirements, define project scope, and prioritize feature backlogs for AI agent use cases.
  • Assist in the planning and estimation of software development projects, ensuring efficient allocation of resources and timely delivery of solutions.
  • Mentor and guide junior engineers via code reviews and design sessions, fostering a collaborative and high-performance team culture, elevating AI engineering best practices across the company., Great Rewards: We offer compensation and benefits built to enhance your physical well-being, mental and emotional health and financial future.
  • Comprehensive Total Rewards program that offers personalized coverage tailor-made for you and your family’s overall well-being.
  • Financial benefits including market-competitive compensation; a 401K savings plan vested from day one that offers a 6% match; performance and recognition-based incentives; and tuition assistance.
  • Access to additional benefits like mental healthcare as well as fertility and adoption assistance.
  • Supports flexibility- We provide workplace flexibility as well as our GEICO Flex program, which offers the ability to work from anywhere in the US for up to four weeks per year.

Requirements

Do you have experience in Version control?, * 5+ years of professional software development experience with at least two general-purpose programming languages such as Java, C++, Python, or C#.

  • 4+ years of experience designing and building AI/ML platforms and systems utilizing open-source/cloud-agnostic components such as search engines (e.g., OpenSearch, Milvus), data warehouses (e.g., Snowflake), streaming platforms (e.g., Kafka), relational databases (e.g., PostgreSQL), NoSQL (e.g. Cassandra), distributed processing (e.g., Spark, Ray), workflow management (e.g., Airflow, Temporal), memory management (e.g., Redis/Valkey), etc.
  • 3+ years’ experience contributing towards end-to-end software development lifecycles (version control, CI/CD pipelines, Kubernetes clusters, testing, monitoring & alerting, production support, etc.).
  • 3+ years’ experience building evaluation and observability systems for AI/ML models and LLMs, especially utilizing GPU-powered infrastructure.
  • Familiarity with harness engineering concepts - memory management, RAG, context/ tool management, guardrails, etc.
  • Strong communication and problem-solving skills to excel in dynamic, cross-functional decision-making environments.
  • Bachelor’s degree or above in Computer Science, Engineering, Statistics, or a related field., * 3+ years’ experience building conversational experiences and agentic workflows, leveraging open-source and proprietary LLMs
  • Experience contributing to AI agent harness infrastructure - tool dispatch, error recovery, session state management, or sub-agent coordination using feedforward/feedback control patterns.
  • Experience with AI agent skill systems - building or integrating reusable skill packages, skill registries, MCP servers, etc. along with governance & control measures.
  • Experience with multi-agent orchestration frameworks (LangGraph, AutoGen, CrewAI).
  • Experience with LLM observability platforms such as LangSmith, Langfuse, etc.
  • Experience building ai agent guardrails

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Health insurance
  • Adoption assistance
  • 401(k) 6% Match

About the company

Great Company: At GEICO, we help our customers through life’s twists and turns. Our mission is to protect people when they need it most and we’re constantly evolving to stay ahead of their needs.

We’re an iconic brand that thrives on innovation, exceeding our customers’ expectations and enabling our collective success. From day one, you’ll take on exciting challenges that help you grow and collaborate with dynamic teams who want to make a positive impact on people’s lives.

Great Careers: We offer a career where you can learn, grow, and thrive through personalized development programs, created with your career - and your potential - in mind. You’ll have access to industry leading training, certification assistance, career mentorship and coaching with supportive leaders at all levels.

Great Culture: We foster an inclusive culture of shared success, rooted in integrity, a bias for action and a winning mindset. Grounded by our core values, we have an an established culture of caring, inclusion, and belonging, that values different perspectives. Our teams are led by dynamic, multi-faceted teams led by supportive leaders, driven by performance excellence and unified under a shared purpose.

As part of our culture, we also offer employee engagement and recognition programs that reward the positive impact our work makes on the lives of our customers.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:45 min

Fusing developer experience and platform engineering for agentic SDLC

Julia Kordick Julia Kordick · WWC Europe 2026

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all