> Markdown version of [/jobs/ext/2004465-senior-generative-ai-developer](https://www.wearedevelopers.com/jobs/ext/2004465-senior-generative-ai-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Generative AI Developer

- **Company:** Citigroup, Inc.
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Automation of Tests, Microsoft Azure, Cloud Computing, Code Review, Encodings, Continuous Integration, Information Engineering, Python (Programming Language), NoSQL, Performance Tuning, Search Technologies, Software Engineering, SQL Databases, Google Cloud, Flask (Web Framework), Delivery Pipeline, Large Language Models, Multi-Agent Systems, Prompt Engineering, Generative AI, Git, Fastapi, AI Platforms, Kubernetes, Machine Learning Operations, Api Design, GPT, Data Pipelines, Docker
- **Published:** August 9, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-generative-ai-developer-new-york-ny-usa-58872910

## About the Role

Platform * Collaborate with AI Risk and Compliance to meet regulatory and data privacy standards * Design data pipelines and optimize vector databases (Pinecone, Weaviate, pgvector) for AI systems * Mentor junior developers, lead code reviews, contribute to GenAI standards across COO Technology * Translate COO business requirements into technical AI solutions with clear trade-offs and timelines Tasks * 6+ years of software engineering experience * 2+ years focused on Generative AI / LLM development * Expert-level Python with async, API development (FastAPI, Flask) * Hands-on experience with GenAI & LLM stacks (LangChain, LangGraph, LlamaIndex) * Experience with Google Cloud AI Platform * Proven RAG architectures, embedding pipelines, vector search * Strong prompt engineering, few-shot, and chain-of-thought techniques * Experience integrating with LLM APIs (OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, Google Vertex AI) * ML fundamentals with fine-tuning (LoRA, PEFT) and inference aaaa
features * Cloud experience with AWS, Azure, or GCP; data engineering with SQL, NoSQL, vector DBs (Pinecone, Weaviate, Chroma, pgvector) * CI/CD, Docker, Kubernetes, Git, automated testing * Financial services acumen (preferred) Key requirements * medical, dental & vision coverage * 401(k) * life, accident, and disability insurance * wellness programs * paid time off * vacation and holidays

## Description

Experteer Overview In this hands-on role, you architect, build, and operationalize cutting-edge Generative AI and LLM solutions to transform Citi's operational teams. You work with cross-functional partners to deliver enterprise-grade AI capabilities at scale, balancing research with production software engineering. You will design end-to-end GenAI pipelines, ensure governance and compliance, and mentor junior developers, shaping AI solutions across the COO Technology division. Compensation / Benefits * Design and implement end-to-end Generative AI pipelines, including LLM integrations, RAG systems, autonomous agents, and prompt frameworks * Develop robust Python services and APIs powering AI-driven features across COO platforms * Evaluate and fine-tune LLMs and embeddings for financial use cases (GPT-5, Claude, Mistral) * Build ML/GenAI deployment pipelines with MLOps for reliability, observability, and governance * Design multi-agent orchestration frameworks for complex operational workflows * Collaborate with AI Risk and Compliance to meet regulatory and data privacy standards * Design data pipelines and optimize vector databases (Pinecone, Weaviate, pgvector) for AI systems * Mentor junior developers, lead code reviews, contribute to GenAI standards across COO Technology * Translate COO business requirements into technical AI solutions with clear trade-offs and timelines Tasks * 6+ years of software engineering experience * 2+ years focused on Generative AI / LLM development * Expert-level Python with async, API development (FastAPI, Flask) * Hands-on experience with GenAI & LLM stacks (LangChain, LangGraph, LlamaIndex) * Experience with Google Cloud AI Platform * Proven RAG architectures, embedding pipelines, vector search * Strong prompt engineering, few-shot, and chain-of-thought techniques * Experience integrating with LLM APIs (OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, Google Vertex AI) * ML fundamentals with fine-tuning (LoRA, PEFT) and inference optimization * Cloud experience with AWS, Azure, or GCP; data engineering with SQL, NoSQL, vector DBs (Pinecone, Weaviate, Chroma, pgvector) * CI/CD, Docker, Kubernetes, Git, automated testing * Financial services acumen (preferred) Key requirements * medical, dental & vision coverage * 401(k) * life, accident, and disability insurance * wellness programs * paid time off * vacation and holidays


## Related Videos

- [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge)
- [Speak, Code, Deploy: Transforming Developer Experience with Voice Commands](https://www.wearedevelopers.com/videos/1159-speak-code-deploy-transforming-developer-experience-with-voice-commands)
- [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai)

## Related Articles

- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)