> Markdown version of [/jobs/ext/2196420-senior-software-engineer-ai-new-york](https://www.wearedevelopers.com/jobs/ext/2196420-senior-software-engineer-ai-new-york). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer, AI (New York) - **Company:** Fitch Group, Inc. - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $140,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Application Integration Architecture, Microsoft Azure, Cloud Computing, Computer Programming, Machine Learning, Systems Development Life Cycle, Tensorflow, Search Technologies, Software Engineering, Systems Integration, Workflow Management Systems, Enterprise Software Applications, Chatbots, Pytorch, Large Language Models, Generative AI, Backend, Fastapi, Containerization, Kubernetes, Machine Learning Operations, AWS EKS, Docker, Service Stack - **Published:** August 23, 2026 - **Apply:** https://www.careerjet.com/job/usf3426dac7a316738ad54e051af307801/eaa ## About the Role * 7+ years of professional experience designing, developing, and deploying production-grade AI/ML systems, with a proven track record of delivering sophisticated generative AI and machine learning solutions at scale. * 5+ years in full stack software engineering building and deploying real-world enterprise applications; advanced Python programming skills with strong backend development capabilities. * Proven experience in developing and deploying intelligent conversational AI systems using RAG architectures, Model Context Protocol (MCP), AI-enabled search, vector databases, and LLM integration in real-time enterprise environments. * Hands-on enterprise experience developing GenAI applications using LangChain and LangGraph frameworks with expertise in agent architecture design, state management, memory systems, and graph-based workflow orchestration. * Strong technical expertise in embeddings, vector databases for AI integration, and LLM integration/fine-tuning across platforms such as OpenAI, LLaMA; solid understanding of ML algorithms with production experience using frameworks and tools including FastAPI, PyTorch/TensorFlow, and MLflow. * Extensive experience building and integrating generative AI solutions into production environments, including working with large language models, designing multi agentic systems and embedding AI capabilities into existing product ecosystems. * Strong foundation in MLOps practices, containerization technologies (Docker, Kubernetes/AWS EKS), cloud infrastructure (AWS/Azure), AI-specific services (AWS Bedrock, SageMaker, Azure AI Search), and orchestration tools. * Excellent communication and collaboration skills, with the ability to translate complex technical concepts for diverse stakeholders and work effectively across cross-functional teams. ## Description * Lead transformative GenAI system development - Spearhead the creation of sophisticated generative AI solutions including enterprise chatbot platforms, evaluation frameworks, agentic workflows, RAG architectures, applied GenAI applications, and Model Context Protocol (MCP) implementations; deliver production-grade, scalable code that meets enterprise performance standards. * Pioneer AI innovation through hands-on engineering - Experiment with cutting-edge foundation models, design and implement GenAI/ML architectures, assess emerging AI technologies, develop rapid proofs-of-concept, and bridge the gap between research breakthroughs and production-ready capabilities that generate tangible business value. * Build robust production infrastructure - Develop enterprise-scale APIs (FastAPI) for deployment, architect and implement comprehensive cloud-based AI infrastructure on AWS/Azure, and ensure systems are optimized for performance, reliability, and scalability. * Demonstrate full-stack engineering excellence - Apply proficiency across the entire technology stack to build enterprise-grade websites and applications, integrating AI capabilities seamlessly into user-facing products and backend systems. * Build and deliver reliable AI solutions - Participate in the full software development lifecycle for AI initiatives, contribute technical insights to design discussions, apply engineering best practices. * Collaborate and communicate effectively - Partner with cross-functional teams including product managers, engineers and business stakeholders to translate complex technical concepts, gather requirements, and ensure AI solutions directly address user needs and strategic objectives. ## Related Videos - [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Should we build Generative AI into our existing software?](https://www.wearedevelopers.com/videos/1129-should-we-build-generative-ai-into-our-existing-software) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)