> Markdown version of [/jobs/ext/1819549-generative-ai-engineer](https://www.wearedevelopers.com/jobs/ext/1819549-generative-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Generative AI Engineer - **Company:** Afficiency Inc. - **Location:** New York, NY, United States - **Experience:** Experienced - **Salary:** $100,000.0 - $120,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Automated Storage and Retrieval Systems, Audit Trail, Microsoft Azure, Cloud Computing, Information Engineering, Data Security, Elasticsearch, Python (Programming Language), Machine Learning, Regression Testing, Software Engineering, Privacy Controls, Reinforcement Learning, Data Logging, Data Ingestion, Flask (Web Framework), Large Language Models, Snowflake, Generative AI, Rate Limiting, Fastapi, Kubernetes, Wikis, Machine Learning Operations, Terraform, GPT, Docker, Databricks - **Published:** July 15, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=be5a298b53e539ed ## About the Role * Education: Master's degree or equivalent experience required * 3+ years in software engineering, data engineering, ML engineering, or applied AI, including recent GenAI delivery in production. * Demonstrated expertise in RAG system design and optimization, including: * chunking + metadata enrichment, hybrid search, re-ranking, retrieval evaluation * grounding/citations and hallucination mitigation patterns * Strong Python and backend engineering skills (FastAPI/Flask), plus strong SQL. * Experience working in regulated or security-conscious environments, with knowledge of: * access controls/entitlements, data privacy, logging/audit trails, secure SDLC practices * Proven ability to work effectively as an IC consultant: * communicate architecture decisions clearly * influence cross-functional stakeholders without direct authority produce high-quality documentation and handoff materials Nice to Have * Fine-tuning experience (SFT, LoRA/QLoRA) and familiarity with preference optimization concepts (DPO/RLHF) * Vector/hybrid search platforms: Elasticsearch/OpenSearch vector, FAISS, Pinecone, Weaviate, Milvus * LLMOps tooling: MLflow/W&B, OpenTelemetry, prompt registries, evaluation frameworks * Cloud + platform: AWS/Azure/GCP, Docker/Kubernetes, Terraform ## Description As a Generative AI Engineer at Afficiency, you will be responsible for designing, developing and deploying Generative AI solutions that enhance our core product platforms and client implementations. You will work closely with engineering, data science, and infrastructure teams to build scalable AI-driven applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), model fine-tuning, and reinforcement learning approaches. This role is ideal for someone who is based in the NYC Metro Area, passionate about building real-world GenAI applications and bringing them into production, while continuously improving performance, reliability, and user outcomes., * Deliver GenAI solutions end-to-end * Own technical design and implementation of GenAI applications from discovery through production handoff. * Build APIs/services that integrate with enterprise systems and analytics platforms. * Implement enterprise-grade RAG * Design ingestion pipelines for internal content (PDFs, policies, research, dashboards, ticketing, wikis). * Build retrieval systems with hybrid search, filtering, re-ranking, query rewriting, and context optimization. * Implement permission-aware retrieval aligned to entitlements and data access policies. * Establish evaluation and quality controls. * Define metrics for retrieval quality and answer grounding (faithfulness, citation accuracy, coverage). * Create golden datasets, regression tests, and automated evaluation harnesses. * Operationalize GenAI (LLMOps) * Instrument observability (latency, cost, token usage, error rates) and implement safe rollout patterns. * Implement caching, rate limiting, fallbacks, and incident-ready operational practices. * Partner across teams to land solutions * Collaborate with business owners to translate requirements into workable designs. * Work with Security/Compliance to embed guardrails, auditability, and privacy controls. * Provide clear documentation and implementation of playbooks to enable internal teams' post-engagement., * LLM frameworks: LangChain, LlamaIndex, Semantic Kernel (optional) * Vector/hybrid search: Open to different skillsets * Data: (Snowflake/Databricks/warehouse), event pipelines, document stores * Observability: logging/tracing/metrics, dashboards, alerting ## Related Videos - [Should we build Generative AI into our existing software?](https://www.wearedevelopers.com/videos/1129-should-we-build-generative-ai-into-our-existing-software) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Living Documentation That Can't Die](https://www.wearedevelopers.com/videos/2025-living-documentation-that-can-t-die) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [Make it simple, using generative AI to accelerate learning](https://www.wearedevelopers.com/videos/969-make-it-simple-using-generative-ai-to-accelerate-learning) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [How to Use Generative AI to Accelerate Learning to Code](https://www.wearedevelopers.com/magazine/530-how-to-use-generative-ai-to-accelerate-learning-to-code)