AI Engineer Generative AI & RAG Systems (DS/ML)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+4 more
Job description
Join a high-impact AI Accelerator initiative as the hands-on engineer responsible for building the technical backbone of a governed generative AI ecosystem. You’ll design secure multi-agent workflows, implement retrieval-augmented generation pipelines, and establish the evaluation frameworks that make AI outputs traceable, trustworthy, and enterprise-ready. Working in two-week agile sprints, you’ll collaborate directly with Data Scientists, ML Engineers, Business Analysts, and SMEs to turn ambiguous business challenges into production-grade AI solutions. This is a rare opportunity to work at the intersection of generative AI engineering and responsible AI governance building systems that scale trust, not just technology., * Design and implement retrieval pipelines, metadata tagging, and quality checks for a governed knowledge base
- Build secure multi-agent workflows combining LLM reasoning with deterministic logic and safe tool orchestration
- Define agent roles, validation checkpoints, error handling, and human-in-the-loop review points
- Create evaluation datasets and metrics covering relevance, grounding, correctness, and traceability
- Develop reusable prompt, workflow, and orchestration patterns for cross-functional teams
- Instrument agent performance tracking including latency, cost-to-serve, and revision effort
- Deliver working increments each sprint and maintain a prioritized enhancement backlog
- Apply secure development, Responsible AI, and data-governance practices throughout
Ideal Candidates Will Have:
- A passion for building AI systems that are not just powerful, but accountable and explainable
- Experience translating ambiguous business needs into testable, measurable technical requirements
- A collaborative mindset for working across data science, engineering, and business stakeholder teams
Requirements
- Bachelor’s degree in Computer Science, Data Science, ML, or equivalent practical experience
- 5+ years in software, data science, ML, or AI engineering with production-quality Python development
- Hands-on experience building LLM applications, RAG systems, or agentic workflows using APIs
- Strong grasp of testing, CI/CD, API design, documentation, and observability practices
- Experience with embeddings, vector/hybrid search, and retrieval evaluation design
Other Skills:
- Familiarity with LLM orchestration or agent-workflow platforms
- Experience designing evaluation frameworks, guardrails, or prompt/version management
- Knowledge of data governance, access control, and auditability standards
- ML lifecycle support experience (feature documentation, model bootstrapping)
About the company
Calance is a global IT company with operations in the United States, Canada, and India. Over the years, Calance has grown organically and has acquired numerous successful IT Services firms along the way. As a result, the company today is a mix of diverse cultures, talents, and expertise that collaborate globally to bring our best capabilities and thinking to clients. Calance also offers benefits which includes Medical, Dental, Vision care, and 401K.
Calance - the place to grow.
www.calance.com
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…