Generative AI Engineer Role

Open Data Watch, Inc.
Washington, DC, United States
30 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Automated Storage and Retrieval Systems Computer Programming Software Debugging Information Extraction Search Technologies Systems Integration Management of Software Versions Large Language Models Model Validation Generative AI Low Latency
+1 more
Software Version Control

Job description

Generative AI Engineers build production applications around foundation models and large language models. They turn model capabilities into tools for search, drafting, summarization, information extraction, multimodal work, and guided action, with the controls and evidence needed to understand how those tools behave.

The role concentrates on application and context engineering. Generative AI Engineers connect models to authoritative knowledge, tools, and workflows; design prompts and structured outputs; evaluate quality, grounding, safety, security, latency, and cost; and monitor the application after release. They treat fluent output as something to test, not proof that the system is correct.

What you’ll build

  • Grounded assistants and knowledge applications with retrieval-augmented generation (RAG), hybrid or vector search, citations, metadata filtering, and source-level access controls.
  • Drafting, summarization, classification, extraction, and transformation services exposed through user interfaces or APIs.
  • Agents and multistep workflows with defined tool schemas, constrained permissions, approval gates, memory boundaries, replay, and exception handling.
  • Evaluation systems with curated test cases, task-specific rubrics, retrieval measures, grounding checks, safety and security tests, and regression thresholds.
  • Operational pipelines for versioning prompts and configurations, comparing models, tracing execution, monitoring quality and cost, collecting feedback, and responding to incidents.

Who you are

You are an application engineer who can work with fast-moving model capabilities without chasing every new release. You choose architectures by evidence, make uncertainty visible, and separate a convincing demonstration from a dependable service.

You think in complete workflows: sources, context, models, tools, permissions, people, and failure paths. You collaborate with domain experts, data and software engineers, security and privacy specialists, and accountable owners to decide where generation helps and where deterministic methods or human judgment should remain in control.

Requirements

  • A strong application-engineering foundation, including programming, APIs, testing, version control, service integration, and production debugging.
  • Practical experience with foundation-model integration, prompt and context design, structured outputs, model selection, and failure analysis.
  • Working knowledge of retrieval systems, embeddings, search, knowledge stores, document ingestion, and data-access controls.
  • Evaluation discipline across answer quality, retrieval relevance, grounding, safety, security, latency, cost, and user outcomes.
  • The judgment to constrain tools and agents, design human-review paths, document limitations, and respond when production behavior changes.

Benefits & conditions

Compensation, benefits, work location, and employment terms are set for each specific opening and will be stated with that opening

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:48 min

Balancing delivery latency with stream reliability and scale

Phil Cluff · LIVE

2:37 min

Tracing the evolution from early AI to generative AI

Mike Mike · World Congress 2025

5:08 min

Validating requests and responses using data transfer objects

Roman Alexis Anastasini · World Congress 2021

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

3:37 min

Accessing API documentation and testing remote driving latency

Alexandru Ciinaru Alexandru Ciinaru +3 · World Congress 2025

3:02 min

Evolution of software engineering roles with artificial intelligence

Laurie Voss Laurie Voss +4 · LIVE

Videos

See all

Related articles

See all