Senior Gen AI Engineer

Master Compliance
Woodbridge Township, NJ, United States
3 months ago
Apply on indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$87,942.0 - $105,914.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Application Performance Management Microsoft Azure Continuous Integration Python (Programming Language) Network Security Role-Based Access Control Search Technologies Management of Software Versions Prompt Engineering Generative AI
+6 more
Fastapi Machine Learning Operations Azure Service Fabric Restful APIs Key Vault Microservices

Job description

  1. Design and develop Generative AI solutions using Azure OpenAI Service, including prompt engineering, embeddings, and model orchestration for enterprise use cases.
  2. Build Retrieval-Augmented Generation (RAG) pipelines by integrating Azure AI Search, vector databases, and structured/unstructured enterprise data sources.
  3. Develop scalable APIs and microservices for GenAI applications using Python/ Fast API or Java-based services deployed on Azure PaaS
  4. Implement Responsible AI controls, including content moderation, prompt/output filtering using Azure AI Content Safety
  5. Orchestrate end-to-end GenAI workflows leveraging Azure AI Foundry/Projects, integrating tools, functions, and agent-based reasoning 6.Deploy and manage GenAI workloads on Azure using secure networking, RBAC, Key Vault, and enterprise security standards

  6. Monitor and evaluate model performance using Azure Monitor, Application Insights, and GenAI evaluation metrics
  7. Optimize prompt and model usage for performance, latency, and cost efficiency across development and production environments
  8. Collaborate with business and data teams to translate requirements into GenAI-enabled solutions aligned to enterprise governance and compliance
  9. Support CI/CD and MLOps pipelines for GenAI applications, ensuring versioning, testing, traceability, and controlled releases on Azure

Requirements

Do you have experience in Python?

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:33 min

Connecting frontends via a FastAPI proxy backend layer

Saoussen Chaabnia Saoussen Chaabnia · Europe 2026 Virtual

4:55 min

Centralizing credentials management using Azure Key Vault resource integration

Marcel Lupo · LIVE

2:59 min

The danger of adopting default REST APIs

Stefan Priebsch · World Congress 2021

1:49 min

Augmenting junior and principal engineering roles with AI

Neel Sundaresan Neel Sundaresan +1 · World Congress 2026 Europe

3:34 min

Approaching language models as scalable synchronous rest APIs

Patrick Koss Patrick Koss · World Congress 2025

2:21 min

Structuring the backend architecture of machine learning workspaces

Jose Luis Latorre Millas · LIVE

Videos

See all

Related articles

See all