AI Foundation Model Engineer

Usg Inc.
Jersey City, United States of America
12 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Jersey City, United States of America

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Engineering
Continuous Integration
Data Security
Python
Machine Learning
Open Source Technology
Performance Tuning
TensorFlow
Search Technologies
Software Deployment
Software Engineering
Data Logging
Enterprise Software Applications
PyTorch
Transfer Learning
Large Language Models
Model Validation
Software Application Programming
Generative AI
Containerization
AI Platforms
Kubernetes
HuggingFace
Machine Learning Operations
Virtual Agents
REST
Serverless Computing
Databricks
Microservices

Job description

Seeking an experienced AI Foundation Model Engineer to design, build, deploy, and optimize enterprise-grade AI solutions powered by Large Language Models (LLMs), Generative AI, Retrieval-Augmented Generation (RAG), and agentic AI workflows. This role is responsible for developing scalable, secure, and production-ready AI applications while ensuring operational excellence, observability, governance, and compliance within enterprise environments., * Design and develop LLM-powered applications including knowledge assistants, document intelligence platforms, workflow agents, summarization tools, and decision-support systems.

  • Build Retrieval-Augmented Generation (RAG) pipelines using embeddings, semantic search, vector databases, chunking strategies, reranking, response grounding, and citation mechanisms.
  • Fine-tune and optimize foundation models using techniques such as LoRA, PEFT, instruction tuning, transfer learning, knowledge distillation, quantization, and domain adaptation.
  • Develop scalable APIs, microservices, model-serving infrastructure, and integration services across cloud, hybrid, and containerized environments.
  • Optimize inference workloads for latency, throughput, token efficiency, scalability, reliability, cost optimization, and user experience.
  • Implement observability solutions for AI applications including prompt logging, retrieval quality metrics, hallucination detection, model drift monitoring, service health, user feedback, and cost telemetry.
  • Embed security, privacy, Responsible AI, model governance, and enterprise risk controls throughout the AI application lifecycle.
  • Create production documentation, deployment guides, runbooks, release documentation, testing evidence, and audit-ready implementation artifacts.
  • Collaborate with AI Researchers, Platform Engineers, Security, Product, Architecture, and Business teams to deliver enterprise AI capabilities.

Requirements

The ideal candidate combines strong AI/ML engineering expertise with cloud-native software development and production deployment experience., * 7+ years of experience in AI/ML Engineering, Applied Machine Learning, Platform Engineering, Software Engineering, or related disciplines.

  • Hands-on experience developing applications using Large Language Models (LLMs), Transformers, embeddings, Retrieval-Augmented Generation (RAG), semantic search, and Generative AI architectures.
  • Strong Python development experience with frameworks such as PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Semantic Kernel, or equivalent AI frameworks.
  • Experience deploying production AI services using REST APIs, microservices, containers, Kubernetes, CI/CD pipelines, cloud-native services, and monitoring platforms.
  • Strong understanding of model evaluation, fine-tuning, inference optimization, secure data handling, and AI application performance tuning.
  • Experience working with cloud platforms and distributed AI workloads.
  • Excellent problem-solving, software engineering, and collaboration skills., * Experience within Banking, Financial Services, FinTech, Risk Management, Compliance, Financial Crime, Operations, or Enterprise Technology.
  • Experience with Azure OpenAI, AWS Bedrock, Google Vertex AI, Databricks, vLLM, Triton Inference Server, MLflow, Kubeflow, AI model gateways, or similar enterprise AI platforms.
  • Familiarity with Responsible AI, AI Governance, Model Risk Management, Audit Controls, AI Cost Governance, and private or open-source LLM deployments.
  • Experience deploying enterprise-scale AI platforms in regulated environments.

Apply for this position