REMOTE -Principal Software Developer- Agentic AI, Healthcare AI

Oracle
United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) A/B Testing Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Databases Data Structures Software Debugging Distributed Systems Elasticsearch
+30 more
Python (Programming Language) Knowledge-Based Systems Machine Learning Oracle (Applications) Queueing Systems Cloud Services Software Engineering Data Streaming Workflow Management Systems IBM Watson Health Chatbots Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Concurrency Prompt Engineering Apache Spark Backend Event Driven Architecture Containerization Kubernetes Information Technology Low Latency Apache Kafka Video Streaming Virtual Agents Asynchronous Programming Oracle Cloud Infrastructure Serverless Computing Docker

Job description

  • Architect, design, develop, deploy, and operate production-grade AI systems powered by LLMs, agents, retrieval, and enterprise data.
  • Build agentic AI systems that leverage tool use, memory, planning, orchestration, and workflow automation to solve complex business problems.
  • Design and implement scalable RAG, search, retrieval, ranking, and knowledge systems across structured and unstructured data sources.
  • Develop LLM-powered applications, including prompt and context engineering, tool integrations, model routing, guardrails, and workflow orchestration.
  • Optimize AI systems for quality, latency, reliability, scalability, observability, and cost efficiency.
  • Establish evaluation frameworks, experimentation platforms, and feedback loops to continuously improve AI system performance and user outcomes.
  • Build and maintain cloud-native services, APIs, SDKs, and distributed systems that enable reliable development and operation of AI capabilities.
  • Design and support asynchronous communication patterns, event-driven architectures, and workflow orchestration using messaging and streaming technologies.
  • Partner closely with applied scientists, engineers, product managers, and domain experts to translate ambiguous requirements into scalable technical solutions.
  • Drive architecture decisions, mentor engineers, and raise engineering standards across the organization.

Requirements

  • 8+ years of professional experience in software engineering, machine learning engineering, applied machine learning, or related fields.
  • BS/MS/PhD in Computer Science, Engineering, Machine Learning, Artificial Intelligence, or equivalent practical experience.
  • Proven track record of designing, building, and operating production ML, AI, LLM, RAG, search, recommendation, conversational AI, or agentic AI systems at scale.
  • Strong software engineering fundamentals, including distributed systems, concurrency, APIs, data structures, algorithms, testing, debugging, and production operations.
  • Proficiency in Python and Java with experience developing and maintaining production software in both languages.
  • Hands-on experience building scalable backend services, cloud-native systems, APIs, distributed applications, or model-serving platforms.
  • Experience with modern LLM ecosystems, including prompt engineering, tool calling, retrieval-augmented generation, model serving, evaluation, and deployment.
  • Experience building search, retrieval, ranking, vector database, or enterprise knowledge systems.
  • Experience with asynchronous communication patterns, message queues, pub/sub systems, data streaming platforms, or event-driven architectures.
  • Experience with containerized applications and Kubernetes-based deployments.
  • Strong technical judgment and the ability to balance quality, latency, reliability, scalability, and cost tradeoffs.
  • Demonstrated ownership of complex technical problems from architecture through production operation.
  • Strong communication skills and experience working effectively across engineering, product, and applied science teams., * Experience building agentic AI systems involving planning, tool orchestration, memory, autonomous workflows, or multi-agent architectures.
  • Experience with frameworks and platforms such as LangGraph, LangChain, LlamaIndex, Semantic Kernel, MCP, or equivalent orchestration technologies.
  • Experience with retrieval and ranking technologies such as Elasticsearch, OpenSearch, vector databases, hybrid search, reranking, and query understanding systems.
  • Experience designing and operating production LLM serving platforms with responsibility for latency, throughput, reliability, scalability, observability, and cost efficiency.
  • Experience with model adaptation techniques such as fine-tuning, LoRA, distillation, preference optimization, or domain adaptation.
  • Experience building evaluation systems, A/B testing frameworks, human-in-the-loop review processes, and AI quality measurement platforms.
  • Experience with OCI, AWS, Azure, or GCP and technologies such as Docker, Kubernetes, Kafka, Spark, or equivalent distributed systems.
  • Experience developing tools, frameworks, APIs, or platforms used by applied scientists, data scientists, or machine learning engineers.
  • Experience building AI systems in healthcare, enterprise SaaS, regulated environments, or other privacy-sensitive domains.
  • Demonstrated technical leadership through architecture ownership, mentoring, cross-functional collaboration, and delivery of high-impact initiatives.

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on eeho.fa.us2.oraclecloud.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:00 min

Introduction to chatbot infrastructure and cloud challenges

Stan Girard Stan Girard · World Congress 2024

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

Videos

See all

Related articles

See all