Senior Core Infrastructure Software Engineer

Oracle
Nashville, TN, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Agile Methodology Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Computer Programming Cursor (Graphical User Interface Elements) Software Debugging Programming Tools Distributed Systems Fault Tolerance
+20 more
Python (Programming Language) Load Testing Oracle (Applications) Software Tools Cloud Services Azure Machine Learning Software Engineering Strategies of Testing Cloud Platform System Performance Testing Large Language Models Prompt Engineering Kubernetes Information Technology Low Latency Production Code Integration Frameworks Oracle Cloud Infrastructure Docker Golang

Job description

Oracle Cloud Infrastructure is seeking a Senior Core Infrastructure Software Engineer to join the AI Innovation team! This is an senior, experienced, hands-on software engineering role responsible for designing, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will work on building production-grade cloud distributed systems, agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI applications used in large-scale, business-critical environments.

The Senior Core Infrastructure Software Engineer is a Senior experienced, hands-on software engineer role responsible for designing, building, and operating next-generation AI systems on Oracle Cloud Infrastructure (OCI). This person will work on building production-grade cloud distributed systems, agentic AI platforms, autonomous workflows, scalable inference infrastructure, and enterprise AI applications used in large-scale, business-critical environments.

This role owns moderately complex components within OCI Cloud platform services or SDKs; leads team-level improvements to integration frameworks and developer tooling. Performs deep debugging across a bounded set of distributed services, driving fixes that protect downstream consumers and upgrade paths. Analyzes usage, performance, and error budgets for specific platform surfaces; implements targeted resilience and capacity optimizations. Authors and curates team-scoped documentation, samples, and adoption guidance. The ideal candidate combines deep distributed systems experience with practical AI-native engineering.

Key Responsibilities include:

  • Implements and contributes to the development for components of distributed systems that support horizontal and vertical scaling including leveraging distributed state management tools.
  • Design, implement, and deliver scalable agentic AI systems capable of reasoning, planning, tool use, workflow execution, multi-step task orchestration, and safe human-in-the-loop escalation.
  • Implement scalability, performance, availability, and durability requirements for owned services and components.
  • Designs and implements functional requirements and testing for assigned features within an existing system
  • Optimize services for high-throughput, low-latency, and large-scale cloud workloads.
  • Implement systems that handle network unreliability, service disruptions, and partition scenarios while meeting SLOs.
  • Establish telemetry, KPIs, dashboards, and alerts to monitor service health, performance, reliability, and customer impact.
  • Drive performance testing, load testing, fault injection, brownout testing, and other validation strategies to ensure correctness and resiliency.
  • Implement secure infrastructure controls for multi-tenant cloud environments, including access controls, encryption, and remediation of security gaps.
  • Develop automation, Infrastructure as Code, and deployment tooling to support safe patching, updates, rollbacks, and operational recovery.
  • Designs and implements automation scripts and tooling used to troubleshoot operational issues.
  • Take ownership of production operations, including troubleshooting, incident response, root cause analysis, and ongoing service improvements.
  • Adheres to change management plans for patching, updating, and rolling back applications.
  • Strengthen operational readiness by improving runbooks, monitoring, change management, deployment safety, and recovery processes.
  • Applies advanced security measures to protect data and applications in multi-tenant environments, including encryption and access controls.
  • Collaborates with the team to ensure cloud infrastructure complies with relevant industry standards and regulations and that documentation is up-to-date

Requirements

  • Bachelor’s, Master’s, or Ph.D. in Computer Science, AI/ML, Engineering, or a related field, or equivalent practical experience.
  • 3-7+ years of professional software engineering experience
  • Experience in designing and developing high-scale distributed systems, cloud services, infrastructure platforms, or AI/ML platform services.
  • Strong programming skills in Java or Golang or Python and ability to contribute high-quality production code, reviews, tests, and debugging in complex distributed environments.
  • Strong expertise with Kubernetes, Docker, cloud-native infrastructure, service-to-service communication, scalability, fault tolerance, observability, and performance analysis.
  • Agile Methodologies: Demonstrated ability to use agile methodologies to drive continuous improvement and product delivery
  • Excellent written and verbal communication, * Experience with large scale cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).
  • Practical experience with orchestration frameworks such as LangGraph, LangChain, CrewAI, AutoGen, LlamaIndex, or similar ecosystems.
  • Understanding of LLM application patterns, including prompt design, structured outputs, function/tool calling, context management, RAG, memory, tool safety, and evaluation.
  • Experience using AI-assisted software development tools such as Codex, Claude Code, Cursor, Copilot, or similar systems in large-scale engineering environments

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on eeho.fa.us2.oraclecloud.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:33 min

Case study on adopting Kubernetes and Golang effectively

Andrew Holway · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · WWC Europe 2026

Videos

See all

Related articles

See all