> Markdown version of [/jobs/ext/1810873-senior-principal-network-development-engineer](https://www.wearedevelopers.com/jobs/ext/1810873-senior-principal-network-development-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Principal Network Development Engineer... - **Company:** Oracle - **Location:** Nashville, TN, United States - **Experience:** Expert - **Salary:** $135,200.0 - $306,400.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Systems Engineering, Bash Shell, Network Congestion, Continuous Integration, Data Centers, Software Debugging, Decision Support Systems, Distributed Computing Environment, Distributed Systems, Network Interface Controllers, Firmware, InfiniBand, Python (Programming Language), PCI Express, Remote Direct Memory Access, Broadcom, Azure Machine Learning, Systems Architecture, Traffic Analysis, AI Infrastructure, Hardware Testing, Backend, Information Technology, Low Latency, Hardware Acceleration, Oracle Cloud Infrastructure - **Published:** July 4, 2026 - **Apply:** https://www.juju.com/job/00000000ghl82g ## About the Role + Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field + 8-12+ years of experience in networking, systems engineering, or hardware validation in large-scale distributed environments + Deep expertise in NIC architecture and advanced features (RDMA/RoCE, congestion control, SR-IOV, queueing, offloads) + Strong understanding of distributed systems networking for AI/ML workloads (e.g., collective communication patterns, east-west traffic scaling) + Advanced knowledge of Linux networking stack and kernel-level debugging + Proven experience leading hardware qualification and/or NPI efforts in data center or cloud environments + Strong debugging skills across hardware, firmware, driver, and system layers + Proficiency in automation and tooling (Python, Bash, or similar) + Experience with performance benchmarking and traffic analysis in high-scale environments Preferred Qualifications + Experience with AI/HPC networking (e.g., RoCEv2, InfiniBand concepts, GPU cluster networking) + Familiarity with distributed training frameworks (e.g., NCCL) and their network behavior + Knowledge of PCIe, NUMA, and GPU/accelerator interconnect considerations + Experience in hyperscale cloud environments + Exposure to SmartNICs, DPUs, or offload-driven architectures + Experience building validation pipelines integrated with CI/CD systems + Background in large-scale cluster bring-up and production operations IC5 (Principal) Expectations + **Technical Leadership at Scale:** Owns and drives critical, cross-organizational initiatives that impact OCI AI infrastructure at fleet level ## Description We are seeking a Senior Principal Network Development Engineer (IC5) to lead backend NIC qualification and New Product Introduction (NPI) for next-generation networking platforms supporting GPU- and accelerator-based clusters. This role is critical to enabling OCI's AI superclusters by ensuring NIC technologies meet stringent requirements for RDMA performance, cluster scale, and workload isolation. As an IC5, you will operate as a technical leader owning complex, ambiguous problem spaces end-to-end. You will drive cross-organizational initiatives spanning hardware vendors, OCI compute and networking, and data center operations, while influencing architecture and long-term roadmap decisions., + **End-to-End Ownership:** Operates with high autonomy in ambiguous spaces, defining problems, strategy, and execution without requiring direction + **Cross-Org Influence:** Partners effectively across compute, networking, hardware, and operations teams; influences external vendors and internal architecture decisions + **Depth + Breadth:** Brings deep domain expertise in networking/NICs while understanding adjacent systems (compute, storage, AI workloads) + **Operational Excellence:** Drives high standards for reliability, scalability, and performance in production environments + **Data-Driven Decision Making:** Uses metrics, benchmarking, and production telemetry to guide decisions and prioritize work + **Mentorship & Multiplication:** Elevates team capability through mentorship, technical guidance, and raising engineering standards + **Customer Impact Focus:** Aligns engineering decisions with the needs of OCI AI customers and large-scale training workloads Responsibilities + Own the end-to-end qualification strategy and execution for backend NICs supporting OCI AI clusters (RDMA/RoCE-based fabrics) + Lead NIC NPI for AI infrastructure, from early silicon bring-up through fleet-wide deployment across OCI regions + Define validation methodologies for high-performance, low-latency distributed training workloads (e.g., GPU collectives, east-west traffic patterns) + Drive deep performance characterization and tuning of NICs in AI cluster environments (latency, throughput, tail latency, congestion behavior) + Partner with NIC and silicon vendors (e.g., NVIDIA/Mellanox, Broadcom, Intel) to resolve complex hardware/firmware issues and influence feature design + Collaborate with OCI AI/ML platform, cluster networking, and host software teams to ensure optimal integration with drivers, kernel, and user-space stacks + Build and scale automated validation frameworks for continuous qualification across rapidly evolving AI hardware generations + Lead root cause analysis (RCA) for systemic issues impacting cluster performance or reliability, driving fixes across stack layers + Establish qualification gates, acceptance criteria, and release readiness processes aligned with OCI production standards + Use production telemetry and workload insights to inform validation strategy and proactively identify risk areas + Influence NIC and system architecture to meet the demands of next-generation AI workloads Disclaimer: Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements. ## Related Videos - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Playing Pong on a shoulder press machine](https://www.wearedevelopers.com/videos/100140-playing-pong-on-a-shoulder-press-machine) - [The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)](https://www.wearedevelopers.com/videos/2067-the-gashlycrumb-tinies-of-ai-networking-you-must-know-or-languish) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Agent Smith Gets Hardware: Autonomous IoT Hacking From Debug Port to Cloud API](https://www.wearedevelopers.com/videos/100258-agent-smith-gets-hardware-autonomous-iot-hacking-from-debug-port-to-cloud-api) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)