> Markdown version of [/jobs/ext/1486954-ai-inference-core-infrastructure-sw-engineer](https://www.wearedevelopers.com/jobs/ext/1486954-ai-inference-core-infrastructure-sw-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Inference Core - Infrastructure SW Engineer - **Company:** Cerebras Systems - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computing Platforms, Automation of Tests, Software Debugging, Software Design Patterns, Programming Tools, Python (Programming Language), Multiprocessing, Software Architecture, Software Maintenance, Software Systems, Test Execution Engine, Web Application Frameworks, Concurrency, Backend, Fastapi, Event Driven Architecture, Build Management, Pytest, Containerization, Kubernetes, Information Technology, Build Tools, Machine Learning Operations - **Published:** July 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=9310faad5055d7e6 ## About the Role * 3+ years of professional software-engineering experience. * Strong proficiency in Python and a solid understanding of the language's strengths, limitations, and runtime behavior. * Experience designing maintainable software systems, libraries, frameworks, backend services, or developer-facing APIs. * Good judgment around software architecture, abstraction boundaries, design patterns, extensibility, and long-term maintainability. * Understanding of concurrency concepts such as processes, threads, asynchronous execution, synchronization, and shared state. * Foundational understanding of operating systems, including processes, signals, filesystems, resource management, and program execution. * Foundational understanding of distributed-systems concepts such as retries, timeouts, idempotency, partial failure, coordination, and eventual consistency. * Strong debugging and problem-solving skills, including the ability to form hypotheses, gather evidence, and work through unfamiliar systems independently. Preferred Skills & Qualifications * Experience with Python concurrency technologies such as asyncio, multiprocessing, concurrent futures, or event-driven systems. * Experience building orchestration engines, workflow systems, schedulers, distributed job runners, or control-plane software. * Experience developing test infrastructure or extensions for frameworks such as pytest. * Familiarity with CI systems, build systems, release infrastructure, or developer-productivity tooling. * Experience with Kubernetes, containerized environments, cluster schedulers, or remote execution systems. * BS/MS in Computer Science or a related field, or equivalent practical experience. ## Description The Core Infrastructure team builds the software systems that power engineering workflows across Cerebras. Our infrastructure coordinates complex work across machines, clusters, development environments, and hardware systems. We build orchestration frameworks, execution engines, scheduling systems, test infrastructure, developer tools, and reusable software platforms that allow engineers to build, test, qualify, and deliver software reliably at scale. These systems are primarily built in Python, but the work goes far beyond scripting or automation. Our frameworks act as the control plane for distributed workflows, managing resources, execution state, concurrency, failures, retries, dependencies, and observability across large and complex environments., We are hiring a Software Engineer to design and build the core software behind Cerebras engineering infrastructure. You will work on Python frameworks, orchestration systems, distributed execution, scheduling, test infrastructure, and developer tooling. You will help define the architecture and APIs that other engineering teams depend on every day. This role is a strong fit for an engineer who enjoys reading unfamiliar code, understanding how systems fit together, debugging difficult problems, and improving the underlying design rather than applying one-off fixes. We value strong software-engineering fundamentals, independent problem solving, and sound systems thinking more than familiarity with any particular infrastructure product., * Design, develop, test, and maintain Python frameworks and services used to orchestrate engineering workflows across machines and clusters. * Build reusable abstractions for scheduling, distributed execution, resource management, test execution, workflow planning, and failure recovery. * Define clear APIs, module boundaries, extension points, and data models that allow infrastructure systems to evolve without becoming difficult to maintain. * Reason about concurrency, asynchronous execution, multiprocessing, state management, retries, idempotency, cancellation, and partial failures. * Debug complex issues spanning Python applications, operating systems, processes, filesystems, networking, remote machines, and distributed services. * Write high-quality automated tests and documentation for infrastructure that is expected to be reliable and widely reused. * Partner with platform, CI, release, quality, ML systems, and product engineering teams to understand requirements and translate them into scalable software designs. ## Related Videos - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Building and Deploying Multi-Agent Systems with ADK and Vertex AI](https://www.wearedevelopers.com/videos/1918-building-and-deploying-multi-agent-systems-with-adk-and-vertex-ai) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)