> Markdown version of [/jobs/ext/2942980-software-engineer-iii](https://www.wearedevelopers.com/jobs/ext/2942980-software-engineer-iii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer III - **Company:** GitHub - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Salary:** $285,900.0 - **Contract:** Permanent contract - **Skills:** C (Programming Language), JavaScript (Programming Language), Adobe InDesign, Application Programming Interfaces (APIs), Artificial Intelligence, Automation of Tests, C Sharp (Programming Language), C++ (Programming Language), Cloud Computing, Code Review, Computer Engineering, Computer Literacy, Data Stores, Relational Databases, Github, Design of User Interfaces, Human-Computer Interaction, Python (Programming Language), Microsoft Software, Language Modeling, NoSQL, Open Source Technology, Reliability Engineering, Ruby, Software Engineering, Rust (Programming Language), Scripting, GitHub Copilot, System Availability, Backend, Kubernetes, Information Technology, Serverless Computing, Golang, Programming Languages - **Published:** September 16, 2026 - **Apply:** https://www.careerbuilder.com/job-details/software-engineer-iii-copilot-models-inference-new-york-ny--972f7c02-8992-45f6-9dff-15e5dcac16fb ## About the Role * 4+ years experience in Software Engineering, Computer Science, or related technical discipline with proven experience maintaining and delivering production software languages including, but not limited to, C, C++, C#, JavaScript, Go, Ruby, Rust, or Python. * OR Associate's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 3+ years experience. * OR Bachelor's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 2+ years experience in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, JavaScript, Go, Ruby, Rust, or Python. * OR Master's Degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field. * OR equivalent experience, * Experience applying software design principles such as clear interfaces, useful abstractions, and composition to build maintainable and testable systems. * Experience working with both relational databases and NoSQL data stores, including making appropriate data-modeling and access-pattern tradeoffs. * Experience building or operating cloud-native services, including containers, Kubernetes, or managed cloud infrastructure. * Experience with AI or large language model inference systems, model APIs, or model-provider integrations. * Experience with observability and reliability engineering, including improving latency, capacity, resilience, or incident response for production services. * Experience with canary releases, feature flags, progressive delivery, or other safe rollout practices., Accounting, Application Programming Interface (API), Artificial Intelligence (AI), Artificial Intelligence (AI) Programming Languages, Automation, C Programming Language, C++ Programming Language, Cloud Computing, Coaching, Code Reviews, Communication Skills, Computer Engineering, Computer Science, Computer Skills, DNA, Data Modeling, Documentation, Electrical Engineering, Electronic Engineering, GitHub, Go Programming Language (Golang), High Availability, Incident Response, JavaScript, Mathematics, Microsoft C# (C Sharp), Modeling Languages, NoSQL, On Call, Open Source, Operational Improvement, Performance Management, Physics, Product Lifecycle, Product Safety, Production Management, Prototyping, Python Programming/Scripting Language, Relational Databases (RDBMS), Reliability Engineering, Reporting Dashboards, Risk Management, Risk Modeling, Ruby, Rust Programming Language, Sales, Service Delivery, Software Design, Software Development, Software Engineering, Technical/Engineering Design, Test Automation, Testing, User Interface/Experience (UI/UX) ## Description As a software engineer at GitHub, you will enhance the collaboration experience at GitHub by working closely with a community of engineers and designers with a distributed, diverse and passionate team delivering the services that millions of developers depend on. In this role you will design, prototype, implement, ship and support highly performant and inspiring user experiences with your team. The GitHub Copilot Models Inference team builds and operates the backend services and APIs that connect Copilot experiences to AI model providers. These systems make models available safely and reliably at global scale while managing the production realities of provider integrations, request routing, service health, latency, capacity, and changing model availability. As a Software Engineer III, you will deliver production features end to end and help operate the services you change. You will participate in design and code reviews, build tests and operational safeguards, prepare changes for rollout, and use production signals to improve reliability and performance. Clear communication matters on this distributed team. You will work with engineers and partners across Models Lifecycle, product, safety, infrastructure, and external model providers through a mix of live conversations and thoughtful written updates. This is a hands-on individual contributor role with opportunities to grow ownership through increasingly independent delivery. Responsibilities Design, implement, test, deploy, and maintain backend services and APIs that connect GitHub Copilot experiences to model providers. Own scoped features end to end, from technical design and implementation through operational readiness, safe rollout, measurement, and follow-up. Integrate new models and provider capabilities while accounting for availability, compatibility, capacity, failure modes, and safe fallback behavior. Improve service latency, throughput, capacity efficiency, and high-availability behavior using measurable production outcomes. Add and maintain automated tests, dashboards, alerts, runbooks, and diagnostics that make service and model health understandable and actionable Keep teammates and partners informed through clear discussions, written updates, and documentation, especially when decisions, risks, or incidents affect others. Participate in code reviews and design discussions, incorporating feedback and helping teammates ship maintainable changes. Participate in on-call and first-responder rotations, investigate incidents, communicate impact, restore service, and complete appropriate repair and automation work. Use progressive delivery practices and production evidence to reduce risk when launching models, changing routing behavior, or updating provider integrations. Collaborate with Models Lifecycle, product, safety, infrastructure, and provider partners to deliver model availability and operational improvements across team boundaries. ## About GitHub GitHub is **_where people build software_**. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects. **Tech Stack:** Ruby, Ruby on Rails **Industries:** Enterprise Software, Platform [Company profile](https://www.wearedevelopers.com/companies/3968-github) ### More Jobs at GitHub - [Senior Software Engineer](https://www.wearedevelopers.com/jobs/ext/2934667-senior-software-engineer) - [Software Engineer I](https://www.wearedevelopers.com/jobs/ext/2224713-software-engineer-i) - [Staff Software Engineer, Compute Platform](https://www.wearedevelopers.com/jobs/ext/2615501-staff-software-engineer-compute-platform) - [Staff Software Engineer, GitHub Intelligence (Copilot Agents)](https://www.wearedevelopers.com/jobs/ext/2650582-staff-software-engineer-github-intelligence-copilot-agents) - [Staff Systems Engineer, Database Infrastructure](https://www.wearedevelopers.com/jobs/ext/2376353-staff-systems-engineer-database-infrastructure) ## Related Videos - [You’re a great coder? That alone won’t get you far: The soft skills secret in IT success](https://www.wearedevelopers.com/videos/1076-you-re-a-great-coder-that-alone-won-t-get-you-far-the-soft-skills-secret-in-it-success) - [Coffee with Developers: David Heinemeier Hansson](https://www.wearedevelopers.com/videos/875-coffee-with-developers-david-heinemeier-hansson) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Retooling and refactoring - an investment in people.](https://www.wearedevelopers.com/videos/371-retooling-and-refactoring-an-investment-in-people) - [The Software Engineer 2030: From Coder To AI Orchestrator? - Patrick Schnell](https://www.wearedevelopers.com/videos/1825-the-software-engineer-2030-from-coder-to-ai-orchestrator-patrick-schnell) ## Related Articles - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [What is Software Engineering?](https://www.wearedevelopers.com/magazine/289-what-is-software-engineering) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers) - [Is Software Engineering Hard?](https://www.wearedevelopers.com/magazine/448-is-software-engineering-hard) - [Best Countries for Software Engineers](https://www.wearedevelopers.com/magazine/267-best-countries-for-software-engineers)