> Markdown version of [/jobs/ext/1376549-software-engineer-3-ai-platform](https://www.wearedevelopers.com/jobs/ext/1376549-software-engineer-3-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - 3 (AI Platform) - **Company:** SHAWKY ENGINEERING, LLC - **Location:** Laurel, MD, United States - **Salary:** $280,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Cloud Engineering, Encodings, Linux, DevOps, Programming Tools, Distributed Systems, Python (Programming Language), Performance Tuning, Prometheus, Systems Integration, Web Applications, Data Logging, High Performance Computing, System Availability, Grafana, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, BIG-IP Access Policy Manager (APM) - **Published:** July 22, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=4b53f97f5be69a8d ## About the Role * Deep technical expertise across AI/ML, Python software engineering, Linux systems, and CNO, with experience leveraging modern AI development tools such as Claude Code. * Expertise in architecting scalable, high-impact solutions. * Strong ability to rapidly diagnose and resolve complex issues in production environments. * Seasoned customer service chops: engaging high level stakeholders, translating requirements, and prototying and demoing MVP capabilities., * Skills Requirements: Proven experience building and maintaining production systems at scale. * Experience with high-volume web application architecture and performance optimization. * Strong background in systems integration across diverse technologies and platforms. * Hands-on experience with cloud engineering in AWS. * Proficiency with Kubernetes administration and deployment patterns. * Strong Python programming skills. * Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus). * Familiarity with CI/CD pipelines and DevOps practices. * Strong change management and organizational influence skills. * Ability to thrive in ambiguous environments and create structure where needed. * Excellent communication and collaboration skills. * Nice to Haves: Experience with AI inference serving technologies (vLLM, LiteLLM, etc.). * Previous experience with agentic frameworks (LangChain). * Knowledge of vector databases and embedding systems. * Experience with high-performance computing or distributed systems. ## Description We operate with a lean infrastructure-no unnecessary layers, no red tape. That means: * Above-market compensation tied to performance. * Minimal meetings, maximum time spent building. * Your work ships fast and matters immediately. We intentionally stay small to preserve agility and ensure every team member is highly valued and highly compensated. What You'll Do * This current opening is for software engineer positions on the enterprise AI Platform team. * This is an Amazing Opportunity to be at the forefront of AI Inference serving at scale. * Build and maintain the platform that provides the foundation for the customer's AI capabilities, focusing on inference services while supporting the broader ecosystem of AI-enabled applications including Agents, RAG, Batch Inference and so much more. * Design, implement, and optimize infrastructure for AI model inference at scale., * Design, implement, and optimize infrastructure for AI model inference at scale. * Support the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies. * Navigate ambiguity and define solutions for underspecified systems and requirements . * Drive adoption of new technologies and practices across engineering teams. * Implement monitoring, logging, and observability solutions for AI services. * Automate infrastructure provisioning and configuration using IaC principles. * Ensure high availability, reliability, and performance of AI platform components * Contribute to security best practices for AI systems and data. * Provide technical guidance and informal mentorship to junior engineers. ## Related Videos - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [DevOps for AI: running LLMs in production with Kubernetes and KubeFlow](https://www.wearedevelopers.com/videos/1222-devops-for-ai-running-llms-in-production-with-kubernetes-and-kubeflow) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)