Software Engineer - 3 (AI Platform)

We operate with a lean infrastructure-no unnecessary layers, no red tape. That means:

• Above-market compensation tied to performance.
• Minimal meetings, maximum time spent building.
• Your work ships fast and matters immediately.

We intentionally stay small to preserve agility and ensure every team member is highly valued and highly compensated.

What You’ll Do

• This current opening is for software engineer positions on the enterprise AI Platform team.
• This is an Amazing Opportunity to be at the forefront of AI Inference serving at scale.
• Build and maintain the platform that provides the foundation for the customer’s AI capabilities, focusing on inference services while supporting the broader ecosystem of AI-enabled applications including Agents, RAG, Batch Inference and so much more.
• Design, implement, and optimize infrastructure for AI model inference at scale., * Design, implement, and optimize infrastructure for AI model inference at scale.
• Support the development and maintenance of production AI services and applications, including retrieval augmented generation (RAG), autonomous agents, and emerging technologies.
• Navigate ambiguity and define solutions for underspecified systems and requirements .
• Drive adoption of new technologies and practices across engineering teams.
• Implement monitoring, logging, and observability solutions for AI services.
• Automate infrastructure provisioning and configuration using IaC principles.
• Ensure high availability, reliability, and performance of AI platform components
• Contribute to security best practices for AI systems and data.
• Provide technical guidance and informal mentorship to junior engineers.

• Deep technical expertise across AI/ML, Python software engineering, Linux systems, and CNO, with experience leveraging modern AI development tools such as Claude Code.
• Expertise in architecting scalable, high-impact solutions.
• Strong ability to rapidly diagnose and resolve complex issues in production environments.
• Seasoned customer service chops: engaging high level stakeholders, translating requirements, and prototying and demoing MVP capabilities., * Skills Requirements: Proven experience building and maintaining production systems at scale.
• Experience with high-volume web application architecture and performance optimization.
• Strong background in systems integration across diverse technologies and platforms.
• Hands-on experience with cloud engineering in AWS.
• Proficiency with Kubernetes administration and deployment patterns.
• Strong Python programming skills.
• Experience implementing observability solutions (APM, OpenTelemetry, Grafana, Prometheus).
• Familiarity with CI/CD pipelines and DevOps practices.
• Strong change management and organizational influence skills.
• Ability to thrive in ambiguous environments and create structure where needed.
• Excellent communication and collaboration skills.
• Nice to Haves: Experience with AI inference serving technologies (vLLM, LiteLLM, etc.).
• Previous experience with agentic frameworks (LangChain).
• Knowledge of vector databases and embedding systems.
• Experience with high-performance computing or distributed systems.

Pulled from the full job description

• Paid training
• AD&D insurance
• Health insurance
• Paid time off
• Vision insurance
• Health savings account
• Dental insurance

Full job description

REQUIREMENT: Active TS/SCI Clearance with Full Scope Polygraph

Are you tired of being underpaid or stuck on work that doesn’t matter?

At Shawky Engineering, we build AI solutions that directly support real-world operational needs on the most mission essential contract in CNO. Our work is fast-paced, high-impact, and delivered by a small, elite team., * Above Market Compensation

• 10% 401k retirement gift IMMEDIATELY vested every paycheck
• 6 Weeks PTO a year! Enjoy your life!
• Excellent medical plans for you and your family including HSA
• 100% company paid dental benefits
• 100% company paid vision benefits
• 100% company paid term life insurance
• 100% company paid short-term disability
• 100% company paid long-term disability
• 100% company paid AD&D Insurance
• 100% company paid training based on approval
• GUARANTEED Annual performance review to increase your pay
• MISSION ESSENTIAL contract (you won’t be sitting home unpaid during the next furlough)