AI Platform Engineer
Role details
Job location
Tech stack
Job description
MassMutual's AI Platform Engineering team is seeking a skilled AI Platform Engineer to contribute to the design, development, and operation of our growing AI platform. You will work on meaningful platform challenges, collaborate closely with senior engineers, and take ownership of platform components that power MassMutual's AI initiatives.
The Team
This is a unique opportunity to work on the team that builds and operates the platform powering MassMutual's AI initiatives. The team operates at the intersection of cloud infrastructure, AI/ML systems, and developer experience-delivering foundational capabilities that shape how the entire organization builds and deploys AI. We partner closely with AI engineering, product, and cloud engineering teams across the enterprise, and we invest in growth through a culture of peer learning, candid feedback, and shared technical standards. This team is defined by a shared commitment to engineering excellence, clear documentation, and a drive to make hard problems tractable.
The Impact
- Contribute to the design and implementation of platform components-cloud infrastructure, AI serving layers, and developer tooling-with guidance from senior engineers.
- Take ownership of discrete features or modules within critical platform systems such as the LLM gateway, model serving infrastructure, and enterprise integration patterns. Participate in writing ADRs and technical documentation.
- Participate in design reviews, contribute constructive feedback on pull requests, and collaborate with teammates on complex engineering challenges.
- Execute platform initiatives end to end within your scope-breaking down tasks, managing your work, and delivering quality outcomes in production.
- Support platform reliability efforts: contribute to Service Level Objective definitions, implement observability instrumentation, participate in incident response, and help improve platform stability.
- Implement governance and compliance controls-data residency, access management, audit logging-in alignment with enterprise requirements and established patterns.
- Collaborate with AI engineering, product, and cloud engineering teams; communicate technical context and trade-offs clearly in cross-functional settings.
- Contribute to team documentation habits, code quality, and shared engineering standards., What to Expect as Part of MassMutual and the Team
- Regular meetings with the AI Platform Engineering team
- Focused one-on-one meetings with your manager
- Networking opportunities including access to Asian, Hispanic/Latinx, African American, women, LGBTQIA+, veteran and disability-focused Business Resource Groups
- Access to learning content on Degreed and other informational platforms
- Your ethics and integrity will be valued by a company with a strong and stable ethical business with industry leading pay and benefits, In addition to top-line medical and dental coverage, personalized mental health solutions, on-site and virtual health coaching, and much more, MassMutual reimburses employees up to $1,250 per year for eligible expenses supporting mental, physical, and financial well-being.
Requirements
Do you have experience in SRE?, * 2+ years of experience in platform, infrastructure, or SRE roles, with demonstrated ownership of platform components or services.
- 2+ years of experience with cloud-native architecture across AWS, GCP, or Azure-containerized deployments, managed services, and basic multi-tenancy patterns.
- 2+ years of experience delivering platform features from development through production, with the ability to manage ambiguity within a defined scope.
- 2+ years of experience working with IaC and GitOps tools: Terraform or Pulumi, ArgoCD, and standard deployment patterns., * Familiarity with Kubernetes (CKA, CKAD, or equivalent AWS certifications a plus); working knowledge of cloud-native concepts including managed services, networking, and identity.
- Exposure to AI/ML infrastructure: model serving, inference pipelines, or LLM integration patterns.
- Clear written communication: ability to produce useful technical documentation and explain implementation decisions to teammates.
- Hands-on experience with LLM serving frameworks-vLLM, Triton, Ray Serve-or familiarity with AI gateway patterns.
- Exposure to FinOps principles or GPU cost considerations in inference workloads.
- Experience contributing to internal developer platforms (IDPs) with an appreciation for developer experience.
- Open-source contributions to platform or ML infrastructure tooling.
- Ability to influence peers through technical credibility and collaborative problem-solving.
- Comfort operating in ambiguous environments, with a habit of asking good clarifying questions and building shared understanding.
Benefits & conditions
3.73.7 out of 5 stars Boston, MA $134,400 - $176,400 a year - Full-time, Pulled from the full job description
- Tuition reimbursement
- 401(k)
- Health insurance
- Paid time off
- Dental insurance
- Bereavement leave
- Commuter assistance, There's more to your life than your job and there's more to your aspirations than a paycheck. We take a holistic view of compensation and benefits that provides the flexibility to create a healthy balance in your life for work, family, and community. We offer the benefits you'd expect, like medical, dental, 401(k), and generous vacation time, but we also offer ones you might not expect, like three paid days for volunteering, a $1,250 annual Well-Being Wallet, and up to 320 hours of caregiver leave.
Explore some of our offerings below.
Paid Time Off
- In addition to generous vacation time, paid holidays, and flexible holidays, MassMutual offers 'take care' time to care for yourself or someone you love-whether for physical illness or mental health., In addition to competitive salaries and bonuses, educational assistance programs, and much more, MassMutual offers up to a 10% total 401(k) benefit, consisting of a 5% company match and a 5% annual contribution.
Taking Care
MassMutual offers generous maternity and parental leaves, as well as bereavement leave to mourn the loss of a loved one (and the employee defines 'loved one'). In addition, we offer up to 320 hours of caregiver leave to help employees support loved ones in times of need.