Software Engineer III - AI/ML Platform Operations - Remote

CSAA Insurance Services, Inc.
Boston, MA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$105,345.0 - $140,550.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) JavaScript (Programming Language) Artificial Intelligence Amazon Web Services Software as a Service Cloud Computing Databases Continuous Integration Information Engineering Data Integration Dataspaces DevOps
+30 more
Github Monitoring of Systems Python (Programming Language) Machine Learning Apache Maven Node.Js Reliability Engineering Prometheus Azure Machine Learning Software Engineering TypeScript Datadog Data Logging System Availability Large Language Models Grafana Software Troubleshooting Generative AI Containerization AI Platforms Kubernetes Information Technology Deployment Automation Data Management Machine Learning Operations Cloudwatch Splunk Serverless Computing Jenkins Databricks

Job description

Your Role: We are seeking a Software Engineer - AI/ML Platform Operations to lead the operational excellence, reliability, and support of our enterprise AI and data platforms. This role is responsible for ensuring the stability, scalability, observability, governance, and operational readiness of AI/ML solutions that power critical business capabilities.

This is not a traditional software application development role. While strong software engineering skills are essential, the primary focus is on AI platform operations, MLOps, automation, reliability engineering, deployment support, observability, governance, and continuous improvement of enterprise AI capabilities.

Your Work: You will work across a modern technology ecosystem that includes Palantir Foundry, AWS Bedrock, Amazon SageMaker, cloud-native services, and emerging Generative AI technologies. You will partner with Data Engineering, Data Science, Architecture, Infrastructure, Security, and Product teams to support production AI workloads and enable the successful adoption of AI capabilities across the organization.

AI Platform Operations & Reliability

  • Provide technical leadership for AI/ML platforms including Palantir, AWS Bedrock, Amazon SageMaker, and related cloud-native technologies.
  • Ensure platform reliability, scalability, performance, security, and operational readiness for production AI workloads.
  • Support deployment, monitoring, maintenance, and lifecycle management of AI/ML solutions and Generative AI services.
  • Establish operational standards, support models, service-level objectives (SLOs), and platform governance practices.

MLOps, Automation & Observability

  • Design and implement automation, monitoring, observability, and operational tooling to improve platform reliability and efficiency.
  • Develop and maintain dashboards, health metrics, alerts, logging frameworks, and operational runbooks.
  • Enhance CI/CD pipelines, deployment automation, infrastructure-as-code, and model release processes.
  • Implement best practices for MLOps, model monitoring, model lifecycle management, and AI operational governance.

Incident Management & Problem Resolution

  • Serve as a senior escalation point for complex production issues involving AI platforms, machine learning workloads, cloud infrastructure, and data integrations.
  • Lead root cause analysis efforts and drive corrective and preventive actions to improve platform stability.
  • Solve performance, availability, deployment, and integration issues across AI and data ecosystems.
  • Partner with engineering and business teams to rapidly restore service and minimize operational risk.

Technical Leadership & Collaboration

  • Provide mentorship, technical guidance, and operational expertise to engineers and platform teams.
  • Influence platform strategy, architecture decisions, operational processes, and technology adoption.
  • Collaborate with team members to align platform capabilities with business priorities and AI adoption goals.
  • Communicate complex technical concepts effectively to both technical and non-technical audiences.

Continuous Improvement & Innovation

  • Remain current with advancements in AI/ML, Generative AI, cloud technologies, platform engineering, and reliability practices.
  • Identify opportunities to improve operational efficiency, governance, security, and developer experience.
  • Champion modern engineering practices including automation, observability, DevOps, Site Reliability Engineering (SRE), and AI Operations (AIOps)., Sustainability: As climate change leads to more frequent and severe weather events, we are taking bold action to build more resilient communities and reduce our environmental impact. Submit your application to be considered. We communicate via email, so check your inbox and/or your spam folder to ensure you don’t miss important updates from us., If you apply and are selected to continue in the recruiting process, we will schedule a preliminary call with you to discuss the role and will disclose during that call the available salary/hourly rate range based on your location. Factors used to determine the actual salary offered may include location, experience, or education.

Requirements

  • 3+ years of progressive experience in software engineering, platform engineering, cloud operations, MLOps, DevOps, or related technical disciplines.
  • Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
  • Experience supporting production cloud-based applications and services in AWS environments.
  • Strong experience with software engineering and automation using languages such as Python, Java, JavaScript/TypeScript, or Node.js.
  • Experience with CI/CD, build, integration, and deployment tools such as Jenkins, Maven, GitHub Actions, or equivalent.
  • Experience with cloud-native services including compute, storage, networking, databases, and serverless architectures.
  • Experience building and maintaining operational monitoring, observability, and alerting solutions.
  • Strong troubleshooting, incident response, and root cause analysis skills.
  • Excellent communication, collaboration, and technical leadership capabilities.

What would make us excited about you?

  • Experience with AI/ML platforms such as Palantir Foundry, Amazon SageMaker, AWS Bedrock, Databricks, or similar ecosystems.
  • Experience supporting Generative AI applications, LLM-based solutions, prompt orchestration frameworks, and Retrieval-Augmented Generation (RAG) architectures.
  • Knowledge of MLOps practices including model deployment, monitoring, governance, experimentation, and lifecycle management.
  • Experience with observability and monitoring platforms such as Datadog, Splunk, Grafana, Prometheus, CloudWatch, or OpenTelemetry.
  • Familiarity with AI governance, responsible AI principles, model risk management, and operational controls.
  • Relevant cloud, AI/ML, DevOps, or platform engineering certifications
  • Actively shapes our company culture (e.g., participating in employee resource groups, volunteering, etc.)
  • Lives into cultural norms (e.g., willing to have cameras when it matters: helping onboard new team members, building relationships, etc.)
  • Travels as needed for role, including divisional / team meetings and other in-person meetings
  • Fulfills business needs, which may include investing extra time, helping other teams, etc

Benefits & conditions

Pulled from the full job description

  • 401(k) matching, Recognition: We offer a total compensation package, annual bonus eligibility for most roles, 401(k) with a company match, and so much more! Read more about what we offer and what it is like to be a part of our dynamic team at https://careers.csaainsurance.aaa.com/us/en/benefits., The national average salary range for this position is $105,345.00-$117,050.00. However, we have a location-based compensation structure. Our salary ranges vary and are calculated based on work location. The starting pay range for this position across all the states we hire in is $105,345.00-$140,550.00. This role also includes an opportunity for a company-wide annual discretionary bonus, through our Annual Incentive Plan (AIP), of up to 8% of eligible pay.

About the company

CSAA Insurance Group (CSAA IG), a AAA insurer, is one of the leading personal lines property and casualty insurance groups in the United States. Here, every employee shapes our mission. We build innovative, human-centered solutions that help AAA members prevent, prepare for, and recover from life’s uncertainties. You will join a collaborative, inclusive culture where your strengths have room to grow and your ideas can drive real impact. Step into a role where you can contribute to our shared success through meaningful work., Career Growth: We believe in growth for everyone. Here at CSAA IG, leaders and mentors partner with employees to align interests, unlock development opportunities, and support long-term success.

Flexible Workplace: We embrace a remote-first culture through our Flexible Workplace. Most employees hold Home-Flex roles, working primarily from home, often with the flexibility to work from various locations including CSAA offices. Our flexible workplace empowers you to balance remote work with intentional in-person moments that deepen connection and collaboration.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

2:38 min

Establishing comprehensive monitoring and log management

Michael Eder +1 · LIVE

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all