> Markdown version of [/jobs/ext/1647408-principal-engineer-python-api-development](https://www.wearedevelopers.com/jobs/ext/1647408-principal-engineer-python-api-development). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Engineer - Python API Development - **Company:** Fmr LLC - **Location:** Coppell, TX, United States - **Experience:** Expert - **Salary:** $107,000.0 - $216,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon S3, Computing Platforms, Automation of Tests, Microsoft Azure, Cloud Computing, Code Review, Continuous Integration, Data Architecture, Linux, DevOps, Distributed Systems, Groovy, Python (Programming Language), Machine Learning, Routing, Open Source Technology, Performance Tuning, Azure Machine Learning, Software Engineering, Web Services, Enterprise Data Management, Scripting, Enterprise Software Applications, Cloud Platform System, Cloudformation, Containerization, Git Flow, Information Technology, Deployment Automation, Api Design, Cloudwatch, Amazon Simple Queue Service (SQS), Terraform, Docker, Jenkins - **Published:** July 3, 2026 - **Apply:** https://www.careerboard.com/us/en/find-jobs-in-United-States/-048F6A33F9896F2D82/ ## About the Role * Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related engineering discipline; 8+ years (typically 10+) building and operating production platforms and services at scale. * Deep software engineering expertise in Python and distributed systems, with a track record of building production-grade services, libraries, and internal platforms. You model engineering excellence through clean designs, automated testing, and maintainable abstractions; Linux fluency and Scripting are required. * Familiarity with Java or Groovy is a plus. * Knowledge or experience with GenAI Gateways or LiteLLM a big plus. * Cloud platform leadership (AWS)-hands-on with S3, Lambda, Batch, Step Functions, EventBridge, CloudWatch, and SNS/SQS-and experience shaping platform patterns that other teams adopt. Experience enabling managed ML services (eg, SageMaker) as part of broader platform capabilities; exposure to Azure or GCP is beneficial. * DevOps and CI/CD at scale, owning standards for automated build/test/deploy (eg, Jenkins, Git-based workflows), containerization (Docker), release governance, and multi-environment promotion for ML-enabled workloads. * Infrastructure as Code (CloudFormation, Terraform/OpenTofu) and platform reliability engineering (SLOs/error budgets, capacity planning, cost observability, incident response, and post-mortems) for ML serving and data/feature pipelines. ## Description As a Principal Engineer on the Enterprise AI/ML Platform team, you will tackle the most complex technical challenges involved in delivering machine learning at enterprise scale. You will design, build, and evolve reliable, secure, and cost-efficient platform capabilities-from model packaging and serving to observability and lifecycle management-working closely with multiple teams to ensure these capabilities are practical, robust, and widely usable in production. You will take a hands-on role across enterprise repositories, improving shared services, CI/CD workflows, and infrastructure patterns where they have the greatest impact. This includes deep technical investigation of performance and scalability issues, such as tracking down bottlenecks in web services, analyzing system and application metrics, and optimizing GPU utilization, throughput, and resource efficiency across ML workloads. The Expertise & Skills You Bring, * ML enablement in production: model packaging, deployment strategies (batch/online/streaming), inference routing, traffic management, performance tuning, observability, and controls for responsible use-without a research or modeling focus. * Cross-org technical leadership: you mentor junior and senior engineers, are a backbone of code review across repos, and routinely consider impacts on upstream/downstream systems when proposing changes. * Set platform strategy and standards for ML packaging, deployment, serving, and observability-driving consistent adoption across squads and business units. * Partner with Data Scientists to package, scale, and operationalize models; define the APIs, guardrails, and automation that take work from experimentation to reliable production. * Enable secure, scalable access to traditional and generative models by collaborating with platform and application engineers to integrate through enterprise gateways and services. * Advance model/data observability-tooling for data and feature drift detection, prediction-quality monitoring and uncertainty signals, and automated diagnostics/explainability. * Lead cross-platform incident response and post-mortems, drive systemic fixes, and evolve standards to prevent recurrence-across applications and the platform. * Uplevel engineering velocity by introducing reusable frameworks, paved paths, and CI/CD templates that simplify integration, reduce toil, and improve reliability at scale. * Reduce cost and complexity across the ML ecosystem through pragmatic technology choices, clear abstractions, and a long-term platform roadmap. The Team The Enterprise Data Science Platform, part of the Fidelity Data Architecture team within the Enterprise Technology business unit, is responsible for delivering scalable AI/ML capabilities across the organization. The team designs and builds advanced cloud-based, open-source, software platforms in close collaboration with Data Scientists, enabling the efficient packaging, deployment, and operation of AI/ML models at production scale. In addition, the platform develops and maintains enterprise-grade gateways that allow teams across the company to securely discover, access, and consume AI/ML models. These gateways provide critical visibility into model usage and costs, while generating insights into model effectiveness, adoption patterns, and opportunities for continuous improvement. The base salary range for this position is $107,000-216,000 USD per year. ## Related Videos - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)