Senior ML / AWS Engineer - Pipeline Hardening, Governance & Integrations
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
You’ll own the parts of the systems that make them trustworthy and connected: hardened batch pipelines, model governance and lineage, and the external data integrations the systems depend on. In a regulated setting this is not back-office work - the ability to show exactly how a model was trained, on what data, and why it flagged an account is a core requirement, and this seat owns it. The second seat arrives as the DeFi integration surface materializes: attribution vendors, chain-data providers, and the international exchange’s market-metadata feeds.
What you’ll do:
- Hardening and maintaining the batch pipelines and feature infrastructure the models run on. This is proven, high-value work: turning multi-hour hangs into completing jobs took real data-skew engineering (pre-aggregation, windowing, connection-pool and capacity tuning), and that discipline needs a permanent owner.
- Model governance: versioning, lineage, reproducibility, and audit-ready records of how every model and flag was produced. We already stamp model-package version, scoring-run ID, and feature-snapshot time on every score, gate registration behind quality checks, and run a feature-contract check that stops a run rather than silently scoring on drifted features. This seat extends and defends that - across both estates.
- The external integrations that feed the systems - surveillance-vendor feeds (Eventus, in first-wave AWS ingestion), screening providers (PEP/sanctions), KYC/identity sources (a live feed plus historical), market/event data, and, as the DeFi build ramps, blockchain-attribution vendors and chain-data providers.
- The MLOps tooling that keeps deployments consistent and reversible.
- Keeping the systems audit-ready as they grow, in partnership with data science and compliance.
Requirements
- 5+ years of experience in data / ML pipeline engineering
- Hands-on MLOps: model registries, versioning, lineage, and reproducible deployment
- Experience building and maintaining third-party API and data integrations
- Production AWS experience
- Comfort working to governance and audit requirements; regulated-domain experience a plus
Benefits & conditions
The base pay for this position is $190,000-290,000. A bonus will be provided as part of the compensation package, in addition to a full range of medical, financial, and/or other benefits.
About the company
At TWG AI, we drive innovation and business transformation across a range of industries-including financial services, insurance, technology, media, and sports-by leveraging data and AI as core assets. Our AI-first, cloud-native approach delivers real-time intelligence and interactive business applications, empowering informed decision-making for both customers and employees.
We prioritize responsible data and AI practices, ensuring ethical standards and regulatory compliance. Our decentralized structure enables each business unit to operate autonomously, supported by a central AI Solutions Group, while strategic partnerships with leading data and AI vendors fuel game-changing efforts in marketing, operations, and product development.
You will collaborate with management to advance our data and analytics transformation, enhance productivity, and enable agile, data-driven decisions. By leveraging relationships with top tech startups and universities, you will help create competitive advantages and drive enterprise innovation.
At TWG, your contributions will support our goal of sustained growth and superior returns, as we deliver rare value and impact across our businesses.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production
MLOps – What’s the deal behind it?
Dev Digest 120 - Apple and peers