Remote Senior Machine Learning Engineer
Role details
Job location
Tech stack
Job description
- Design and build data pipelines for agent training, including collection, filtering, deduplication, formatting, and versioning across text, image, and multimodal sources.
- Build and maintain infrastructure for efficient data loading, storage, and retrieval at scale.
- Collaborate with research scientists to translate research requirements into concrete data specifications and iterate as experiments reveal new needs.
- Create evaluation datasets and benchmarks in collaboration with researchers, curating task distributions that surface real failure modes.
- Develop tooling for dataset construction, including human annotation workflows, synthetic data generation, and preference data collection for RLHF/DPO-style training.
- Own data quality by building validation frameworks, monitoring for drift and contamination, and establishing standards for trustworthy and reproducible datasets.
- Document datasets thoroughly, including provenance, known limitations, intended use cases, and versioning history.
- Implement comprehensive test coverage for data pipelines and ML workflows to ensure reliability and catch regressions early.
- Elevate codebase quality through code reviews, refactoring, and establishing engineering best practices that help research velocity scale sustainably.
- Contribute to team roadmaps by identifying data bottlenecks and proposing solutions that unblock research velocity.
Technologies:
- AI
- Cloud
- DevOps
- Support
- LLM
- Python
- AWS
- HTTP
- Machine Learning
Requirements
- Strong software engineering skills in Python, with experience building production-grade data pipelines and ML DevOps.
- Practical experience with prompt engineering, designing, testing, and refining prompts for reliable LLM/VLM outputs.
- Experience with ML data workflows, including large-scale data processing and loading, data versioning, and training format considerations such as tokenization, batching, and sharding.
- Hands-on experience working with data pipelines for large-scale distributed ML training runs.
- Familiarity with annotation tooling and human-in-the-loop data collection.
- Understanding of ML training requirements and what good data looks like for LLM/VLM fine-tuning.
- Experience loading and writing large datasets to and from cloud infrastructure and distributed storage systems.
- Strong communication skills to scope ambiguous problems and translate needs into actionable plans.
- A collaborative approach, with comfort taking ownership and iterating quickly.
- Experience with preference data collection for RLHF or reward modelling.
- Familiarity with multimodal data such as image-text pairs, video, and design assets.
- Experience building synthetic data generation pipelines using LLMs.
- Background in data quality metrics and monitoring systems.
- Contributions to dataset releases or benchmarks in the ML community.
About the company
We're a global online visual communications platform on a mission to empower the world to design. Featuring a simple drag-and-drop user interface and a vast range of templates ranging from presentations, documents, websites, social media graphics, posters, apparel to videos, plus a huge library of fonts, stock photography, illustrations, video footage, and audio clips, anyone can take an idea and create something beautiful on Canva on any device, from anywhere in the world.
Since our launch in 2013, we’ve had the crazy big goal of making design accessible to everyone. We were founded on the belief that people shouldn't need to understand complex software to unlock their creativity. We’re leveling the playing field and democratizing access to design and visual communication by empowering 100% of the world to communicate in a way that was once limited to the 1%.
We've always had a deeper mission surrounding Canva — which we talk about as our 'simple' two-step plan: to build one of the world’s most valuable companies, and to do the most good we possibly can. We're committed to our core value of Being a Force for Good, so as the value of our company grows, so too does our ability to have a positive impact on the world.