Perception Machine Learning Engineer

AIM Intelligent Machine, Inc.
Seattle, United States
3 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Computer Vision C++ (Programming Language) Software Debugging Python (Programming Language) Machine Learning Object Detection Tensorflow Sensor Fusion Software Engineering Pytorch Machine Learning Operations Lidar
+1 more
Data Pipelines

Job description

  • Architect and develop perception algorithms for scene understanding, obstacle detection, terrain modeling, and machine awareness.
  • Advance AIM’s perception stack including sensor fusion, environment modeling, and machine-centric perception pipelines.
  • Develop algorithms that operate reliably in complex, dynamic earthmoving environments.

Build Production Machine Learning Systems

  • Develop and deploy machine learning models for perception tasks including object detection, segmentation, depth estimation, and terrain understanding.
  • Optimize models for real-time inference on edge compute platforms.
  • Build scalable data pipelines for training, evaluation, and model iteration.

Integrate Perception with the Autonomy Stack

  • Collaborate with robotics, controls, systems, and software teams to integrate perception outputs into planning and control systems.
  • Ensure perception systems interact correctly with localization, SLAM, mapping, and safety systems.
  • Design perception interfaces that are robust, testable, and observableResponsibilities

  • Advance AIM’s perception stack and sensor fusion algorithms
  • This involves breaking new ground as earth moving machines don’t merely navigate on existing mapped roads - they modify and build the environment as they work which poses interesting novel challenges
  • Research and development of state-of-the-art machine learning methods
  • Comfortable with hands-on applications on machines deployed in the field
  • Apply real-world experience with localization and SLAM state-of-the-art methods

Requirements

You’re an engineer who loves solving difficult perception problems where machine learning meets the physical world.

You have experience building production machine learning systems that operate on real hardware, not just in research environments. You understand how perception algorithms behave under real-world constraints such as sensor noise, environmental variability, limited compute, and incomplete data.

You enjoy working across the full perception stack - from sensor data ingestion and calibration, through model development and training, to deployment on edge compute and real-time inference pipelines.

You take ownership of outcomes, not just models. You debug deeply, validate rigorously, and iterate quickly using field data to continuously improve system performance.

You’re motivated by building perception systems that enable safe, reliable autonomy in environments where failure is not acceptable.

As a Senior Perception Machine Learning Engineer, you will design, develop, and deploy the perception systems that allow AIM’s autonomous machines to understand and interact with their environment., Core ML Fundamentals

  • Experience designing, training, and evaluating machine learning models
  • Strong understanding of the mathematics behind training (optimization, gradients, regularization, bias-variance tradeoff)
  • Familiarity with training dynamics (overfitting, underfitting, convergence issues, data imbalance)
  • Excellent grasp of machine perception methods in 2D and 3D (depth sensing)
  • Experience with perception sensor calibration techniques (camera, lidar, radar, etc.)

Computer Vision Fundamentals

  • Experience working on real-world computer vision problems (classification, detection, segmentation, tracking, etc.)
  • Understanding of image representations, augmentations, and data preprocessing strategies
  • Awareness of common architectures and when to use them (CNNs, transformers, hybrid approaches)
  • Ability to reason about evaluation metrics and tradeoffs (precision/recall, mAP, IoU, etc.)Proven track record of deployed ML-based perception systems, ideally on autonomous vehicles

Overall Engineering Skillset

  • Experience shipping production models
  • Excellent software development skills in python
  • Proficiency in Tensorflow, PyTorch, Python, C++
  • Creativity and curiosity for solving complex problems

About the company

About AIM Intelligent Machines

Curious if you want to terraform earth?

Everything humanity depends on is mined, dug, or grown. At AIM, we are building the autonomous linchpin of civilization. We transform heavy machinery-bulldozers, loaders, excavators-into AI-powered fleets that operate continuously, safely, and at peak performance in the world’s harshest environments.

AIM runs production mines, large scale infrastructure builds, and defense operations as a TRL9 hardened system, not a science experiment. We have been automating this massive space with embodied AI and emerged as the market choice for ground engagement autonomy.

Built by engineers from mining, construction, Waymo, SpaceX, Google and Tesla, AIM enables scalable earthmoving, turbocharging the global economy’s physical foundation. AIM is backed by some of the most sophisticated capital in the world, including General Catalyst, Khosla Ventures, Elad Gil, Human Capital, Ironspring Ventures, Mantis, DCVC., Joining AIM, You Will

  • Solve a massive set of real-world problems that require scalable earth moving
  • Accomplish that via deploying and expanding cutting edge tech
  • Run your workstreams with the largest degree of autonomy
  • Have an opportunity for rapid growth and a large voice on the direction of the company
  • Receive company funded medical, dental, vision, 401k, life insurance, gourmet food & perks
  • Experience a strong onsite collaboration (AIM offices, labs and proving grounds on the east side of the Greater Seattle area)
  • Have an opportunity to travel to unique sites around the world (Americas, Australia, Africa & more)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:17 min

Validating lidar sensor models against real noise

Ulrich Wurstbauer +1 · LIVE

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · World Congress 2025

2:08 min

Processing physical environment data with lidar models

Oliver Zimmert · LIVE

49 sec

Developing verifiable safety metrics for automated driving perception

Nico Schmidt · LIVE

Videos

See all

Related articles

See all