Senior Engineer, Autonomy ML Systems

The Autonomy Subsystems team at Motional is focused on designing and evaluating modules of the autonomy software. We are seeking a talented senior engineer to contribute to evaluation of our machine learning subsystems. Our team performs a variety of evaluations of machine learning models, including offline model eval, evaluation of open and closed-loop re-simulations, and assessment of on-road performance. Our goal is to establish metrics that describe autonomy subsystem performance, evaluate against those metrics to validate performance, and provide meaningful insight to ML developers and teams, working closely alongside them to improve the performance of ML models on the car., We are looking for a highly-technical systems engineer with experience designing and evaluating safety critical systems and machine learning models. Bring your passion for autonomy, robotics, and machine learning to our team to help build a production-ready system and prepare for our scaled robotaxi service deployment., * Define, prototype, and validate advanced metrics that bring new insights to model performance evaluation for autonomy subsystems (mainly focused on perception, prediction, and planning).

• Assess coverage of existing training and testing, then curate test sets that sufficiently capture Motional's intended deployment operational design domain, across many axes (agent types, interaction types, map/spatial, etc.).
• Evaluate machine learning model performance against these metrics and tests.
• Assess system-level performance and subsystem contribution to system behavior through large-scale data analysis of on-road and simulation events.
• Define performance requirements for autonomy subsystems, and supporting analyses required to establish these targets.
• Coordinate subsystem-level evaluation with other system-level testing efforts across the systems team in support of the safety case and safety claims.

• An engineer who has demonstrated strong cross-functional collaborative skills and is highly self-starting. This is a highly cooperative role across systems, autonomy, infrastructure, and other parts of the organization.
• Proven engineer with 5+ years of experience working on high-tech safety critical systems or robotics, ideally from a systems, robotics, or similar background.
• Master's degree in relevant fields (systems, robotics, ML, CS, etc.) or Bachelor's degree plus significant relevant in-field experience.
• Skilled Python developer, familiarity with analyzing the large scale data required to train and test ML models.
• Experience designing unique metrics that capture key aspects of system behavior and are used to enhance model development.

Bonus Skills:

• Experience training machine learning models, familiarity with state-of-the-art ML model architectures.
• Deep experience with a specific aspect of machine learning for autonomous robotics (perception, prediction, or planning).
• Knowledge of C++, especially applied to safety critical systems.
• Experience with systems verification and validation techniques
• Experience with regression testing updates to already-deployed software in a safety-critical environment.
• Experience with automotive standards (E.g: ISO 12207, ISO 26262, ISO 21448)
• Experience with software quality management and assurance activities (E.g: IATF 16949, ISO 9001)
• Thorough understanding of robotics systems including sensors, actuators, mechatronics and software systems
• Work in cross collaboration teams to address problems and find solutions

Physical Demands:

While performing the duties of this job, the employee is frequently required to sit, talk, or hear. The employee is occasionally required to stand and at times for long periods; walk; use hands to finger, handle, or feel; reach with hands and arms. The employee must occasionally lift and move up to 50 pounds.

Motional is a leading autonomous driving company on a mission to make driverless vehicles a safe, reliable, and accessible reality. Backed by Hyundai Motor Group, Motional is at the forefront of the physical AI revolution. Motional isn't just building first-of-its-kind technology; we are transforming transportation to create safer streets and more sustainable mobility options. The Systems Readiness and Performance team is the crucial bridge between software development and real-world deployment. We are responsible for driving system design, for verifying and validating the autonomy stack, and for defining, measuring, and validating system performance targets. We work closely with stakeholders in autonomy, infrastructure, and operations to build the definitive safety case for the commercial launch of our fully driverless IONIQ 5 robotaxis in Las Vegas later this year., Motional AD LLC is an Equal Employment Opportunity employer and we welcome all qualified applicants. All applicants will receive impartial consideration without regard to race, sex, color, national origin, age, disability, veteran status, genetic data, religion, gender identity, sexual orientation or other legally protected status. Motional AD LLC is a Drug-free workplace. Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. We're driven by something more. Our journey is always people first. We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect. Our team is made up of engineers, researchers, innovators, dreamers and doers, who are creating a technology with the potential to transform the way we move. Higher purpose, greater impact. We're creating first-of-its-kind technology that will transform transportation. To do so successfully, we must design for everyone in our cities and on our roads. We believe in building a great place to work through a progressive, global culture that is diverse, inclusive, and ensures people feel valued at every level of the organization. Diversity helps us to see the world differently; it's not only good for our business, it's the right thing to do. Scale up, not starting up. Our team is behind some of the industry's largest leaps forward, including the first fully-autonomous cross-country drive in the U.S, the launch of the world's first robotaxi pilot, and operation of the world's longest-standing public robotaxi fleet. We're driven to scale; we're moving towards commercialization of our technology, and we need team members who are ready to embrace change and challenges. Formed as a joint venture between Hyundai Motor Group and Aptiv, Motional is fundamentally changing how people move through their lives. Headquartered in Boston, Motional has operations in the U.S and Asia. For more information, visit www.Motional.com and follow us on Twitter, LinkedIn, Instagram and YouTube. Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility.