Senior/Staff Software Engineer - Perception & Sensing

• Execute the PCP metrics pipeline, assessing how hardware updates across various sensors impact PCP performance sensitivity in 3D scene understanding, live mapping and localization, especially in adverse weather and winter conditions.
• Design and run structured A/B testing experiments, including side-by-side custom mount runs and tandem vehicle data collection, to clear sensors for the winter ODD.
• Collaborate with AHE to correlate sensor-specific lab tests (e.g., heater/defroster impacts on camera lenses, snow accumulation on radomes) to downstream PCP performance.
• Root cause detection regressions to understand how early fusion models compensate for modality degradation in challenging environments.
• Design & develop performant and efficient multi-sensor fusion model to leverage the complementary advantage of on-board (low cost) sensors to improve Perception performance for highway and adverse weather.

Do you have experience in Data collection?, * Strong C++ and Python for running and modifying PCP metrics pipelines, automated testing, and re-simulations.

• Experience with A/B testing methodology (RBV - Risk Balanced Verification) for evaluating hardware/software changes in varied environments.
• Familiarity with diverse perception outputs and how environmental factors (like snow or fog) degrade bounding box precision/recall, point clouds, and 3D occupancy.
• Ability to define complex data collection plans for winter ODDs (e.g., specific snow types, ice, low temperatures).
• Experience with designing, developing and deploying multi-modality fusion based Perception models for 3D object detection, 3D segmentation & occupancy, Mapping and Localization., * Experience in performance optimization to fit complex ML stack to low-power low cost edge compute (e.g., Nvidia Thor, TensorRT optimization).
• Experience with designing better sensor or better ML model for an anomaly or rare event/objects detection

Pulled from the full job description

• Health insurance
• Paid time off
• Life insurance
• RSU, Base Salary Range There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position. Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.