Software Engineer, Sensors & Computer Vision

Reality Labs (RL) Sensors Team at Meta is helping build novel products in Augmented and Virtual Reality. Our team explores, develops, and delivers new cutting-edge sensing technologies that serve as the foundation of current and future AR/VR products at Meta. Sensors are a crucial component for enabling core features on our products such as world-locked rendering, hand, body & eye tracking, image stabilization, scene reconstruction, mapping, and health sensing.The team is composed of a multi-disciplinary team of engineers and scientists. We work cross-functionally across multiple products to deliver sensing solutions tailored for the requirements and constraints of each particular product/feature and develop platform technologies that can be reutilized across multiple products and product lines.We are looking for Software Engineers with experience in sensor technologies and want to build performant and scalable software pipelines for sensor fusion and multi-modal machine learning algorithms for AR/VR. In this role you will define and implement software frameworks and tools for efficient ingestion of sensor data, scalable model training and neural network architecture development, visualization of complex multi-modal sensor data, and more. You will collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next generation sensor systems, including alternative sensing modalities and novel sensing algorithms.

Required Skills:

Software Engineer, Sensors & Computer Vision Responsibilities:

1. Design and develop new frameworks and core software components to implement, optimize, visualize, and debug sensor fusion and machine learning algorithms
2. Design and implement state-of-the-art Machine Learning Algorithms using PyTorch, TensorFlow, or other platforms
3. Develop relationships and lead engagements with internal and external industrial and research partners to develop and scale novel technologies from incubation to production
4. Collaborate with other engineers and researchers across Meta to develop new concepts and technologies for next-generation sensor systems, including alternative sensing modalities and novel sensing algorithms that advance the state-of-the-art in AR/VR systems

5. 5+ years of experience coding with C++ and Python for design and development of sensor fusion and machine learning technologies and systems
6. Demonstrated experience with modern machine learning frameworks such as PyTorch or TensorFlow
7. Familiarity with modern machine learning algorithms, specifically deep Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), transformers, clustering, and dimensionality reduction
8. Experience with common digital signal processing techniques such as digital filtering, Fourier transform, correlation, and modulation
9. Experience in designing software systems and machine learning models targeted for edge devices

Preferred Qualifications:

Preferred Qualifications:

10. Familiarity with the emerging augmented reality and virtual reality technologies
11. Demonstrated experience in cross-group and cross-culture collaboration
12. Proven track record of achieving significant results as demonstrated by patents or first-authored publications
13. Experience developing novel approaches to complex technical problems, such as proposing new architectures, algorithms, or system designs
14. Familiarity with Simultaneous Localization and Mapping (SLAM) and Visual Inertial Odometry (VIO)
15. Experience with cameras and 3D image reconstruction techniques
16. Familiarity with cameras, inertial sensors, pressure sensors, magnetometers, and/or similar sensors