Research Engineer, Computer Vision

Facebook Inc.
Pittsburgh, PA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Algorithm Design Computer Vision C++ (Programming Language) Python (Programming Language) Machine Learning Language Modeling Tensorflow Pytorch Large Language Models Deep Learning Information Technology

Job description

As a Research Engineer focused on Multi-Modal Understanding, you will develop advanced algorithms that integrate computer vision with other modalities such as language, audio, and sensor data. You will also drive the curation of multi-modal datasets and ground truth annotation pipelines to support model training and evaluation. You will work closely with our research team to bring innovative multi-modal solutions to production, bridging the gap between visual perception and holistic contextual understanding for immersive applications., * Design and implement multi-modal understanding systems that combine vision, language, and other sensory inputs to enable richer contextual awareness

  • Develop algorithms for cross-modal learning, fusion, and reasoning to improve human-AI interaction
  • Lead the curation and management of multi-modal datasets, ensuring data quality and diversity across vision, language, and sensor modalities
  • Design and oversee ground truth annotation workflows and quality assurance processes for multi-modal data
  • Complete medium to large features spanning multiple tasks independently with minimal to no guidance
  • Collaborate with researchers and engineers across computer vision and machine learning teams to drive multi-modal innovation
  • Develop well-organized code with proper testing and documentation, building production-ready multi-modal systems

Requirements

  • Proven experience with C++ and/or Python, including experience with modern features
  • Experience working with deep learning frameworks such as PyTorch and TensorFlow
  • Demonstrated experience working collaboratively in cross-functional teams

Preferred Qualifications:

  • Master’s degree in Computer Science, Computer Vision, Machine Learning, or related field
  • Experience with vision-language models or multi-modal transformers
  • Publications or contributions to multi-modal understanding research
  • Familiarity with large language models and their integration with visual understanding systems
  • Experience with data curation, annotation tools, or ground truth labeling pipelines

About the company

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobmonkeyjobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:11 min

Applying artificial intelligence frameworks for social good initiatives

Toju Duke · WWC 2022

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

1:25 min

Distinguishing artificial intelligence from deep learning

Sam Witteveen · Coffee With Developers

3:47 min

From crafted algorithms to deep learning and pattern recognition

Jonas Andrulis Jonas Andrulis · WWC 2024

2:36 min

Exploring high-level Python frameworks for accelerated enterprise artificial intelligence

Paul Graham Paul Graham · LIVE

Videos

See all

Related articles

See all