Research Engineer, Computer Vision

BINGHAMTOM UNIVERSITY
United States
14 days ago
Apply on www.themuse.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Shift work

Tech stack

Clean Code Principles Artificial Intelligence Computer Vision Batch Processing Cloud Computing Metadata Language Modeling Object Detection Sensor Fusion Systems Integration Video Editing Web Application Frameworks
+6 more
Pytorch Deep Learning Model Validation Backend Machine Learning Operations Autodesk Autocad

Job description

We are hiring a Senior Software Engineer focused on Computer Vision and Multimodal AI to build robust perception and understanding systems used across multiple teams and product areas. You will develop end-to-end pipelines that transform images and video into structured, reliable observations by combining modern vision models with multimodal reasoning and contextual signals (for example: domain metadata, documents, and sensor inputs)

This role blends applied research with strong software engineering: rapid iteration, rigorous evaluation, and production-minded implementation for cloud-scale batch processing and interactive workflows, * Design, build, and improve multi-stage computer vision pipelines that may include segmentation, detection, tracking, and VLM-based analysis, producing structured outputs (entities, attributes, actions/events, confidence, provenance)

  • Build systems that handle real-world variability in visual inputs (for example: low resolution, poor lighting, motion blur, cluttered scenes, inconsistent capture devices)
  • Work with diverse media types such as photos, video, timelapse, 360 video, and RGB-D when available
  • Fuse visual evidence with contextual inputs such as metadata, documents, and sensor streams to improve recognition quality and reduce ambiguity
  • Evaluate and integrate state-of-the-art vision and vision-language foundation models, including open-vocabulary recognition, grounded perception, segmentation, and multimodal reasoning
  • Apply fine-tuning or adaptation approaches when needed; partner with ML teams on training, data strategy, and infrastructure best practices
  • Define measurable acceptance criteria and benchmarking for accuracy, robustness, latency/cost, and reliability across datasets and domains
  • Build scalable cloud workflows for batch processing and integrate outputs with APIs and downstream consumers
  • Improve operational performance and cost via batching, caching, model selection, and pipeline observability
  • Write maintainable code, contribute to design docs, code reviews, shared libraries, and cross-team technical decisions

Requirements

  • Bachelor’s degree in Computer Science, Electrical Engineering, Robotics, or related field (or equivalent practical experience)
  • 4+ years of experience building computer vision systems using Python
  • Strong experience with deep learning for computer vision (detection, segmentation, and/or video understanding) using modern frameworks such as PyTorch
  • Experience taking ML prototypes into reliable pipelines, including evaluation, monitoring, and failure analysis
  • Experience building or integrating ML systems into cloud or backend workflows (batch processing and/or services)
  • Strong collaboration and communication skills; ability to work across teams and stakeholders, * Experience with vision-language models (VLMs) and multimodal systems (for example: grounded vision, open-vocabulary recognition, retrieval-augmented multimodal reasoning)
  • Experience with multimodal fusion (combining imagery/video with metadata, documents, and sensor signals)
  • Experience with video pipelines (tracking, temporal aggregation, long-video processing)
  • Experience with real-world datasets, including data curation, labelling strategy, augmentation, and quality control under limited data constraints
  • Experience developing reusable platform components adopted across multiple teams

What Success Looks Like

  • Delivered an end-to-end system that ingests real-world image/video inputs and outputs a structured, queryable set of observations (objects plus activities/events), with clear accuracy and reliability metrics
  • Demonstrated robustness to common visual failure modes (lighting, occlusion, clutter, camera variation) and measurable improvements when contextual signals are available
  • Built a modular pipeline architecture (segmentation/detection/VLM reasoning components) that can be reused and extended across domains and teams
  • Maintained strong engineering quality: reproducible experiments, documented decisions, maintainable code, and dependable integrations

Keywords (for candidate matching)

Computer Vision, Deep Learning, PyTorch, Object Detection, Segmentation, Tracking, Video Understanding, Vision-Language Models (VLM), Multimodal AI, Open-Vocabulary, Grounding, Sensor Fusion, Data Curation, Model Evaluation, Benchmarking, Cloud ML Pipelines, Batch Processing, MLOps, Observability

LI-JK3

Benefits & conditions

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.

Diversity & Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

About the company

Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk - it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.

When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.themuse.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

Videos

See all

Related articles

See all