Principal Vision Systems Engineer
Role details
Job location
Tech stack
Job description
We are seeking a Principal Vision Systems Engineer to lead the development of a next-generation ultra-high-speed, ultra-low-latency vision-based position feedback system for precision control of magnetically levitated rigid bodies.
This role will serve as the technical owner of the vision system, overseeing the co-development of a custom smart camera and FPGA-based image processing platform and delivering real-time 6DOF pose estimation with deterministic latency performance (<100 s) and high update rates (>2 kHz).
The successful candidate will work across computer vision, embedded systems, FPGA architecture, and control system integration to enable closed-loop control performance beyond current commercial solutions., System Architecture & Technical Leadership
- Own the end-to-end vision system architecture:
- Image acquisition
- FPGA-based processing
- Target extraction
- 6DOF pose estimation
- Controller interface and synchronization
- Define HW/SW/FPGA partitioning aligned with performance goals
- Lead design trade-offs (resolution vs speed vs latency vs field of view)
Algorithm Development (Real-Time / FPGA-Oriented)
- Develop algorithms for:
- Sub-pixel target extraction
- Multi-body tracking
- Real-time 6DOF pose estimation
- Translate prototype algorithms (MATLAB/Python) into FPGA-compatible implementations
- Optimize for deterministic latency and minimal jitter
FPGA Co-Development Oversight
- Collaborate with external partner on:
- Smart camera development
- FPGA processing pipelines
- Guide FPGA implementation strategy and architecture
- Participate in design reviews and risk mitigation
Controller Integration & Closed-Loop Performance
- Define low-latency interfaces between vision system and controller
- Ensure deterministic timing and synchronization
- Validate performance in closed-loop control applications
Performance Validation & Testing
- Define validation plans for:
- Latency and jitter
- Spatial accuracy
- Multi-target tracking robustness
- Benchmark against existing systems
Sensor & Optical System Specification
- Lead evaluation of:
- High-speed CMOS sensors
- Precision optical systems
- Support system-level trade studies
Program Leadership
- Serve as technical interface to external development partner
- Drive architecture definition and technical milestones
- Lead cross-functional collaboration (controls, hardware, software), 5. Key Performance Objectives
- Deliver system architecture supporting:
-
2 kHz update rate
- <100 s latency
- Complete FPGA-based proof-of-concept with external partner
- Demonstrate stable low-jitter performance in closed-loop control
- Enable integration into levitated rigid body system, At Brooks, we aim to foster a collaborative and engaging environment while offering flexibility where possible. Work arrangements may include a mix of in-office and remote work, depending on the nature of the role and business needs. Specific expectations will be shared during the interview process.
Brooks is committed to fostering a diverse and inclusive workplace and proudly serves as an equal-opportunity employer. We welcome all qualified applicants regardless of race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other legally protected characteristics.
Diversity enhances our innovative capabilities and strengthens our ability to serve our customers and communities effectively. At Brooks Automation, we celebrate the unique experiences and perspectives each individual brings, believing they are essential to our collective success. Join us in building a workplace where every team member is valued and can thrive.
For applicants with disabilities requiring accommodations, don't hesitate to get in touch with or call +1 to discuss your needs.
Review EEO Law & EEO Statement.
Brooks Automation participates in E-Verify to confirm eligibility for employment in the United States. For more details, visit E-Verify is a registered trademark of the U.S. Department of Homeland Security.
Requirements
- MS or PhD in Computer Vision, Electrical Engineering, Robotics, or related field
- 10+ years of experience in:
- Vision systems
- Real-time or embedded systems
- Proven experience delivering low-latency vision or sensor-based systems
Technical Skills
- 3D pose estimation (PnP, multi-camera systems)
- Sub-pixel feature extraction and tracking
- Camera calibration (intrinsic/extrinsic)
- Real-time system design and latency optimization
- Programming: C/C++, Python, MATLAB
Embedded / FPGA Knowledge
- Understanding of FPGA-based image processing pipelines
- Fixed-point arithmetic and hardware constraints
- Experience collaborating with FPGA teams, * Experience in:
- Semiconductor or precision automation systems
- Metrology-grade measurement systems
- Closed-loop motion control
- Familiarity with:
- Industrial vision standards (GigE Vision, GenICam)
- Deterministic communication interfaces (SPI, BiSS, FPGA-based links), * Systems-level thinking and architecture ownership
- Strong analytical and problem-solving skills
- Cross-functional collaboration
- Technical communication with internal and external teams
- Ability to execute in high-uncertainty development environments
Benefits & conditions
Base Salary Range: $132,456.81 USD to $179,206.28 USD
Factors which may affect starting pay within this range may include geography/market, skills, education, experience and other qualifications of the successful candidate.
This position is also eligible for an annual discretionary bonus., At Brooks, we offer the following benefits for this position, subject to applicable eligibility requirements:
- Medical, Dental, Vision and Disability Insurance
- 401(k) Plan
- Exempt employees are provided company paid holidays and Flexible Vacation to enjoy personal time off and incidental sickness.
Have a question about our benefits and compensation package? Your recruiter can share more with you during the hiring process.