Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
We are seeking an experienced Data Engineer to architect, build, and maintain the complex, real-time data streams generated by our fleet of mobile and static robots. This critical role involves managing video, telemetry, and sensor data, ensuring low-latency processing for real-time monitoring, efficient debugging, and training of our machine learning models.
Due to the nature of the projects worked on in this position, applicants must be a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees.
Primary duties include:
· Design, build, and optimize high-throughput, low-latency data pipelines using cloud (Azure) and on-prem services, specialized for streaming and time-series data.
· Manage and process data generated from robot telemetry (position, velocity, battery life, etc.).
· Develop solutions for efficient ingestion, storage, and retrieval of high-resolution video and Lidar point cloud data.
· Facilitate efficient access to data for R&D teams.
· Work with software engineers to define data formats and communication protocols for transmission from the robot to the cloud.
· Implement mechanisms for dealing with intermittent connectivity and ensuring data completeness.
Requirements
· Minimum of 3 years of hands-on experience in a Data Engineering role, with significant focus on real-time or streaming data.
· Experience with data storage services, including cloud-based (such as Azure Data Lake) and self-hosted.
· Expert-level proficiency in Python and data query languages.
· Experience with streaming data processing frameworks.
· Experience with time-series databases.
Preferred Experience:
· 5+ years of experience in Data Engineering, particularly within the robotics, IoT, or autonomous systems domain.
· Experience handling and processing video data at scale.
· Familiarity with Kubernetes for deploying scalable processing applications.
· Knowledge of geospatial data (GIS) processing and mapping libraries.
· Strong understanding of networking concepts and low-latency data transfer protocols relevant to robotics., * Data Engineer in Robotics, IoT or Autonomous Systems Domain: 5 years (Required)
Benefits & conditions
Pulled from the full job description
- 401(k)
- Health insurance
- Paid time off
- Vision insurance
- Dental insurance, * 401(k)
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance
Application Question(s):
- Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes Or No
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
How to Become an AI Engineer
Making Data Warehouses Fast: A Developer’s Story
Fully Remote Software Engineer Jobs