Data Engineer

Asylon Incorporated
Norristown, PA, United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$120,000.0 - $160,000.0
Working hours
Regular working hours
Job source

Tech stack

Geographic Information Systems Microsoft Azure Communications Protocols Computer Networks Databases Data Transmissions Information Engineering Query Languages Software Debugging Python (Programming Language) Machine Learning Azure Data Lake
+8 more
Data Streaming Data Processing Data Storage Technologies Kubernetes Low Latency Real Time Data Lidar Data Pipelines

Job description

We are seeking an experienced Data Engineer to architect, build, and maintain the complex, real-time data streams generated by our fleet of mobile and static robots. This critical role involves managing video, telemetry, and sensor data, ensuring low-latency processing for real-time monitoring, efficient debugging, and training of our machine learning models.

Due to the nature of the projects worked on in this position, applicants must be a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees.

Primary duties include:

· Design, build, and optimize high-throughput, low-latency data pipelines using cloud (Azure) and on-prem services, specialized for streaming and time-series data.

· Manage and process data generated from robot telemetry (position, velocity, battery life, etc.).

· Develop solutions for efficient ingestion, storage, and retrieval of high-resolution video and Lidar point cloud data.

· Facilitate efficient access to data for R&D teams.

· Work with software engineers to define data formats and communication protocols for transmission from the robot to the cloud.

· Implement mechanisms for dealing with intermittent connectivity and ensuring data completeness.

Requirements

· Minimum of 3 years of hands-on experience in a Data Engineering role, with significant focus on real-time or streaming data.

· Experience with data storage services, including cloud-based (such as Azure Data Lake) and self-hosted.

· Expert-level proficiency in Python and data query languages.

· Experience with streaming data processing frameworks.

· Experience with time-series databases.

Preferred Experience:

· 5+ years of experience in Data Engineering, particularly within the robotics, IoT, or autonomous systems domain.

· Experience handling and processing video data at scale.

· Familiarity with Kubernetes for deploying scalable processing applications.

· Knowledge of geospatial data (GIS) processing and mapping libraries.

· Strong understanding of networking concepts and low-latency data transfer protocols relevant to robotics., * Data Engineer in Robotics, IoT or Autonomous Systems Domain: 5 years (Required)

Benefits & conditions

Pulled from the full job description

  • 401(k)
  • Health insurance
  • Paid time off
  • Vision insurance
  • Dental insurance, * 401(k)
  • Dental insurance
  • Health insurance
  • Paid time off
  • Vision insurance

Application Question(s):

  • Are you a U.S. Person as defined by 22 C.F.R. §120.62. This includes U.S. Citizens, lawful permanent residents, refugees, or asylees. Yes Or No

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:17 min

Validating lidar sensor models against real noise

Ulrich Wurstbauer +1 · LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

2:08 min

Processing physical environment data with lidar models

Oliver Zimmert · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all