> Markdown version of [/jobs/ext/2847461-data-engineer](https://www.wearedevelopers.com/jobs/ext/2847461-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Shipin Systems Inc. - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Adobe InDesign, Amazon Web Services, Computer Vision, Batch Processing, C++ (Programming Language), Code Review, Information Engineering, Relational Databases, DevOps, Python (Programming Language), PostgreSQL, Machine Learning, Operational Databases, Video Editing, Stream Processing, Data Pipelines - **Published:** September 11, 2026 - **Apply:** https://www.thejobnetwork.com/job/eed98fea-7d9d-4dbf-ac88-9fe7ec52969a/senior-data-engineer ## About the Role * 5+ years of experience designing and operating production data pipelines. * Strong Python proficiency- this is your primary language day to day. * Hands-on experience with PostgreSQL or equivalent relational databases. * Solid understanding of integrating ML models into large-scale production environments. * Comfort working across hybrid architectures (on-prem + cloud), ideally including AWS. * Strong communication and collaboration skills. Advantage * Familiarity with Rust or C++ * Experience with image or video processing pipelines * Experience with edge or embedded computing environments ## Description We're looking for a Senior Data Engineer to join our R&D team and take end-to-end ownership of the data pipelines that sit at the core of FleetVision. Our architecture is uniquely challenging: pipelines run on-premises, aboard vessels at sea, processing continuous, high-volume video streams in real time, in resource-constrained environments, without reliable connectivity. You'll own both the reliability of what exists today and the redesign of what comes next, as we scale the platform and expand into new vessel segments and data sources. You'll work closely with computer vision, DevOps, and product managers, sitting at the intersection of the on-prem edge and our AWS cloud infrastructure. The problems here are genuinely challenging: low-latency stream processing, ML model integration at the edge, hybrid deployment pipelines, and mission-critical uptime on vessels where downtime isn't an option., * Design, implement, and optimize data pipelines running in on-prem, vessel-based environments - with a focus on performance, reliability, and real-time throughput. * Own the full pipeline lifecycle: from maintaining and stabilizing existing systems to driving architectural redesigns and optimizations. * Develop high-performance pipelines for both stream and batch processing of large-scale video and telemetry data. * Integrate on-prem pipeline infrastructure with AWS cloud services - covering both deployment workflows and publishing pipeline output to the cloud. * Collaborate with ML and computer vision engineers to deploy and operationalize models in real-time, resource-constrained edge environments. * Partner with DevOps, product managers, and algorithm teams to build the infrastructure needed to support new product features and improve system performance. * Write clean, maintainable Python code; participate in design and code reviews with high quality standards. * Troubleshoot and resolve pipeline issues quickly, minimizing downtime on systems that run 24/7 at sea. * Stay current with developments in data engineering and proactively apply them to improve existing processes. ## Related Videos - [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [Tracking vehicles at scale](https://www.wearedevelopers.com/videos/1999-tracking-vehicles-at-scale) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview](https://www.wearedevelopers.com/magazine/563-dev-digest-159-ai-pipelines-10x-faster-typescript-how-to-interview) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Building AI Solutions with Rust and Docker](https://www.wearedevelopers.com/magazine/494-building-ai-solutions-with-rust-and-docker) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 168: Hacking Postgres, Blocking Meta and Fixing CSS](https://www.wearedevelopers.com/magazine/588-dev-digest-168-hacking-postgres-blocking-meta-and-fixing-css)