Thorsten Riess

Tracking vehicles at scale

Can your database replace a stream processor and a graph database? See a pragmatic approach to building scalable tracking systems with fewer moving parts.

Tracking vehicles at scale
#1about 6 minutes

Minimizing moving parts in a telematics platform

Adopting a philosophy of simplicity by using a single source of truth and composable tools reduces operational complexity for small teams.

#2about 2 minutes

Building a simple infrastructure with HashiCorp tools

Using single-purpose tools like Nomad and Consul provides most of the value of a larger platform like Kubernetes with a fraction of the operational overhead.

#3about 3 minutes

Using Postgres as a single source of truth

Leveraging Postgres with PostGIS and Neon provides a unified data layer that avoids the complexity of synchronizing multiple specialized databases.

#4about 5 minutes

Implementing a Kalman filter directly in Postgres

A Kalman filter for cleaning noisy GPS data can be implemented as a PL/pgSQL function, eliminating the need for a separate stateful stream processor.

#5about 3 minutes

Detecting vehicle trips with SQL triggers and queries

Using database triggers and continuous queries to merge location points into trips provides near-real-time results without an external stream processor.

#6about 5 minutes

Modeling time-variant trailer graphs in Postgres

A temporal graph of vehicle-trailer relationships can be modeled and enforced directly in Postgres using interval columns and deferred triggers, avoiding a separate graph database.

#7about 3 minutes

Querying cold storage from the browser with DuckDB

Offloading old data to Parquet on S3 and querying it from the client's browser with DuckDB-Wasm eliminates the need for a server-side data lake.

#8about 4 minutes

Reviewing the simplified stack and its trade-offs

The simplified architecture has trade-offs like a steeper learning curve for PL/pgSQL, but the benefits of reduced operational complexity are significant for small teams.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles

From learning to earning

Jobs that call for the skills explored in this talk.