Sign up or log in to watch the video
Convert batch code into streaming with Python
Bobur Umurzokov - 1 month ago
The advent of real-time data processing has redefined how businesses operate, but the journey to real-time has its challenges. Many organizations find themselves juggling separate workflows and teams for batch and streaming data processing, each presenting unique difficulties. Batch processing, while effective for large datasets, can be costly, slow, and not well-suited for API integration. On the other hand, streaming, despite its speed and low latency, often has restricted functionality. This talk explores how Pathway is an open framework in Python for real-time data processing that provides a unified platform for batch and streaming. You will see with examples how simple it is to make your batch code run in streaming and learn how to build a data processing pipeline that ingests data from various data sources, processes, analyzes, and sends it to output streams in real-time.
Jobs with related skills
Senior Software Engineer (m/f/d)
CGI
·
11 days ago
Darmstadt, Germany
+4
Hybrid
ANWENDUNGSENTWICKLER (M/W/D) MIT SCHWERPUNKT ERP
RENA Technologies GmbH
·
1 month ago
Gütenbach, Germany
Software Developer (m/w/d) – Web Services & Network
Pan Dacom Direkt GmbH
·
1 month ago
Dreieich, Germany
Machine Learning Engineer für Deep Learning (w/m/d)
HUK-Coburg Versicherungsgruppe
·
25 days ago
Coburg, Germany
Related videos