FGY-2221 Streaming ETL on the Shoulders of Giants | Voxxed Days

Voxxed Days Ticino 2019
on Saturday 5 October

   Streaming ETL on the Shoulders of Giants


Big Data & Machine Learning
Big Data & Machine Learning
Intermediate level
Room B1 Saturday from 11:15 til 12:00

Life doesn’t happen in batch mode which is why application engineers and data architects need to closely cooperate to bridge the "gap" between technology built for data in motion vs data at rest. Without doubt stream processing is a big deal these days and oftentimes we find Apache Kafka as the central nervous system of company-wide data architectures. However, many real-world uses cases simply need an operational data store which is flexible, robust and scalable enough to live up to diverse application-related requirements and challenges. For that reason, this session explores different options in order to build rock solid data integration pipelines between MongoDB and Apache Kafka. The focus lies on configuration-based data in motion scenarios leveraging the Kafka Connect framework in order to lay out streaming ETL pipeline examples, most of which can be realized without writing a single line of code.

data pipelines   data streaming   NoSQL  
Hans-Peter Grahsl
Hans-Peter Grahsl

Hans-Peter Grahsl is working as a technical trainer for Java Web Development and is responsible for the internal education department at NETCONOMY Software & Consulting GmbH in Graz, Austria. As an independent consultant he is supporting customers during the conception and implementation of on-premise or cloud-based data architectures using modern technology stacks and NoSQL data stores. Hans-Peter is also an associate lecturer for Software Engineering at CAMPUS 02 University of Applied Sciences.

Make sure to download the Android or iOS mobile schedule.