Building Real-Time data pipelines with Kafka Connect - Meetup - May 16th 2017 - USA, IL

Document created by slimbaltagi on May 15, 2017Last modified by aalvarez on May 15, 2017
Version 3Show Document
  • View in full screen mode


Date:May 16th 2017

Here Chicago

425 W Randolph St, Floor 12

Chicago, IL 

Time:5:15 pm (CST)
Registration Link:Chicago area Hadoop User Group (CHUG) (Chicago, IL) | Meetup 




Founded in 2010, the core focus of the Chicago area Hadoop Users Group (CHUG) has been on Hadoop and the related Big Data tools. 

Please come and join us for a talk on Kafka Connect, hosted and sponsored by HERE Chicago and presented by our very own Slim Baltagi from Advanced Analytics LLC


When building a real-time data pipeline or a streaming data application, you often need to import/export data to and from Kafka. You usually build your own DIY solution using Kafka producer or consumer API or use tools such as Scoop, Flume, Camus, Nifi, an ETL tool or even a stream processor!

This talk will introduce the Kafka Connect framework, part of Kafka since 0.9 release, as an easier and simpler alternative and show you in practice how to integrate Kafka with other data systems by simply writing configuration files while leveraging one of the over 60 existing Kafka connectors and writing minimal code if individual messages need to be transformed in flight for data masking or advanced partitioning.




This talk will be answering the following questions:

  • What is Kafka Connect, its key concepts and features?
  • How does it compare to previous options/tools for getting data into and out of Apache Kafka?
  • What are and where to find the over 60 existing Kafka Connect connectors?
  • How to use Kafka Connect connectors in practice with a live demo to rapidly stream events in and out of Kafka through configuration and no code or minimal code?
  • Where to learn more about Kafka connect?



  • Link to complete agenda and details:
  • Speaker Bio:

    • Slim Baltagi is a currently leading the Big Data practice at Advanced Analytics LLC
    • He is a Chicago-based IT leader with extensive Big Data/Fast Data experience as Director/Architect/Engineer at fortune 500 companies.  
    • He is an organizer of many Real-Time streaming analytics meetups in US cities and abroad and a speaker at many Big Data conferences and meetups with over 250,000 views of his slides at  and video recordings on youtube



  • Slide deck and related content will be available after the talk.