[MapR Talk] StreamSets, For The Coding Minimalist In All of Us

Document created by aalvarez on Jul 28, 2016Last modified by maprcommunity on May 31, 2017
Version 2Show Document
  • View in full screen mode

Overview

In an effort to help grow organic communities interested in new technologies, MapR speakers around the world provide technical talks on numerous topics. Please browse our MapR Talks Directory  to learn how to search and request a talk in seconds.

 

Abstract

Two facts about developers: 1. We like to code. 2. We're human (and, therefore, inherently lazy). Which is why we like our IDE's and libraries - They give us the flexibility to code our way through the tough problems, while automating the everyday mundane chores.

 

And that brings us to StreamSets. The promise: An open source IDE for building ingest pipelines with minimal (or no) code, with real-time data flow monitoring, and the ability to adapt to "data drift" caused by unanticipated changes that occur in data streams. This presentation takes a closer look at these capabilities as we step through a live demo using a sandbox environment - we'll configure connectors between HBase, relational databases (using JDBC), Kafka, Elasticsearch, and the filesystem, then we'll look at how these data flows can be monitored with anomaly alerts. Finally, we'll explore what happens when data starts to drift in directions we didn't anticipate.

 

Attendees will gain an understanding of StreamSets' capabilities, along with requirements for configuring data connectors, monitoring, and responding to change.

 

Prerequisite Knowledge

  • Basic knowledge of typical data storage/query platforms (shared filesystems, databases, data warehouses, event logs)
  • Basic understanding of streaming data use cases

 

Audience Type

Technical

 

Location Availability & Request Link

North America. Please refer to the MapR Talks Directory  for specific countries.

You can request this talk here: Speaker Request

 

Related Resources

Find all Meetups and Events resources.

Find all MapR Talks: mapr talk

Learn more about Mapr Talks and how to book a speaker: Meetup and Event Organizers Resources

Attachments

    Outcomes