White paper by StreamSets: IoT Reference Architecture for Hadoop

File uploaded by slimbaltagi on Jun 22, 2017
Version 1Show Document
  • View in full screen mode

This white paper by StreamSets was published in October 2016. This is an overview: "The Internet of Things (IoT) generates a large amount of data that can be used to provide real-time and/or historic insights into sensor measurements. The design and operating environment of these devices presents a unique set of challenges for ingesting data into big data systems. This paper describes a reference architecture for using streamsets Data Collector to move IoT sensor data into Hadoop. Specifically, we will cover two patterns, Real-ˇTime Streaming of IoT Events into Hadoop and Batch-ˇOriented Transfer of Historic or Master Data."