AnsweredAssumed Answered

Is each mini-batch in a DStream represented as a Spark RDD?

Question asked by leeivan on Mar 26, 2016
Latest reply on Mar 29, 2016 by psw63


Each mini-batch in a DStream is represented as a spark RDD.

I think this statement is true. But, in the lesson of Create Data Pipelines with Apache Spark, answer of knowledge check show that it is false. and the explanation is that each complete DStream, sequence of mini-batches, is represented by an RDD.

 

 

Outcomes