AnsweredAssumed Answered

Is each mini-batch is represented as a RDD in Dstreams or not

Question asked by 26tarun on Feb 20, 2017
Latest reply on Feb 23, 2017 by madumoulin

In the course Dev-362 "Lesson 8 - Create Data Pipelines With Apache Spark" at knowledge check of slide no 15 , option no .2 it asks "each mini-batch in a D-Stream represents as a Spark RDD", which i ticked . Subsequently the answer was wrong. 


But firstly on slide 10 it clearly says what is a mini batch and a mini-batch is represented as an RDD in DStreams and then on slide 29 it clearly says that each batch interval is represented as an RDD. 


Please clear my concepts that whether i have a discrepancy in my understanding of the concept and the question being asked on the knowledge check.