AnsweredAssumed Answered

Spark job writing to MapR DB JSON hangs (sometimes) on larger tables

Question asked by jgschmitz on Jun 28, 2018
Latest reply on Jul 6, 2018 by MichaelSegel

So we actually opened a ticket with MapR about this and we ended up closing it because the job started working again.

We have a 22 node cluster with 36gb of memory assigned to the YARN containers - We feel like the code works because  it has completed many times -but will fail once in a while for no apparent reason  is there some configuration with MapR DB I should be checking? The dataset is about 4 million rows - We are using MapR 6.0.1

 

Thanks 

Outcomes