zeeshan

ContainerRequestState [INFO] No more pending requests in queue

Discussion created by zeeshan on Jun 13, 2016


 

I am using a MapR (YARN) cluster with 3 nodes. I am trying to deploy 6 Samza jobs on the cluster for some processing on data streams. All jobs are correct. I tried deploying 2-3 in parallel and they work. However when I deploy all the 6 Samza jobs in parallel I see following logs. The tasks continue to run and dont produce expected output data stream.

 

enter image description here

The status of the nodes on my ResourceManager web dashboard is as follows-

 

 

enter image description here

Can anyone suggest how can this be resolved. I think that maybe the application does not have sufficient resources to run all of them in parallel. What change can I try?

Outcomes