AnsweredAssumed Answered

Odd permission errors using M3 on EMR

Question asked by sorenmacbeth on Sep 3, 2012
Latest reply on Sep 13, 2012 by oae
I'm getting really weird error on my EMR jobflows. I had no issues with running these particular jobflows before. Did something in the mapr packages change? Here is an example log:

    2012-09-03 21:44:30,9101 ERROR Client fs/client/fileclient/cc/client.cc:571 Thread: 140113267664640 Unlink failed for file ip-10-142-130-234.ec2.internal_1346702158683_job_201209031955_0, error Permission denied(13)
    2012-09-03 21:44:30,9102 ERROR Client fs/client/fileclient/cc/client.cc:670 Thread: 140113267664640 Rmdirs failed for dir/file ip-10-142-130-234.ec2.internal_1346702158683_job_201209031955_0, rpc error 13
    2012-09-03 21:44:30,9102 ERROR Client fs/client/fileclient/cc/client.cc:670 Thread: 140113267664640 Rmdirs failed for dir/file history, rpc error 13
    2012-09-03 21:44:30,9102 ERROR JniCommon fs/client/fileclient/cc/jni_common.cc:949 Thread: 140113267664640 remove: File /tmp/cascalog_reserved/20451ace-d754-4105-9fc9-daf9238910df/_lo, rpc error, Permission denied(13)
    2012-09-03 21:56:19,2043 ERROR Client fs/client/fileclient/cc/client.cc:571 Thread: 140113128273664 Unlink failed for file ip-10-142-130-234.ec2.internal_1346702158683_job_201209031955_0, error Permission denied(13)
    2012-09-03 21:56:19,2043 ERROR Client fs/client/fileclient/cc/client.cc:670 Thread: 140113128273664 Rmdirs failed for dir/file ip-10-142-130-234.ec2.internal_1346702158683_job_201209031955_0, rpc error 13
    2012-09-03 21:56:19,2043 ERROR Client fs/client/fileclient/cc/client.cc:670 Thread: 140113128273664 Rmdirs failed for dir/file history, rpc error 13
    2012-09-03 21:56:19,2043 ERROR JniCommon fs/client/fileclient/cc/jni_common.cc:949 Thread: 140113128273664 remove: File /tmp/cascalog_reserved/a8b84f90-fa18-4be2-ad50-f6420ac20cad/_lo, rpc error, Permission denied(13)

The issue seems to be intermittent. I can't reproduce it every time. Some times I get a slightly different error which is complaining about temporary directories not existing.

Thanks in Advance!

Outcomes