AnsweredAssumed Answered

Task tracker not starting

Question asked by pradeep_kumar_gs on Jul 3, 2012
Latest reply on Jul 4, 2012 by nabeel
Hi all,

i was trying to install mapr M3 version on my Laptop as single node configuration.

OS: Ubuntu 12.04 64bit  Ram: 8GB  Dell Latitude E6520

When i try to run job it hangs and no progress.

    /opt/mapr/hadoop/hadoop-0.20.2$ sudo hadoop jar hadoop-0.20.2-dev-examples.jar wordcount /input /output
    12/07/04 13:43:27 INFO fs.JobTrackerWatcher: Current running JobTracker is: localhost/127.0.0.1:9001
    12/07/04 13:43:28 INFO input.FileInputFormat: Total input paths to process : 1
    12/07/04 13:43:28 INFO mapred.JobClient: Running job: job_201207041326_0001
    12/07/04 13:43:29 INFO mapred.JobClient:  map 0% reduce 0%

from logs i was able to figure out that task tracker is not working or it hangs.
the logs say :


    2012-07-04 13:33:57,738 INFO org.apache.hadoop.mapred.TaskTracker: /tmp is not tmpfs or ramfs. Java Hotspot Instrumentation will be disabled by default
    2012-07-04 13:33:57,739 INFO org.apache.hadoop.mapred.TaskTracker: Cleaning up config files from the job history folder
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: TT local config  is /opt/mapr/hadoop/hadoop-0.20.2/conf/mapred-site.xml
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: Loading resource properties file : /opt/mapr//logs/cpu_mem_disk
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: Physical memory reserved for mapreduce tasks = 2692743168 bytes
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: CPUS: 4
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: Total MEM: 7.7567444GB
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: Reserved MEM: 2368MB
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: Reserved MEM for Ephemeral slots 200
    2012-07-04 13:33:57,741 INFO org.apache.hadoop.mapred.TaskTracker: DISKS: 2
    2012-07-04 13:33:57,752 INFO org.apache.hadoop.mapred.TaskTracker: Map slots 3, Default heapsize for map task 423 mb
    2012-07-04 13:33:57,752 INFO org.apache.hadoop.mapred.TaskTracker: Reduce slots 2, Default heapsize for reduce task 550 mb
    2012-07-04 13:33:57,752 INFO org.apache.hadoop.mapred.TaskTracker: Ephemeral slots 1, memory given for each ephemeral slot 200 mb
    2012-07-04 13:33:57,752 INFO org.apache.hadoop.mapred.TaskTracker: Prefetch map slots 2
    2012-07-04 13:34:02,810 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
    2012-07-04 13:34:02,853 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
    2012-07-04 13:34:02,864 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1
    2012-07-04 13:34:02,867 INFO org.apache.hadoop.mapred.TaskTracker: Checking for local volume. If volume is not present command will create and mount it. Command invoked is : /opt/mapr//server/createTTVolume.sh localhost /var/mapr/local/localhost/mapred/ /var/mapr/local/localhost/mapred/taskTracker/
    pradeep@pradeep-office-laptop:/opt/mapr/hadoop/hadoop-0.20.2/logs$ sudo /opt/mapr//server/createTTVolume.sh localhost /var/mapr/local/localhost/mapred/ /var/mapr/local/localhost/mapred/taskTracker/

i found same problem is forum but i tried possible solution in their list. i end up in this problem

    ERROR (22) -  Unable to map host: myhost to non-local ipaddress while creating volume mapr.myhost.local.mapred

command : hadoop fs -ls /

    drwxr-xr-x   - root root          1 2012-07-03 11:39 /input
    drwxrwxrwx   - root root          0 2012-07-03 11:29 /hbase
    drwxr-xr-x   - root root          1 2012-07-03 11:29 /var

command : sudo hadoop mfs -ls


    vrwxrwxrwx Z   - root root          4 2012-07-03 11:37  268435456 /.rw
            p mapr.cluster.root writeable 2049.35.16568 -> 2049.16.2  localhost:5660
    drwxr-xr-x Z   - root root          1 2012-07-03 11:39  268435456 /pradeep
            p 2049.36.16570  localhost:5660
    vrwxrwxrwx U   - root root          0 2012-07-03 11:29  268435456 /hbase
            p mapr.hbase default 2049.32.16562 -> 2050.16.2  localhost:5660
    drwxr-xr-x Z   - root root          1 2012-07-03 11:29  268435456 /var
            p 2049.33.16564  localhost:5660



command : maprcli node list -json

    {
     "timestamp":1341390540746,
     "status":"OK",
     "total":1,
     "data":[
      {
       "id":"2684810528843460725",
       "ip":"192.168.0.217",
       "hostname":"localhost",
       "racktopo":"/default-rack/localhost",
       "health":2,
       "healthDesc":"One or more services is down",
       "service":"webserver,cldb,fileserver,nfs,hoststats,jobtracker",
       "configuredservice":"tasktracker,webserver,cldb,fileserver,nfs,hoststats,jobtracker",
       "fs-heartbeat":0,
       "jt-heartbeat":2,
       "dtotal":4,
       "dused":0,
       "davail":4,
       "rpcs":1,
       "rpcin":166,
       "rpcout":348,
       "disks":1,
       "MapRfs disks":1,
       "faileddisks":0,
       "dreads":0,
       "dreadK":0,
       "dwrites":2,
       "dwriteK":8,
       "cpus":4,
       "utilization":29,
       "uptime":"Fri Jan 16 18:06:23 IST 1970",
       "mtotal":7942,
       "mused":6813,
       "ttmapSlots":0,
       "ttmapUsed":0,
       "ttReduceSlots":0,
       "ttReduceUsed":0,
       "bytesReceived":5280,
       "bytesSent":3569,
       "LogLevelAlarm":0,
       "ServiceCLDBDownNotRunningAlarm":0,
       "ServiceFileserverDownNotRunningAlarm":0,
       "ServiceJTDownNotRunningAlarm":0,
       "ServiceTTDownNotRunningAlarm":1341389769054,
       "ServiceHBMasterDownNotRunningAlarm":0,
       "ServiceHBRegionDownNotRunningAlarm":0,
       "ServiceNFSDownNotRunningAlarm":0,
       "ServiceWebserverDownNotRunningAlarm":0,
       "ServiceHoststatsDownNotRunningAlarm":0,
       "DiskFailureAlarm":0,
       "VersionMismatchAlarm":0,
       "TimeSkewAlarm":0,
       "RootPartitionFullAlarm":0,
       "HomeMapRFullAlarm":0,
       "CorePresentAlarm":0,
       "HighMfsMemoryAlarm":0,
       "PamMisconfiguredAlarm":0,
       "TTLocaldirFullAlarm":0
      }
     ]
    }

Command : Ping localhost



    ping localhost
    PING localhost (127.0.0.1) 56(84) bytes of data.
    64 bytes from localhost (127.0.0.1): icmp_req=1 ttl=64 time=0.017 ms
    64 bytes from localhost (127.0.0.1): icmp_req=2 ttl=64 time=0.018 ms




file : /etc/hosts



    127.0.0.1 localhost office-laptop
    #127.0.1.1 office-laptop
    
    # The following lines are desirable for IPv6 capable hosts
    ::1     ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters




Appreciate your help

Thanks ,
Pradeep Kumar

Outcomes