AnsweredAssumed Answered

"fileserver metrics" not working with Ganglia

Question asked by marek on May 9, 2012
Latest reply on Jun 21, 2012 by abhinav
Hi,

I am having problem getting "fileserver metrics" to work with Ganglia.

Specifically, when /opt/mapr/conf/hadoop-metrics.properties is configured to send "fileserver context" to ganglia (see below), nothing is reported.
I do not see any fileserver-specific info when monitoring activity on port 8649 (telnet localhost 8649), and of course ganglia gui/webpage does not show it either.

 # Configuration of the "fileserver" context for ganglia (THIS DOES NOT WORK)
fileserver.class=com.mapr.fs.cldb.counters.MapRGangliaContext31 
fileserver.period=10 
fileserver.servers=239.2.11.71:8649 
fileserver.spoof=1

As as test, if I switch to send fileserver stats for a file (see below), they are recorded in the /tmp/fsmetrics.log just fine.

 # Configuration of the "fileserver" context for file (WORKS OK) 
fileserver.class=org.apache.hadoop.metrics.file.FileContext 
fileserver.period=10 
fileserver.fileName=/tmp/fsmetrics.log 

-------
My ganglia setup seems to work fine otherwise. I am able to collect all other non-mapr statistics (cpu, memory, network etc). Also, CLDB statistics (when using ganglia, or when recording to a file) work OK (see configs below)

 # Configuration of the "cldb" context for ganglia (WORKS OK)
cldb.class=com.mapr.fs.cldb.counters.MapRGangliaContext31 
cldb.period=10 
cldb.servers=239.2.11.71:8649 
cldb.spoof=1

 # Configuration of the "cldb" context for file (WORKS OK) 
cldb.class=org.apache.hadoop.metrics.file.FileContext 
cldb.period=10 
cldb.fileName=/tmp/cldbmetrics.log

Of course, I have enabled ganglia metrics 
maprcli config save -values '{"cldb.ganglia.cldb.metrics":"1"}' 
maprcli config save -values '{"cldb.ganglia.fileserver.metrics":"1"}'

Also, after any config change, I restart appropriate services (mapr-mfs, mapr-cldb, gmond, gmetad)

-------  
Question:
Has anybody tried to use "fileserver metrics" with ganglia (with success, or with same problem)? 
I searched this forum, and googled for any hints, but no luck :( 
Any feedback/ideas would be appreciated.

Thanks, 
Marek

Outcomes