Spark Troubleshooting guide: Profiling Spark: How to collect jstat data?

Document created by hdevanath Employee on Jun 19, 2017Last modified by hdevanath Employee on Jun 19, 2017
Version 2Show Document
  • View in full screen mode

The jstat utility attaches to a HotSpot JVM, collects and logs performance statistics as specified by the command line options.

 

 

It uses the built-in instrumentation in the Java HotSpot VM to provide information about performance and resource consumption of running applications. The tool can be used when diagnosing performance issues, and in particular issues related to heap sizing and garbage collection. The jstat utility does not require the VM to be started with any special options. The built-in instrumentation in the Java HotSpot VM is enabled by default. 
 

jstat -gc <driver PID> 


What to Expect: 

 

ColumnDescription
S0CCurrent size of Survivor0 area in KB
S1CCurrent size of Survivor1 area in KB
S0UUsed Survivor0 area in KB
S1UUsed Survivor1 area in KB
ECCurrent size of Eden area in KB
EUUsed Eden area in KB
OCCurrent size of old area in KB
OUUsed old area in KB
PCCurrent size of permanent area in KB
PUUsed permanent area in KB
YGCThe number of GC event occurred in young area
YGCTThe accumulated time for GC operations for Yong area
FGCThe number of full GC event occurred
FGCTThe accumulated time for full GC operations
GCTThe total accumulated time for GC operations

Attachments

    Outcomes