How to enable debug and verbose logging for Sqoop

Document created by snayeem Employee on Feb 27, 2016
Version 1Show Document
  • View in full screen mode

Author: Sanjamala Nayeem

Original Publication Date: April 2, 2015

 

 

Env:

  • MapR 4.0.1
  • MapR 3.x
  • sqoop 1.4.5

Goal:

Steps to enable debug log for the sqoop

Solutions:

To enable debug mode on sqoop we need to follow these steps.
Add following two lines in log4j.properties and modify the sqoop command to include --verbose option

sqoop.root.logger=DEBUG,console,DRFA 
org.apache.sqoop=DEBUG, console

The location of the log4j.properties file(s) that you need to edit is based on the type of job or applications that you will run from this client machine:

Job or Application Type

 

core-site.xml Location

MapReduce v1 jobs%MAPR_HOME%\hadoop\hadoop-0.20.0\conf\log4j.properties
YARN applications
(MapReduce v2 or other applications that run on YARN)
%MAPR_HOME%\hadoop\hadoop-2.x.x\etc\hadoop\log4j.properties

 

If you plan to run both MapReduce v1 jobs and MapReduce v2 applicatons, you need to updated both log4j.properties files with the user parameters.

Attachments

    Outcomes