AnsweredAssumed Answered

drill: unable to query the maprfs   (first time user on drill 1.4) 

Question asked by kaushal_jha on Mar 10, 2016
Latest reply on Mar 17, 2016 by kaushal_jha

Hi Team,

   could someone please help me understand what i am missing in order to query a file over the mapr fs?

seems like i am missing something very basic like a non configured storage plugin etc. not sure how to get started.

 

I am on mapr version 5.0, drill version 1.4

 

the below query comes back with table not found  even though that file exists

 

$ hadoop fs -ls /user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0

-rwxr-xr-x   2 bigtable bigtable    7586437 2016-03-10 06:21 /user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0

bigtable@bdadmin01:/bdnfs$

 

 

 

0: jdbc:drill:zk=local> show schemas ;

+---------------------+

|     SCHEMA_NAME     |

+---------------------+

| INFORMATION_SCHEMA  |

| cp.default          |

| dfs.default         |

| dfs.root            |

| dfs.tmp             |

| sys                 |

+---------------------+

6 rows selected (0.274 seconds)

0: jdbc:drill:zk=local> use dfs.root ;

+-------+---------------------------------------+

|  ok   |                summary                |

+-------+---------------------------------------+

| true  | Default schema changed to [dfs.root]  |

+-------+---------------------------------------+

1 row selected (0.156 seconds)

0: jdbc:drill:zk=local> show tables ;

+---------------+-------------+

| TABLE_SCHEMA  | TABLE_NAME  |

+---------------+-------------+

+---------------+-------------+

No rows selected (0.338 seconds)

0: jdbc:drill:zk=local>

0: jdbc:drill:zk=local>

0: jdbc:drill:zk=local> SELECT

. . . . . . . . . . . >     *

. . . . . . . . . . . > FROM dfs.`/user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0`

. . . . . . . . . . . > LIMIT 1 ;

Mar 10, 2016 6:54:41 PM org.apache.calcite.sql.validate.SqlValidatorException <init>

SEVERE: org.apache.calcite.sql.validate.SqlValidatorException: Table 'dfs./user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0' not found

Mar 10, 2016 6:54:41 PM org.apache.calcite.runtime.CalciteException <init>

SEVERE: org.apache.calcite.runtime.CalciteContextException: From line 3, column 6 to line 3, column 8: Table 'dfs./user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0' not found

Error: VALIDATION ERROR: From line 3, column 6 to line 3, column 8: Table 'dfs./user/bigtable/logs/hive/warehouse/bt_sa_stage2_wt_quad_lead_click_details/traffic_day=2016.03.09/000087_0' not found

 

 

 

 

[Error Id: 5e1c8cfb-d831-4b60-b962-260fad175671 on bdmapr01.quinstreet.net:31010] (state=,code=0)

0: jdbc:drill:zk=local>

0: jdbc:drill:zk=local>

Outcomes