AnsweredAssumed Answered

Partition Pruning and directory level query support for MaprDB JSON tables in apache drill.

Question asked by arp4504 on Aug 30, 2017
Latest reply on Aug 31, 2017 by arp4504

Hi,

 

We attempted querying multiple MapRDB JSON tables across multiple directories,using parent directory name only, as shown in the example given in Partition Pruning - MapR 5.0 Documentation - doc.mapr.com as reference. The results were not as expected( data from only one table was fetched, rest of the tables ignored completely). Is partition pruning supported for MaprDB JSON tables? Also, if we create a directory and put multiple MaprDB JSON tables inside the directory, can we use apache drill to query the directory itself (Like shown here : https://drill.apache.org/docs/querying-directories/ )?

 

Note : Another observation here was that for pure JSON text files, or parquet files, data was fetched from multiple directories without any issues.

 

 

Drill version in use : 1.10.0

Maprdb version : 5.2.1

 

mapr-db mapr drill json mapr-db json json tables

Outcomes