Query Tuning and Performance> Misc
What are best practices for managing Drill query profiles?
See all drill best practice FAQs.
A profile is a summary of metrics collected for each query that Drill executes. Query profiles provide very important information that you can use to monitor and analyze query performance.
By default, query profiles are stored in each Drillbit server’s local directory. E.g.,
The disadvantages of using this default are:
Our best practice is to store your query profiles in the MapR-FS (Pstore). By doing so, you can view all query profiles from any Drill WebUI.
The procedure to setup MapR-FS as a Pstore for Drill query profiles as outlined below:
(1) Add drill.exec.sys.store.provider.zk.blobroot to drill-override.conf on all nodes:
(2) Restart all Drillbits
For further details about Pstore, please see https://drill.apache.org/docs/persistent-configuration-storage/
Please keep in mind that currently Drill does not have a feature to set a query profile retention period that will purge query profiles automatically. Depending on your operational needs,
you might need to set up a cronjob, which specifies the number of query profiles to keep based on your maintenance threshold. Once that threshold is exceeded, the cronjob will purge or archive the older profiles.
Retrieving data ...