Author: Bo soon Park
Original Publication Date: September 9, 2015
This article explains the use of the "profiles" directory in the /opt/mapr/drill/drill-<version>/logs/profiles location and the files in it.
Drill all versions
Why these file are created
A profile is a summary of metrics collected for each query that Drill executes. Query profiles provide information that you can use to monitor and analyse query performance. Drill creates a query profile from major, minor, operator, and input stream profiles. Each major fragment profile consists of a list of minor fragment profiles. Each minor fragment profile consists of a list of operator profiles. An operator profile consists of a list of input stream profiles.
Can we delete these file ?
Once the query finishes you can delete these files. But you will not be able to view the history about the query.These files contains information about the query which can be helpful for troubleshooting, if there is any issue.
How can we delete these files automatically
There is no feature in drill to delete these files automatically. Administrator has to maintain them.
For more details, see https://drill.apache.org/docs/query-profiles/