If the chunksize of a file isn't filled does it still use the full chunksize of the disk?
If we have 256MB chunksize and only 64GB of data written to the file do we still have 256MB of disk space used on the cluster?
Our block size (minimum write size) is 8KB. So the last chunk of a file will only occupy as much space as it needs, rounded up to the nearest 8KB.
Perfect thanks Deborah. It would be awesome if this was more clearly documented as I was unable to find this in your documentation anywhere. Appreciate the quick and accurate response though!
Thank you so much for your feedback! We will make a note for the next round documentation publication. Meanwhile, keep your questions and feedback coming.
Retrieving data ...