partitioning key and number of files created
Hi!
Is partitioning key supposed to have an impact on the number of files created?
I am seeing a lot of small parquet files created with partitioning key
%F/%H%M%S, despite 30s interval and 512MB max file size1 Reply
Oh yes it is the case, I tried with less granular key and files are created less often now