Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I have seen threads about minimal and maximum size for zlib compression. I wanted to know what people think is the optimal size for a compressed block of data that will ensure the best speed. Is there an advantage to splitting up a file into say, multiple file blocks.
Thank you.
Splitting data into blocks will only degrade compression ratio, and is unlikely to improve speed.
The main idea behind “splitting into small blocks” is improve access : say you want to read a segment of the file at position PX, then you immediately know it is stored into block BY = PX / BlockSize. Therefore, instead of decoding the whole file, you only decode the block.
And that’s it. If you’re looking for better speed, you’ll have to use some different compression algorithm, such as Snappy or LZ4, which are known to have compression and decompression speed several times faster than zlib.