| Intelli2 <intelli2@mama.com>: Nov 18 10:12PM -0500 Hello... My Parallel Compression Library for Windows and Linux version 4.2 is here.. I have enhanced my Parallel Compression Library, now the process of calculating the CRC is much more optimized and fast, and the process of testing the integrity is much more faster, also i have stress tested it much more and i have found a bug that i have corrected, and now i think that you can be more confident because it is much more stable and very fast. Description: Parallel Compression Library implements Parallel LZ4 , Parallel LZMA , and Parallel Zstd algorithms using my Thread Pool Engine. - It supports memory streams, file streams and files - 64 bit supports - lets you create archive files over 4 GB , supports archives up to 2^63 bytes, compresses and decompresses files up to 2^63 bytes. - Parallel compression and parallel decompression are extremely fast - Now it supports processor groups on windows, so that it can use more than 64 logical processors and it scales well. - It's NUMA-aware and NUMA efficient on windows - It minimizes efficiently the contention so that it scales well. - It supports both compression and decompression rate indicator - You can test the integrity of your compressed file or stream - Easy programming interface - Full source codes available. Now my Parallel compression library is optimized for NUMA and it supports processor groups on windows and it uses only two threads that do the IO (and they are not contending) so that it reduces at best the contention, so that it scales well. Here are the parameters of the constructor: First parameter is: The number of cores you have specify to run the compression algorithm in parallel. Second parameter is: A boolean parameter that is processorgroups to support processor groups on windows , if it is set to true it will enable you to scale beyond 64 logical processors and it will be NUMA efficient. You can download and read about my Parallel Compression Library from: https://sites.google.com/site/aminer68/parallel-compression-library Thank you, Amine Moulay Ramdane. |
| You received this digest because you're subscribed to updates for this group. You can change your settings on the group membership page. To unsubscribe from this group and stop receiving emails from it send an email to comp.programming.threads+unsubscribe@googlegroups.com. |
No comments:
Post a Comment