|
4 | 4 | * **TurboPFor: The synonym for "integer compression"** |
5 | 5 | * **ALL** functions available for **AMD/Intel**, **64 bits ARMv8 NEON** Linux+MacOS/M1 & **Power9 Altivec** |
6 | 6 | * 100% C (C++ headers), as simple as memcpy. OS:Linux amd64, arm64, Power9, MacOs (Amd/intel + Apple M1), |
7 | | - * :new:(2023.04) **Rust** Bindings. Access TurboPFor **incl. SSE/AVX2/Neon!** from Rust |
| 7 | + * **Rust** Bindings. Access TurboPFor **incl. SSE/AVX2/Neon!** from Rust |
8 | 8 | * :+1: **Java** Critical Natives/JNI. Access TurboPFor **incl. SSE/AVX2/Neon!** from Java as fast as calling from C |
9 | 9 | * :sparkles: **FULL** range 8/16/32/64 bits scalar + 16/32/64 bits SIMD functions |
10 | 10 | * No other "Integer Compression" compress/decompress faster |
|
19 | 19 | * **Variable byte** |
20 | 20 | * Scalar **"Variable Byte"** faster and more efficient than **ANY** other implementation |
21 | 21 | * SIMD **TurboByte** fastest group varint (16+32 bits) incl. integrated delta,zigzag,xor,... |
22 | | - * :new:(2023.03)**TurboBitByte** novel hybrid scheme combining the fastest SIMD codecs TurboByte+TurboPack. |
| 22 | + * **TurboBitByte** novel hybrid scheme combining the fastest SIMD codecs TurboByte+TurboPack. |
23 | 23 | Compress considerably better and can be 3 times faster than streamvbyte |
24 | 24 | * **Simple family** |
25 | 25 | * **Novel** **"Variable Simple"** (incl. **RLE**) faster and more efficient than simple16, simple-8b |
26 | 26 | * **Elias fano** |
27 | 27 | * Fastest **"Elias Fano"** implementation w/ or w/o SIMD/AVX2 |
28 | | -* :new:(2023.03)**TurboVLC** novel variable length encoding for large integers |
| 28 | +* **TurboVLC** novel variable length encoding for large integers |
29 | 29 | with exponent + variable bit mantissa |
30 | | -* :new:(2023.03)**Binary interpolative coding** : fastest implementation |
| 30 | +* **Binary interpolative coding** : fastest implementation |
31 | 31 | + **Transform** |
32 | 32 | * Scalar & SIMD Transform: Delta, Zigzag, Zigzag of delta, XOR, |
33 | | - * :new:(2023.03) Transpose/Shuffle with integrated Xor and zigzag delta |
34 | | - * :new:(2023.03) 2D/3D/4D transpose |
| 33 | + * Transpose/Shuffle with integrated Xor and zigzag delta |
| 34 | + * 2D/3D/4D transpose |
35 | 35 | * **lossy** floating point compression with *TurboPFor* or [TurboTranspose](https://github.com/powturbo/TurboTranspose)+lz77/bwt |
36 | | -+ :new:(2023.03)**IC Codecs** transpose/rle + general purpose compression with lz4,zstd,turborc (range coder),bwt... |
| 36 | ++ **IC Codecs** transpose/rle + general purpose compression with lz4,zstd,turborc (range coder),bwt... |
37 | 37 | * **Floating Point Compression** |
38 | 38 | * Delta/Zigzag + improved gorilla style + (Differential) Finite Context Method FCM/DFCM floating point compression |
39 | 39 | * Using **TurboPFor**, unsurpassed compression and more than 8 GB/s throughput |
40 | 40 | * Point wise relative error bound **lossy** floating point compression |
41 | 41 | * **TurboFloat** novel efficient floating point compression using TurboPFor |
42 | | - * :new:(2023.03)**TurboFloat LzXor** novel floating point lempel-ziv compression |
43 | | - * :new:(2023.06) _Float16 16 bits floating point support |
44 | | - * :new:(2023.06) float 16/32/64 bits quantization with variable quantization bit size. |
| 42 | + * **TurboFloat LzXor** novel floating point lempel-ziv compression |
| 43 | + * _Float16 16 bits floating point support |
| 44 | + * float 16/32/64 bits quantization with variable quantization bit size. |
45 | 45 | * **Time Series Compression** |
46 | 46 | * **Fastest Gorilla** 16/32/64 bits style compression (**zigzag of delta** + **RLE**). |
47 | 47 | * can compress timestamps to only 0.01%. Speed > 10 GB/s compression and > 13 GB/s decompress. |
|
66 | 66 | - [Benchmark: Lossy Floating Point Preprocessing Turbo Razor vs Granular bitround vs libroundfast](https://github.com/powturbo/TurboPFor-Integer-Compression/issues/94) |
67 | 67 | - [Benchmark: Lossless/Lossy Floating Point Compression. TurboPFor vs zfp & blosc](https://github.com/powturbo/TurboPFor-Integer-Compression/issues/92) |
68 | 68 | - [Benchmark: TurboPFor: IcApp 16 bits Integer Compression](https://github.com/powturbo/TurboPFor-Integer-Compression/issues/50) |
69 | | -- [Benchmark Intel CPU: Skylake i7-6700 3.4GHz gcc 9.2](https://github.com/powturbo/TurboPFor/issues) |
| 69 | +- [Benchmark Intel CPU: Skylake i7-6700 3.4GHz gcc 9.2](https://github.com/powturbo/TurboPFor-Integer-Compression/issues/47) |
70 | 70 | - [Benchmark ARM: ARMv8 A73-ODROID-N2 1.8GHz](https://github.com/powturbo/TurboPFor/issues/49) |
71 | 71 |
|
72 | 72 | ##### - Synthetic data: |
@@ -499,5 +499,5 @@ Note: Some low level functions (like p4enc32) are limited to 128/256 (SSE/AVX2) |
499 | 499 | * :green_book:[SPDP is a compression/decompression algorithm for binary IEEE 754 32/64 bits floating-point data](http://cs.txstate.edu/~burtscher/research/SPDPcompressor/)<br /> |
500 | 500 | :green_book:[ SPDP - An Automatically Synthesized Lossless Compression Algorithm for Floating-Point Data](http://cs.txstate.edu/~mb92/papers/dcc18.pdf) + [DCC 2018](http://www.cs.brandeis.edu//~dcc/Programs/Program2018.pdf) |
501 | 501 |
|
502 | | -Last update: 10 JUN 2023 |
| 502 | +Last update: 12 APR 2026 |
503 | 503 |
|
0 commit comments