Compression

A lossless PNG compression optimizer

DEFLATE compression and decompression exposed as Read/BufRead/Write streams. Supports miniz_oxide and multiple zlib implementations. Supports zlib, gzip, and raw deflate streams.

A brotli compressor and decompressor that with an interface avoiding the rust stdlib. This makes it suitable for embedded devices and kernels. It is designed with a pluggable allocator so that the standard lib's allocator may be employed. The default build also includes a stdlib allocator and stream interface. Disable this with --features=no-stdlib. All included code is safe.

Library to support the reading and writing of zip files.

Vortex Mask - sorted, unique, non-negative integers

Flatbuffers definitions for Vortex types

Blocked gzip format (BGZF) reader and writer

Protocol buffer definitions for Vortex types

A byte buffer implementation for Vortex

Compressed in-memory representation of the Software Heritage archive graph

Low-level bindings to the system libz library (also known as zlib).

Adaptors between compression crates and Rust's modern asynchronous IO types.

Vortex FSST string array encoding

Vortex run end encoded array

Vortex errors

An asynchronous ZIP archive reading/writing crate.

LZMA / LZMA2 / LZIP / XZ compression ported from 'tukaani xz for java'

High-performance FFT library written in pure Rust.

A crate for decoding and encoding the header part of gzip files based on the gzip header implementation in the flate2 crate.

Safe low-level bindings for the zstd compression library.

Adaptors for various compression algorithms.

Rust bindings to liblzma providing Read/Write streams as well as low-level in-memory encoding/decoding. forked from xz2.

Bindings to libdeflate for DEFLATE (de)compression exposed as non-streaming buffer operations. Contains bindings for raw deflate, zlib, and gzip data.

DEFLATE compression and decompression library rewritten in Rust based on miniz

A Rust implementation of DEFLATE algorithm and related formats (ZLIB, GZIP)

Vortex in memory columnar data format

Vortex physical encoding that compresses temporal components individually

Vortex zig zag array

Vortex Metrics

Vortex ALP array

Vortex file format with all builtin codecs and a sampling compressor.

A small, zero dependency varint implementation in Rust.

Bindings to libbzip2 for bzip2 compression and decompression exposed as Reader/Writer streams.

Fast and easy JPEG encoding, decoding and lossless transforms with TurboJPEG

IPC message format to exchange Vortex arrays across processes

Vortex fastlanes arrays

Pure Rust Zstandard (zstd) compression implementation for OxiArc

Core components for OxiArc - BitReader/Writer, CRC, traits, and error types

Pure Rust LZ4 compression implementation with LZ4-HC

Good compression for numerical sequences

DEFLATE compression and decompression API designed to be Rust drop-in replacement for miniz

Low-level bindings for the zstd compression library.

Bindings to libdeflate for DEFLATE (de)compression exposed as non-streaming buffer operations. Contains bindings for raw deflate, zlib, and gzip data.

Vortex Sparse array

Common definitions across crates

Vortex byte-boolean array

Core async and blocking IO traits and implementations, used by IPC and file format

BtrBlocks style compressor

High-performance RFC 1952 compression and de-compression

Pure Rust DEFLATE compression algorithm (RFC 1951) for OxiArc