Compression

DEFLATE compression and decompression exposed as Read/BufRead/Write streams. Supports miniz_oxide and multiple zlib implementations. Supports zlib, gzip, and raw deflate streams.

A lossless PNG compression optimizer

A brotli compressor and decompressor that with an interface avoiding the rust stdlib. This makes it suitable for embedded devices and kernels. It is designed with a pluggable allocator so that the standard lib's allocator may be employed. The default build also includes a stdlib allocator and stream interface. Disable this with --features=no-stdlib. All included code is safe.

Compressed in-memory representation of the Software Heritage archive graph

Flatbuffers definitions for Vortex types

Low-level bindings to the system libz library (also known as zlib).

Library to support the reading and writing of zip files.

Adaptors between compression crates and Rust's modern asynchronous IO types.

A byte buffer implementation for Vortex

Vortex Mask - sorted, unique, non-negative integers

Blocked gzip format (BGZF) reader and writer

DEFLATE compression and decompression library rewritten in Rust based on miniz

High-performance FFT library written in pure Rust.

Protocol buffer definitions for Vortex types

Vortex FSST string array encoding

Vortex errors

Rust bindings to liblzma providing Read/Write streams as well as low-level in-memory encoding/decoding. forked from xz2.

Low-level bindings to zlib-ng (libz-ng), a high-performance zlib library.

Bindings to libbzip2 for bzip2 compression and decompression exposed as Reader/Writer streams.

Vortex run end encoded array

Fast and easy JPEG encoding, decoding and lossless transforms with TurboJPEG

Bindings to libdeflate for DEFLATE (de)compression exposed as non-streaming buffer operations. Contains bindings for raw deflate, zlib, and gzip data.

Deflate64 implementation based on .NET's implementation

Safe low-level bindings for the zstd compression library.

Vortex file format with all builtin codecs and a sampling compressor.

Vortex zig zag array

Vortex in memory columnar data format

Vortex physical encoding that compresses temporal components individually

LZMA / LZMA2 / LZIP / XZ compression ported from 'tukaani xz for java'

Adaptors for various compression algorithms.

A small, zero dependency varint implementation in Rust.

Low-level bindings for the zstd compression library.

Vortex Metrics

Vortex byte-boolean array

IPC message format to exchange Vortex arrays across processes

Bindings to libdeflate for DEFLATE (de)compression exposed as non-streaming buffer operations. Contains bindings for raw deflate, zlib, and gzip data.

Parallel Compression

The library of data structures based on perfect hashing.

Common definitions across crates

Vortex fastlanes arrays

Vortex ALP array

A variant of include_bytes!/include_str! with compile-time deflation and runtime lazy inflation

Download single files from online zip archives or list the content

Vortex's core type system

FastPFOR lib with C++ Rust wrapper and pure Rust implementation

Binding for the zstd compression library.

Vortex file readers and writers

Core async and blocking IO traits and implementations, used by IPC and file format

BtrBlocks style compressor

Vortex Sparse array