hdf5plugin: Use HDF5 compression filters from Python

19 Sept 2023, 14:00
30m
Main auditorium, building 5 (DESY)

Main auditorium, building 5

DESY

Notkestrasse 85, 22607 Hamburg, Germany
Submitted talk Day 1

Speaker

Thomas VINCENT (ESRF)

Description

hdf5plugin is a Python package (1) providing a set of HDF5 compression filters (namely: Blosc, Blosc2, BitShuffle, BZip2, FciDecomp, LZ4, SZ, SZ3, Zfp, ZStd) and (2) enabling their use from the Python programming language with h5py a thin, pythonic wrapper around libHDF5.

This presentation illustrates how to use hdf5plugin for reading and writing compressed datasets from Python and gives an overview of the different HDF5 compression filters it provides. Finally it concludes on improvement suggestions for the HDF5 compression plugin mechanism.

Website http://www.silx.org/doc/hdf5plugin/latest/

Primary authors

Presentation materials