HDF Compression for data service architectures

20 Sept 2023, 13:30
30m
Main auditorium, building 5 (DESY)

Main auditorium, building 5

DESY

Notkestrasse 85, 22607 Hamburg, Germany
Submitted talk Day 2

Speaker

John Readey (HDF Group)

Description

HSDS (Highly Scalable Data Service) is a REST-based web service that supports most of the features of the HDF library, but running as a service. HSDS supports the standard HDF compressors as well as BLOSC-based compressors "out of the box". In addition, HSDS supports parallel compression/decompression and supports using compression with variable length datatypes. This talk will cover how the HSDS architecture supports these features and some ideas for future development.

Primary author

John Readey (HDF Group)

Presentation materials