5–7 Nov 2025
Deutsches Elektronen-Synchrotron DESY
Europe/Berlin timezone

Streaming Data Anywhere Securely with Tiled Websockets

6 Nov 2025, 15:00
15m
CFEL (Building 99) (Deutsches Elektronen-Synchrotron DESY)

CFEL (Building 99)

Deutsches Elektronen-Synchrotron DESY

Notkestraße 85, 22607 Hamburg
Contributed talk Community Talks

Speaker

Dan Allan (Brookhaven National Laboratory)

Description

New work on Tiled provides streaming access to data. Existing tools, including EPICS and various streaming detector interfaces, satisfy this use case for raw data in an "edge computing" scenario where the consumer is on the same local network as the producer. But to extend this to remote networks—or to stream processed and analyzed data—has typically required building specialized software infrastructure and obtaining special cybersecurity accommodations (exceptions). Tiled streams scientific data structures through the industry-standard protocol Websockets that can flow securely through firewalls and proxies. This was used in July for a user experiment at NSLS-II (SMI 12-ID) in which data was streamed into an ML model running on a compute cluster located on the opposite coast, at the Advanced Light Source. This model provided a live view of features during a time resolved scattering experiment.Accessible Python interfaces make this a promising tool for scientists to build streaming pipelines of processed and analyzed data that can flow securely anywhere there is an Internet connection.

Author

Dan Allan (Brookhaven National Laboratory)

Co-authors

Dylan McReynolds (Lawrence Berkeley National Lab) Eliot Gann (Brookhaven National Laboratory) Garrett Bischof (Brookhaven National Laboratory) Monika Choudhary (Advanced Light Source) Tanny Chavez (Advanced Light Source) Venkateswaran Shekar Xiaoya Chong (Advanced Light Source)

Presentation materials