Workshop on storage control protocols

18 May 2009, 09:00 → 20 May 2009, 18:00 Europe/Berlin

Various (DESY Hamburg)

Patrick Fuhrmann (DESY)

The Storage Resource Manager (SRM) protocol has been successfully applied to the LHC storage GRID for some years now. Being close to the start of the LHC (again), the storage software providers agreed to review the usage of the SRM protocol in the LHC context and to discuss short and long term improvements. The meeting is by invitation only.

Monday 18 May

14:00 → 18:00 Review of the existing SRM protocol usage

This is mainly about gather the following information :

• How do the experiments think, they are using SRM.
• What it the SRM command subset the experiments are currently using.
• How can those operations being optimized.

How can the already planed modifications help :

• Asychronous SRM ls
• Return SRM_INTERNAL_ERROR is SRM or back end is busy.
• Client and server agree on a timeout for operations.

More improvements.

• Can we get rid of httpg ?
• What else can we do without breaking the SRM protocol ?

14:00 Workshop introduction a la Greame.

Speaker: Dr Graeme Stewart (CERN)

Slides perspectives.pdf

14:10 SRM timing statistics seen from FTS gathered from Tier I's

Akos did some investigations on the timing of the SRM of the various SRM SE flavors seen from the FTS perspecive. He will present first results.

Speaker: Dr Akos Frohner (CERN)

Slides SRM-DESY-2009-05-18_FTS-Statistics.pdf

14:20 SRM timing statistics seen from the CASTOR SE point of view.

Giuseppe has been digging into the CASTOR logs and produced timing statistics on SRM requests. Dirk is going to present the initial results.

Speaker: Dr Dirk Duellmann (CERN)

Slides dirkd-srm-desy.pdf

14:30 Protocol obstacles to SRM performance

Several bottlenecks have been identified in the dCache's SRM. Some of these are purely implementation issues, while others are inherent in the protocol. Of the latter group, some can be solved with small protocol changes and others can only be improved cleanly with significant protocol changes. Observations of the usage and behavior of T1_US_FNAL will be included.

Speaker: Dr Matt Crawford (FERMI)

Slides StorageCtl_DESY09_Crawford(2).pdf StorageCtl_DESY09_Crawford.key.zip

14:50 SRM assessment and future plans

We will propose a way to jointly assess during the meeting the current SRM usage for various SRM implementations. This will be the basis for determining desired "core" functionality for SRM, as well as "optional" functionality. We then propose to discuss how to use the "core" and "optional functions/features in a future SRM v3.0 framework. The goal is to achieve guidelines for actions and time lines at the end of the meeting.

Speaker: Prof. Arie Shoshani (LBL)

Slides 09.05.SRM.usage.assessment.pdf 09.05.SRM.usage.assessment.ppt

15:00 break

Tuesday 19 May

09:00 → 11:00 Authentication protoocols

How can Authentication be made faster. Do we need delegation and how can that be done outside GSI/Globus. How do we migrate to a possibly new Authentication mechanism. Does Glue support alternative endpoints.

09:00 Results on evaluation on Security Protocols

Speaker: Dr Jens Jensen (RAL)

09:20 Security Protocol Evalution

Speaker: Dr Frohner Akos (RAL)

more information https://twiki.cern.ch/twiki/bin/view/EGEE/SSLProxyHandling

11:00 → 11:15 break

11:15 → 12:30 Technical Fixes to current implementations

Estimated wait time. Identifying permanent failures. SRM Busy : SRM_INTERNAL_ERROR, Total Request Lifetime. Async SRM ls.

12:30 → 14:00 Lunch

14:00 → 18:00 Protocol feature consolidation and customer feedback

14:00 Consolitating protocol features (Aries megatable)

Speaker: Prof. Arie Shoshani (LBL)

14:20 Status of SRM in OGF

Why we are in OGF, why it's important, where we are at the moment and where we are going.

Speaker: Dr Jens Jensen (RAL)

14:40 SRM issues at CHEP

At CHEP we discussed in particular performance issues and how to speed up access without doing much development. This is a summary of these suggestions.

Speaker: Dr Jens Jensen (RAL)

20:00 → 22:00 Discusson on highly controversal topics

Wednesday 20 May

09:00 → 12:00 Agreements

Are there any results of the discussions above which can be put in a document so that the storage software providers can start thinking of an implementation. This must be the basis of a second meeting.

09:00 Industry meets SRM: Diving into the Future

This talk will give you an overview of the current industry evolutions. Basic ideas of upcoming technology implementations and standards for cloud storage will lead to a discussion about Grid higher-levels of abstraction. Considering to build practical systems, it will be necessary to mix Web 2.0 and Clouds with grid/web services. Therefor it is important to pay attention to associations which will identify, develop and coordinate system standards and interfaces for cloud storage.

Speaker: Mr Bjoern Boettcher (TU Harburg)

Slides IndustryMeetsSRM.pdf

09:30 Follow up on WLCG MoU

Which requests are we still waiting for and which features should be canceled.

Speaker: Andrea Sciaba (CERN)

09:50 Improving global transfer scheduling

Speaker: Dr Gerd Behrmann

Slides srm_scheduling.pdf

10:10 Feedback from Tier I survey (Ron)

Speaker: Dr Patrick Fuhrmann (DESY)

Slides RonsSurvey.pdf

10:30 How to use non-spaces

Speaker: Dr Jean-Philippe Baud (CERN)

10:50 Summary and good bye

Speaker: Dr Greame Stewart (CERN)