Name: Plans and status for alternative, reduced data ingestion at P08
Start: 2023-12-11T10:00:00+01:00
End: 2023-12-11T10:20:00+01:00
Location: No location set

- 1
  Plans and status for an alternative, reduced data ingestion at P08
  
  Speaker: Linus Pithan (FS-EC (Experimente Control))
  
  SciCat_technical_11_12_LinusPithan.pdf
  11.12.2023 from 10:00 - 11:00
  In summary: Linus gave a more general introduction on how do we want meta data to be ingested at P08 or even wider then the title (Plans and status for alternative, reduced data ingestion at P08) suggested, but it became clear why: there are design decisions to be taken, he needs input, directions where to go in order to actually start the implementation, on:
  Who should own the of a dataset / what should be the owner group? This is imporant for updating/editing
  Schema management, central place at DESY. Who wants to be and should be involved?
  How to accomodate user metadata in the ingestion workflow? What infrastructure would be necessary?
  Continue discussion in the next SC General on Friday!
  Highlight, a technical aspect: The grouping of scans into one dataset to reduce the number of datasets, has been locally tested, macros for user interaction (start, stop, update) were added to Sardana, the last “stop”-interaction is tricky, also proper names need to be chosen (not “measurement”) and more thinking is needed. Follow up actual deployment in a smaller round.
  Another P08 issue: need update of meta data during beam time in scicat from time to time, technically not given in scicat that one knows who did which change. Idea: interface that is aware of what’s going on on the beamline. To be followed up.
  Discussion:
  What are the minimal requirements to get the system up and running, automated ingestion, what is specific to P08, what can be addressed on a wider range.
  Enforce standards while still having flexibility for extensions.
  
  Action items:
  @Everybody: think and share your thoughts on Friday about schema in photon science at SCG
  Regina will invite for the round “deploy grouping of P08 datasets”
  Regina will invite for another follow up concerning user-meta-data ingestion Web-UI (done)
  
  Next Monday, 18^th Dec, we’ll have again at 10AM, the last of the SciCat Technicals this year.
  Announcement to come this week.
  
  Participants
  Linus P
  Jan K
  Dmytro K
  Frank S
  Jan G
  Anton B
  Sabrina S
  Florian B
  Chen S
  Igor K
  Nicolas H
  Anjali A
  Jörg H
  RH

Plans and status for alternative, reduced data ingestion at P08

Seminarroom 3b Building 1b 2nd floor

Continue discussion in the next SC General on Friday!

Another P08 issue: need update of meta data during beam time in scicat from time to time, technically not given in scicat that one knows who did which change. Idea: interface that is aware of what’s going on on the beamline. To be followed up.