Author: Koennecke, M.
Paper Title Page
THPHA167 EPICS Data Streaming and HDF File Writing for ESS Benchmarked Using the Virtual AMOR Instrument 1815
  • D. Werder, M. Brambilla, M. Koennecke
    PSI, Villigen PSI, Switzerland
  • F.A. Akeroyd, M.J. Clarke
    STFC/RAL/ISIS, Chilton, Didcot, Oxon, United Kingdom
  • M.D. Jones
    Tessella, Abingdon, United Kingdom
  • A.H.C. Mukai, J.M.C. Nilsson, T.S. Richter
    ESS, Copenhagen, Denmark
  Funding: This work is funded by the European Union Framework Programme for Research and Innovation Horizon 2020, under grant agreement 676548.
As a contribution to the European Spallation Source as part of BrightnESS, the Paul Scherrer Institut is involved in the streaming of EPICS data and the writing of NeXus compliant HDF5 files. We combine this development with the transition of the AMOR instrument at the Paul Scherrer Institut to EPICS and a streaming based data architecture. To guide our development before ESS has operational equipment, we use a detailed simulation of the instrument AMOR at SINQ to test and integrate our data streaming components. We convert EPICS data sources to Google FlatBuffers as our message format and distribute them using Apache Kafka. On the file writing side, we combine the messages from EPICS data sources as well as from neutron events to write HDF5 files at rates up to 4.8 GiB/s using Parallel HDF. This platform will also be used for testing the experiment control software on top of EPICS.
poster icon Poster THPHA167 [0.476 MB]  
DOI • reference for this paper ※  
Export • reference for this paper using ※ BibTeX, ※ LaTeX, ※ Text/Word, ※ RIS, ※ EndNote (xml)