ExaFEL-OLD

The ExaFEL application aims at shrinking the X-ray Free Electron Laser data analysis timescale from weeks to minutes. Near real-time interpretation of molecular structure revealed by X-ray diffraction will require computational intensities of unprecedented scales, coupled to a datapath of unprecedented bandwidth. Detector data rates at light sources are advancing exponentially: the Linac Coherent Light Source (LCLS) will increase its data throughput by three orders of magnitude by 2025. Users of LCLS require an integrated combination of data processing and scientific interpretation, where both aspects demand intensive computational analysis. This analysis must be carried out quickly to allow users to iterate their experiments and extract the most value from scarce beam time. In this proposal we identify a grand challenge: Enabling new photon science from the LCLS will require near real-time analysis (~10 min) of data bursts, requiring burst computational intensities exceeding an exaflop. Achieving such turn around on the future, much larger, data sets using algorithms with higher fidelity than any facility can support today will require exascale resources.  Success will also require an inter-facility R&D partnership. As an end-to-end challenge problem, XFEL applications require significant orchestration of compute, network, and storage resources and present a model use case for ESnet R&D into network operating systems. Leveraging a successful existing collaboration between LCLS and NERSC we present a plan for LCLS to retain its global leadership role for FEL science while also broadening the impact of exascale in related data analysis workflows.

References

ExaFEL Overview

LCLS-II Science Opportunities

LCLS analysis framework

Watch the ExaFEL Demo Video(external link)

Team

NameAffiliationRole and Responsibility
Amedeo PerazzoSLAC/LCLSPI, Data Flow
Wilko KroegerSLAC/LCLSData Flow
Chris O’GradySLAC/LCLSpsana development
Chuck YoonSLAC/LCLSpsana development
Clemens WeningerSLAC/LCLSpsana development
Monarin UervirojnangkoornSLAC/LCLSCrystallography
Audrey Corbeil TherrienSLACWorkflow
Alex AikenSLAC/CSSoftware architecture
Elliott SlaughterSLAC/CSSoftware architecture
Alan HeirichSLAC/CSSoftware architecture
David SkinnerLBL/NERSCResource orchestration
Chin GuokLBL/ESnetNetworking architecture
Alexander SimLBL/ESnetNetworking architecture
John MacAuleyLBL/ESnetNetworking architecture
Nick SauterLBL/MBIBPI, Crystallography
Aaron BrewsterLBL/MBIBCrystallography
Robert BolotovskyLBL/MBIBCrystallography
Asmit BhowmickLBL/MBIBCrystallography
Billy PoonLBL/MBIBCrystallography/KNL
Meiyue ShaoLBL/MBIBCrystallography
Peter ZwartLBL/MBIB/CAMERASingle Particle Imaging
Jeff DonatelliLBL/CAMERASingle Particle Imaging
James SethianLBL/CAMERAAlgorithms
Christine SweeneyLANLWorkflow
Michael WallLANLDiffuse scattering
Pranay KommeraLANLAcceleration/Scaling
Vinay RamakrishnaiahLANLAcceleration/Scaling

 

ExaFEL Video | EXAscale for Free Electron Lasers
(Video Below)

Video