ExaFEL-OLD
The ExaFEL application aims at shrinking the X-ray Free Electron Laser data analysis timescale from weeks to minutes. Near real-time interpretation of molecular structure revealed by X-ray diffraction will require computational intensities of unprecedented scales, coupled to a datapath of unprecedented bandwidth. Detector data rates at light sources are advancing exponentially: the Linac Coherent Light Source (LCLS) will increase its data throughput by three orders of magnitude by 2025. Users of LCLS require an integrated combination of data processing and scientific interpretation, where both aspects demand intensive computational analysis. This analysis must be carried out quickly to allow users to iterate their experiments and extract the most value from scarce beam time. In this proposal we identify a grand challenge: Enabling new photon science from the LCLS will require near real-time analysis (~10 min) of data bursts, requiring burst computational intensities exceeding an exaflop. Achieving such turn around on the future, much larger, data sets using algorithms with higher fidelity than any facility can support today will require exascale resources. Success will also require an inter-facility R&D partnership. As an end-to-end challenge problem, XFEL applications require significant orchestration of compute, network, and storage resources and present a model use case for ESnet R&D into network operating systems. Leveraging a successful existing collaboration between LCLS and NERSC we present a plan for LCLS to retain its global leadership role for FEL science while also broadening the impact of exascale in related data analysis workflows.
References
Team
Name | Affiliation | Role and Responsibility |
---|---|---|
Amedeo Perazzo | SLAC/LCLS | PI, Data Flow |
Wilko Kroeger | SLAC/LCLS | Data Flow |
Chris O’Grady | SLAC/LCLS | psana development |
Chuck Yoon | SLAC/LCLS | psana development |
Clemens Weninger | SLAC/LCLS | psana development |
Monarin Uervirojnangkoorn | SLAC/LCLS | Crystallography |
Audrey Corbeil Therrien | SLAC | Workflow |
Alex Aiken | SLAC/CS | Software architecture |
Elliott Slaughter | SLAC/CS | Software architecture |
Alan Heirich | SLAC/CS | Software architecture |
David Skinner | LBL/NERSC | Resource orchestration |
Chin Guok | LBL/ESnet | Networking architecture |
Alexander Sim | LBL/ESnet | Networking architecture |
John MacAuley | LBL/ESnet | Networking architecture |
Nick Sauter | LBL/MBIB | PI, Crystallography |
Aaron Brewster | LBL/MBIB | Crystallography |
Robert Bolotovsky | LBL/MBIB | Crystallography |
Asmit Bhowmick | LBL/MBIB | Crystallography |
Billy Poon | LBL/MBIB | Crystallography/KNL |
Meiyue Shao | LBL/MBIB | Crystallography |
Peter Zwart | LBL/MBIB/CAMERA | Single Particle Imaging |
Jeff Donatelli | LBL/CAMERA | Single Particle Imaging |
James Sethian | LBL/CAMERA | Algorithms |
Christine Sweeney | LANL | Workflow |
Michael Wall | LANL | Diffuse scattering |
Pranay Kommera | LANL | Acceleration/Scaling |
Vinay Ramakrishnaiah | LANL | Acceleration/Scaling |
ExaFEL Video | EXAscale for Free Electron Lasers
(Video Below)
