ExaFEL

The ExaFEL application aims at shrinking the X-ray Free Electron Laser data analysis timescale from weeks to minutes. Near real-time interpretation of molecular structure revealed by X-ray diffraction will require computational intensities of unprecedented scales, coupled to a datapath of unprecedented bandwidth. Detector data rates at light sources are advancing exponentially: the Linac Coherent Light Source (LCLS) will increase its data throughput by three orders of magnitude by 2025. Users of LCLS require an integrated combination of data processing and scientific interpretation, where both aspects demand intensive computational analysis. This analysis must be carried out quickly to allow users to iterate their experiments and extract the most value from scarce beam time. In this proposal we identify a grand challenge: Enabling new photon science from the LCLS will require near real-time analysis (~10 min) of data bursts, requiring burst computational intensities exceeding an exaflop. Achieving such turn around on the future, much larger, data sets using algorithms with higher fidelity than any facility can support today will require exascale resources.  Success will also require an inter-facility R&D partnership. As an end-to-end challenge problem, XFEL applications require significant orchestration of compute, network, and storage resources and present a model use case for ESnet R&D into network operating systems. Leveraging a successful existing collaboration between LCLS and NERSC we present a plan for LCLS to retain its global leadership role for FEL science while also broadening the impact of exascale in related data analysis workflows.

References

ExaFEL Overview

LCLS-II Science Opportunities

LCLS analysis framework

Watch the ExaFEL Demo Video

 

Team

Name

Affiliation

Role and Responsibility

Amedeo Perazzo

SLAC/LCLS

PI, Data Flow

Wilko Kroeger

SLAC/LCLS

Data Flow

Chris O’Grady

SLAC/LCLS

psana development

Chuck Yoon SLAC/LCLS psana development
Clemens Weninger SLAC/LCLS psana development
Monarin Uervirojnangkoorn SLAC/LCLS Crystallography

Audrey Corbeil Therrien

SLAC Workflow

Alex Aiken

SLAC/CS

Software architecture

Elliott Slaughter

SLAC/CS

Software architecture

Alan Heirich

SLAC/CS

Software architecture

David Skinner

LBL/NERSC

Resource orchestration

Chin Guok

LBL/ESnet

Networking architecture

Alexander Sim LBL/ESnet

Networking architecture

John MacAuley

LBL/ESnet

Networking architecture

Nick Sauter

LBL/MBIB

PI, Crystallography

Aaron Brewster

LBL/MBIB

Crystallography

Robert Bolotovsky

LBL/MBIB Crystallography
Asmit Bhowmick LBL/MBIB Crystallography
Billy Poon LBL/MBIB Crystallography/KNL

Meiyue Shao

LBL/MBIB

Crystallography

Peter Zwart

LBL/MBIB/CAMERA

Single Particle Imaging

Jeff Donatelli

LBL/CAMERA

Single Particle Imaging

James Sethian

LBL/CAMERA

Algorithms

Christine Sweeney LANL Workflow

Michael Wall

LANL

Diffuse scattering

Pranay Kommera LANL Acceleration/Scaling
Vinay Ramakrishnaiah LANL Acceleration/Scaling