Complex data processing

The volume and scale of data, combined with the scientific requirements for near-real-time processing, make Rubin the Legacy Survey of Space and Time (LSST) one of the most ambitious data science projects in astronomy and astrophysics to date. 

By the end of the decade-long LSST, the survey will have created an astronomical catalogue composed of 20 billion galaxies and 17 billion stars and their associated physical properties.

The UK is part of a global data journey

Sophisticated algorithms on high-resolution images will enable the automated detection and classification of celestial objects. The computing and storage resources needed to achieve this feat will be based in three Data Facilities – in the US, the UK, and France. The UK Data Facility will be integrated with the same technologies, databases and algorithms as used at the US Data Facility. The processed data will be pooled, with the entire survey data (imaging and catalogues) available to all three data facilities. 

Thanks to Rubin, more people will have access to more astronomical data than ever before

The volume of LSST data makes it impractical for astronomers to download survey data. Instead, astronomers will run their analysis through the Rubin Science Platform via the Data Facilities and Data Access Centres (DACs). 

The data will be delivered in two ways: prompt products and annual data releases.

• Prompt products – the nightly alert stream supports science that requires rapid follow-up. For every change in the sky detected, an alert will be issued – up to 10 million a night. Through Rubin's community brokers, such as Lasair, users can follow alerts for specific objects of interest, such as supernovae.

• Annual data releases – the UK is part of a shared system to manage, monitor and execute the processing workload. Once processing is complete, an annual data release will be produced and shared with the Rubin Community. Each one will include calibrated images and catalogues of billions of objects. 

Thanks to Rubin, more people will have access to more astronomical data than ever before. The Zooniverse platform will enable amateur astronomers to undertake their own science and contribute to the wealth of discoveries that Rubin has the potential to uncover.