Rubin's hybrid on premises-cloud data access center

William O'Mullane; Yusra AlSayyad; James Chiang; Richard Dubois; Frossie Economou; Fabio Hernandez; Flora Huang; Tim Jenness; Kian-Tat Lim; Yee-Ting Li; Fritz Mueller; Dan Speck; Stephen Pietrowicz; Wei Yang

doi:10.1117/12.3018005

25 July 2024 Rubin's hybrid on premises-cloud data access center

William O'Mullane, Yusra AlSayyad, James Chiang, Richard Dubois, Frossie Economou, Fabio Hernandez, Flora Huang, Tim Jenness, Kian-Tat Lim, Yee-Ting Li, Fritz Mueller, Dan Speck, Stephen Pietrowicz, Wei Yang

Author Affiliations +

Proceedings Volume 13101, Software and Cyberinfrastructure for Astronomy VIII; 131012B (2024) https://doi.org/10.1117/12.3018005
Event: SPIE Astronomical Telescopes + Instrumentation, 2024, Yokohama, Japan

Abstract

Cloud computing offers unparalleled flexibility, a constantly increasing set of “Infrastructure as a Service’’ capabilities, resource elasticity and security isolation. One of the most significant barriers in astronomy to wholesale adoption of cloud infrastructures is the cost for hot storage of large datasets - particularly for Rubin, a Big Data project sized at 0.5 Exabytes (500 Petabytes) over the duration of its ten-year mission. We are planning to reconcile this with a “hybrid” model where user-facing services are deployed on Google Cloud with the majority of data holdings residing in our on-premises Data Facility at SLAC. We discuss the opportunities, status, risks, and technical challenges of this approach.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

William O'Mullane, Yusra AlSayyad, James Chiang, Richard Dubois, Frossie Economou, Fabio Hernandez, Flora Huang, Tim Jenness, Kian-Tat Lim, Yee-Ting Li, Fritz Mueller, Dan Speck, Stephen Pietrowicz, and Wei Yang "Rubin's hybrid on premises-cloud data access center", Proc. SPIE 13101, Software and Cyberinfrastructure for Astronomy VIII, 131012B (25 July 2024); https://doi.org/10.1117/12.3018005

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Clouds

Databases

Data modeling

Data storage

Data archive systems

Observatories

Data backup

Show All Keywords

Keywords/Phrases

Search In:

Publication Years