Monday, April 1 • 11:40am - 12:10pm
JASMIN - On the road to high performance software defined object stores - Jonathan Churchill, STFC

Sign up or log in to save this to your schedule and see who's attending!

The JASMIN “Super Data Cluster”– the UK’s Environmental Data Analysis Platform – Has recently completed its £8M Phase IV upgrade, taking its storage capacity to ~45PetaBytes of high performance storage as well as doubling its cloud and batch computing capabilities. In the heart of this talk we will discuss the innovative new storage and networking technologies that, are being deployed for the first time in an HPC context and how these will be used to improve our user experience and flexibility. The storage technologies deployed for the first time in JASMIN – QuoByte, Caringo and PURE – mark the start of our road map towards high performance Object Storage over the next few years, pushing the boundaries of where Object storage will be used. In the talk I will discuss rationale for and the results of the comparative proof of concept benchmarking exercises of several software defined storage technologies, in our search for a route from high performance parallel file systems, towards high performance object storage of ideally similar performance. I will then discuss the JASMIN 4 all Ethernet network deployment and issues, of an unusual 5 tier routed CLOS “data centre” network with 17Terabits/sec edge bandwidth. I will wrap up with some of the early benchmarking results of the file and object storage, showing in excess of 220Gbytes/sec file and approaching this for S3 object performance. At least one of these new technologies – the 31.5PBytes of QuoByte software defined storage is the largest capacity deployment in the world. This is also the first Caringo deployment as an HPC, as opposed to capacity, object store tier.


Jonathan Churchill

After a 20+ year career in the Semiconductor business designing high performance SRAMs and their associated CAD systems, joined STFC in 2006 focusing on HPC systems and support. In the last 6 years I have been responsible for building and procuring the architecture and systems operations... Read More →

Monday April 1, 2019 11:40am - 12:10pm
Premium 3 Etc.Venues St. Paul's

Attendees (10)