Please use this identifier to cite or link to this item: https://doi.org/10.14529/jsfi170207
Title: InfiniCortex - From proof-of-concept to production
Authors: Noaje G.
Davis A.
Low J.
Seng L.
Lian T.G.
Or?owski L.P.
Chien D.
Sing-Wu L.
Wee T.T. 
Poppe Y.
Kim Kenneth B.H. 
Howard A.
Southwell D.
Gunthorpe J.
Michalewicz M.T.
Keywords: Green computing
Pipeline processing systems
Supercomputers
ADIOS
Global supercomputer connectivity
Hpc clouds
Infiniband
InfiniCloud
InfiniCortex
Superfacilities
Work-flows
Data handling
Issue Date: 2017
Citation: Noaje G., Davis A., Low J., Seng L., Lian T.G., Or?owski L.P., Chien D., Sing-Wu L., Wee T.T., Poppe Y., Kim Kenneth B.H., Howard A., Southwell D., Gunthorpe J., Michalewicz M.T. (2017). InfiniCortex - From proof-of-concept to production. Supercomputing Frontiers and Innovations 4 (2) : 87-102. ScholarBank@NUS Repository. https://doi.org/10.14529/jsfi170207
Abstract: The global effort to build ever more powerful supercomputers is faced with the challenge of ramping up High Performance Computing systems to ExaScale capabilities and, at the same time, keeping the electrical power consumption for a system of that scale at less than 20 MW level. One possible solution, bypassing this local energy limit, is to use distributed supercomputers to alleviate intense power requirements at any single location. The other critical challenge faced by the global computer industry and international scientific collaborations is the requirement of streaming colossal amounts of time-critical data. Examples abound: i) transfer of astrophysical data collected by the Square Kilometre Array to the international partners, ii) streaming of large facilities experimental data through the Pacific Research Platform collaboration of DoE, ESnet and other partners in the US and elsewhere, iii) the Superficilities vision expressed by DoE, iv) new architecture for CERN LHC data processing pipeline focussing on more powerful processing facilities connected by higher throughput connectivity. The InfiniCortex project led by A*STAR Computational Resource Centre demonstrates a worldwide InfiniBand fabric circumnavigating the globe and bringing together, as one concurrent globally distributer HPC system, several supercomputing facilities spanned across four continents (Asia, Australia, Europe and North America). Using global scale InfiniBand connections, with bandwidth utilisation approaching 98% link capacity, we have established a new architectural approach which might lead to the next generation supercomputing systems capable of solving the most complex problems through the aggregation and parallelisation of many globally distributed supercomputers into a single hive-mind of enormous scale. © The Authors 2016.
Source Title: Supercomputing Frontiers and Innovations
URI: https://scholarbank.nus.edu.sg/handle/10635/174665
ISSN: 2409-6008
DOI: 10.14529/jsfi170207
Appears in Collections:Elements
Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
10_14529_jsfi170207.pdf4.29 MBAdobe PDF

OPEN

PublishedView/Download

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.