Home / Blogs

Advantage of Commercial Clouds vs. HPC for Scientific Research

Bill St. Arnaud

The Department of Energy (DoE) recently came out with an excellent report, called the Magellan report, on the advantages and disadvantages of using commercial clouds versus in house High Performance Computers (HPC) for leading edge scientific research.

The DoE probably supports the largest concentration of HPC facilities in the world. I agree with the report that for traditional applications such as computational chemistry, astrophysics, etc. will still need large HPC facilities. But traditional computational intensive applications are becoming a niche market and increasingly many of these applications can now run on specialized commercial "HPC" clouds as for example Nimbix.

The biggest growth in demand for computing is not in computational intensive modeling but data intensive processing. New disciplines such as Astroinformatics, Matinformatics (real-time chemical analysis), Systems biology, Meta-genomics, Computational history, computational linguistics, etc. are the driving force for research computing. Most of these data intensive applications are loosely coupled and are ideally suited for using clouds.

While the growth of data intensive science and use of clouds is well recognized, it is still ongoing debate whether researchers should use in-house clouds or commercial facilities. The DoE report did an extensive analysis on the cost of commercial clouds versus in-house facilities. They compared the cost per compute core of an in-house facility versus that of a commercial provider. While I may argue with some of the assumptions in their analysis: for example they did not include cost of money or real estate in their analysis, nor did they use much lower spot market for commercial cloud pricing, I still agree that, in the near term, commercial clouds will be marginally more expensive than in-house facilities.

From a funding agency perspective, however, there is huge advantage of promoting commercial clouds over an in-house facility. Despite the higher per core costs, the elimination of up-front capital costs of using a commercial cloud is incredibly significant, especially in this time period of fiscal constraint. Any capital expenses that can be delayed or eliminated, and yet not impact the quality of the research, has a huge cost benefit to funding agencies. This is also advantageous to the researcher as well. Usually it takes several years to make a proposal, get approval, acquire and install a large HPC facility. With commercial clouds a researcher can start immediately to undertake their computational research. The upfront cost is very small and their time to market (i.e. publishing the results) can be much faster with a commercial facility. In fact some commercial clouds like Amazon and Azure offer a free pilot service to allow researchers and businesses to migrate their software to the cloud and shake out any possible kinks in their software.

With a commercial facility researchers can scale their application as warranted without incurring any additional capital costs. There is no need for peer review to determine the resources that may be made available to the researcher. More importantly, because the incremental per core costs are very small, many other venues for funding for the computation facility are available, as opposed to the limited funding channels available for the purchase of an in-house facility. For example, some commercial organizations will broker their cloud infrastructure for little or no cost to university researchers, as opposed to commercial users. Many R&E networks are also negotiating significant bulk discounts for commercial cloud services on behalf of the R&E community.

By Bill St. Arnaud , Green IT Networking Consultant

Related topics: Cloud Computing, Data Center

WEEKLY WRAP — Get CircleID's Weekly Summary Report by Email:

Comments

To post comments, please login or create an account.

Related Blogs

Related News

Topics

Industry Updates – Sponsored Posts

Neustar Launches Global Partner Program

Neustar Chief Technology Officer Appointed to FCC's Technological Advisory Council

A Look at Traffic Management for External "Cloud" Load Balancing

Dyn Research: Where Do Companies Host Their Websites?

New Nixu NameSurfer 7.3 Series Powers the Software-Defined Data Centre

Nixu Integrates with Nominum N2 Platform in Hybrid Cloud Environments

Nominum and IBM Partner Around Big Data

New Nixu Solution Slashes Cloud Application Delivery Times from Weeks to Milliseconds

Automate IPAM Set-up with Nixu NEE 1.3 Series

Streamline Application Delivery Processes with Nixu NameSurfer 7.2.2

Neustar Labs Innovation Center Grand Opening (Video)

Neustar and University of Illinois Launch the Neustar Innovation Center

dotMobi And LuxCloud Collaborate on Integration of goMobi Onto LuxCloud SaaS Platform

Facets of gTLD Registry Technical Operations - Registry Services

BlueCat Networks Partners with Computacenter to Deliver Cloud-Ready IP Address Management (IPAM)

Giving VIP Treatment to IPAM with Nixu NameSurfer Suite 7.0.2

Asymmetric DHCP Failover Support with Nixu DHCP Server 2.4 Series

Introduction to Nixu Software: End-to-End Software-Based DNS, DHCP, IPAM Solutions for Your Network

dotMobi Launches Low-Cost Cloud Version of Market-Leading DeviceAtlas Device Detection Service

Nixu Software Participates in World IPv6 Day

Sponsored Topics

Afilias

DNSSEC

Sponsored by
Afilias
Verisign

Security

Sponsored by
Verisign
dotMobi

Mobile

Sponsored by
dotMobi
Minds + Machines

Top-Level Domains

Sponsored by
Minds + Machines