A price-performance analysis of EC2, Google Compute and Rackspace cloud providers for scientific computing
-
3040
Downloads
-
4464
Views
Authors
Saeed Ullah
- Faculty of Computer Science, Preston University, Islamabad, Pakistan.
M. Daud Awan
- Faculty of Computer Science, Preston University, Islamabad, Pakistan.
M. Sikandar Hayat Khiyal
- Faculty of Computer Science, Preston University, Islamabad, Pakistan.
Abstract
One of the recently emerging areas in cloud computing is deployment of virtual machines across
multiple clouds based on providers' ranking. This involves benchmarking of different cloud providers,
development of different techniques for selection of candidate providers and frameworks for ranking
cloud providers. Existing benchmarking studies are mostly focused on selection of best-fit cloud
provider among a set of cloud providers for a particular set of quality attributes based on industry
best standard tools and techniques. However, most of the researches are focused on performance
of IaaS cloud providers and price-performance analysis is normally ignored while benchmarking
IaaS metrics. In this work, we propose a novel QoS based ranking methodology along with price-
performance analysis that can be used as an input for selecting candidate cloud providers. Our
proposed mechanism allows cloud consumers to find the most cost effective virtual machines for a
given set of user preferences. As a case study, we present performance evaluation and benchmarking
results of three major cloud providers: Google, Amazon and Rackspace.
Share and Cite
ISRP Style
Saeed Ullah, M. Daud Awan, M. Sikandar Hayat Khiyal, A price-performance analysis of EC2, Google Compute and Rackspace cloud providers for scientific computing, Journal of Mathematics and Computer Science, 16 (2016), no. 2, 178-192
AMA Style
Ullah Saeed, Awan M. Daud, Khiyal M. Sikandar Hayat, A price-performance analysis of EC2, Google Compute and Rackspace cloud providers for scientific computing. J Math Comput SCI-JM. (2016); 16(2):178-192
Chicago/Turabian Style
Ullah, Saeed, Awan, M. Daud, Khiyal, M. Sikandar Hayat. "A price-performance analysis of EC2, Google Compute and Rackspace cloud providers for scientific computing." Journal of Mathematics and Computer Science, 16, no. 2 (2016): 178-192
Keywords
- Cloud Computing
- infrastructure-as-a-service
- benchmarking
- price-performance analysis
- ranking
References
-
[1]
G. Aceto, A. Botta, W. De Donato, A. Pescapé, Cloud monitoring: A survey , Comput. Networks, 57 (2013), 2093-2115.
-
[2]
R. Bader, M. Brehm, R. Ebner, H. Heller, L. Palm, F. Wagner , TeraFlops Computing with the Hitachi SR8000-F1: From Vision to Reality, High Performance Computing in Science and Engineering, Springer Berlin Heidelberg, (2002), 3-8.
-
[3]
S. K. Barker, P. Shenoy, Empirical evaluation of latency-sensitive application performance in the cloud, Proceedings of the first annual ACM SIGMM conference on Multimedia systems, (2010), 35-46.
-
[4]
R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility, Future Gener. Comput. Syst., 25 (2009), 599-616.
-
[5]
T. Chauhan, S. Chaudhary, V. Kumar, M. Bhise, Service level agreement parameter matching in cloud computing, World Congress on Information and Communication Technologies (WICT), (2011), 564-570.
-
[6]
L. Cheng, C. L. Wang, QoS Scheduling for Latency-sensitive , Cloud Applications, 2011 (2011 ), 10 pages.
-
[7]
, CIO WebBusiness, December 1, (1997)
-
[8]
A. Fries, J. P. i. de Mora, R. Sirvent, Java-based communication in a High Performance Computing environment , EAS Public. Ser., 45 (2010), 103-106.
-
[9]
S. K. Garg, S. Versteeg, R. Buyya, A framework for ranking of cloud computing services, Future Gener. Comput. Syst., 29 (2013), 1012-1023.
-
[10]
L. Gillam, B. Li, J. O'Loughlin, A. P. S. Tomar, Fair benchmarking for cloud computing systems, J. Cloud Comput. Adv. Syst. Appl., 2013 (2013 ), 6 pages.
-
[11]
N. K. Govindaraju, S. Larsen, J. Gray, D. Manocha, A memory model for scientific algorithms on graphics processors , Proceedings of the ACM/IEEE SC Conference, (2006)
-
[12]
P. T. Homer, Constructing Scientific Applications from Heterogeneous Resources, Ph.D. Dissertation, Technical Report 94-33, Department of Computer Science, University of Arizona (1994)
-
[13]
C. Hristea, D. Lenoski, J. Keen , Measuring memory hierarchy performance of cache-coherent multiprocessors using micro benchmarks, ACM/IEEE 1997 , Conference on Supercomputing (1997)
-
[14]
, , , (https://archive.org/download/tucows 69604 Ubench/ubench-0.32.tar.gz.),
-
[15]
, , , ( http://blog.cloudharmony.com/2010/06/disk-io-benchmarking-in-cloud.html.),
-
[16]
, , , ( http://cloudspectator.com. ),
-
[17]
, Service Measurement Index Framework Version 2.1 , http://csmic.org/downloads/SMI Overview TwoPointOne.pdf, (Online)
-
[18]
, , , ( https://iperf.fr ),
-
[19]
A. Lenk, M. Menzel, J. Lipsky, S. Tai, P. Offermann, What are you paying for? Performance benchmarking for infrastructure-as-a-service offerings, IEEE International Conference on Cloud Computing (CLOUD), (2011), 484-491.
-
[20]
A. Li, X. Yang, S. Kandula, M. Zhang, CloudCmp: comparing public cloud providers, Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, (2010), 1-14.
-
[21]
M. Malawski, G. Juve, E. Deelman, J. Nabrzyski, Cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds, Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, 22 (2012), 1-11.
-
[22]
, Phoronix Test Suite Suites - http://openbenchmarking.org. , , (http://openbenchmarking.org. )
-
[23]
, Practical Guide to Cloud Service Level Agreements Version 2.0 , http://www.cloud- council.org/deliverables/CSCC-Practical-Guide-to-Cloud-Service-Agreements.pdf , (Online)
-
[24]
, , , (pypi.python.org/pypi/speedtest-cli ),
-
[25]
D. A. Reed, Scalable Input/Output: achieving system balance, The MIT Press, U.S.A. (2003)
-
[26]
C. B. Rodamilans, A. Baruchi, E. T. Midorikaa, Experiences Applying Performance Evaluation to Select a Cloud Provider, Proceedings of recent advances in computer engineerwing, communications and information technology (2014)
-
[27]
S. Sindhu, S. A. Mukherjee , A Dynamic List Scheduling Algorithm for Scheduling HPC Application in a Cloud Environment, , ([Online] retrieved from http://searchdl.org/public/book series/AETS/7/178.pdf. )
-
[28]
W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, A. Klepchukov, S. Patil, A. Fox, D. Patterson, Cloudstone: Multi-platform, multi-language benchmark and measurement tools for web 2.0, Proceedings of the 1st Workshop on Cloud Computing, (2008)
-
[29]
R. Van den Bossche, K. Vanmechelen, J. Broeckhove, Cost-optimal scheduling in hybrid IaaS clouds for deadline constrained workloads, IEEE 3rd International Conference on Cloud Computing (CLOUD), (2010), 228-235.
-
[30]
C. Vazquez, R. Krishnan, E. John , Cloud Computing Benchmarking: A Survey, Proceedings of the International Conference on Grid Computing and Applications (GCA), The Steering Committee of The World Congress in Computer Science, , Computer Engineering and Applied Computing (2014)
-
[31]
, , , (www.coker.com.au/bonnie++ ),
-
[32]
, , , ( www.dacapobench.org ),
-
[33]
, , , ( www.icl.cs.utk.edu/projects/ llcbench/ cachebench.html),
-
[34]
, , , ( www.iozone.org ),
-
[35]
, , , (www.forbes.com/sites/joemckendrick/2014/07/28/ibm-microsoft-surge-ahead-of-amazon-in-cloud- revenues-analysts-estimate ),
-
[36]
, , , (www.spec.org/jvm2008. ),
-
[37]
D. Zhao, Z. Zhang, X. Zhou, T. Li, K. Wang, D. Kimpe, I. Raicu, F. S. Fusion, Toward supporting data-intensive scientific applications on extreme-scale high-performance computing systems, IEEE International Conference on Big Data, (2014), 61-70.
-
[38]
Z. Zheng, X. Wu, Y. Zhang, M. Lyu, J. Wang, QoS Ranking Prediction for Cloud Services, IEEE Trans. Parallel Distrib. Syst., 24 (2012), 1213-1222.
-
[39]
Z. Zhong, V. Rychkov, A. Lastovetsky, Data partitioning on heterogeneous multicore platforms, IEEE International Conference on Cluster Computing (CLUSTER), (2011), 580-584.