Data Parallel Application Development and Performance with Azure
Zhang De-an · OhioLink ETD Center (Ohio Library and Information Network) · 2011
The Microsoft Windows Azure technology platform provides on-demand, cloud-based computing, where the cloud is a set of interconnected computing resources located in one or more data centers.Recently, Windows Azure platform is available in data centers in most area of the world large cities.MPI is a message passing library standard, which has many participating organizations, including vendors, researchers, software library developers, and users.The goal of the Message Passing Interface is to establish a portable, efficient, and flexible standard for message passing that will be widely used parallel programs.The advantages of developing message passing software using are well known as its portability, efficiency, and flexibility.This thesis is about how to develop MPI like applications on Windows Azure Platform and simulate parallel computing in cloud.The specific goal is to simulate MPI_Reduce and MPI_Allreduce on Windows Azure, and use this simulation to support and build data parallel applications on windows Azure.We also compare the performances of three data parallel applications under three platforms which are traditional clusters, Azure with queue and Azure with WCF.iii is one of the most outstanding professors in the areas of parallel and distributed system and cloud computing.I feel really lucky to have him as my adviser.Professor Gagan Agrawal has been doing research in those areas for decades.His excellent knowledge and foresight is a gold mine to me.With his help and guidance, I finished my thesis step by step and also found out the right direction in computer science I am interested about, which is windows azure and windows communication foundation.I will be remembering and have gratitude to him for the rest of my life.I would also like to thank Dr. Feng Qin for agreeing to serve on my Master's examination committee.I would also like to thank Neil Mackenzie---MMVP (Microsoft Most Valuable Professional) and YiYun Luo---MCS (Microsoft Contingent Staff).Both of them work at Microsoft Azure Team, and they have given me a lot of help on some technical details about the mechanism of queue and VMs working behind of Windows Azure.