Azure is fascinating, but even more fascinating is the marriage of Azure and TFS!
Introduction
Recently, a client I worked for had 2 major business critical applications being delivered. With very little time budgeted for Performance testing, we immediately hit a bottleneck when the performance testing phase started, the in house infrastructure team could not support the hardware requirements in the short notice. It was suggested that the performance testing be performed on one of the QA environments which was a fraction of the production environment. This didn’t seem right, the team decided to turn to the cloud. The team took advantage of the elasticity offered by Azure, starting with a single test agent which was provisioned and ready for use. Within 30 minutes, the team scaled up to 17 test agents to perform a very comprehensive performance testing cycle. Issues were identified and resolved but the highlight was that the cost of running the ‘test rig’ proved to be less than if hosted on premise by the infrastructure team. Thank you for taking the time out to read this blog post. In the series of posts, I’ll try and cover the start to end of everything you need to know to use Azure to build your Test Rig in the cloud.
But Why Azure? I Have My Own Data Centre…
If the environment is provisioned in your own datacentre:
- No matter what level of service agreement you may have with your infrastructure team, there will be down time when the environment is patched
- How fast can you scale up or down the environments (keeping the enterprise processes in mind)
Administration, Cost, Flexibility and Scalability are the areas you would want to think around when taking the decision between your own Data Centre and Azure!
How is Microsoft's Public Cloud Offering Different from Amazon’s Public Cloud Offering?
Microsoft's offering of the Cloud is a hybrid of Platform as a Service (PaaS) and Infrastructure as a Service (IaaS) which distinguishes Microsoft's offering from other providers such as Amazon (Amazon only offers IaaS).
| PaaS – Platform as a Service | IaaS – Infrastructure as a Service |
| Fills the needs of those who want to build and run custom applications as services. | Similar to traditional hosting, where a business will use the hosted environment as a logical extension of the on-premises datacentre. |
| A service provider offers a pre-configured, virtualized application server environment to which applications can be deployed by the development staff. Since the service providers manage the hardware (patching, upgrades and so forth), as well as application server uptime, the involvement of IT pros is minimized. On-demand scalability combined with hardware and application server management relieves developers from infrastructure concerns and allows them to focus on building applications. | The servers (physical and virtual) are rented on an as-needed basis, and the IT professionals who manage the infrastructure have full control of the software configuration. This kind of flexibility increases the complexity of the IT environment, as customer IT professionals need to maintain the servers as though they are on-premises. The maintenance activities may include patching and upgrades of the OS and the application server, load balancing, failover clustering of database servers, backup and restoration, and any other activities that mitigate the risks of hardware and software failures. |
The biggest advantage with PaaS is that you do not have to worry about maintaining the environment, you can focus all your time in solving the business problems with your solution rather than worrying about maintaining the environment. If you decide to use a VM Role on Azure, you are asking for IaaS, more on this later. A nice blog post here on the difference between Saas, PaaS and IaaS.
Now that we are convinced why we should be turning to the cloud and why in specific Azure, let’s discuss about the Test Rig.
The Load Test Rig – Topology
Now the moment of truth, Of course a big part of getting value from cloud computing is identifying the most adequate workloads to take to the cloud, so I’ve decided to try to make a Load Testing rig where the Agents are running on Windows Azure.
I’ll talk you through the above topology:
- User: User kick starts the load test run from the developer workstation on premise. This passes the request to the Test Controller.
- Test Controller: The Test Controller is on premise connected to the same domain as the developer workstation. As soon as the Test Controller receives the request, it makes use of the Windows Azure Connect service to orchestrate the test responsibilities to all the Test Agents. The Windows Azure Connect endpoint software must be active on all Azure instances and on the Controller machine as well. This allows IP connectivity between them and, given that the firewall is properly configured, allows the Controller to send work loads to the agents. In parallel, the Controller will collect the performance data from the agents, using the traditional WMI mechanisms.
- Test Agents: The Test Agents are on the Windows Azure Public Cloud, as soon as the test controller issues instructions to the test agents, the test agents start executing the load tests. The HTTP requests are issued against the web server on premise, the results are captured by the test agents. And finally the results are passed over to the controller.
- Servers: The Web Server and DB Server are hosted on premise in the datacentre, this is usually the case with business critical applications, you probably want to manage them yourself.
Recap and What’s next?
So, in the introduction in the series of blog posts on Load Testing in the cloud, I highlighted why creating a test rig in the cloud is a good idea, what advantages Windows Azure offers and the Test Rig topology that I will be using. I would also like to mention that I stumbled upon this [Video] on Azure in a nutshell, great watch if you are new to Windows Azure. In the next post, I intend to start setting up the Load Test Environment and discuss pricing with respect to test agent machine types that will be used in the test rig. Hope you enjoyed this post, If you have any recommendations on things that I should consider or any questions or feedback, feel free to add to this blog post. Remember to subscribe to http://feeds.feedburner.com/TarunArora.
See you in Part II.
