Abdullah Almurayh
MSCS Graduate Candidate
Committee members:
Dr. Edward Chow (Advisor)
Dr. Chuan Yue
Dr. Albert Glock
Fall 2011
MCEVE / Abdullah Almurayh
1
8/26/2011
2
Widely used technology
Benefits of Virtualization
Consolidation and isolation
Reduced power and cooling
Green computing
Ease of deployment and administration
High availability and disaster recovery
Applications of virtualization
Education
Software Evaluation
Enabling the dynamic data center
Cloud computing
Load Balancing
Information Technology
Departments
Disaster Recovery
Personal use
MCEVE / Abdullah Almurayh 8/26/2011
3
Virtualization types:
• Full-virtualization
• Para-virtualization
• Operating system-level virtualization
• Emulation
Virtualization Projects:
• Xen
• VMware
• Windows Server 2008 R2 – Hyper-V
• OpenVZ
• Red Hat Virtualization RHEV
• Virtual box
Many companies, datacenters, organizations, universities, and IT have virtualized their servers.
Even Small business and individuals started using their virtualization solutions. Availability of Low-cost Public Clouds, e.g. Amazon AWS
MCEVE / Abdullah Almurayh 8/26/2011
Virtual Machine (VM):
• Guest Operating System.
• More flexibility.
• Full Virtualization, Para- Virtualization.
• Xen, Vmware, Virtual box, RHEV.
4
Virtual Private Server(VPS):
• Share host Operating System.
• Less flexibility when the host Kernel
• more efficient.
• OS-level Virtualization.
• Linux-Vserver, OpenVZ.
MCEVE / Abdullah Almurayh 8/26/2011
VM vs. VPS:
Xen [ Para-Virtualization Virtual Machine]
VMware [ Full Virtualization Virtual Machine]
OpenVZ [ OS-level Virtualization Virtual Private Server]
Figure: Comparison of latency performance by different message sizes
Figure: Comparison of read and write performance by different file sizes
Figures are Cited from: Chaudhary, V.; Minsuk Cha; Walters, J.P.; Guercio, S.; Gallo, S.; , "A Comparison of Virtualization
Technologies for HPC," Advanced Information Networking and Applications, 2008. AINA 2008. 22nd International Conference on , vol., no., pp.861-868, 25-28 March 2008, http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=4482796&isnumber=4482669
5
MCEVE / Abdullah Almurayh 8/26/2011
6
MCEVE / Abdullah Almurayh 8/26/2011
Optimizing utilization of resource pools in web application servers
By: Alexander Totok, Vijay Karamcheti, Concurrency and Computation: Practice and Experience, vol. 22 (2010), pp.
2421-2444.
Research work in the area of modeling underlying server environments produces different results.
This research work can also include bottleneck identification and tuning to identify system metrics for performance enhancement.
Includes identification of different application configuration parameters to determine performance goals.
The process of configuring virtualized environments is to achieve performance goals by producing better decisions of making virtualized environments . The proposed research is focused on the model of application configuration.
MCEVE / Abdullah Almurayh 8/26/2011
7
Quality in use: Meeting user needs for quality
By: NigelBevan. Journal of Systems and Software. ACM. Dec,1999.Pages 89-96 http://dl.acm.org/citation.cfm?id=340343
This paper describes a framework for software product quality developed for:
• Internal quality: static properties of the code.
• External quality: behaviour of the software when it is executed.
• Quality in use: the extent to which the software meets the needs of the user.
The paper defines the quality in use as a broader view of different concepts such as functionality, reliability, usability, efficiency, and the like.
This framework is needed for evaluating the MCEVE software or application.
MCEVE / Abdullah Almurayh 8/26/2011
8
A Quality of Service Management Framework Based on User
Expectations
Vikas Deora, J. Shao, W. Alex Gray and Nick J. Fiddian, Service-Oriented Computing - ICSOC 2003, p.104-114
This paper presents a quality of service management framework based on user expectations by collecting expectations as well as ratings from the users of a service then calculating the quality of the service. This approach does not allow the user to specify, for example, the minimum and maximum expectations.
MCEVE is also based on user expectations; however, it allows the user to specify weights of these expectations .
MCEVE / Abdullah Almurayh 8/26/2011
9
CPU scalability of different leading virtualization solutions in the UNIX and distributed server market
• Cited from: Not All Server Virtualization Solutions are Created Equal
• By: Andre Metelo
• IBM SWG Competitive Project Office. 08/13/2010
10
MCEVE / Abdullah Almurayh 8/26/2011
Trade-off Complexity of Platforms vs. Benchmarks
Native
VMware
Xen
Figure: Passmark – CPU results compared to native (higher is better).
Cited From: VMware, "A Performance Comparison of Hypervisors" 2007.
Native
Xen
VMware
User-mode
Figure : Relative performance of native Linux
(L), XenoLinux (X), VMware workstation 3.2
(V) and User-Mode Linux (U) (higher is better).
Cited From: P. Barham, B. Dragovic, K. Fraser, S. Hand,
T. Harris, A. Ho, et a, "Xen and the art of virtualization," in In Proc. Of the 19th ACM Symposium on Operating
System Principles, Bolton Landing, NY, Oct. 2003..
MCEVE / Abdullah Almurayh 8/26/2011
11
• Use user weighted considerations as inputs for algorithmic outputs
• To have suggested solutions in easy way and low cost.
• A user can get a good overview of configurations that may meet his expectations.
MCEVE / Abdullah Almurayh 8/26/2011
12
Cost:
• Adopting the appropriate decisions resulting in hours configuring virtualized environments instead of spending days researching and comparing existing results.
• The cost can be reduced by the use of existing reliable results instead of performing tests and experiments that cost money and time.
Performance:
• Performance can be enhanced by using solutions that are based on the best performance comparisons.
• Trying different unbeknown solutions may have potential failures and lead to inefficient virtualized environments.
MCEVE / Abdullah Almurayh
13
14
Different opinions lead to different decisions
MCEVE / Abdullah Almurayh combined views
Conf : user configuration
Weight : user configuration weight
Measure : benchmark measurement
W : Weight value
M : measurement value
Mix : overall calculation n : number of resulted solution best : best selection of the overall results.
15
MCEVE / Abdullah Almurayh
16
MCEVE / Abdullah Almurayh
SPCE virtualization measurements (SPECvirt)
17
MCEVE / Abdullah Almurayh
Example
MCEVE Implementation
Web Application Based
Implementation
18
MCEVE / Abdullah Almurayh
Inputs:
1) Considerations
2) Constraints
3) Weighted priorities
19
MCEVE / Abdullah Almurayh
Results:
1) Considerations
2) Weighted priorities
3) List of solutions
20
MCEVE / Abdullah Almurayh
Suggestions:
1) Hardware
2) Platform
3) Measurements
21
MCEVE / Abdullah Almurayh
Detailed configurations
22
MCEVE / Abdullah Almurayh
Execution time:
• Execution time is the time between the submission and result delivering.
• Execution time is impacted by the quantity of the considered parameters.
Test bed Specifications
Machine Type
OS Name
Virtual Machine
Windows XP
Web Server Apache 2.5.10
System Manufacturer VMware Virtual Platform
Total Physical Memory 128.00 MB
Total Virtual Memory 2.00 GB
0,35
0,3
0,25
0,2
0,15
0,1
0,05
0
ALL
Time 0,321323
ALL-2011
0,191892
Virtualizatio n Platform:
ESX
Avg Resp.
Time App
Server
0,272906 0,241496
User expectations
SSD
0,087024
HP-
RHEV/2011
0,0915742
MCEVE / Abdullah Almurayh
23
Effectiveness:
The functionality of the Model depends on the user inputs that any failure of a specific input can be effective.
The Model responds to user changes and functions relatively to these changes.
Accuracy:
This demonstrates how precisely and accurately the Model produces the results.
Compare a human perspective to the Model results
Data Transparency:
Data transparency in the Model indicates the data independency which exists when the code is not subjected to change when any change in the data occurs.
MCEVE / Abdullah Almurayh
24
Configuration # 14:
Intel Xeon E7- 4870 2.4 GHz , 80 cores, 8 chips, 10 cores/chip, 2 threads/core , 2 TB RAM (128 x 16 GB, Quad Rank x4 PC3-8500 CL7
ECC DDR3 1066MHz LP RDIMM) , 576 x 73 GB 15k RPM SAS storage,
2 x Broadcom NetXtreme II Gigabit Ethernet , 4 x Intel x520 10Gb,
RedHat RHEV Virtualization Platform.
Benchmarks
Application Server Performance
Web Server Performance
Mail Server Performance
Overall Performance
Capacity
Avg Resp. Time App Server
Avg Resp. Time Idel
Price
Measurements
33.4983
54.0049
88.7385
7067
432
1.20181
9.03028
$18,000.00
Description
Request per second in application virtual server
Request per second in Web Server virtual server
Request per second in Mail virtual server
Overall Performance of the above performance benchmarks
Number of virtual servers per one physical server
Average response time of application virtual server performance
Average response time of Idle virtual server performance
The price of purchasing/licensing a virtualization platform
25 http://www.spec.org/virt_sc2010/results/res2011q2/virt_sc2010-20110419-00027-perf.html
MCEVE / Abdullah Almurayh
Impact of Weighted Priorities on Selection
Scenario (0)
Weighted priorities
Application Performance
10
Conf#14 score
1
Configurations Application
Performance conf#14 33.4983
conf#13 conf#7
33.4945
33.4929
conf#15 conf#8 conf#12 conf#5 conf#4
33.4751
33.4636
33.4629
33.4407
33.4272
conf#11 conf#1 conf#2 conf#6 conf#9 conf#10 conf#3
33.4156
33.4008
33.4007
33.3361
33.0474
33.0474
32.1869
26
32,5
32
31,5
34
33,5
33
MCEVE / Abdullah Almurayh
Impact of Weighted Priorities on Selection
Scenario (1)
Weighted priorities
Application Performance Avg Resp. Time App Server
10
10
10
10
0
1
2
3
10
10
10
10
10
10
10
4
5
6
7
8
9
10
Conf#14 score
2
2
3
2
2
3
3
1
1
1
2
Configurations conf#15 conf#7 conf#5 conf#14 conf#2 conf#13 conf#4 conf#11 conf#12 conf#8 conf#3 conf#9 conf#1 conf#10 conf#6
Latency
1.17154
1.17929
1.18875
1.20181
1.21857
1.23182
1.29222
1.34103
1.34316
1.34714
1.37154
1.37684
1.38583
1.50053
1.53393
1,8
1,6
1,4
1,2
1
0,8
0,6
0,4
0,2
0
MCEVE / Abdullah Almurayh
27
Impact of Weighted Priorities on Selection
Scenario (2)
Configurations conf#14 conf#15 conf#11 conf#12 conf#7 conf#6 conf#13 conf#9 conf#10 conf#4 conf#5 conf#2 conf#8 conf#3 conf#1
Overall
Performance
Score
7067
3824
3802
3723
2742
2721
2144
1820
1811
1763
1763
1369
1367
1221
1169
6000
5000
4000
3000
2000
1000
0
8000
Application
Performance
10
10
10
10
10
10
10
10
10
10
10
7000
Weighted priorities
Avg Resp. Time App
Server
10
10
10
10
10
10
10
10
10
10
10
Overall
Performance Score
0
1
2
3
4
5
6
7
8
9
10
Conf#14 score
1
1
1
3
1
1
1
1
1
1
1
MCEVE / Abdullah Almurayh
28
Impact of Weighted Priorities on Selection
Scenario (3)
Configurations conf#3 conf#15 conf#10 conf#1 conf#2 conf#4 conf#8 conf#9 conf#13 conf#6 conf#7 conf#12 conf#11 conf#5 conf#14
29
Cost
2500
4166.67
4167
4500
4500
4500
4500
4500
4500
6667
6667
8333
9000
18000
18000
18000
16000
14000
12000
10000
8000
6000
Application
Performance
10
10
10
10
10
10
10
10
10
10
10
20000
4000
2000
0
Weighted priorities
Avg Resp. Time
App Server
Overall Performance
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
10
8
9
10
4
5
6
7
Cost
“price”
0
1
2
3
MCEVE / Abdullah Almurayh
Conf#14
Score
11
14
14
14
1
1
2
2
14
14
14
Impact of Weighted Priorities on Selection
Scenario (4)
Configurations Number of VM conf#14 432 conf#11 conf#15
234
234 conf#12 conf#6 conf#7 conf#13
228
168
168
132 conf#9 conf#10 conf#4 conf#5 conf#2 conf#8 conf#3 conf#1
114
114
108
108
84
84
78
72
30
200
150
100
50
0
Application
Performance
10
10
10
10
10
10
10
10
10
10
10
500
450
400
350
300
250
Weighted priorities
Avg Resp. Time App
Server
10
10
10
10
10
10
10
10
10
10
10
Overall
Performance
10
10
10
10
10
10
10
10
10
10
10
MCEVE / Abdullah Almurayh
Price
10
10
10
10
10
10
10
10
10
10
10
Capacity
6
7
4
5
0
1
2
3
8
9
10
Conf#14 score
14
14
14
14
14
14
14
14
14
14
14
Impact of Weighted Priorities on Selection
Configuration # 14 Scores based on the users weighted priorities
Lower is closer to the user’s expectation
12
11
10
9
8
7
6
5
15
14
13
4
3
2
1
0
Scenario 1
Weights changes
Scenario 2 Scenario 3
MCEVE / Abdullah Almurayh
31
Scenario 4
Benchmarks Comparisons of Competitive Configurations benchmarks comparisons between Configurations #14 and its competitive
Configurations #15
Benchmarks
Application Performance
Web Server Performance
Mail Server Performance
Overall Performance
Capacity
Avg Resp. Time App Server
Avg Resp. Time Idel
Price
SPECvirt_sc2010 Result
Conf#14 Measurements
33.4983
54.0049
88.7385
7067
432
1.20181
9.03028
$18,000.00
Conf#15 Measurements
33.4751
53.9654
88.6013
3824
234
1.17154
5.44872
$ 4 , 166.67
Conf#14 Conf#15
MCEVE / Abdullah Almurayh
32
Needed a lot of time to read and research in many different topics related to
Virtualization.
Needed to implement parameters prediction algorithms, but could not be validated.
Tested Virtualization solutions to understand the differences between them.
Testing Xenserver on UCCS HP blade servers due to unsatisfied requirements in my desktop.
Needed a lot of effort for calculating converting SPEC data into data that
MCEVE uses.
33
I developed a model (MCEVE ) for suggesting better solutions of virtualized environments based on the user weighted considerations.
MCEVE still needs a lot of data to ensure that MCEVE yields dependable results.
The execution time of MCEVE increases as the data grows
The accuracy of MCEVE needs to be normalized since it is impacted by big values such as the cost.
MCEVE / Abdullah Almurayh
Working in future on a different evaluation method by testing the suggested configurations.
Identifying fundamentally different opportunities to provide vast data comes from trustworthy sources
The Model needs a Data Standard that includes naming agreements for data elements and other system components.
There is a need for an offset that can be associated to a large benchmark such as the “Price” to reduce its negative effectiveness.
The Model application can be published in the real world and surveyed.
MCEVE / Abdullah Almurayh
34
I proposed the MCEVE Model that could help users to efficiently configure virtualized environments in an easier and reduced cost manner.
The model uses user considerations and configurations as inputs for algorithmic outputs /suggestions.
The proposed Model helps to minimize unexpected events driven by inefficient configurations.
The model saves user ’s time by adopting the right decisions in hours instead of spending days researching and comparing existing results and reduces the cost of performing tests and experiments.
Performance can be enhanced by using solutions accordingly to real solutions rather than trying different solutions that can lead to high cost.
MCEVE / Abdullah Almurayh
35
36
Demo and
MCEVE / Abdullah Almurayh
[1]
[2]
[3]
[4]
[5]
[6]
[7]
[8]
[9]
[10]
[11]
[12]
[13]
[14]
[15]
[16]
[17]
[18]
[19]
[20]
[21]
37
VMware, "Virtualization Overview," 2006. [Online]. Available: http://www.vmware.com/pdf/virtualization.pdf.
VMware, "Disaster Recovery Virtualization," 2007. [Online]. Available: http://www.vmware.com/files/pdf/DR_VMware_DoubleTake.pdf.
Wikipedia, "Comparison of platform virtualmachines," 7 July 2011 . [Online]. Available: http://en.wikipedia.org/wiki/Comparison_of_platform_virtual_machines.
Intel, "Intel® Virtualization Technology (Intel® VT)," [Online]. Available: http://www.intel.com/technology/virtualization/technology.htm. [Accessed 1 Jan
2011].
AMD, "AMD Virtualization (AMD-
V™) Technology," [Online]. Available: http://sites.amd.com/us/business/it-solutions/virtualization/Pages/amd-v.aspx.
[Accessed 11 Jan 2011].
Wikipedia, "Comparison of application virtual machines," 15 May 2011. [Online]. Available: http://en.wikipedia.org/wiki/Comparison_of_application_virtual_machines.
J. P. Walters, Vipin Chaudhary, Minsuk Cha, Salvatore Guercio Jr. and Steve Gallo, "A Comparison of Virtualization Technologies for HPC," in 22nd
International Conference on Advanced Information Networking and Applications/DOI 10.1109/AINA.2008.45, 2002.
VMware, "A Performance Comparison of Hypervisors," 2007. [Online]. Available: http://www.cc.iitd.ernet.in/misc/cloud/hypervisor_performance.pdf.
P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, et a, "Xen and the art of virtualization," in In Proc. Of the 19th ACM Symposium on Operating
System Principles, Bolton Landing, NY, Oct. 2003..
S. Nanda and T.-c. Chiueh, "A Survey on Virtualization Technologies," 2005. [Online]. Available: http://www.ecsl.cs.sunysb.edu/tr/TR179.pdf. [Accessed 05
Dec 2010].
IBM, "Virtualization
— why it's hot and how to get started," [Online]. Available: http://www-03.ibm.com/systems/virtualization/news/view/062807.html.
[Accessed 09 Dec 2010].
White, J., & Pilbeam, A., "A Survey of Virtualization Technologies With Performance Testing," 2010. [Online]. Available: http://arxiv.org/abs/1010.3233.
A. Metelo, "Not All Server Virtualization Solutions Are Created Equal," IBM SWG Competitive Project Office, 13 Aug 2010. [Online]. Available: ftp://ftp.software.ibm.com/software/solutions/2982/Not_All_Server_Virtualization_Solutions_Are_Created_Equal.pdf.
J. Fornaeus, "Device hypervisors," in Design Automation Conference (DAC), 2010 47th , Alameda, CA, 18 June 2010.
C. Scheffy, Virtualization For Dummies,® AMD Special Edition, AMD Special Edition ed., Hoboken, NJ: Wiley Publishing, Inc., 2007, pp. 22-28.
Binbin Zhang, Xiaolin Wang, Rongfeng Lai,Liang Yang, Yingwei Luo, Zhenlin Wang and Xiaoming Li, "A Survey on I/O Virtualization and Optimization," in
The Fifth Annual ChinaGrid Conference/DOI 10.1109/ChinaGrid.2010.54, 2010.
I. Habib, "Virtualization with KVM," 01 Feb 2008. [Online]. Available: http://www.linuxjournal.com/article/9764.
Redhat, "www.redhat.com," 2009. [Online]. Available: http://www.redhat.com/f/pdf/rhev/DOC-KVM.pdf.
M. T. Jones, "An overview of virtualization methods, architectures, and implementations," 29 Dec 2006. [Online]. Available: http://www.ibm.com/developerworks/linux/library/l-linuxvirt/.
J. Fisher-Ogden, "Abstract Hardware Support for Efficient Virtualization," 12 Dec 2006. [Online]. Available: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.110.1676.
R. Arash, H. Salimi and M. Sharifi, "Improving Software Dependability Using System-Level Virtualization: A Survey," in 2010 IEEE 24th International
Conference on Advanced Information Networking and Applications Workshops, IEEE , 2010.
MCEVE / Abdullah Almurayh
[24]
[25]
[26]
[27]
[28]
[22]
[23]
[29]
[30]
[31]
[32]
[33]
[34]
[35]
[36]
[37]
[38]
[39]
[40]
[41]
[42]
[43]
[44]
[45]
B. Underdahl, M. Lewis and T. and Mueting, Cloud Computing Clusters For Dummies, AMD Special Edition ed., Hoboken, NJ: Wiley Publishing, Inc., 2010.
I. G. Education, "Virtualization in Education," October 2007. [Online]. Available: • http://www-
07.ibm.com/solutions/in/education/download/Virtualization%20in%20Education.pdf.
P. X. Zhou, "Distributed and Internet Systems Lab," [Online]. Available: http://www.cs.uccs.edu/~zbo/Lab.html. [Accessed 07 May 2011].
C. E. Chow, "Homework #3. LVS Cluster," 09 March 2011. [Online]. Available: http://cs.uccs.edu/~cs526/hw3S2011.html.
T. L. V. Server, "What is virtual server?," 13 Jan 2011. [Online]. Available: http://www.linuxvirtualserver.org/.
Amazon, "Amazon Elastic Compute Cloud," [Online]. Available: http://aws.amazon.com/ec2/. [Accessed 23 May 2011].
PlateSpin, "Consolidated Disaster Recovery Using Virtualization," 2007. [Online]. Available: http://www.meritalk.com/uploads_legacy/whitepapers/White_Paper_Conslidated_DR_Using_Virtualization.pdf.
Xen, "What is Xen Hypervisor?," 03 March 2010. [Online]. Available: http://www.xen.org/files/Marketing/WhatisXen.pdf.
V. Inc., "Virtualization Basics," [Online]. Available: http://www.vmware.com/virtualization/history.html. [Accessed 19 May 2011].
M. Tulloch, Understanding Microsoft Virtualization Solutions, 2nd ed., Microsoft Press, 2010, pp. 26-30.
M. Ahmed, S. Zahda and M. and Abbasbas, "Server Consolidation Using OpenVZ: Performance Evaluation," in II th International Conference on Computer and Information Technology, December, 2008.
K. Kolyshkin, "Virtualization in Linux," 1 September 2006. [Online]. Available: http://download.openvz.org/doc/openvz-intro.pdf.
R. HAT, "RED HAT Enterprise Virtualization Hypervisor," 29 October 2010. [Online]. Available: http://www.redhat.com/f/pdf/rhev/RHEV_Hypervisor_Doc076_1010_web.pdf.
OpenVZWiki, "Virtuozzo," 18 June 2008. [Online]. Available: http://wiki.openvz.org/Virtuozzo.
P. V. Containers, "An Introduction to OS Virtualization and Parallels Virtuozzo Containers," 27 April 2009. [Online]. Available: http://www.parallels.com/r/pdf/wp/pvc/Parallels_Virtuozzo_Containers_WP_an_introduction_to_os_EN.pdf.
VirtualBox, "Welcome to VirtualBox.org!," Oracle, [Online]. Available: http://download.virtualbox.org/virtualbox/UserManual.pdf. [Accessed 22 March 2011].
Oracle, "Oracle VM VirtualBox," Oracle, [Online]. Available: http://www.oracle.com/us/technologies/virtualization/061976.html. [Accessed 22 March 2011].
Linux-VServer.org, "Welcome to Linux-VServer.org," Linux-VServer.org, 17 March 2011. [Online]. Available: http://linux-vserver.org/Welcome_to_Linux-
VServer.org.
D. Gelernter, "Truth, Beauty, and the Virtual Machine," DISCOVER, 1 September 1997 . [Online]. Available: http://discovermagazine.com/1997/sep/truthbeautyandth1217.
Wikipedia, "Virtual Machine," 12 July 2011. [Online]. Available: http://en.wikipedia.org/wiki/Virtual_machine.
SUSE, "SUSE Linux Enterprise Server Virtualization with Xen," Novell, Inc, 03 Dec 2010. [Online]. Available: http://doc.opensuse.org/products_new/draft/SLES/SLES-xen/index.html.
Wikipedia, "Virtual private server," 15 July 2011. [Online]. Available: http://en.wikipedia.org/wiki/Virtual_private_server.
VMware, "Virtualization Basics," VMware, Inc., [Online]. Available: http://www.vmware.com/virtualization/virtual-machine.html.
Casteleyn, Sven, Florian Daniel, Peter Dolog, and Maristella Matera, Engineering Web Applications, Springer, 2009, p. 3.4.1 The WebML Model..
MCEVE / Abdullah Almurayh
38
[53]
[54]
[55]
[56]
[57]
[58]
[59]
[62]
[63]
[64]
[65]
[66]
[67]
[68]
[46]
[47]
[48]
[49]
[50]
[51]
[52]
[60]
[61]
SPEC, "SPECvirt_sc2010 Results," 2010. [Online]. Available: http://www.spec.org/virt_sc2010/results/.
SPEC, "Performance Details," 2010. [Online]. Available: http://www.spec.org/virt_sc2010/results/res2011q2/virt_sc2010-20110420-00028perf.html#Performance Details.
VMware, "VMware Cost-Per- Application Calculator Methodology," 2011. [Online]. Available: http://www.vmware.com/files/pdf/vmware-cost-per-applicationcalculator- methodology.pdf.
VMware, "VMware vSphere™ 4.1 Pricing, Packaging and Licensing Overview," August 2010. [Online]. Available: http://www.vmware.com/files/pdf/vsphere_pricing.pdf.
P. Rob and C. Coronel, Database Systems: Design, Implementation, and Management, 8th ed., Cengage Learning, 2007, p. 704 pages.
Apache, "Apache Web Server," [Online]. Available: http://www.apache.org/.
Michelle J. Gosselin, Jennifer Schommer, "Confining the Apache Web Server with Security-Enhanced Linux," 2002. [Online]. Available: http://www.cse.psu.edu/~tjaeger/cse543-f06/papers/gosselin_apache_selinux.pdf.
W3Schools, "HTML Tutorial," [Online]. Available: http://www.w3schools.com/html/default.asp. [Accessed 20 June 2011].
Wikipedia, "PHP," [Online]. Available: http://en.wikipedia.org/wiki/PHP.
P. D. Group, "PHP Manual," July 2011. [Online]. Available: http://www.php.net/manual/en/index.php.
Wikipedia, "MySQL," 12 July 2011. [Online]. Available: http://en.wikipedia.org/wiki/MySQL.
MySQL, "MySQL 5.5 Reference Manual," Oracle , 2011. [Online]. Available: http://dev.mysql.com/doc/refman/5.5/en/index.html .
Wikipedia, "Solid state drive," [Online]. Available: http://en.wikipedia.org/wiki/Solid-state_drive.
Ekker, Neal; Coughlin, Tom; Handy, Jim, "The Solid State Storage," January 2009. [Online]. Available: http://members.snia.org/apps/group_public/download.php/35796/SSSI%20Wht%20Paper%20Final.pdf.
IBM, "SPECvirt_sc2010 Result," SPEC, Apr 2011. [Online]. Available: http://www.spec.org/virt_sc2010/results/res2011q2/virt_sc2010-20110419-00027perf.html. [Accessed May 2011].
IBM, "Configurations #15 - SPECvirt_sc2010 Result," SPEC, Jul 2011. [Online]. Available: http://www.spec.org/virt_sc2010/results/res2011q3/virt_sc2010-
20110712-00031-perf.html. [Accessed Aug 2011].
Weibull, Experiment Design and Analysis Reference, ReliaSoft, 2008, p. 438.
&. A. P. John L. Hennessy, Computer Architecture, Morgan Kaufmann ed., 2006.
XEN, "The Xen® hypervisor," [Online]. Available: http://www.xen.org/.
Citrix, "XenServer," Citrix Systems, Inc, [Online]. Available: http://support.citrix.com/article/CTX124972.
Citrix, "XenCenter," Citrix Systems, Inc, 07 March 2011. [Online]. Available: http://community.citrix.com/display/xs/XenCenter.
R. Cordova, "Enhancing Network Scanning For Discovering Vulnerabilities," University of Colorado at Colorado Springs, Colorado Springs, CO, 2010.
T. j. Project, "jQuery," The jQuery Project, [Online]. Available: http://jquery.com/. [Accessed 2011 Aug 03].
MCEVE / Abdullah Almurayh
39