
Strategies for testing software systems virtualization
This material may be useful for those who test the systems of the type described and for managers these projects.
Osadchaya Helen, tesing equipment tester controller: Author
Co-author: Helen Futornyak, Junior Tester driver's test equipment
href = "http://www.apriorit.com"> Apriorit Inc.
Virtualization software
Virtualization broad deservedly becomes more and more popular and so do the virtualization software, in particular. Due to virtualization the end user can work with the usual things and not think that is actually virtual objects. Can solve the wide range of issues related to the use of real resources.
Let's examine the virtualization software systems that offer virtual applications and desktops to the end user. This means that we will examine systems that allow users to use different applications without installing on the user's computer (eg, working with MS Word without having to install all Microsoft Office on the computer). Or it can be when working with different operating systems without having real computers with various operating systems installed on them necessary.
In other words, with the help of these systems, the application starts on the client computer and it looks as if it were installed locally. Users are free to work with data without making changes to your local computer.
Examples of virtualization systems such as Microsoft App-V, VMware ThinApp, Citrix XenApp, and many others.
Test Environment
Red
The virtualization software systems are first of all client-server applications. That is why interaction with the network is inevitable.
Very often, a full test of virtualization systems, we need to create a separate sub test network with a domain controller and several computers added to this domain.
Is sufficient to separate a small capacity computer as a domain controller. The possibility to install several systems in it and so our test of compatibility with different operating systems on driver domain (usually, it is 2003/2008/2008R2 Windows server operating systems.)
You must install the following functions in the domain controller:
- Active Directory Domain Services;
- DHCP;
- DNS.
You must configure the gateway for Internet access from the local network. Therefore, you need a switch and several network cables for network configuration.
Virtual Computer
We need many computers, because we have to review the work with all clients and servers support. In addition, we may need to try to work with different processors, sound cards and other hardware. Virtual machines are used for these purposes. Profits generated by the virtual machines are VMware Workstation, Microsoft Virtual PC, Parallels Workstation, VirtualBox and Sun
Despite evidence in virtual machines is easier, do not forget to test on real equipment. The results obtained in the virtual environment may differ from the results of tests on real.
VDI
If the desktop infrastructure support virtual takes place in the test project (ie where the user can obtain not only the remote desktop, but the entire virtual machine available) Additional test environment required for the hypervisor.
It is better to assign a separate physical computer to install the hypervisor. The most commonly used hypervisors are:
- ESX / ESXi VMWare;
- Micosoft Windows Server 2008 R2 with Hyper-V role installed;
- Micosoft Hyper-V Server 2008 R2 (no GUI).
We recommend the installation of hypervisors on different hard drives.
ESX / ESXi is very demanding on the hardware (CPU, network card) is for so check compatibility beforehand.
Wide Area Network Emulator
In the process of testing on the local network, we may have to emulate the work of the global network and the emulation of the slow connection (delay packets). We will need the global network for this emulator, for example, WANem (you can download from http://wanem.sourceforge.net/).
Printers virtual
If the test system supports the redirection of printers in the session, we will need not only real printers, but also virtual to test the system. Virtual Printer is a program that emulates the work of the printer, but does not require an actual device (typically, the action is performed to print file.)
Examples of virtual printers are:
- Adobe Acrobat;
- PDFCreator;
- FinePrint, etc.
Additional devices
Depending on the specific test system and the reorientation of the devices that support it, too may need the following:
- printer;
- scanner;
- headset with a microphone;
- webcam;
- USB flash drives;
- Card reader;
- USB hub.
Testing Types
Settings test
This type of testing is inevitable for virtualization systems and takes into account a number of parameters. The main parameters of the test operating system configuration and capacity (32 – or 64-bit).
The system must be tested on all supported operating systems for both the server side customer.
The server may be comprised of several components, which may or must be installed on different computers. It also increases the number of all possible combinations. Therefore, the priority is necessary.
It is good if the system is in use, they have their users, and we know what operating systems I use. In Here, we have to prove exactly in these early operating systems.
If you do not know anything about end users, we can see the statistics of systems operational use in the world or in a defined region (if the system is intended for distribution in any given region). These statistics are easily found Internet (eg http://www.w3schools.com/browsers/browsers_os.asp).
It is also important to vary and run tests with different editions operating system (Standard, Enterprise, Home, Premium, etc.) and with different service packs, updates, etc.
Therefore, we have to make a table – Array of settings and configuration settings here in order of significance. In the simplest case, is roughly as follows:
Table A matrix configuration
In this table, is convenient to make configurations proven and ongoing with different colors. And we can also mark last settings in earlier versions.
If the test system is intended not only for personal computers and laptops as a customer but also for thin clients and PDAs, these too must be included in the configuration table.
If the test system provides the web interface clients, add the browsers as possible to the settings:
- IE;
- Firefox;
- Chrome;
- Opera;
- Safari, etc.
Unable to run tests on all configurations. In general, the larger configurations priorities are covered.
Installation Testing
Generally, the server virtualization systems consists of several components allow installation on multiple computers and distribute the load so. Or maybe feature can be used to install or remove some of the functionality defined.
Therefore, there is a set of cases that must be tested:
- The default installation;
- The cancellation of the facility;
- The installation of separate components on different computers;
- The installation of all components on a single computer;
- Installation additional components;
- The removal of one or more components;
- Reinstalling the application;
- Suppression of all components;
- Installing the combination of components (to compile the optimum set of cases, we use the method of all couples or just select the combinations that are most suitable for the real situation);
- Installation for all users / current user.
The client side depends on the project. Installation with or without the set of components is also possible. In the general case, the test will the same as for the server.
Do not forget that the test is not the only facility in the virtual machine, but also real.
If the system is in use, it is likely that the new software version will be proposed to users in two ways: as a stand-alone and as the Service Pack. For it is necessary to check the version upgrade to the new one.
Functional Testing
It is the main type of evidence which verifies product functionality. Also evidence of interaction with third-party software, end user will probably use takes place.
- First, it is necessary to verify the use cases, ie what the user is likely to do with the system.
Under the specific the program will last at least two types of users: administrator, who will deploy and configure the system and the end user (really extreme), which only work with the client side and start from there the necessary applications and desktops created by the administrator on the server for him.
Thus, first we must all use cases for system testing.
- Then we delve into the functional tests.
To do this, we must divide the project into logical parts (features) and write a detailed test plan for each part. We can start testing with the test plan developed after the smoke test (see below) was adopted with success and that this feature is not blocking defects.
- It is also is important to check how the system tested, works with other applications that the end user to use.
For example, if the audio system works with redirected and / or video only and not use the rules will be interesting to see how it will work for communicators programs such as Skype, ICQ and Microsoft Office Communicator.
Performance Tests
Performance testing is to define whether the developed system is effective and not abuse of resources.
For example, charging work of certain servers is checked when receiving remote applications of these servers for several clients at the same time.
What to do?
As a general rule, it checks the memory and CPU usage and traffic.
- To check the CPU usage and memory, we can use Windows standard tools such as Task Manager and Performance Monitor (perfmon command run from the command line).
- To control traffic, BWMeter can use, for example (you can download from http://bwmeter.en.softonic.com/).
If the load balancer takes place in the system (similar to the load balancer in Windows Server) is required to charge certain servers for testing purposes artificially (for example, increase the use of memory and CPU).
To do this, we can use third-party utilities, such as Rmma for use of the CPU (can be downloaded from http://cpu.rightmark.org/products/rmma.shtml) and MEMTEST Alegre to the increased use of memory (can be downloaded from http://www.alegr-memtest.com-about.com/).
High and loads more
It is important to check the system performance under conditions that are the most approximate to reality (at high loads). To test this performance test cargo holds. For example, we check the server's response time to many clients connecting to it.
If the number of customers with which we made tests exceeds the number stated, the greater load test, ie stress testing. In this case, we are interested in the system correctly reacts to the increased load.
Regression testing
Evidence related to the changes is probably the most widely used type of virtualization systems. These systems are not written at a time, gradually extending its functionality. Therefore, to receive the trial version, it is first necessary to verify the functionality Basic and see if something broke when changes in the program.
To verify the core functionality quickly for test plans to smoke regression tests are ready. Are prepared to set priorities in the plan for the complete test trials and the selection of cases with the highest priority test plan priority.
We recommend that you complete the exam the 1-2 configuration with the highest priority and the smoke test in other settings.
Automated Testing
Virtualization software testing systems is a vast array of automation tasks: from the most simple to automate the installation of the universal complex automation systems to start the hypervisor, virtual teams start the customers need, and provide the user's session with the required parameters.
The development of such "smart" systems are very complicated which is why it is usually sufficient to take self-tests of regression testing. In the simplest case is a set of cases for the control surface of the work of implementing and carrying out tests of the simplest and most common actions (acceptance testing). Or, better, can be quite an extensive set of test cases for smoke. In this case, when the next version is ready for testing, first, we find cases that perform automated verification of the overall program operation (Acceptance or smoke). And if the self-test revealed no defects blocking, we can deepen the test of either feature.
Most self-tests virtualization systems have the client-server architecture. First, we need to prepare the client (it will start and connect to the server). Then we have get the session and start the server self-test in the session. The server side check, which must review and submit a response to the client. The customer will receive the message, write data in the report, and logging.
If we have a number of self-tests covering a certain test plan, then you must also provide a solution to run the tests in the required order. This solution will also have client-server architecture for most of the evidence.
Thus, in the general case, the client and the servers are part of the management system client / server automated testing. This system begins at client and server parts test accordingly and receive and send messages between the client and server.
Conclusion
Among the types of tests, which did not mention GUI and usability testing. However, does not mean that such tests are not done for virtualization systems. But generally, the main emphasis is on functionality.
Generally, it is impossible to consider all possible risks, while the definition of the evaluation strategy systems virtualization in advance. Above all because the product requirements often change in the development process generally. And technology does not stop.
The strategy is a dynamic structure. You have to react to changes appropriately. Only in this case, we can reduce the risks in testing and receive high quality product.
About the Author
Helen Osadchaya is Tester in Driver Development Team in Apriorit Inc. She is also a tutor og Helen Futornyak, who is Junior Tester of the same team.
Apriorit Inc. is external provider of software research and development services. Main specialization of the company is driver development, cloud computing and virtualization, corporate security, professional software research.
Overclocking, Benchmarking, and Monitoring Tools (2 of 2) (HD)
|
|
Computer Memory Saver $9.99 Saves the memory of the on-board vehicle computer when the battery is disconnected. Plugs into cigarette lighter. Use with 9 volt alkaline battery (not included). |
|
|
9 Volt Battery Computer Memory Saver $13.95 Automotive computer memory retaining tool designed to maintain the memory of the on-board vehicle computer (CCU) when the power source (battery) is disconnected. Use of this tool when changing or interrupting the power source prevents loss of certain driveability codes, keyless entry codes, digital radio setting, cellular phone settings and other memory related functions. Prevents loss of radio function on anti-theft radio systems. ? Use with 9 volt alkaline batteryBy Kastar Hand Tools. |
|
|
Carbonate KH Test Kit $3.9 Use enclosed instructions to test for carbonate hardness, the measure of dissolved carbonate and bicarbonate ion concentrations, also called alkilinity. Use this kit to test tap water and fresh or salt water aquariums for carbonate and bicarbonate ion concentrations. Helps detect fish stress caused by rapid pH shifts, the result of low alkilinity. Maintains correct buffering capacity in aquariums. Kit includes: test solution, test tubes with caps, instructions, and computer-analyzed laminated color card to read results. |
|
|
Memory Foam $9.99 The bendable MEMORY FOAM wrist rest from HandStands is a quality computer accessory |
|
|
test $1.99 test text |
|
|
Compact Flash CE To CF Hard Disk Adapter for Computer Laptop $8.49 Description:Compact Flash CE To CF Hard Disk Adapter for Computer Laptop.CE To CF Hard Disk Adapter is ideal to allowing you to connect a hard drive to your PC for data rescue.As this device connects to the IDE bus the drive is not hot swappable.Computer CE To CF Adapter is 50 pin male to 48 pin female connection.Weight: 6.0g.applicate in:For factory test (mainboard, sound card, display card, memory module, etc.)Emmbeded computer, industrial PC, microcontroller system use this card to store emmbeded OS, such as LINUX, WINCE or store user’s software, data.computer factory use edge out harddisk progress testing.Package included: 1 x Laptop CE To CF Adapter |
|
|
API Saltwater Master Test Kit $37.99 Maintaining good water quality is the key to successful fishkeeping. With the API Saltwater Master Test Kit you can test the most important conditions in your marine aquarium. Plus, this kit includes step-by-step instructions on how to perform each test, how to interpret the results, and how to correct unsafe water conditions. Includes High Range pH, Ammonia, Nitrite, and Nitrate. Kit features computer-analyzed laminated color cards, instruction booklet, 4 test tubes, a waterproof holding tray and test tube rack. |
|
|
Freshwater Nitrite Test Kit $4.9 Toxic nitrite is produced by the biological filter as it detoxifies ammonia. Use this product only with freshwater aquariums. Includes: instructions, testing solution, test tube with cap, computer analyzed laminated color card. To use: Fill a clean test tube with five milliliters of water. Add 5 drops of testing solution. Cap and shake five seconds. Don’t hold finger over open tube end as this may affect reading. Wait five minutes. Read results against color chart in kit. |
|
|
Freshwater pH Test Kit $3.4 This kit will measure pH levels from 6.0 to 7.6. It is important to keep a proper pH balance for best water quality. Includes: testing solution, instructions, test tube with cap, and computer analyzed laminated color card. To use: Fill clean test tube with five milliliters of water. Add three drops of solution. Cap tube. Do not put finger on open end of tube as this may affect reading. Shake five seconds. Wait five minutes for color to develop. Read color against chart. |
|
|
USB Thermograph (TEMPer A) Thermometer Test Thermometer $39.9 The thermograph is a miniature stand-alone device that can record temperatures of equipment and environment accurately by using the metashell. And it can store the data for a long time. You can connect it to computer by the USB port to operate, and it also can use offline. It can use for collect temperature data in transportation and storing of chemical, food, environment researching and so on. Range of measuring:TEMPerA : -40~+80 Degree Centigrade / -40~+176 Degree Fahrenheit TEMPerB: -40~+150 Degree Centigrade / -40~+302 Degree Fahrenheit TEMPer8K: -40~+80 Degree Centigrade / -40~+176 Degree Fahrenheit Level of waterproof : IP*7 Battery : Li battery 110mAH, 3.7 V Memory capability: 100,000 items Recording interva: between 1 second to 255 hours Indication of LED signal: When the battery is charging up the green LED flashing; when the device is working ,the red LED flashing; when there is an abnormastate or delay to start work, the blue LED flashing. Battery standby time: between 1 to 5 months Outer power supply: support Life: Record times >100.000, data retention > 40 years, battery rechargeable and re-dischargeable > 500 times. Keep data secret and user management function. Software install:Install USB driver: put the CD into the computer driver, running the USB driversetup.exeInstall the framework: running the thermograph DotNetFXDotNetFX.exeInstalthe application: running the thermograph setup.exe Finished install: running the thermograph.exe on the desktop. When finished install, the system wilclue on you to choose the language.Weight: 16 g |
|
|
API Freshwater Master Test Kit $37.99 Maintaining good water quality is the key to successful fishkeeping. With the API Freshwater Master Test Kit you can test the most important levels in your freshwater aquarium. Plus, this kit includes step-by-step instructions on how to perform each test, how to interpret the results, and how to correct unsafe water conditions. Includes Freshwater pH, High Range pH, Ammonia, Nitrite, and Nitrate. Kit features computer-analyzed laminated color cards, instruction booklet, 4 test tubes, a holding tray and test tube rack. |
|
|
Gateway 4DX2 -50 Mini Computer 16MB Memory Upgrade $11.99 Gateway 4DX2 -50 Mini Computer 16MB FPM |
|
|
Gateway 4DX2 -50 Mini Computer 32MB Memory Upgrade $15.99 Gateway 4DX2 -50 Mini Computer 32MB FPM |
|
|
Gateway 4DX2 -50 Mini Computer 4MB Memory Upgrade $11.99 Gateway 4DX2 -50 Mini Computer 4MB FPM |
|
|
Gateway 4DX2 -50 Mini Computer 8MB Memory Upgrade $15.99 Gateway 4DX2 -50 Mini Computer 8MB FPM |
|
|
DSR Automotive Computer Memory Saver $26.95 ? This accessory connector plugs the OBD II head into the car?s OBD II source? Insert the male connector into an external power-source to save the electrical settings within the vehicle when the battery is disconnected? Protects vehicle fault codes, drivability codes, keyless entry codes and digital radio settings |
|
|
IBM USB Memory Key for VMware ESXi 3.5 Update 4 – Complete Product – 1 Server – Utility – Standard Retail 41Y8269 $28.56 IBM USB Memory Key for VMware ESXi 3.5 Update 4 – Complete Product – 1 Server – Utility – Standard Retail 41Y8269 |
|
|
High Range pH Test Kit $3.8 Tests tap water for high pH levels in the range of 7.4 to 8.8. A high ph of 8.8 is recommended for the African Cichlid. Includes: testing solution, test tube with cap, instructions, and computer analyzed laminated color card. To use: Fill clean test tube with five milliliters of water. Add five drops of testing solution. Cap tube. Do not hold finger over open end of tube as this may affect reading. Shake five seconds. Wait five minutes for color to develop. Read against chart. |
|
|
JanSport Super Computer – Black $50.95 The Super Computer backpack from JanSport features S-curve EVA shoulder straps, a large main compartment, a dedicated side-entry 15 inch padded laptop compartment, a front utility pocket with an organizer, a vertical stash pocket, a padded bottom to protect contents and a web haul handle. |
|
|
Gateway 4DX Series 4DX2 -50 Mini Computer 16MB 70ns FPM SIMM 144-pin Memory $11.99 Gateway 4DX Series 4DX2 -50 Mini Computer 16MB 70ns FPM SIMM 144-pin Memory |
This day in history...
Powered By WPHistory
