Load and Performance Tools
Content
From http://www.testingfaqs.org/ Load Testing Link Takes you to Brian Marick’s web page http://www.testingfaqs.org/t-load.html
Load and Performance Tools
Tools that specialize in putting a heavy load on systems (especially client-server systems). These tools are often also GUI test drivers.
Current Listings
• • • • • • • • • • • • • • • • • • • • • • •
ANTS - Advanced .NET Testing System AutoController AutoController with Virtual DirectTest Benchmark Factory BurnInTest Capacity Calibration Chariot CYRANO ServerPack e-Load FORECAST ITF - Internetworking Test Facility Jmeter Load Load Runner Product Family Microsoft Web Application Stress Tool (WAS) Monitor Master NetPressure OpenSTA Portent preVue-ASCII preVue-X Profiler PureAgent
• • • • • • • • • • • • • • • • • • •
PureLoad QALoad QEngine QuotiumPRO Rational Suite PerformanceStudio ReliAgent Scapa StressTest for Hyperion Essbase Scapa StressTest for Thin Client SilkPerformer smartTest SSW Performance PRO! 2000 SSW Performance PRO! 97 Teleprocessing Network Simulator TestMaker WAPT Web Performance Trainer WebLoad Web Roller Webserver Stress Tool
Tools Listed Elsewhere
These tools fit better into a different category, but are worth mentioning here as well. Their main listing is in the other category.
• • • •
CYRANO Test eValid FREstimate WhenToStop
preVue-ASCII
Kind of Tool System Performance / Load Testing Tool Company IBM Rational Software http://www.rational.com/products/prevue/ Software Description preVue performs quality assurance, performance measurement, and regression testing of character-based UNIX applications. The preVue system is the basis for the entire preVue product family. preVue's record/playback technology allows testers to automatically record the workload of 1 to 1000's of virtual user sessions, create test scripts, execute test sessions, and evaluate the summarized reports and graphs. preVue utilizes Remote Terminal Emulation to replicate the workload of actual application users on the System Under Test. preVue provides verification of and timing information for the System Under Test responses over communication mediums including: RS-232-C, Ethernet, Token Ring, FDDI, and X.25 networks. preVue allows testers to perform multi-user performance benchmarks that measure the application response times, system throughput, and system stress levels. preVue has no special hardware requirements and has been successfully ported to a wide range of UNIX platforms. Platforms Supported on all major UNIX platforms. Entry updated July 20, 1998. Return to Listings
preVue-X
Kind of Tool System Performance / Load Testing Tool Company IBM Rational Software http://www.rational.com/products/prevue/ Software Description
preVue-X provides non-intrusive regression and performance testing of X-Window applications. preVue-X accurately emulates multiple users while requiring no special hooks into your application or X Libraries, thus guaranteeing that the application tested is the same application that will be deployed. preVue-X operates at the X protocol level and independently of the GUI. It automatically collects all user interactions with the application (e.g., mouse movements, button activity, keystrokes, think time delays) into an easily editable test script for playback. Features include automated synchronization and time-stamping; geometry independence and script viewer. Platforms Tests all versions of UNIX, X server, GUI toolkits, etc; supported on all major UNIX platforms Entry updated July 20, 1998. Return to Listings
Load Runner Product Family
Kind of Tool Multi-user system and server testing tool Company Mercury Interactive http://www.merc-int.com/ Software Description Automated client/server system testing tools which provide performance testing, load testing and system tuning for multi-user applications Platforms LoadRunner/UX: for UNIX/X Window Applications LoadRunner/PC: for MS Windows Applications LoadRunner/XL: for Server Functionality and Performance LoadRunner/RTE: for Terminal-Based Applications Return to Listings
ITF - Internetworking Test Facility
Kind of Tool Network test driver/manager Company
Applied Computer Technology P.O. Box 497006 Garland, TX 75049-7006 Phone: (214) 240-6744 FAX: (214) 240-5824 E-mail: [email protected] http://www.acomtech.com Software Description The ITF™ (Internetworking Test Facility) system provides a PC-based environment for the development, comprehensive architectural conformance verification, load/stress and performance testing of TCP/IP TN3270/tn5250 products. Ready-to-run validated tests are available and you can easily add to them using our test case development tools. Platforms DOS, Windows 98, Windows NT Entry updated January 11, 2001. Return to Listings
Chariot®
Kind of Tool Load and Performance Tool Company NetIQ Corporation 3553 N. First St. San Jose, CA 95134 Phone: 1-408-856-3000, 1-888-323-6768 FAX: 1-408-273-0578 E-mail: [email protected] http://www.netiq.com/products/chr/ Entry updated March 20, 2003. Return to Listings
WebLoad 3.0
Kind of Tool
Web Application Scalability Testing Tool--Internet and intranet Company RadView Software 1050 Waltham Street Lexington, MA 02421 Phone: 888 723-8439 FAX: 877 723-8439 E-mail: [email protected] http://www.radview.com Software Description WebLoad 3.0 is the premier scalability testing solution for Web applications—Internet and intranet. WebLoad delivers open-interoperability with Web server applications, comprehensive HTTP support, automated operation, single-point management and realtime graphical and statistical analysis for maximum testing performance, ease-of-use and value. WebLoad verifies Web application scalability by generating a load composed of Virtual Clients that simulate real-world traffic. Users create JavaScript-based test scripts that define the behavior of the Virtual Clients. WebLoad executes these test scripts and monitors the Web application’s performance providing real-time graphical and statistical results and comprehensive reports. Platforms Win32 and UNIX platforms Entry added March 3, 1999. Return to Listings
QALoadTM
Kind of Tool Enterprise-wide load testing tool Company Compuware www.compuware.com/ Software Description QALoadTMis Compuware's enterprise-wide load testing tool for client/server or midrange hosted applications. It supports Oracle, Sybase, Microsoft SQL Server and any ODBCcompliant database, as well as http (web), character-based (TelNet), or Tuxedo traffic. QALoad can stress your client/server system by simulating hundreds or thousands of
users simultaneously performing different operations. It creates test scripts that are used to simulate application transactions on the client/server system without involving end users or their equipment. QALoad is part of Compuware's comprehensive QACenterTM family of application testing products. Platforms All Windows and character based platforms Return to Listings
Benchmark Factory
TM
Kind of Tool Load Testing Tool Company Quest Software, Inc. 8001 Irvine Center Drive Irvine, CA 92618 Phone: (949) 754-8000 (See web page for other locations) E-mail: mailto:[email protected] http://www.quest.com Software Description Benchmark Factory® is a load testing and capacity planning tool for critical e-business environments. It can be used to put enormous stress on a system, which is typically hard to achieve in a standard testing environment. When a system breaks it is typically under extreme load, and this is generally when it is needed most. By identifying system capacity and performance bottlenecks before they occur, Benchmark Factory facilitates proactive testing, which in turn reduces downtime, development costs, and potential loss of revenue. With Benchmark Factory you have the ability to:
• • • •
Determine system throughput and capacity for web, database, email Create web tests using a standard web browser, a built-in spider, or actual web traffic history Examine tests results with built-in analysis features or Excel Reports Simulate thousands of concurrent users with a minimal amount of hardware
Platforms Windows NT/2000, Windows 9x/ME Capable of testing internet applications, email servers, file servers and database servers.
Entry updated July 13, 2001. Return to Listings
Teleprocessing Network Simulator
Kind of Tool Performance, Function, & Automated Regression Testing, and Network Design Evaluation Tool Company IBM IBM - Icing Networking 3039 Cornwallis Road F11A/502 Research Triangle Park, NC U.S.A. 27709 Phone:1-800 TEL-TPNS (800-835-8767)(in the US & Canada) or call 919-543-5983 (Worldwide) FAX: (919) 254-1190 E-mail: [email protected] http://www.networking.ibm.com/tns/tnsprod.htm Software Description Teleprocessing Network Simulator (TPNS) improves network computing by conducting stress, performance, regression, function and capacity planning tests with SNA, CPI-C and enhanced TCP support. A market leader with a track record in enterprise testing for over 20 years with an ISO 9000 certification, TPNS can be used to determine system performance and response time, to evaluate network design, to perform functional testing, and to automate regression testing. Used as a basic tool in a comprehensive test plan, TPNS increases the effectiveness of system testing by providing a structured and systematic approach to all phases of testing. Also, to accommodate your business needs, a variety of TPNS-based testing services offerings are available. Platforms TPNS Version 3 Release 5 runs on the IBM System/390 processors, the IBM System/370 processors (including ES/9370), and 3090 processors and the following operating systems: MVS/370, MVS/XA, MVS/ESA, OS/390, and VM/ESA (please see "http://www.networking.ibm.com/tns/tnsover.htm" for specific release details). Return to Listings
CYRANO ServerPack
Kind of Tool Automated Load and Stress Testing with RDBMS Analysis Company CYRANO, Inc. 26 Parker Street Newburyport, MA 01950-4010 Phone: (800) 714-4900 FAX: (978) 462-4755 E-mail: [email protected] http://www.cyrano.com Software Description Automated performance testing of client/server systems using simulated clients. ServerPack can simulate client loads for any type of client (MS Windows, X-Windows, VMS, batch processes, etc) which communicate via TCP/IP. ServerPack can also drive the running of MS Windows application on PCs. Initial test scenarios and scripts are typically created using wizards. The CYRANO TestCommander automatically captures SQL transactions between the client and the server. ServerPack includes a powerful integrated GUI transaction modeler, which simplifies script development by allowing users to enhance SQL transactions for multiuser tests without having to write code. Test analysis includes the standard response time graphs as well as DBMS performance data, which is integrated into response time graphs. This allows you to really "drill-down" to find the links between poor response times and database issues (locking contention, table scans, etc) Platforms WindowsNT, Solaris, HP/UX for client simulation Microsoft Windows NT, Windows 95 and Windows 3.x for optional playback of Windows applications Entry added May 21, 1998. Return to Listings
AutoController
Kind of Tool Load Tester/Manager Company
AutoTester Inc. www.autotester.com/ Software Description AutoController provides a centralized environment for distributed or stress testing of Windows and OS/2 client/server applications across a network. Platforms Windows 95, Windows NT, OS/2 2.1 and higher Entry added May 28, 1998. Return to Listings
AutoController with Virtual DirectTest
Kind of Tool Load and Performance Tool Company AutoTester Inc. www.autotester.com/ Software Description AutoController with Virtual DirectTest gives SAP R/3 users true end-to-end load and performance testing by simulating transactions of hundreds or thousands of users against the R/3 system. Platforms Windows NT Entry added May 28, 1998. Return to Listings
e-Load
Kind of Tool Load, Stress and Scalability testing tool for Web Applications Company Empirix http://www.empirix.com/ Software Description
e-Load, a component of the e-Test Suite, is the easiest way to test the scalability of your e-Business application. It can be used by developers early in the development process to validate the scalability of the overall architecture and avoid costly rework later. It can also be used to test and tune the completed application under load prior to deployment. e-Load utilizes the same Visual Scripts created for functional testing with e-Tester to emulate hundreds or thousands of "Virtual Users". You can define any number of custom load scenarios by simply pointing and clicking on the names of the pre-recorded Visual Scripts and then specifying how many virtual users of each type you wish to run. You can change the number and type of users on-the-fly to try "what-if" scenarios as you vary the loading conditions or application settings. e-Load's integrated real-time graphics and reporting capabilities allow for easy interpretation of load testing results. Visit our website today for a fully functional free trial at www.empirix.com Platforms Windows NT, 95 and 98 Entry updated August 22, 2000. Return to Listings
FORECAST
Kind of Tool Load Testing Tool for Web Server and Client Server Volume, Load and Performance Testing Company Facilita Software Development Radway Green Venture Park Crewe, Cheshire, CW12 5PR United Kingdom Phone: 01270 886 186 FAX: 01270 886 138 E-mail: [email protected] http://www.facilita.co.uk Software Description FORECAST is a non-intrusive client server and web server load testing tool that simulates users on a system. It allows you to perform extensive and realistic load testing before a system goes live. Platforms
UNIX: Solaris, AIX, SCO, Digital UNIX._____ PC: NT and LINUX available shortly Entry added August 21, 1999. Return to Listings
PureLoad
Kind of Tool Performance Testing and Analysing Tool Company Minq Software http://www.minq.se/ Software Description PureLoad is a Java-based performance testing and analyzing tool that helps application developers by automating the process of stress testing their server applications. This is achieved by simulating several hundreds of users performing tasks. Statistics are used to analyze the bottlenecks in the system, primarily the performance, scalability and quality characteristics. Platforms Java 2 version 1.3. PureLoad has been tested and verified on Solaris/SPARC, Windows NT/2000 and Linux. Entry updated November 18, 2001. Return to Listings
Rational Suite PerformanceStudio
Kind of Tool Performance testing tools Company IBM Rational Software http://www.rational.com/products/pstudio/ Entry added October 20, 2000. Return to Listings
SilkPerformer
Kind of Tool Load and performance testing tool Company Segue Software, Inc. http://www.segue.com/ Entry added October 20, 2000. Return to Listings
Portent
Kind of Tool E-business Load and Performance Testing Tool Company loadtesting.com 28411 Harvest View Lane Trabuco Canyon, CA 92679 E-mail: [email protected] http://www.loadtesting.com Software Description Loadtesting.com provides the Portent family of load testing products for testing various levels of system complexity and different protocols such as HTTP, FTP, SMTP and POP, databases, and more. It has a useful test script editor, data analysis tool, and has a price performance 20x greater than most other load testing tools that cost much more for similar functionality. Platforms All operating systems that have a Java 2 virtual machine available such as Windows, Solaris, Linux, BSD, Mac OS X, and more Entry added December 19, 2000. Return to Listings
Capacity Calibration
Kind of Tool
Web Site Application Load and Performance Testing Company Distributed Computing, Inc. 55 New Montgomery Street, Suite 605 San Francisco, CA 94105 Phone: 415-462-1260 Fax: 415-462-1260 E-mail: [email protected] http://www.capcal.com/ Software Description Distributed Computing, Inc. (DCI) is a San Francisco-based company that developed the Capacity Calibration (CapCal) technology to deliver "last mile" Web site and network capacity and performance testing that every firm, small or large, can afford to costeffectively implement. We have solutions from simple pay-per-use services over the Internet to full-scale enterprise license solutions and professional services offerings. CapCal is the first technology to deliver a commercial application of the distributed computing model whereby the spare cycles and bandwidth of computers sitting on desktops in homes and offices around the world are used to measure the capacity and performance of any network or Web site. Previous solutions to the problem of measuring Web site performance under variable loads have been extremely costly and complicated because they require dedicated hardware to generate the load and use arcane scripting languages to write the test scripts. DCI's founders and developers, who are pioneers in the automated software testing industry, have developed a revolutionary technology that solves the twin problems of cost and complexity in a powerful and elegant fashion. CapCal's distributed architecture duplicates the real world conditions that are necessary to measure the performance of any server or network, public or private, under variable usage loads without requiring dedicated hardware or programming skills. This provides the means whereby Web infrastructure can be cost-effectively exercised in its entirety, providing the data necessary to identify and correct performance problems that would otherwise go undetected. Companies in the system integration, systems management, Web development, hosting, hardware and consulting industries use CapCal to deliver the highest quality products and services to their customers by providing real world validation in a way that no other technology can.
If your company delivers Web-based solutions in any form, DCI and the CapCal technology will give you and your customers the assurance that the final product meets the performance levels and availability that are necessary in today's online world. Platforms Any system with Java support. Entry updated March 20, 2003. Return to Listings
Microsoft Web Application Stress Tool (WAS)
Kind of Tool Web stress tool (freeware) Company Microsoft http://www.microsoft.com/technet/itsolutions/intranet/downloads/webstres.asp Software Description Microsoft Web Application Stress (formerly called "Homer") is a simulation tool that is designed to realistically reproduce multiple browsers requesting pages from a web application. It was developed by web testers. We have made the tool as easy to use as possible by masking some of the complexities of web server testing. This makes the tool desirable for anyone interested in gathering performance data on their web site. The tool is a consolidation of many of the best features we have seen over the years, as well as few features of our own. The Internet is rapidly changing and so are the tools used to test it. Platforms This version covers the most needed features for stress testing three tier personalized Active Server Page web sites running on Microsoft Windows NT server 4.0 and Windows 2000. Entry updated March 20, 2003. Return to Listings
Load
Kind of Tool Performance and scalability utility for Web apps and Web Services (freeware) Company PushToTest.com Frank Cohen 2248 Montezuma Drive Campbell, CA 95008 USA Phone: 408 374 7426 FAX: 408 374 1458 E-mail: [email protected] www.pushtotest.com Software Description Testing Web application software and SOAP-based Web Services for performance and scalability is no longer an option. Load, a free open-source test utility, features a scripting language and library of test objects to create intelligent agents that drive a Web application. Running hundreds of agents concurrently shows how your software performs in production environments. Intelligent testing makes your software development better, faster. Platforms Load is written in Java and runs everywhere Java does, including Windows, Linux, Solaris, Macintosh and more. Load is distributed under a free "Apache" style open-source agreement. You get Load, the source code and you may make changes to Load yourself. Entry added December 27, 2001. Return to Listings
Webserver Stress Tool
Kind of Tool Versatile Web Server Load-, Performance-, and Stress-Test Company Paessler GmbH Otto-Seeling-Promenade 2-4 D-90762 Fuerth/Germany Phone: N/A FAX: +49-911-7399031 E-mail: [email protected] http://www.paessler.com Software Description
Webserver Stress Tool is an agressively priced and easy to use load test application for webservers. The software simulates the traffic and usage generated by a large number of simultaneous web users, enabling website administrators to test the ability of their servers to handle various loads and capacities. The test results compare easily to those of much higher priced competitor products. But since the software design was kept very straightforward the software is much easier to use! Within 5 minutes after downloading and installing the first load test can be conducted. Because no part of the software has to be installed on the server itself Webserver Stress Tool works with all webservers! Detailed test logs and several easy to read graphs make it easy to analyze the results. Webserver Stress Tool for Windows (95/98/ME/NT/2000/XP) can benchmark static pages, JSPs/ASPs and CGIs for performance-, load- and stress-tests.Webserver Stress Tool is available in three editions, Standard, Professional and Enterprise. Please visit our website for details about Webserver Stress Tool, download the free trial edition or take our Guided Tour. Platforms Client: Windows 95/98/ME/XP/2000/NT, Server: Any Entry added January 24, 2002. Return to Listings
Web Roller
Kind of Tool Internet/Intranet applications Performance-, Load-, and Stress- testing tool, good abilities of dynamic test data generation make it suitable for functional testing Company Novosoft, Inc. 4 pr. Koptyuga, Novosibirsk, 630090, Russia Phone: +7 3832 396 358 Fax: +7 3832 342 035 E-mail: [email protected] http://webapplicationstesting.com Software Description
Web Roller is a load testing tool that provides a consistent and reliable way to test and learn about performance characteristics of web and Intranet applications before putting them on the market. It helps developers and QA professionals to ensure that their Web applications meet the high performance standards and end users demands. Exceptional user friendliness and rich functionality makes Web Roller one of the best testing solutions available on the present-day market. Key Features Summary
• • • • • • •
Performance, load, stress and functional testing Rich embedded abilities of dynamic test data generation Accurate and realistic user simulation More load from less hardware Supports all standard Internet security features Comprehensive test reports and charts Intuitive user interface
For more information please visit webapplicationstesting.com/. Platforms Windows XP/2000/NT. There is command line version for Linux Entry updated March 12, 2002. Return to Listings
ANTS - Advanced .NET Testing System
Kind of Tool Load testing tool for .NET web services and other web applications. Company Red Gate Software Ltd. www.red-gate.com/ Software Description ANTS (Advanced .NET Testing System) is for load testing XML Web Services or other Visual Studio .NET written web applications. ANTS will help determine how many concurrent users can simultaneously use an application. Platforms ANTS is designed to test web applications using Microsoft technologies. Less detailed tests can be run on any web applications. ANTS runs on windows machines, IE6 and the .NET framework.
Entry updated February 22, 2002. Return to Listings
NetPressure
Kind of Tool Capacity planning and load testing tool Company Synthetic Networks, Inc. 252 Open Square Way Suite 419 Holyoke, MA 01040 USA Phone: 413 420 0162 Fax: 413 425 0074 E-mail: [email protected] http://www.syntheticnets.com Software Description NetPressure load tests with real user traffic, including DNS, HTTP, FTP, NNTP, streaming media, POP3, SMTP, NFS, CIFS, etc. - through access authentication systems like PPPOE or DHCP, as necessary. Unlimited scalability; GUI-driven management station; no scripting; open API. Errors are isolated and identified in real-time; traffic is monitored at every step in a protocol exchange (e.g., time of DNS lookup, time to logon to server, etc.). Log kept of all transactions and detailed reporting available for every test. Platforms Linux, Solaris, Windows NT/XP/2000 Entry updated March 20, 2002. Return to Listings
Scapa StressTest for Citrix Thin Client
Kind of Tool automated performance testing tool Company Scapa Technologies 245 Park Avenue
New York, NY 10167 USA Phone: 212 792 4032 Fax: 212 372 8798 E-mail: [email protected]; [email protected] http://www.scapatech.com Software Description Scapa StressTest for Thin Client is an automated performance testing tool that tests how well Thin Client deployments perform under variable load. The tool is highly scalable and can generate in-depth performance analysis of systems running up to 10's of thousands of users. Available globally through members of the Citrix Solutions Network™ under affordable licensing and support packages, its unique n-Tier Resonance technology quickly provides accurate client-server timings through direct use of the ICA or RDP channel. Platforms Citrix MetaFrame 1.8 and XP product family for Windows. Any standard scripting tool such as Winrunner, Visual Test, SilkTest, Winbatch, Wintask or other. Entry updated March 28, 2002. Return to Listings
Scapa StressTest for Hyperion Essbase
Kind of Tool Automated performance testing tool Company Scapa Technologies 245 Park Avenue New York, NY 10167 USA Phone: 212 792 4032 Fax: 212 372 8798 E-mail: [email protected], [email protected] http://www.scapatech.com Software Description Scapa StressTest is an automated stress/load testing tool that measures the effect on systems capacity and scalability of proposed upgrades and developments to Hyperion Essbase and IBM DB2 OLAP Server deployments. Its unique generalization process allows entire information systems to be analyzed thoroughly from a single terminal by
enabling rapid, accurate simulation of the behavior of large numbers of users doing different tasks on an OLAP application. The analysis engine in the new release of Scapa StressTest processes complex transactions, such as block upgrades of spreadsheet information, very quickly. Platforms PC/Win 2000 / PC/Win95/98/NT Sun/SunOS/Solaris IBM/AIX HP/HPUX Hyperion Essbase 5.x, 6.0, 6.2 or 6.5, IBM DB2 OLAP Server V1.1 or V7.1. Any Essbase client applications such as Microsoft Excel or Lotus 1-2-3 with Spreadsheet Add-in, Alphablox, Hyperion Analyzer, DecisionWorks, Temtec Executive Viewer, A3, ArcPlan, Business Objects, BudgetPlus. Entry updated April 26, 2002. Return to Listings
SSW Performance PRO! 97
Kind of Tool Database Tool Company Superior Software for Windows Pty Ltd Suite 10 Gateway Court, 81 - 91 Military Rd Neutral Bay Sydney, NSW, 2089 Australia Phone: 061 2 9953 3000 Fax: 061 2 9953 3105 E-mail: [email protected] http://www.ssw.com.au Software Description Essential for performance tuning your Access frontend or upsizing to SQL Server SSW Performance PRO! analyses every form, combo and list box in your Access 97, 2000 or 2002 app. It checks the SQL statements and reports on the slowest features. It tells you exactly where to spend time that will make a difference to the speed of your application. You can also use SSW Performance PRO! after you've upsized an application to SQL Server to pinpoint where tuning is required. Platforms Windows 98, ME, NT 4.0, 2000 or XP
Entry updated June 4, 2002. Return to Listings
SSW Performance PRO! 2000
Kind of Tool Database Tool Company Superior Software for Windows Pty Ltd Suite 10 Gateway Court, 81 - 91 Military Rd Neutral Bay Sydney, NSW, 2089 Australia Phone: 061 2 9953 3000 Fax: 061 2 9953 3105 E-mail: [email protected] http://www.ssw.com.au Software Description Essential for performance tuning your Access frontend or upsizing to SQL Server SSW Performance PRO! analyses every form, combo and list box in your Access 97, 2000 or 2002 app. It checks the SQL statements and reports on the slowest features. It tells you exactly where to spend time that will make a difference to the speed of your application. You can also use SSW Performance PRO! after you've upsized an application to SQL Server to pinpoint where tuning is required. Platforms Windows 98, ME, NT 4.0, 2000 or XP Entry updated June 4, 2002. Return to Listings
smartTest
Kind of Tool Pre-deployment and in-service load testing tool Company
interNetwork Bierstadter Strasse 7 65189 Wiesbaden Germany Phone: +49-(0)611-16657-0 Fax: +49-(0)611-16657-57 E-mail: [email protected] http://www.internetwork-ag.de Software Description smartTest product suite provides unique capabilities for simulated synthetic transaction network testing. Load testing with smartTest provides comprehensive information about the performance of entire systems including availability, response time, throughput, and compliance. smartTest leverages open systems technology, is scalable across hardware platforms, and is architected to easily integrate new protocols and authentication standards as they are developed. Its unique characteristics include the ability to test all network devices, generate traffic over new access and authentication protocols, provide scalability in terms of the number of users, and stress test all network service components. Platforms Windows NT/98/2000, Linux, Solaris, HP-UX, AIX,IRIX, Tru64 Unix Entry updated June 10, 2002. Return to Listings
TestMaker
Kind of Tool A solution to assure Web service functionality, scalability and performance as part of an enterprise's security strategy. (freeware) Company PushToTest.com Frank Cohen 2248 Montezuma Drive Campbell, CA 95008 USA Phone: 408 374 7426 FAX: 408 374 1458 E-mail: [email protected] www.pushtotest.com
Entry added March 20, 2003. Return to Listings
QuotiumPRO
Kind of Tool Web load testing solution Company Quotium Technologies 100 Cummings Center, Suite 336B Beverly, MA 01915 Phone: 978 867 2800 Fax: 978 867 2005 E-mail: [email protected] http://www.quotium.com/ Software Description QuotiumPRO is a professional web load testing tool that analyses and predicts application behavior and performance. It tests an entire architecture by emulating very large numbers of realistic users, as well as sharp load variations. Associated with performance and transaction monitoring tools, QuotiumPRO identifies and pinpoints in real-time any bottleneck and its cause. These monitors also allow a pro-active surveillance of transactions, and a recording of the context in which incidents may have occurred. Platforms Windows 2000 Entry updated May 19, 2004. Return to Listings
OpenSTA
Kind of Tool Web site load and performance test tool (freeware) Organization opensta.org http://opensta.org/ Software Description
A distributed software testing architecture based on CORBA. OpenSTA is designed to be used by Performance Testing Consultants or other technically proficient individuals. Using OpenSTA a user can generate realistic heavy loads simulating the activity of hundreds to thousands of virtual users. This capability is fully realized through OpenSTA's distributed testing architecture. OpenSTA graphs both virtual user response times and resource utilization information from all Web Servers, Application Servers, Database Servers and Operating Platforms under test, so that precise performance measurements can be gathered during load tests and analysis on these measurements can be performed. OpenSTA is Open Source software licensed under the GNU General Public License. Platforms Windows NT SP5, Windows 2000, and Windows XP Entry updated May 2, 2003. Return to Listings
Monitor Master
Kind of Tool Quality Management Solution - load, functional, stress and usability testing Company Argogroup Oak House, Shackleford Road, Elstead, Surrey, GU8 6LB, United Kingdom Phone: +44 1252 705705 Fax: +44 1252 705706 E-mail: [email protected] http://www.argogroup.com/ Software Description Monitor Master is a quality management solution for wireless data services WML/XHTML, SMS and MMS. Monitor Master helps Operators and Content Developers ensure that end-users of wireless applications will have the best quality of experience possible - regardless of the handset being used. Platforms Windows2000 or XP Requires IE5.5 or higher
Entry updated October 29, 2002. Return to Listings
WAPT
Kind of Tool Load, Stress and Performance testing of web sites and web-based intranet applications. Company Novosoft, Inc. 4 Koptyuga ave., Novosibirsk, 630090, Russia Phone: 1-866-849-0354 (toll-free for USA only) +7-383-230-3469 (outside USA) Fax: +7-383-234-2035 E-mail: [email protected] http://novosoft-us.com/ Software Description Novosoft WAPT http://loadtestingtool.com/ is an easy to use and cost-effective yet powerful testing tool for web environment. With WAPT you can test and analyze the performance characteristics and bottlenecks of your web site under various load conditions. WAPT has a number of features to test sites with dynamic content and secure HTTPS pages. Key Features Summary
• • • • • • • • •
Accurate Real User Simulation Dynamic Test Data Generation Recording and Playback of HTTPS/SSL Pages Flexible Test Volume & Load Definition Clear Reports and Graphs Full Log of Virtual Users Activities Adjustable delays ("think times") between requests to simulate real user behavior Support of redirects, including redirects to another server Support of all types of proxies
For more information please visit http://loadtestingtool.com/. Platforms Windows XP/2000/NT (recommended) and Windows 9x/ME
Entry updated December 24, 2002. Return to Listings
Web Performance Trainer
Kind of Tool Web performance, load testing, and stress testing software Organization Web Performance, Inc. 9207 Baileywick Road, Suite 203 Phone: 919-845-7601 Fax: 919-845-7603 E-mail: [email protected] http://www.webperformanceinc.com/ Software Description Web Performance Trainer?'s user capacity reports tell you how many users your web site is capable of handling at one time using your own unique performance criteria. Because data is collected at the URL level, it not only identifies slow web pages, but identifies the particular part of the web page that caused the problem. Its hard to find features include support for client certificates, IP spoofing, NTML, SSL, data replacement, and complicated session tracking schemes. Platforms Linux, Windows 2000, XP, NT, & Solaris Entry updated May 27, 2004. Return to Listings
PureAgent
Kind of Tool Response time monitoring agent Company Minq Software http://www.minq.se/ Software Description
PureAgent is a performance monitoring tool that replicates real users generating activities on server applications. Use PureAgent to check how your customers experience your applications. PureAgent measures the total round trip time it takes to execute one or many user operations accessing either static or dynamic content. The results are presented as charts in a standard web browser, alarm levels can be defined which might trigger notifications to be sent by Email. The monitored scenario of user operations is created using the PureTest application. Platforms Windows, Linux, Solaris Entry updated December 9, 2002. Return to Listings
BurnInTest
Kind of Tool PC hardware and device driver load testing tool Company PassMark Software 18 Kennedy St. Kingsford, NSW Australia Phone: +612 9326 5476 Fax: +612 9326 3109 E-mail: [email protected] http://www.passmark.com/ Software Description BurnInTest is a software tool that allows all the major sub-systems of a computer to be simultaneously stress tested for endurance, reliability and stability. BurnInTest tests the CPU, hard drives, CD ROMs, DVDs, sound cards, 2D graphics, 3D graphics, RAM, network connections & printers. The Pro version can also test tape drives, USB, serial and parallel ports. This can all be done simultaneously as the application is multithreaded. Platforms Windows 98, ME, XP, 2000 Entry updated March 9, 2003. Return to Listings
ReliAgent
Kind of Tool Verification and validation tool Company ReliAgent Phone: (813) 558-6685 Fax: (813) 558-6686 E-mail: [email protected] http://www.reliagent.com/ Software Description ReliAgent is the first quality tool built to be embedded into your system. To ensure reliability, plan for things to break: the same quality features need to be tested in development, QA, and used in production Platforms Wintel, Linux, Solaris Entry updated March 21, 2003. Return to Listings
Profiler
Kind of Tool Execution profiling tools for many languages Company Semantic Designs, Inc. http://www.semdesigns.com/ Software Description SD's Profiler tools collect information about execution frequency of all blocks of code in an application. A graphical display sorts this information by file or by frequency, and the relative execution costs are showing graphically superimposed over the source code. Available for C, COBOL, and Java. For C and Java, easily customzized to work in embedded or realtime contexts. Extremly low probe overhead during execution. Platforms Probe installer runs under Windows/NT/2K/XP. Applcation under test can run on any platform. Profile display results can run anywhere a JVM is present.
Entry updated April 5, 2003. Return to Listings
QEngine
Kind of Tool Web page test automation tool with record and playback. Organization AdventNet Inc 5645 Gibraltar Drive Pleasanton, CA 94588 USA Phone: +1-925-924-9500 Fax: +1-925-924-9600 E-mail: [email protected] http://www.adventnet.com/ Software Description AdventNet QEngine WebTest is a powerful, affordable and highly intuitive tool that provides the quickest and most accurate way to test the functionality of your Web applications /e-Commerce in both Windows and Linux machines. Provides an easy-tolearn user interface to completely automate the creation of sophisticated test scripts, letting you to record and playback Web browser events in IE and Mozilla browsers. Platforms Windows (IE & Mozilla), Linux (Mozilla) Entry updated September 20, 2004. Return to Listings
Jmeter
Kind of Tool Load and performance test tool (freeware) Organization The Apache Jakarta Project http://jakarta.apache.org/jmeter/ Software Description
Apache JMeter is a 100% pure Java desktop application designed to load test functional behavior and measure performance. It was originally designed for testing Web Applications but has since expanded to other test functions. Platforms JMeter has been tested and works under Unix (Solaris, Linux, etc) and Windows (98, NT, 2000). Entry updated November 30, 2004.
Load and Performance Tools
Tools that specialize in putting a heavy load on systems (especially client-server systems). These tools are often also GUI test drivers.
Current Listings
• • • • • • • • • • • • • • • • • • • • • • •
ANTS - Advanced .NET Testing System AutoController AutoController with Virtual DirectTest Benchmark Factory BurnInTest Capacity Calibration Chariot CYRANO ServerPack e-Load FORECAST ITF - Internetworking Test Facility Jmeter Load Load Runner Product Family Microsoft Web Application Stress Tool (WAS) Monitor Master NetPressure OpenSTA Portent preVue-ASCII preVue-X Profiler PureAgent
• • • • • • • • • • • • • • • • • • •
PureLoad QALoad QEngine QuotiumPRO Rational Suite PerformanceStudio ReliAgent Scapa StressTest for Hyperion Essbase Scapa StressTest for Thin Client SilkPerformer smartTest SSW Performance PRO! 2000 SSW Performance PRO! 97 Teleprocessing Network Simulator TestMaker WAPT Web Performance Trainer WebLoad Web Roller Webserver Stress Tool
Tools Listed Elsewhere
These tools fit better into a different category, but are worth mentioning here as well. Their main listing is in the other category.
• • • •
CYRANO Test eValid FREstimate WhenToStop
preVue-ASCII
Kind of Tool System Performance / Load Testing Tool Company IBM Rational Software http://www.rational.com/products/prevue/ Software Description preVue performs quality assurance, performance measurement, and regression testing of character-based UNIX applications. The preVue system is the basis for the entire preVue product family. preVue's record/playback technology allows testers to automatically record the workload of 1 to 1000's of virtual user sessions, create test scripts, execute test sessions, and evaluate the summarized reports and graphs. preVue utilizes Remote Terminal Emulation to replicate the workload of actual application users on the System Under Test. preVue provides verification of and timing information for the System Under Test responses over communication mediums including: RS-232-C, Ethernet, Token Ring, FDDI, and X.25 networks. preVue allows testers to perform multi-user performance benchmarks that measure the application response times, system throughput, and system stress levels. preVue has no special hardware requirements and has been successfully ported to a wide range of UNIX platforms. Platforms Supported on all major UNIX platforms. Entry updated July 20, 1998. Return to Listings
preVue-X
Kind of Tool System Performance / Load Testing Tool Company IBM Rational Software http://www.rational.com/products/prevue/ Software Description
preVue-X provides non-intrusive regression and performance testing of X-Window applications. preVue-X accurately emulates multiple users while requiring no special hooks into your application or X Libraries, thus guaranteeing that the application tested is the same application that will be deployed. preVue-X operates at the X protocol level and independently of the GUI. It automatically collects all user interactions with the application (e.g., mouse movements, button activity, keystrokes, think time delays) into an easily editable test script for playback. Features include automated synchronization and time-stamping; geometry independence and script viewer. Platforms Tests all versions of UNIX, X server, GUI toolkits, etc; supported on all major UNIX platforms Entry updated July 20, 1998. Return to Listings
Load Runner Product Family
Kind of Tool Multi-user system and server testing tool Company Mercury Interactive http://www.merc-int.com/ Software Description Automated client/server system testing tools which provide performance testing, load testing and system tuning for multi-user applications Platforms LoadRunner/UX: for UNIX/X Window Applications LoadRunner/PC: for MS Windows Applications LoadRunner/XL: for Server Functionality and Performance LoadRunner/RTE: for Terminal-Based Applications Return to Listings
ITF - Internetworking Test Facility
Kind of Tool Network test driver/manager Company
Applied Computer Technology P.O. Box 497006 Garland, TX 75049-7006 Phone: (214) 240-6744 FAX: (214) 240-5824 E-mail: [email protected] http://www.acomtech.com Software Description The ITF™ (Internetworking Test Facility) system provides a PC-based environment for the development, comprehensive architectural conformance verification, load/stress and performance testing of TCP/IP TN3270/tn5250 products. Ready-to-run validated tests are available and you can easily add to them using our test case development tools. Platforms DOS, Windows 98, Windows NT Entry updated January 11, 2001. Return to Listings
Chariot®
Kind of Tool Load and Performance Tool Company NetIQ Corporation 3553 N. First St. San Jose, CA 95134 Phone: 1-408-856-3000, 1-888-323-6768 FAX: 1-408-273-0578 E-mail: [email protected] http://www.netiq.com/products/chr/ Entry updated March 20, 2003. Return to Listings
WebLoad 3.0
Kind of Tool
Web Application Scalability Testing Tool--Internet and intranet Company RadView Software 1050 Waltham Street Lexington, MA 02421 Phone: 888 723-8439 FAX: 877 723-8439 E-mail: [email protected] http://www.radview.com Software Description WebLoad 3.0 is the premier scalability testing solution for Web applications—Internet and intranet. WebLoad delivers open-interoperability with Web server applications, comprehensive HTTP support, automated operation, single-point management and realtime graphical and statistical analysis for maximum testing performance, ease-of-use and value. WebLoad verifies Web application scalability by generating a load composed of Virtual Clients that simulate real-world traffic. Users create JavaScript-based test scripts that define the behavior of the Virtual Clients. WebLoad executes these test scripts and monitors the Web application’s performance providing real-time graphical and statistical results and comprehensive reports. Platforms Win32 and UNIX platforms Entry added March 3, 1999. Return to Listings
QALoadTM
Kind of Tool Enterprise-wide load testing tool Company Compuware www.compuware.com/ Software Description QALoadTMis Compuware's enterprise-wide load testing tool for client/server or midrange hosted applications. It supports Oracle, Sybase, Microsoft SQL Server and any ODBCcompliant database, as well as http (web), character-based (TelNet), or Tuxedo traffic. QALoad can stress your client/server system by simulating hundreds or thousands of
users simultaneously performing different operations. It creates test scripts that are used to simulate application transactions on the client/server system without involving end users or their equipment. QALoad is part of Compuware's comprehensive QACenterTM family of application testing products. Platforms All Windows and character based platforms Return to Listings
Benchmark Factory
TM
Kind of Tool Load Testing Tool Company Quest Software, Inc. 8001 Irvine Center Drive Irvine, CA 92618 Phone: (949) 754-8000 (See web page for other locations) E-mail: mailto:[email protected] http://www.quest.com Software Description Benchmark Factory® is a load testing and capacity planning tool for critical e-business environments. It can be used to put enormous stress on a system, which is typically hard to achieve in a standard testing environment. When a system breaks it is typically under extreme load, and this is generally when it is needed most. By identifying system capacity and performance bottlenecks before they occur, Benchmark Factory facilitates proactive testing, which in turn reduces downtime, development costs, and potential loss of revenue. With Benchmark Factory you have the ability to:
• • • •
Determine system throughput and capacity for web, database, email Create web tests using a standard web browser, a built-in spider, or actual web traffic history Examine tests results with built-in analysis features or Excel Reports Simulate thousands of concurrent users with a minimal amount of hardware
Platforms Windows NT/2000, Windows 9x/ME Capable of testing internet applications, email servers, file servers and database servers.
Entry updated July 13, 2001. Return to Listings
Teleprocessing Network Simulator
Kind of Tool Performance, Function, & Automated Regression Testing, and Network Design Evaluation Tool Company IBM IBM - Icing Networking 3039 Cornwallis Road F11A/502 Research Triangle Park, NC U.S.A. 27709 Phone:1-800 TEL-TPNS (800-835-8767)(in the US & Canada) or call 919-543-5983 (Worldwide) FAX: (919) 254-1190 E-mail: [email protected] http://www.networking.ibm.com/tns/tnsprod.htm Software Description Teleprocessing Network Simulator (TPNS) improves network computing by conducting stress, performance, regression, function and capacity planning tests with SNA, CPI-C and enhanced TCP support. A market leader with a track record in enterprise testing for over 20 years with an ISO 9000 certification, TPNS can be used to determine system performance and response time, to evaluate network design, to perform functional testing, and to automate regression testing. Used as a basic tool in a comprehensive test plan, TPNS increases the effectiveness of system testing by providing a structured and systematic approach to all phases of testing. Also, to accommodate your business needs, a variety of TPNS-based testing services offerings are available. Platforms TPNS Version 3 Release 5 runs on the IBM System/390 processors, the IBM System/370 processors (including ES/9370), and 3090 processors and the following operating systems: MVS/370, MVS/XA, MVS/ESA, OS/390, and VM/ESA (please see "http://www.networking.ibm.com/tns/tnsover.htm" for specific release details). Return to Listings
CYRANO ServerPack
Kind of Tool Automated Load and Stress Testing with RDBMS Analysis Company CYRANO, Inc. 26 Parker Street Newburyport, MA 01950-4010 Phone: (800) 714-4900 FAX: (978) 462-4755 E-mail: [email protected] http://www.cyrano.com Software Description Automated performance testing of client/server systems using simulated clients. ServerPack can simulate client loads for any type of client (MS Windows, X-Windows, VMS, batch processes, etc) which communicate via TCP/IP. ServerPack can also drive the running of MS Windows application on PCs. Initial test scenarios and scripts are typically created using wizards. The CYRANO TestCommander automatically captures SQL transactions between the client and the server. ServerPack includes a powerful integrated GUI transaction modeler, which simplifies script development by allowing users to enhance SQL transactions for multiuser tests without having to write code. Test analysis includes the standard response time graphs as well as DBMS performance data, which is integrated into response time graphs. This allows you to really "drill-down" to find the links between poor response times and database issues (locking contention, table scans, etc) Platforms WindowsNT, Solaris, HP/UX for client simulation Microsoft Windows NT, Windows 95 and Windows 3.x for optional playback of Windows applications Entry added May 21, 1998. Return to Listings
AutoController
Kind of Tool Load Tester/Manager Company
AutoTester Inc. www.autotester.com/ Software Description AutoController provides a centralized environment for distributed or stress testing of Windows and OS/2 client/server applications across a network. Platforms Windows 95, Windows NT, OS/2 2.1 and higher Entry added May 28, 1998. Return to Listings
AutoController with Virtual DirectTest
Kind of Tool Load and Performance Tool Company AutoTester Inc. www.autotester.com/ Software Description AutoController with Virtual DirectTest gives SAP R/3 users true end-to-end load and performance testing by simulating transactions of hundreds or thousands of users against the R/3 system. Platforms Windows NT Entry added May 28, 1998. Return to Listings
e-Load
Kind of Tool Load, Stress and Scalability testing tool for Web Applications Company Empirix http://www.empirix.com/ Software Description
e-Load, a component of the e-Test Suite, is the easiest way to test the scalability of your e-Business application. It can be used by developers early in the development process to validate the scalability of the overall architecture and avoid costly rework later. It can also be used to test and tune the completed application under load prior to deployment. e-Load utilizes the same Visual Scripts created for functional testing with e-Tester to emulate hundreds or thousands of "Virtual Users". You can define any number of custom load scenarios by simply pointing and clicking on the names of the pre-recorded Visual Scripts and then specifying how many virtual users of each type you wish to run. You can change the number and type of users on-the-fly to try "what-if" scenarios as you vary the loading conditions or application settings. e-Load's integrated real-time graphics and reporting capabilities allow for easy interpretation of load testing results. Visit our website today for a fully functional free trial at www.empirix.com Platforms Windows NT, 95 and 98 Entry updated August 22, 2000. Return to Listings
FORECAST
Kind of Tool Load Testing Tool for Web Server and Client Server Volume, Load and Performance Testing Company Facilita Software Development Radway Green Venture Park Crewe, Cheshire, CW12 5PR United Kingdom Phone: 01270 886 186 FAX: 01270 886 138 E-mail: [email protected] http://www.facilita.co.uk Software Description FORECAST is a non-intrusive client server and web server load testing tool that simulates users on a system. It allows you to perform extensive and realistic load testing before a system goes live. Platforms
UNIX: Solaris, AIX, SCO, Digital UNIX._____ PC: NT and LINUX available shortly Entry added August 21, 1999. Return to Listings
PureLoad
Kind of Tool Performance Testing and Analysing Tool Company Minq Software http://www.minq.se/ Software Description PureLoad is a Java-based performance testing and analyzing tool that helps application developers by automating the process of stress testing their server applications. This is achieved by simulating several hundreds of users performing tasks. Statistics are used to analyze the bottlenecks in the system, primarily the performance, scalability and quality characteristics. Platforms Java 2 version 1.3. PureLoad has been tested and verified on Solaris/SPARC, Windows NT/2000 and Linux. Entry updated November 18, 2001. Return to Listings
Rational Suite PerformanceStudio
Kind of Tool Performance testing tools Company IBM Rational Software http://www.rational.com/products/pstudio/ Entry added October 20, 2000. Return to Listings
SilkPerformer
Kind of Tool Load and performance testing tool Company Segue Software, Inc. http://www.segue.com/ Entry added October 20, 2000. Return to Listings
Portent
Kind of Tool E-business Load and Performance Testing Tool Company loadtesting.com 28411 Harvest View Lane Trabuco Canyon, CA 92679 E-mail: [email protected] http://www.loadtesting.com Software Description Loadtesting.com provides the Portent family of load testing products for testing various levels of system complexity and different protocols such as HTTP, FTP, SMTP and POP, databases, and more. It has a useful test script editor, data analysis tool, and has a price performance 20x greater than most other load testing tools that cost much more for similar functionality. Platforms All operating systems that have a Java 2 virtual machine available such as Windows, Solaris, Linux, BSD, Mac OS X, and more Entry added December 19, 2000. Return to Listings
Capacity Calibration
Kind of Tool
Web Site Application Load and Performance Testing Company Distributed Computing, Inc. 55 New Montgomery Street, Suite 605 San Francisco, CA 94105 Phone: 415-462-1260 Fax: 415-462-1260 E-mail: [email protected] http://www.capcal.com/ Software Description Distributed Computing, Inc. (DCI) is a San Francisco-based company that developed the Capacity Calibration (CapCal) technology to deliver "last mile" Web site and network capacity and performance testing that every firm, small or large, can afford to costeffectively implement. We have solutions from simple pay-per-use services over the Internet to full-scale enterprise license solutions and professional services offerings. CapCal is the first technology to deliver a commercial application of the distributed computing model whereby the spare cycles and bandwidth of computers sitting on desktops in homes and offices around the world are used to measure the capacity and performance of any network or Web site. Previous solutions to the problem of measuring Web site performance under variable loads have been extremely costly and complicated because they require dedicated hardware to generate the load and use arcane scripting languages to write the test scripts. DCI's founders and developers, who are pioneers in the automated software testing industry, have developed a revolutionary technology that solves the twin problems of cost and complexity in a powerful and elegant fashion. CapCal's distributed architecture duplicates the real world conditions that are necessary to measure the performance of any server or network, public or private, under variable usage loads without requiring dedicated hardware or programming skills. This provides the means whereby Web infrastructure can be cost-effectively exercised in its entirety, providing the data necessary to identify and correct performance problems that would otherwise go undetected. Companies in the system integration, systems management, Web development, hosting, hardware and consulting industries use CapCal to deliver the highest quality products and services to their customers by providing real world validation in a way that no other technology can.
If your company delivers Web-based solutions in any form, DCI and the CapCal technology will give you and your customers the assurance that the final product meets the performance levels and availability that are necessary in today's online world. Platforms Any system with Java support. Entry updated March 20, 2003. Return to Listings
Microsoft Web Application Stress Tool (WAS)
Kind of Tool Web stress tool (freeware) Company Microsoft http://www.microsoft.com/technet/itsolutions/intranet/downloads/webstres.asp Software Description Microsoft Web Application Stress (formerly called "Homer") is a simulation tool that is designed to realistically reproduce multiple browsers requesting pages from a web application. It was developed by web testers. We have made the tool as easy to use as possible by masking some of the complexities of web server testing. This makes the tool desirable for anyone interested in gathering performance data on their web site. The tool is a consolidation of many of the best features we have seen over the years, as well as few features of our own. The Internet is rapidly changing and so are the tools used to test it. Platforms This version covers the most needed features for stress testing three tier personalized Active Server Page web sites running on Microsoft Windows NT server 4.0 and Windows 2000. Entry updated March 20, 2003. Return to Listings
Load
Kind of Tool Performance and scalability utility for Web apps and Web Services (freeware) Company PushToTest.com Frank Cohen 2248 Montezuma Drive Campbell, CA 95008 USA Phone: 408 374 7426 FAX: 408 374 1458 E-mail: [email protected] www.pushtotest.com Software Description Testing Web application software and SOAP-based Web Services for performance and scalability is no longer an option. Load, a free open-source test utility, features a scripting language and library of test objects to create intelligent agents that drive a Web application. Running hundreds of agents concurrently shows how your software performs in production environments. Intelligent testing makes your software development better, faster. Platforms Load is written in Java and runs everywhere Java does, including Windows, Linux, Solaris, Macintosh and more. Load is distributed under a free "Apache" style open-source agreement. You get Load, the source code and you may make changes to Load yourself. Entry added December 27, 2001. Return to Listings
Webserver Stress Tool
Kind of Tool Versatile Web Server Load-, Performance-, and Stress-Test Company Paessler GmbH Otto-Seeling-Promenade 2-4 D-90762 Fuerth/Germany Phone: N/A FAX: +49-911-7399031 E-mail: [email protected] http://www.paessler.com Software Description
Webserver Stress Tool is an agressively priced and easy to use load test application for webservers. The software simulates the traffic and usage generated by a large number of simultaneous web users, enabling website administrators to test the ability of their servers to handle various loads and capacities. The test results compare easily to those of much higher priced competitor products. But since the software design was kept very straightforward the software is much easier to use! Within 5 minutes after downloading and installing the first load test can be conducted. Because no part of the software has to be installed on the server itself Webserver Stress Tool works with all webservers! Detailed test logs and several easy to read graphs make it easy to analyze the results. Webserver Stress Tool for Windows (95/98/ME/NT/2000/XP) can benchmark static pages, JSPs/ASPs and CGIs for performance-, load- and stress-tests.Webserver Stress Tool is available in three editions, Standard, Professional and Enterprise. Please visit our website for details about Webserver Stress Tool, download the free trial edition or take our Guided Tour. Platforms Client: Windows 95/98/ME/XP/2000/NT, Server: Any Entry added January 24, 2002. Return to Listings
Web Roller
Kind of Tool Internet/Intranet applications Performance-, Load-, and Stress- testing tool, good abilities of dynamic test data generation make it suitable for functional testing Company Novosoft, Inc. 4 pr. Koptyuga, Novosibirsk, 630090, Russia Phone: +7 3832 396 358 Fax: +7 3832 342 035 E-mail: [email protected] http://webapplicationstesting.com Software Description
Web Roller is a load testing tool that provides a consistent and reliable way to test and learn about performance characteristics of web and Intranet applications before putting them on the market. It helps developers and QA professionals to ensure that their Web applications meet the high performance standards and end users demands. Exceptional user friendliness and rich functionality makes Web Roller one of the best testing solutions available on the present-day market. Key Features Summary
• • • • • • •
Performance, load, stress and functional testing Rich embedded abilities of dynamic test data generation Accurate and realistic user simulation More load from less hardware Supports all standard Internet security features Comprehensive test reports and charts Intuitive user interface
For more information please visit webapplicationstesting.com/. Platforms Windows XP/2000/NT. There is command line version for Linux Entry updated March 12, 2002. Return to Listings
ANTS - Advanced .NET Testing System
Kind of Tool Load testing tool for .NET web services and other web applications. Company Red Gate Software Ltd. www.red-gate.com/ Software Description ANTS (Advanced .NET Testing System) is for load testing XML Web Services or other Visual Studio .NET written web applications. ANTS will help determine how many concurrent users can simultaneously use an application. Platforms ANTS is designed to test web applications using Microsoft technologies. Less detailed tests can be run on any web applications. ANTS runs on windows machines, IE6 and the .NET framework.
Entry updated February 22, 2002. Return to Listings
NetPressure
Kind of Tool Capacity planning and load testing tool Company Synthetic Networks, Inc. 252 Open Square Way Suite 419 Holyoke, MA 01040 USA Phone: 413 420 0162 Fax: 413 425 0074 E-mail: [email protected] http://www.syntheticnets.com Software Description NetPressure load tests with real user traffic, including DNS, HTTP, FTP, NNTP, streaming media, POP3, SMTP, NFS, CIFS, etc. - through access authentication systems like PPPOE or DHCP, as necessary. Unlimited scalability; GUI-driven management station; no scripting; open API. Errors are isolated and identified in real-time; traffic is monitored at every step in a protocol exchange (e.g., time of DNS lookup, time to logon to server, etc.). Log kept of all transactions and detailed reporting available for every test. Platforms Linux, Solaris, Windows NT/XP/2000 Entry updated March 20, 2002. Return to Listings
Scapa StressTest for Citrix Thin Client
Kind of Tool automated performance testing tool Company Scapa Technologies 245 Park Avenue
New York, NY 10167 USA Phone: 212 792 4032 Fax: 212 372 8798 E-mail: [email protected]; [email protected] http://www.scapatech.com Software Description Scapa StressTest for Thin Client is an automated performance testing tool that tests how well Thin Client deployments perform under variable load. The tool is highly scalable and can generate in-depth performance analysis of systems running up to 10's of thousands of users. Available globally through members of the Citrix Solutions Network™ under affordable licensing and support packages, its unique n-Tier Resonance technology quickly provides accurate client-server timings through direct use of the ICA or RDP channel. Platforms Citrix MetaFrame 1.8 and XP product family for Windows. Any standard scripting tool such as Winrunner, Visual Test, SilkTest, Winbatch, Wintask or other. Entry updated March 28, 2002. Return to Listings
Scapa StressTest for Hyperion Essbase
Kind of Tool Automated performance testing tool Company Scapa Technologies 245 Park Avenue New York, NY 10167 USA Phone: 212 792 4032 Fax: 212 372 8798 E-mail: [email protected], [email protected] http://www.scapatech.com Software Description Scapa StressTest is an automated stress/load testing tool that measures the effect on systems capacity and scalability of proposed upgrades and developments to Hyperion Essbase and IBM DB2 OLAP Server deployments. Its unique generalization process allows entire information systems to be analyzed thoroughly from a single terminal by
enabling rapid, accurate simulation of the behavior of large numbers of users doing different tasks on an OLAP application. The analysis engine in the new release of Scapa StressTest processes complex transactions, such as block upgrades of spreadsheet information, very quickly. Platforms PC/Win 2000 / PC/Win95/98/NT Sun/SunOS/Solaris IBM/AIX HP/HPUX Hyperion Essbase 5.x, 6.0, 6.2 or 6.5, IBM DB2 OLAP Server V1.1 or V7.1. Any Essbase client applications such as Microsoft Excel or Lotus 1-2-3 with Spreadsheet Add-in, Alphablox, Hyperion Analyzer, DecisionWorks, Temtec Executive Viewer, A3, ArcPlan, Business Objects, BudgetPlus. Entry updated April 26, 2002. Return to Listings
SSW Performance PRO! 97
Kind of Tool Database Tool Company Superior Software for Windows Pty Ltd Suite 10 Gateway Court, 81 - 91 Military Rd Neutral Bay Sydney, NSW, 2089 Australia Phone: 061 2 9953 3000 Fax: 061 2 9953 3105 E-mail: [email protected] http://www.ssw.com.au Software Description Essential for performance tuning your Access frontend or upsizing to SQL Server SSW Performance PRO! analyses every form, combo and list box in your Access 97, 2000 or 2002 app. It checks the SQL statements and reports on the slowest features. It tells you exactly where to spend time that will make a difference to the speed of your application. You can also use SSW Performance PRO! after you've upsized an application to SQL Server to pinpoint where tuning is required. Platforms Windows 98, ME, NT 4.0, 2000 or XP
Entry updated June 4, 2002. Return to Listings
SSW Performance PRO! 2000
Kind of Tool Database Tool Company Superior Software for Windows Pty Ltd Suite 10 Gateway Court, 81 - 91 Military Rd Neutral Bay Sydney, NSW, 2089 Australia Phone: 061 2 9953 3000 Fax: 061 2 9953 3105 E-mail: [email protected] http://www.ssw.com.au Software Description Essential for performance tuning your Access frontend or upsizing to SQL Server SSW Performance PRO! analyses every form, combo and list box in your Access 97, 2000 or 2002 app. It checks the SQL statements and reports on the slowest features. It tells you exactly where to spend time that will make a difference to the speed of your application. You can also use SSW Performance PRO! after you've upsized an application to SQL Server to pinpoint where tuning is required. Platforms Windows 98, ME, NT 4.0, 2000 or XP Entry updated June 4, 2002. Return to Listings
smartTest
Kind of Tool Pre-deployment and in-service load testing tool Company
interNetwork Bierstadter Strasse 7 65189 Wiesbaden Germany Phone: +49-(0)611-16657-0 Fax: +49-(0)611-16657-57 E-mail: [email protected] http://www.internetwork-ag.de Software Description smartTest product suite provides unique capabilities for simulated synthetic transaction network testing. Load testing with smartTest provides comprehensive information about the performance of entire systems including availability, response time, throughput, and compliance. smartTest leverages open systems technology, is scalable across hardware platforms, and is architected to easily integrate new protocols and authentication standards as they are developed. Its unique characteristics include the ability to test all network devices, generate traffic over new access and authentication protocols, provide scalability in terms of the number of users, and stress test all network service components. Platforms Windows NT/98/2000, Linux, Solaris, HP-UX, AIX,IRIX, Tru64 Unix Entry updated June 10, 2002. Return to Listings
TestMaker
Kind of Tool A solution to assure Web service functionality, scalability and performance as part of an enterprise's security strategy. (freeware) Company PushToTest.com Frank Cohen 2248 Montezuma Drive Campbell, CA 95008 USA Phone: 408 374 7426 FAX: 408 374 1458 E-mail: [email protected] www.pushtotest.com
Entry added March 20, 2003. Return to Listings
QuotiumPRO
Kind of Tool Web load testing solution Company Quotium Technologies 100 Cummings Center, Suite 336B Beverly, MA 01915 Phone: 978 867 2800 Fax: 978 867 2005 E-mail: [email protected] http://www.quotium.com/ Software Description QuotiumPRO is a professional web load testing tool that analyses and predicts application behavior and performance. It tests an entire architecture by emulating very large numbers of realistic users, as well as sharp load variations. Associated with performance and transaction monitoring tools, QuotiumPRO identifies and pinpoints in real-time any bottleneck and its cause. These monitors also allow a pro-active surveillance of transactions, and a recording of the context in which incidents may have occurred. Platforms Windows 2000 Entry updated May 19, 2004. Return to Listings
OpenSTA
Kind of Tool Web site load and performance test tool (freeware) Organization opensta.org http://opensta.org/ Software Description
A distributed software testing architecture based on CORBA. OpenSTA is designed to be used by Performance Testing Consultants or other technically proficient individuals. Using OpenSTA a user can generate realistic heavy loads simulating the activity of hundreds to thousands of virtual users. This capability is fully realized through OpenSTA's distributed testing architecture. OpenSTA graphs both virtual user response times and resource utilization information from all Web Servers, Application Servers, Database Servers and Operating Platforms under test, so that precise performance measurements can be gathered during load tests and analysis on these measurements can be performed. OpenSTA is Open Source software licensed under the GNU General Public License. Platforms Windows NT SP5, Windows 2000, and Windows XP Entry updated May 2, 2003. Return to Listings
Monitor Master
Kind of Tool Quality Management Solution - load, functional, stress and usability testing Company Argogroup Oak House, Shackleford Road, Elstead, Surrey, GU8 6LB, United Kingdom Phone: +44 1252 705705 Fax: +44 1252 705706 E-mail: [email protected] http://www.argogroup.com/ Software Description Monitor Master is a quality management solution for wireless data services WML/XHTML, SMS and MMS. Monitor Master helps Operators and Content Developers ensure that end-users of wireless applications will have the best quality of experience possible - regardless of the handset being used. Platforms Windows2000 or XP Requires IE5.5 or higher
Entry updated October 29, 2002. Return to Listings
WAPT
Kind of Tool Load, Stress and Performance testing of web sites and web-based intranet applications. Company Novosoft, Inc. 4 Koptyuga ave., Novosibirsk, 630090, Russia Phone: 1-866-849-0354 (toll-free for USA only) +7-383-230-3469 (outside USA) Fax: +7-383-234-2035 E-mail: [email protected] http://novosoft-us.com/ Software Description Novosoft WAPT http://loadtestingtool.com/ is an easy to use and cost-effective yet powerful testing tool for web environment. With WAPT you can test and analyze the performance characteristics and bottlenecks of your web site under various load conditions. WAPT has a number of features to test sites with dynamic content and secure HTTPS pages. Key Features Summary
• • • • • • • • •
Accurate Real User Simulation Dynamic Test Data Generation Recording and Playback of HTTPS/SSL Pages Flexible Test Volume & Load Definition Clear Reports and Graphs Full Log of Virtual Users Activities Adjustable delays ("think times") between requests to simulate real user behavior Support of redirects, including redirects to another server Support of all types of proxies
For more information please visit http://loadtestingtool.com/. Platforms Windows XP/2000/NT (recommended) and Windows 9x/ME
Entry updated December 24, 2002. Return to Listings
Web Performance Trainer
Kind of Tool Web performance, load testing, and stress testing software Organization Web Performance, Inc. 9207 Baileywick Road, Suite 203 Phone: 919-845-7601 Fax: 919-845-7603 E-mail: [email protected] http://www.webperformanceinc.com/ Software Description Web Performance Trainer?'s user capacity reports tell you how many users your web site is capable of handling at one time using your own unique performance criteria. Because data is collected at the URL level, it not only identifies slow web pages, but identifies the particular part of the web page that caused the problem. Its hard to find features include support for client certificates, IP spoofing, NTML, SSL, data replacement, and complicated session tracking schemes. Platforms Linux, Windows 2000, XP, NT, & Solaris Entry updated May 27, 2004. Return to Listings
PureAgent
Kind of Tool Response time monitoring agent Company Minq Software http://www.minq.se/ Software Description
PureAgent is a performance monitoring tool that replicates real users generating activities on server applications. Use PureAgent to check how your customers experience your applications. PureAgent measures the total round trip time it takes to execute one or many user operations accessing either static or dynamic content. The results are presented as charts in a standard web browser, alarm levels can be defined which might trigger notifications to be sent by Email. The monitored scenario of user operations is created using the PureTest application. Platforms Windows, Linux, Solaris Entry updated December 9, 2002. Return to Listings
BurnInTest
Kind of Tool PC hardware and device driver load testing tool Company PassMark Software 18 Kennedy St. Kingsford, NSW Australia Phone: +612 9326 5476 Fax: +612 9326 3109 E-mail: [email protected] http://www.passmark.com/ Software Description BurnInTest is a software tool that allows all the major sub-systems of a computer to be simultaneously stress tested for endurance, reliability and stability. BurnInTest tests the CPU, hard drives, CD ROMs, DVDs, sound cards, 2D graphics, 3D graphics, RAM, network connections & printers. The Pro version can also test tape drives, USB, serial and parallel ports. This can all be done simultaneously as the application is multithreaded. Platforms Windows 98, ME, XP, 2000 Entry updated March 9, 2003. Return to Listings
ReliAgent
Kind of Tool Verification and validation tool Company ReliAgent Phone: (813) 558-6685 Fax: (813) 558-6686 E-mail: [email protected] http://www.reliagent.com/ Software Description ReliAgent is the first quality tool built to be embedded into your system. To ensure reliability, plan for things to break: the same quality features need to be tested in development, QA, and used in production Platforms Wintel, Linux, Solaris Entry updated March 21, 2003. Return to Listings
Profiler
Kind of Tool Execution profiling tools for many languages Company Semantic Designs, Inc. http://www.semdesigns.com/ Software Description SD's Profiler tools collect information about execution frequency of all blocks of code in an application. A graphical display sorts this information by file or by frequency, and the relative execution costs are showing graphically superimposed over the source code. Available for C, COBOL, and Java. For C and Java, easily customzized to work in embedded or realtime contexts. Extremly low probe overhead during execution. Platforms Probe installer runs under Windows/NT/2K/XP. Applcation under test can run on any platform. Profile display results can run anywhere a JVM is present.
Entry updated April 5, 2003. Return to Listings
QEngine
Kind of Tool Web page test automation tool with record and playback. Organization AdventNet Inc 5645 Gibraltar Drive Pleasanton, CA 94588 USA Phone: +1-925-924-9500 Fax: +1-925-924-9600 E-mail: [email protected] http://www.adventnet.com/ Software Description AdventNet QEngine WebTest is a powerful, affordable and highly intuitive tool that provides the quickest and most accurate way to test the functionality of your Web applications /e-Commerce in both Windows and Linux machines. Provides an easy-tolearn user interface to completely automate the creation of sophisticated test scripts, letting you to record and playback Web browser events in IE and Mozilla browsers. Platforms Windows (IE & Mozilla), Linux (Mozilla) Entry updated September 20, 2004. Return to Listings
Jmeter
Kind of Tool Load and performance test tool (freeware) Organization The Apache Jakarta Project http://jakarta.apache.org/jmeter/ Software Description
Apache JMeter is a 100% pure Java desktop application designed to load test functional behavior and measure performance. It was originally designed for testing Web Applications but has since expanded to other test functions. Platforms JMeter has been tested and works under Unix (Solaris, Linux, etc) and Windows (98, NT, 2000). Entry updated November 30, 2004.
