Performance Analysis and Test Tool Sources


A wide variety of vendors provides performance testing and analysis tools. Rick Hower's web site, the Software QA/Test Resource Center, provides a listing of tools. [1] In this appendix, we provide a shorter list of common tools.

[1] Software QA/Test Resource Center web site by Rick Hower. Retrieved December 27, 2001, from the World Wide Web: <http://www.softwareqatest.com/qatweb1.html>. This site lists hundreds of products, including load and performance test tools, Java test tools, external site monitoring services, web site management tools, and log analysis tools.

Java Profilers

Use a Java profiler tool during the development of any Java application to identify performance hot-spots in the application code. Also, the tools prove useful in analyzing object creation rates, finding memory leaks, and many other important performance analysis tasks . Several companies provide profiling tools. Two widely used profilers are Sitraka JProbe and VMGEAR Optimizeit (recently purchased by Borland). In addition, IBM recently released profiling function in the IBM WebSphere Studio Application Developer.

IBM WebSphere Application Developer Workbench

The WebSphere Application Developer Workbench provides monitoring and profiling tools for recognizing, isolating, and fixing performance problems. You use the tool to view, among other things, object creation and garbage collection, execution sequences, thread interactions, and object references from within the development environment.

Sitraka JProbe Suite

Sitraka JProbe Suite provides performance profiling, memory debugging, code coverage, and thread analysis capabilities in one integrated suite, designed for Java developers. JProbe Suite includes the JProbe Profiler, Threadalyzer, and Coverage.

VMGEAR Optimizeit

The Optimizeit Suite includes three integrated tools for tuning performance throughout the development cycle. Optimizeit also supports tracking down performance bottlenecks, correcting memory leaks, and uncovering thread contention .

Java Profiler Product Summary
Company Product Web Site
IBM WebSphere Application Developer Workbench <http://www.ibm.com>
Sitraka JProbe <http://www.sitraka.com>
VMGEAR (Borland) Optimizeit <http://www.optimizeit.com>

Performance Test Tools

At least fifty different performance test tools products exist. [2] In Chapters 7 and 8, we provide examples using two popular tools, Mercury Interactive LoadRunner and Segue SilkPerformer, and provide a more complete listing of available performance test tools here. Many of these companies also provide performance monitoring and functional test products.

[2] See Rick Hower's web site, Software QA/Test Resource Center. Retrieved December 27, 2001, from the World Wide Web. This site lists approximately 50 load and performance test tools.

Apache's ApacheBench

ApacheBench is an Internet Benchmarking tool that comes (free) with the Apache Web Server. See <http://httpd.apache.org/docs/programs/ab.html>.

Apache Jmeter

Apache Jmeter is a 100% pure Java desktop application designed to load test functional behavior and measure performance. It is part of the Jakarta project at <http://jakarta.apache.org/jmeter/index.html>.

Compuware QALoad

QALoad simulates load generated by many users on your application. The company also provides a Script Development Workbench for developing test scripts, and test results are available in a variety of reports , graphs, and charts . Compuware also provides testing and monitoring products.

Empirix e-Load

The e-Load tool provides a scalability testing solution designed specifically for the web. It provides real-time, detailed performance views for each tier of the system under test, as well as supporting customized reports. Empirix also provides functional testing and monitoring products.

Mercury Interactive Astra LoadTest

Mercury offers Astra LoadTest, a load driver tool for smaller web sites. Astra LoadTest focuses on supporting HTTP-based testing and includes real-time graphing and monitoring of operating systems, HTTP servers, application servers, and databases.

Mercury Interactive LoadRunner

LoadRunner is Mercury's high-end, scalable, automated load testing solution. LoadRunner includes real-time graphing and monitoring of an extensive set of operating systems, web servers, application servers, and databases. Mercury Interactive also provides functional testing and monitoring products.

Quest Benchmark Factory

Benchmark Factory provides a scalable load testing, capacity planning, and performance tuning tool. Benchmark Factory allows you to determine system capacity, pinpoint system bottlenecks, and isolate system stress related problems. Quest also provides performance analysis and monitoring products.

Rational Suite TestStudio

Rational Suite TestStudio supports performance testing via simulating virtual testers. Rational provides support to build complex usage scenarios and produce realistic system loads. They also provide development and testing products.

RadView Software WebLOAD

WebLOAD simulates real-life Internet user behaviors and reports performance issues and bottlenecks within an application to help companies successfully deploy high-performing e-business applications. RadView also provides functional testing tools.

Segue SilkPerformer

Segue's SilkPerformer lets you simulate the fluctuating demands of a live e-business environment. SilkPerformer can predict the scalability and performance of your web application, ensuring its reliability before it goes live. Segue also provides functional test and monitoring products.

Load Driver Summary
Company Product Web Site
Apache ApacheBench <www.apache.org>
Apache JMeter <Jakarta.apache.org>
Compuware QALoad <www.compuware.com>
Empirix e-Load <www.empirix.com>
Mercury Interactive Astra LoadTest <www.mercuryinteractive.com>
Mercury Interactive LoadRunner <www.mercuryinteractive.com>
Quest Benchmark Factory <www.quest.com>
Rational Performance Studio <www.rational.com>
Segue SilkPerformer <www.segue.com>
RadView Software WebLOAD <www.radview.com>

Java Application Performance Monitoring

Many of the load driver tools listed above provide integrated performance monitors to collect data during testing. In addition, we'd like to mention a new class of product for Java applications: performance monitoring tools. Consider using these products to provide in-depth information on the web application that is executing during the load test. Unlike Java profilers, these tools are less intrusive and typically do not significantly alter the application's performance, which allows you to analyze performance issues under load conditions. While these tools focus on production monitoring, they sometimes come in handy for testing high-performance web sites, or if you cannot isolate a performance problem with your existing tool set.

Precise Indepth for J2EE

Precise Indepth for J2EE collects detailed application response time data, as well as JVM and system performance data. Though sold as a production monitoring product, Precise provides an HTML interface displaying HTTP or EJB entry points sorted by response time, with drill-down capabilities. These features also make it easy to see performance problems during load testing. Precise also provides Indepth products for other web site components , such as databases, as well as a monitoring framework.

Sitraka PerformaSure

PerformaSure targets the performance testing environment specifically by using a combination of lightweight instrumentation to provide high-level performance data across web server, application server, and database. The company also provides more performance intrusive drill-down capabilities.

Wily Technologies Introscope

Introscope provides monitoring for a wide range of Java applications. Introscope specifically monitors EJB and servlet performance, JVM memory, JDBC connections, CPU utilization, and network socket traffic. Introscope is customizable to add other monitoring points. Introscope provides a set of tailorable dashboards to monitor key components of your choice.

Java Application Performance Monitoring Summary
Company Product Web Site
Precise Software Solutions Indepth for the J2EE platform <www.precise.com>
Sitraka PerformaSure <www.sitraka.com>
Wily Technology Introscope <www.wilytech.com>

Database Performance Analysis

The monitoring tools discussed so far focus on production monitoring for Java web applications or Java applications in general. However, specialized monitors also exist for monitoring databases. Like their Java monitoring cousins, these tools focus on production database monitoring, but they sometimes prove valuable during testing as well. If your web application includes a significant database access component, these tools may aid database optimization.

Database Performance Monitoring Summary

Additional products supporting IBM's DB2 database are listed in the Global Solutions Directory at: <http://www8.software.ibm.com/solutions/isv/igssg.nsf/searchgui2>.

Company Product Web Site
DGI Flight Deck, SQL-GUY, and other related products <www.databaseguys.com>
Precise Solutions

Indepth for Oracle

Indepth for DB2 UDB

<www.precise.com>
Quest

Spotlight on Oracle

Spotlight on SQL Server

Quest Central for DB2, and other related products

<www.quest.com>

Network Protocol Analyzers

Network protocol analyzers range in price from freeware to more than $100,000. The table below contains a list of some common network analyzers. [3]

[3] "Selecting a Protocol Analyzer," posted on NetworkWorldFusion, October 8, 2001, by Ron Nutter. Retrieved December 27, 2001, from the World Wide Web: <http://www.nwfusion.com/columnists/2001/1008helpdesk.htm>.

Network Protocol Analyzer Summary
Company Product Web Site
Ethereal Ethereal <www.ethereal.com>
Sniffer Technologies (Network Associates) Sniffer <www.sniffer.com>
Wildpackets Etherpeek <www.wildpackets.com>

Product Capabilities

In addition to the specialized monitoring products, don't forget the excellent , low impact capabilities packaged with the operating systems and middleware. Frequently, these are the only monitoring products you need during your tests. Chapter 12 contains descriptions and examples using some of these tools.

Product Capabilities Summary
Component Tool
Network netstat
System

UNIX: vmstat, iostat, sar

Microsoft Windows: Performance Monitor

Application Server

WebSphere Resource Analyzer

WebSphere Thread Analyzer

WebLogic Administration Console

Java Virtual Machine Verbosegc
Database Server

DB2 Snapshot

Oracle Statspack, Oracle Enterprise Manager

Production Monitoring Solutions

Once your site is in production, you'll need to monitor the performance for problem identification and ongoing capacity planning. For completeness, we have included below a list of production monitoring products providing support for IBM's WebSphere Application Server and other leading application servers. [4]

[4] For a list of performance monitoring products supporting IBM's WebSphere Application Server, see <http://www-4.ibm.com/software/webservers/pw/dhtml/wsperformance/performance_bpsolutions.html>.

Production Monitoring Summary
Company Product Web Site
Altaworks Panorama <www.altaworks.com>
BMC Software Patrol <www.bmc.com>
Candle OMEGAMON <www.candle.com>
Computer Associates Unicenter <www.ca.com>
Dirig Software Fenway <www.dirig.com>
Empirix OneSight <www.empirix.com>
IBM Tivoli Web Component Manager <www.tivoli.com>
IBM Tivoli Tivoli Manager for WebSphere <www.tivoli.com>
Mercury Interactive Topaz <www.mercuryinteractive.com>
Nastel Technologies AutoPilot <www.nastel.com>
Precise Software Solutions Precise Indepth <www.precise.com>
Wily Technologies Introscope <www.wilytech.com>


Performance Analysis for Java Web Sites
Performance Analysis for Javaв„ў Websites
ISBN: 0201844540
EAN: 2147483647
Year: 2001
Pages: 126

flylib.com © 2008-2017.
If you may any questions please contact us: flylib@qtcs.net