Foreword.
Introduction.
Acknowledgments.
1. Basic Performance Lingo.
Measurement Terminology.
Load: Customers Using Your Web Site.
Throughput: Customers Served over Time.
Response Time: Time to Serve the Customer.
Optimization Terminology.
Path Length: The Steps to Service a Request.
Bottleneck: Resource Contention under Load.
Scaling: Adding Resources to Improve Performance.
Summary.
2. Java Application Server Performance.
Web Content Types.
Web Application Basics.
The Model-View-Controller Design Pattern.
Servlets.
JavaServer Pages (JSPs).
Assorted Application Server Tuning Tips 56Beyond the Basics.
HTTP Sessions.
Enterprise JavaBeans (EJBs).
Database Connection Pool Management.
Web Services.
Other Features.
Built-in HTTP Servers.
General Object Pool Management.
Multiple Instances: Clones.
Summary.
3. The Performance Roles of Key Web Site Components.
Network Components.
Routers.
Firewalls.
Proxy Servers.
Network Interface Cards (NICs).
Load Balancers.
Affinity Routing.
HTTP Servers.
Threads or Processes (Listeners).
Timeouts.
Logging.
Keep-Alive.
Operating System Settings.
SSL/HTTPS.
Plug-Ins.
Application Servers.
Security.
Databases and Other Back-End Resources.
Caching.
Web Site Topologies.
Vertical Scaling.
Horizontal Scaling.
Choosing between a Few Big Machines or Many Smaller Machines.
Best Practices.
Summary.
4. Java Specifics.
The Java Virtual Machine.
Heap Management.
Garbage Collection.
Java Coding Techniques.
Minimizing Object Creation.
Multi-Threading Issues.
Summary.
5. Performance Profiles of Common Web Sites.
Financial Sites.
Caching Potential.
Special Considerations.
Performance Testing Considerations.
B2B (Business-to-Business) Sites.
Caching Potential.
Special Considerations.
Performance Testing a B2B Site.
e-Commerce Sites.
Caching Potential.
Special Considerations.
Performance Testing an e-Commerce Site.
Portal Sites.
Caching Potential.
Special Considerations: Traffic Patterns.
Performance Testing a Portal Site.
Information Sites.
Caching Potential.
Special Considerations: Traffic Patterns.
Performance Testing an Information Site.
Pervasive Client Device Support.
Caching Potential.
Special Considerations.
Performance Testing Sites That Support Pervasive Devices.
Web Services.
Summary.
6. Developing a Performance Test Plan.
Test Goals.
Peak Load.
Throughput Estimates.
Response Time Measurements.
Defining the Test Scope.
Building the Test.
Scalability Testing.
Building the Performance Team.
Summary.
7. Test Scripts.
Getting Started.
Pet Store Overview.
Determining User Behavior.
A Typical Test Script.
Test Scripts Basics.
Model the Real Users.
Develop Multiple, Short Scripts.
Write Atomic Scripts.
Develop Primitive Scripts.
Making Test Scripts Dynamic.
Support Dynamic Decisions.
Dynamically Created Web Pages.
Dynamic Data Entry.
Provide Sufficient Data.
Building Test Scenarios.
Putting Scripts Together.
Use Weighted Testing.
Exercise the Whole Web Site.
Common Pitfalls.
Inaccuracies.
Hard-Coded Cookies.
Unsuitable Think Times.
No Parameterization.
Idealized Users.
Oversimplified Scripts.
Myopic Scripts.
Summary.
8. Selecting the Right Test Tools.
Production Simulation Requirements.
Users.
Scripts.
Automation and Centralized Control.
Pricing and Licensing.
Tool Requirements for Reproducible Results.
Reporting.
Verification of Results.
Real-Time Server Machine Test Monitoring.
Buy versus Build.
Summary.
9. Test Environment Construction and Tuning.
The Network.
Network Isolation.
Network Capacity.
e-Commerce Network Capacity Planning Example.
Network Components.
Network Protocol Analyzers and Network Monitoring.
The Servers.
Application Server Machines.
Database Servers.
Legacy Servers.
The Load Generators.
Master/Slave Configurations.
After the Performance Test.
Hardware and Test Planning.
Summary.
10. Case Study: Preparing to Test.
Case Study Assumptions.
Fictional Customer: TriMont Mountain Outfitters.
An Introduction to the TriMont Web Site.
Site Requirements.
Initial Assessment.
Next Steps.
Detailed TriMont Web Site Planning Estimates.
Calculating Throughput (Page Rate and Request Rate).
Network Analysis.
HTTP Session Pressure.
Test Scenarios.
Moving Ahead.
Summary.
11. Executing a Successful Test.
Testing Overview.
Test Analysis and Tuning Process.
Test and Measure.
Validate.
Analyze.
Tune.
Test Phases.
Phase 1: Simple, Single-User Paths.
Phase 2: User Ramp-Up.
Test Environment Configurations.
Start Simple.
Add Complexity.
Summary.
12. Collecting Useful Data.
CPU Utilization.
Monitoring CPU on UNIX Systems.
Monitoring CPU on Windows Systems.
Monitoring CPU with a Test Tool.
Java Monitoring.
Verbose Garbage Collection.
Thread Trace.
Other Performance Monitors.
Network Monitoring.
Software Logs.
Java Application Server Monitors.
Summary.
13. Common Bottleneck Symptoms.
Underutilization.
Insufficient Network Capacity.
Application Serialization.
Insufficient Resources.
Insufficient Test Client Resource.
Scalability Problem.
Bursty Utilization.
Application Synchronization.
Client Synchronization.
Back-End Systems.
Garbage Collection.
Timeout Issues.
Network Issues.
High CPU Utilization
High User CPU.
High System CPU.
High Wait CPU.
Uneven Cluster Loading.
Network Issues.
Routing Issues.
Summary.
14. Case Study: During the Test.
Update.
Test Environment.
Hardware Configuration.
Input Data.
Calculating Hardware Requirement Estimate (Pre-Test).
HTTP Session Pressure.
Testing Underway.
Burstiness.
Underutilization.
Next Steps.
Summary.
15. Capacity Planning and Site Growth.
Review Plan Requirements.
Review Load, Throughput, and Response Time Objectives.
Incorporate Headroom.
Review Performance Test Results.
Single-Server User Ramp-Up.
Scalability Data.
Processor Utilization.
Projecting Performance.
Projecting Application Server Requirements.
Projecting Hardware Capacity.
Scaling Assumptions.
Case Study: Capacity Planning.
Review Plan Requirements.
Review Performance Test Results.
Project Capacity.
Ongoing Capacity Planning.
Collecting Production Data.
Analyzing Production Data.
Summary.
Appendix A. Planning Worksheets.
Capacity Sizing Worksheet.
Input Data.
Calculating Peak Load (Concurrent Users).
Calculating Throughput (Page Rate and Request Rate).
Network Capacity Sizing Worksheet.
Input Data.
Calculating Network Requirements.
Network Sizing.
JVM Memory HTTP Session Sizing Worksheet.
Input Data.
Calculating HTTP Session Memory Requirement.
Hardware Sizing Worksheet.
Input Data.
Calculating Hardware Requirement Estimate (Pre-Test).
Capacity Planning Worksheet.
Part 1: Requirements Summary.
Part 2: Performance Results Summary.
Part 3: Capacity Planning Estimates.
Appendix B. Pre-Test Checklists.
Web Application Checklist.
Servlets.
Java Server Pages.
JavaBeans.
XML/XSL.
Static Content.
Logging.
HTTP Session.
Enterprise JavaBeans.
Web Services.
Database Connection.
Object Pools.
Garbage Collection.
Component Checklist.
Routers.
Firewalls.
Proxy Servers.
Network Interface Cards.
Operating System.
HTTP Servers.
Web Container.
Thread Pools.
Enterprise JavaBean Container.
JVM Heap.
Application Server Clones.
Database Server.
Legacy Systems.
Test Team Checklist.
Test Team.
Support Team.
Web Application Developers.
Leadership and Management Team.
Test Environment Checklist.
Controlled Environment.
Network.
Hardware.
Prerequisite Software.
Application Code.
Back-End.
Test Simulation and Tooling Checklist.
Performance Test Tool Resources.
Test Scripts and Scenarios.
Tools.
Appendix C. Test Tools.
Performance Analysis and Test Tool Sources.
@BHEADS = Java Profilers.
Performance Test Tools.
Java Application Performance Monitoring.
Database Performance Analysis.
Network Protocol Analyzers.
Product Capabilities.
Production Monitoring Solutions.
Load Driver Checklist.
Sample LoadRunner Script.
LoadRunner Initialization Section.
LoadRunner Action1 Section.
LoadRunner End Section.
Sample SilkPerformer Script.
Sign-in, Browse, and Purchase Script.
Search Script.
New Account Script.
Appendix D. Performance Test Checklists and Worksheets.
Performance Test Results Worksheet.
Results Verification Checklist.
Tuning Settings Worksheet.
Hardware.
Operating System.
HTTP Server.
Application Server.
JVM.
Application Parameters.
Database Server.
Bottleneck Removal Checklist.
Underutilization.
Bursty Utilization.
High CPU Utilization.
Uneven Cluster Loading.
Summary Test Results Graph.
Bibliography.
Index. 0201844540T08282002
