SPEC Announces SPECweb99 Benchmark, Successor to Industry-Standard SPECweb96.MANASSAS, Va.--(BUSINESS WIRE)--August 16, 1999-- New web server benchmark's workload includes dynamic web-page generation The Standard Performance Evaluation Corporation The Standard Performance Evaluation Corporation (SPEC) is a non-profit organization that aims to produce "fair, impartial and meaningful benchmarks for computers." SPEC was founded in 1988 and their goal is to ensure that the marketplace has a fair and useful set of metrics to (SPEC) announces SPECweb99, a new version of its benchmark for measuring the performance of web servers. SPECweb99 replaces SPECweb96, an acknowledged worldwide standard for web server performance evaluation Performance evaluation The assessment of a manager's results, which involves, first, determining whether the money manager added value by outperforming the established benchmark (performance measurement) and, second, determining how the money manager achieved the calculated return . Both benchmarks were developed by SPEC's Open Systems Group (OSG OSG Open Scene Graph OSG Open Science Grid OSG Office of the Secretary-General (United Nations) OSG Open Systems Group OSG Office of the Surgeon General (HHS - PHS) ), whose membership includes leading web product vendors and research organizations. "SPECweb99 builds upon the widely endorsed methodology introduced with SPECweb96," says Kaivalya M. Dixit, SPEC president. "We've updated the framework and workload to reflect industry changes, but we've adhered to the elements that make this a SPEC benchmark: standardized implementation, workload and run rules; full disclosure of information that ensures results can be reproduced; and availability of source code for customized internal testing." Reflecting Real-World Usage SPECweb99 is targeted at web server hardware and software vendors and customers seeking performance data for web server purchasing. The new benchmark supports HTTP HTTP in full HyperText Transfer Protocol Standard application-level protocol used for exchanging files on the World Wide Web. HTTP runs on top of the TCP/IP protocol. 1.0 and HTTP1.1 protocols. The SPECweb99 workload simulates accesses to a web service provider, where the server supports home pages for a number of different organizations. Each home page is a collection of files ranging in size from small icons to large documents and images. As in the real world, certain files within the home page are more popular than others. The workload simulates dynamic operations such as "rotating" advertisements on a web page, customized web page creation, and user registration. The benchmark's metric is SPECweb99. It represents the number of simultaneous connections the web server can support using the predefined workload. The SPECweb99 test harness In software testing, a test harness or automated test framework is a collection of software and test data configured to test a program unit by running it under varying conditions and monitor its behavior and outputs. emulates clients sending the HTTP requests in the workload over slow Internet connections to the web server. The benchmark is designed to model conditions that will exist during its lifetime. The SPECweb99 workload is based on analyses of server logs from a variety of popular Internet servers and some smaller web sites. Workload files are divided into four classes according to according to prep. 1. As stated or indicated by; on the authority of: according to historians. 2. In keeping with: according to instructions. 3. size, from less than 1 KB to slightly less than 1 MB. Access patterns to the files were determined according to the analyses of server logs. The access analyses reflect actual usage for a web service provider, with certain files being more popular than others. First Results Online The first set of SPECweb99 performance results is available now on SPEC's web site ( http://www.spec.org/osg/web99/ ). Subsequent results will be posted on an ongoing basis as they are submitted to SPEC's review process. SPECweb99 results are not comparable to those of its predecessor benchmark, SPECweb96. There will be a six-month transition period between the new and old benchmarks. During this period, SPEC will accept, review and publish results from both benchmark versions. Afterward, only SPECweb99 results will be accepted for publication. SPECweb99 is strictly a web server performance measure; it does not report web client, web client/server, or WAN performance. Future SPECweb releases are expected to address features such as proxy, multimedia and encryption performance. "We're gratified grat·i·fy tr.v. grat·i·fied, grat·i·fy·ing, grat·i·fies 1. To please or satisfy: His achievement gratified his father. See Synonyms at please. 2. by the industry acceptance of the SPECweb benchmark," says Gyan Bhal, SPECweb99 release manager, "but we know we have a non-stop job on our hands to keep pace with the rapid evolution of web technologies." Member organizations involved in the development of SPECweb99 include Compaq, Dell, Hewlett-Packard, IBM (International Business Machines Corporation, Armonk, NY, www.ibm.com) The world's largest computer company. IBM's product lines include the S/390 mainframes (zSeries), AS/400 midrange business systems (iSeries), RS/6000 workstations and servers (pSeries), Intel-based servers (xSeries) , Intel, Microsoft, Mindcraft, Netscape, Siemens, SGI (SGI, Sunnyvale, CA, www.sgi.com) A manufacturer of workstations and servers, founded in 1982 by Jim Clark. The company was founded as Silicon Graphics, Inc., but changed to its acronym in 1999. , Sun Microsystems, and Unisys. Although not a SPEC member, Cisco Systems also contributed. Available Now SPECweb99 is available immediately on CD-ROM CD-ROM: see compact disc. CD-ROM in full compact disc read-only memory Type of computer storage medium that is read optically (e.g., by a laser). for $800. A discount is available for universities and other non-profits as well as for SPECweb96 licensees. The benchmark's developer, SPEC, is a non-profit corporation formed to establish, maintain and endorse a standardized set of relevant benchmarks that can be applied to the newest generation of high-performance computers. SPEC member groups include the Open Systems Group (OSG), the High-Performance Group (HPG HPG human pituitary gonadotropin. ); and the Graphics Performance Characterization (GPC (1) A PC that uses the Linux-based gOS operating system. See gOS. (2) (GPC Group) Originally the Graphics Performance Characterization committee of the NCGA, the GPC Group is now part of Standard Performance Evaluation Corporation (SPEC) and oversees the following ) Group. The membership consists of leading computer hardware and software vendors, universities and research facilities. For more information, contact Dianne Rice, SPEC, 10754 Ambassador Drive, Ste. 201, Manassas, VA 20109; tel: 703-331-0180; fax: 703-331-0181; e-mail: info@spec.org or visit http://www.spec.org . Additional information, including answers to frequently asked questions about SPECWeb99 and the latest benchmark results, is available at: http://www.spec.org/osg/web99/ |
|
||||||||||||||||
Printer friendly
Cite/link
Email
Feedback
Reader Opinion