TPC Benchmarks


	Home
	Results TPC-App TPC-C TPC-E TPC-H
	Benchmarks TPC-App TPC-C - Results - Description - FAQ TPC-E TPC-H Pricing Spec Obsolete - TPC-A - TPC-B - TPC-D - TPC-R - TPC-W
	Technical Articles
	Related Links
	What's New
	About the TPC What is the TPC Mailing List Applications Press Documentation
	Who We Are Members Affiliates
	Member Login
	Contact Us

TPC Benchmarks

TPC-App

TPC Benchmark™ App (TPC-App) is an application server and web services benchmark. The workload is performed in a managed environment that simulates the activities of a business-to-business transactional application server operating in a 24x7 environment. TPC-App showcases the performance capabilities of application server systems. The workload exercises commercially available application server products, messaging products, and databases associated with such environments, which are characterized by:

Multiple on-line business sessions
Commercially available application environment
Use of XML documents and SOAP for data exchange
Business to business application logic
Distributed transaction management
Reliable and durable messaging
Dynamic web service response generation with database access and update
Simultaneous execution of multiple transaction types that span a breadth of business functions.
Databases consisting of many tables with a wide variety of sizes, attributes, and relationships
Transaction integrity (ACID properties)

TPC-C

TPC-C simulates a complete computing environment where a population of users executes transactions against a database. The benchmark is centered around the principal activities (transactions) of an order-entry environment. These transactions include entering and delivering orders, recording payments, checking the status of orders, and monitoring the level of stock at the warehouses. While the benchmark portrays the activity of a wholesale supplier, TPC-C is not limited to the activity of any particular business segment, but, rather represents any industry that must manage, sell, or distribute a product or service.

TPC-C involves a mix of five concurrent transactions of different types and complexity either executed on-line or queued for deferred execution. It does so by exercising a breadth of system components associated with such environments, which are characterized by:

The simultaneous execution of multiple transaction types that span a breadth of complexity
On-line and deferred transaction execution modes
Multiple on-line terminal sessions
Moderate system and application execution time
Significant disk input/output
Transaction integrity (ACID properties)
Non-uniform distribution of data access through primary and secondary keys
Databases consisting of many tables with a wide variety of sizes, attributes, and relationships
Contention on data access and update

TPC-C performance is measured in new-order transactions per minute. The primary metrics are the transaction rate (tpmC), the associated price per transaction ($/tpmC), and the availability date of the priced configuration.

TPC-E

TPC Benchmark™ E (TPC-E) is a new On-Line Transaction Processing (OLTP) workload developed by the TPC. The TPC-E benchmark uses a database to model a brokerage firm with customers who generate transactions related to trades, account inquiries, and market research. The brokerage firm in turn interacts with financial markets to execute orders on behalf of the customers and updates relevant account information.

The benchmark is “scalable,” meaning that the number of customers defined for the brokerage firm can be varied to represent the workloads of different-size businesses. The benchmark defines the required mix of transactions the benchmark must maintain. The TPC-E metric is given in transactions per second (tps). It specifically refers to the number of Trade-Result transactions the server can sustain over a period of time.

Although the underlying business model of TPC-E is a brokerage firm, the database schema, data population, transactions, and implementation rules have been designed to be broadly representative of modern OLTP systems.

TPC-H

The TPC Benchmark™H (TPC-H) is a decision support benchmark. It consists of a suite of business oriented ad-hoc queries and concurrent data modifications. The queries and the data populating the database have been chosen to have broad industry-wide relevance. This benchmark illustrates decision support systems that examine large volumes of data, execute queries with a high degree of complexity, and give answers to critical business questions.

The performance metric reported by TPC-H is called the TPC-H Composite Query-per-Hour Performance Metric (QphH@Size), and reflects multiple aspects of the capability of the system to process queries. These aspects include the selected database size against which the queries are executed, the query processing power when queries are submitted by a single stream, and the query throughput when queries are submitted by multiple concurrent users. The TPC-H Price/Performance metric is expressed as $/QphH@Size.

Pricing

The TPC Pricing Subcommittee was chartered to recommend revisions to the existing pricing methodology so that prices used in published TPC results are verifiable. In the course of this activity, a decision was made to develop a single pricing specification that is consistent for all TPC benchmark. This specification is now complete.

Home Results Benchmarks Technical Articles Related Links What's New About the TPC Who We Are Privacy Policy About Pricing Contact Us