The DevTest development team performed testing to show benchmarks for performance of service virtualization. You can use these benchmarks to help tune the performance of your system.
The following data represents a simple scenario to identify the behavior of VSE under heavy load. The variation of the independent variable has been limited to the payload size. Performance data has been collected for the following payload sizes: 1 KB, 10 KB, and 100 KB.
The following graphic pictures the topology of the Performance Lab.
Windows 2012 R2 64-bit VMs
4 individual cores assigned and reserved
16 GB reserved
Intel® Xeon® CPU ES-2680 v3 @ 2.5GHz, 1 Core
DevTest version: 10.1.0.108
|Execution Mode||Most Efficient|
Other components: WARN
A single virtual service was deployed to the VSE. Each HTTP call produces a single transaction count in the VSE. There is no search and replacement activity involved in this transaction. The service returns an exact match response. Further processing is required neither at the requests nor the response level.
|JSON Response Payload Size||Average TPS||Max TPS||Total Transactions per Run||
|1 KB||10,822||11,560||39,202,897||13%||93%||REST Data Protocol|
|10 KB||8,405||8,808||29,888,786||18%||90%||REST Data Protocol|
|100 KB||2,974||3176||10,635,062||13%||90%||REST Data Protocol|
Duration of each test run: 60 minutes during off-peak hours
The data that are provided in the previous table represents the number of transactions that are handled by the VSE during each 60-minute test run.
The following charts represent data that were captured from the VSE server machine during the execution of each test run. The machines hosting the database utilized a very modest amount of resources. The machine hosting the registry consumed limited CPU time (2 to 3%) and approximately 40% of the available RAM. Disk activity of the registry ranged from 50 to 100 KB/sec. This demonstrates that the machines supporting the VSE machine do not represent a bottleneck during the test runs.
Available Memory: 13.5 GB out of total of 16 GB
Available Memory: 13.4 GB out of total of 16 GB