Xebra Benchmarks

Revision as of 10:10, 1 September 2009 by Fabioz (Talk | contribs) (→‎Environment)

About | Installation | Documentation | Tutorials | Frequently Asked Questions


Environment

  • Windows 7 64Bit
  • Xebra revision 80570
  • Eiffel Studio 6.5.7.9743 GPL Edition - windows
  • Eiffel src revision 80570
  • IIS 7.5.7100
  • Apache 2.2.11
  • ApacheBench 2.3
  • Tomcat 6.0

Settings

  • Using experimental library
  • Server and webapps are finalized. Webapp is unmanaged.

The page has the following content: 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 STRICT//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>Xebra Hello World Application</title>
</head>
<body>
Hello {print 'WORLD' or 'world' depending on current time}
</body>
</html>

Results

Xebra Webapp on Apache Xebra Webapp on IIS Java JSP Webapp on Tomcat Static Page on Apache

1000 requests, concurrency level 1 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      1
Time taken for tests:   9.290 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    107.64 [#/sec] (mean)
Time per request:       9.290 [ms] (mean)
Time per request:       9.290 [ms] (mean, across all concurrent requests)
Transfer rate:          75.27 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     7    9   1.4      9      21
Waiting:        7    9   1.4      9      21
Total:          7    9   1.4      9      21
 
Percentage of the requests served within a certain time (ms)
  50%      9
  66%     10
  75%     10
  80%     10
  90%     11
  95%     11
  98%     14
  99%     16
 100%     21 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      1
Time taken for tests:   9.243 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    108.19 [#/sec] (mean)
Time per request:       9.243 [ms] (mean)
Time per request:       9.243 [ms] (mean, across all concurrent requests)
Transfer rate:          114.84 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:     7    9   4.0      8      63
Waiting:        7    9   4.0      8      63
Total:          7    9   4.0      8      63
 
Percentage of the requests served within a certain time (ms)
  50%      8
  66%      9
  75%      9
  80%      9
  90%     10
  95%     13
  98%     16
  99%     31
 100%     63 (longest request)
 
tomcat
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      1
Time taken for tests:   0.893 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1120.35 [#/sec] (mean)
Time per request:       0.893 [ms] (mean)
Time per request:       0.893 [ms] (mean, across all concurrent requests)
Transfer rate:          649.89 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     0    1   0.6      1      11
Waiting:        0    1   0.6      1      11
Total:          0    1   0.5      1      11
 
Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      1
  95%      1
  98%      1
  99%      1
 100%     11 (longest request)

1000 requests, concurrency level 10 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      10
Time taken for tests:   8.527 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    117.27 [#/sec] (mean)
Time per request:       85.273 [ms] (mean)
Time per request:       8.527 [ms] (mean, across all concurrent requests)
Transfer rate:          82.00 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:    31   84  10.5     87     107
Waiting:       31   84  10.5     87     107
Total:         31   85  10.5     87     107
 
Percentage of the requests served within a certain time (ms)
  50%     87
  66%     90
  75%     93
  80%     95
  90%     98
  95%    101
  98%    103
  99%    104
 100%    107 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      10
Time taken for tests:   5.491 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    182.11 [#/sec] (mean)
Time per request:       54.912 [ms] (mean)
Time per request:       5.491 [ms] (mean, across all concurrent requests)
Transfer rate:          193.31 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   1.8      0      27
Processing:    10   54  20.2     49     169
Waiting:        9   53  20.2     49     169
Total:         11   54  20.2     50     169
 
Percentage of the requests served within a certain time (ms)
  50%     50
  66%     57
  75%     63
  80%     67
  90%     81
  95%     96
  98%    111
  99%    124
 100%    169 (longest request)
 
tomcat
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      10
Time taken for tests:   0.559 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1790.21 [#/sec] (mean)
Time per request:       5.586 [ms] (mean)
Time per request:       0.559 [ms] (mean, across all concurrent requests)
Transfer rate:          1038.46 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:     1    5   2.9      5      87
Waiting:        1    5   2.9      5      87
Total:          2    5   2.9      5      87
 
Percentage of the requests served within a certain time (ms)
  50%      5
  66%      6
  75%      6
  80%      6
  90%      6
  95%      7
  98%      9
  99%     11
 100%     87 (longest request)

1000 requests, concurrency level 100 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      100
Time taken for tests:   8.970 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    111.49 [#/sec] (mean)
Time per request:       896.973 [ms] (mean)
Time per request:       8.970 [ms] (mean, across all concurrent requests)
Transfer rate:          77.95 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:    54  846 175.6    912    1018
Waiting:       54  846 175.6    912    1018
Total:         54  846 175.6    912    1018
 
Percentage of the requests served within a certain time (ms)
  50%    912
  66%    929
  75%    940
  80%    972
  90%    994
  95%   1002
  98%   1014
  99%   1016
 100%   1018 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      100
Time taken for tests:   5.517 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    181.27 [#/sec] (mean)
Time per request:       551.660 [ms] (mean)
Time per request:       5.517 [ms] (mean, across all concurrent requests)
Transfer rate:          192.42 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   2.0      0      23
Processing:    19  526  97.3    544     672
Waiting:       19  525  97.2    544     672
Total:         19  527  97.6    546     672
 
Percentage of the requests served within a certain time (ms)
  50%    546
  66%    559
  75%    567
  80%    574
  90%    594
  95%    613
  98%    628
  99%    644
 100%    672 (longest request)
 
tomcat
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      100
Time taken for tests:   0.647 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1544.49 [#/sec] (mean)
Time per request:       64.746 [ms] (mean)
Time per request:       0.647 [ms] (mean, across all concurrent requests)
Transfer rate:          895.93 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       3
Processing:    21   61  10.1     63      84
Waiting:       20   61  10.1     63      84
Total:         21   61  10.1     63      84
 
Percentage of the requests served within a certain time (ms)
  50%     63
  66%     63
  75%     65
  80%     67
  90%     71
  95%     75
  98%     78
  99%     79
 100%     84 (longest request)
Retrieved from "https://dev.eiffel.com/index.php?title=Xebra_Benchmarks&oldid=13441"