Difference between revisions of "Xebra Benchmarks"

(Environment)
(Results)
Line 32: Line 32:
  
 
{| class="wikitable"
 
{| class="wikitable"
! Xebra Webapp
+
! Xebra Webapp on Apache
 +
! Xebra Webapp on IIS
 
! Java JSP Webapp on Tomcat
 
! Java JSP Webapp on Tomcat
 
! Static Page on Apache
 
! Static Page on Apache
Line 78: Line 79:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      1
 +
Time taken for tests:  9.243 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    108.19 [#/sec] (mean)
 +
Time per request:      9.243 [ms] (mean)
 +
Time per request:      9.243 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          114.84 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    0  0.4      0      1
 +
Processing:    7    9  4.0      8      63
 +
Waiting:        7    9  4.0      8      63
 +
Total:          7    9  4.0      8      63
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%      8
 +
  66%      9
 +
  75%      9
 +
  80%      9
 +
  90%    10
 +
  95%    13
 +
  98%    16
 +
  99%    31
 +
100%    63 (longest request)
 +
</code>
 +
|
 +
<code>
 +
tomcat
 
</code>
 
</code>
 
|
 
|
Line 158: Line 194:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      10
 +
Time taken for tests:  5.491 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    182.11 [#/sec] (mean)
 +
Time per request:      54.912 [ms] (mean)
 +
Time per request:      5.491 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          193.31 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    1  1.8      0      27
 +
Processing:    10  54  20.2    49    169
 +
Waiting:        9  53  20.2    49    169
 +
Total:        11  54  20.2    50    169
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%    50
 +
  66%    57
 +
  75%    63
 +
  80%    67
 +
  90%    81
 +
  95%    96
 +
  98%    111
 +
  99%    124
 +
100%    169 (longest request)
 +
</code>
 +
|
 +
<code>
 +
tomcat
 
</code>
 
</code>
 
|
 
|
Line 238: Line 309:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      100
 +
Time taken for tests:  5.517 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    181.27 [#/sec] (mean)
 +
Time per request:      551.660 [ms] (mean)
 +
Time per request:      5.517 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          192.42 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    1  2.0      0      23
 +
Processing:    19  526  97.3    544    672
 +
Waiting:      19  525  97.2    544    672
 +
Total:        19  527  97.6    546    672
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%    546
 +
  66%    559
 +
  75%    567
 +
  80%    574
 +
  90%    594
 +
  95%    613
 +
  98%    628
 +
  99%    644
 +
100%    672 (longest request)
 +
</code>
 +
|
 +
<code>
 +
tomcat
 
</code>
 
</code>
 
|
 
|

Revision as of 10:55, 1 September 2009

About | Installation | Documentation | Tutorials | Frequently Asked Questions


Environment

  • Windows 7 64Bit
  • Xebra revision 80570
  • Eiffel Studio 6.5.7.9743 GPL Edition - windows
  • Eiffel src revision 80570
  • IIS 7.5.7100
  • Apache 2.2.11
  • ApacheBench 2.3

Settings

  • Using experimental library
  • Server and webapps are finalized. Webapp is unmanaged.

The page has the following content:

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 STRICT//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>Xebra Hello World Application</title>
</head>
<body>
Hello {print 'WORLD' or 'world' depending on current time}
</body>
</html>

Results

Xebra Webapp on Apache Xebra Webapp on IIS Java JSP Webapp on Tomcat Static Page on Apache

1000 requests, concurrency level 1

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      1
Time taken for tests:   9.290 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    107.64 [#/sec] (mean)
Time per request:       9.290 [ms] (mean)
Time per request:       9.290 [ms] (mean, across all concurrent requests)
Transfer rate:          75.27 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     7    9   1.4      9      21
Waiting:        7    9   1.4      9      21
Total:          7    9   1.4      9      21
 
Percentage of the requests served within a certain time (ms)
  50%      9
  66%     10
  75%     10
  80%     10
  90%     11
  95%     11
  98%     14
  99%     16
 100%     21 (longest request)
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      1
Time taken for tests:   9.243 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    108.19 [#/sec] (mean)
Time per request:       9.243 [ms] (mean)
Time per request:       9.243 [ms] (mean, across all concurrent requests)
Transfer rate:          114.84 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:     7    9   4.0      8      63
Waiting:        7    9   4.0      8      63
Total:          7    9   4.0      8      63
 
Percentage of the requests served within a certain time (ms)
  50%      8
  66%      9
  75%      9
  80%      9
  90%     10
  95%     13
  98%     16
  99%     31
 100%     63 (longest request)
tomcat
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      1
Time taken for tests:   0.893 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1120.35 [#/sec] (mean)
Time per request:       0.893 [ms] (mean)
Time per request:       0.893 [ms] (mean, across all concurrent requests)
Transfer rate:          649.89 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     0    1   0.6      1      11
Waiting:        0    1   0.6      1      11
Total:          0    1   0.5      1      11
 
Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      1
  95%      1
  98%      1
  99%      1
 100%     11 (longest request)

1000 requests, concurrency level 10

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      10
Time taken for tests:   8.527 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    117.27 [#/sec] (mean)
Time per request:       85.273 [ms] (mean)
Time per request:       8.527 [ms] (mean, across all concurrent requests)
Transfer rate:          82.00 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:    31   84  10.5     87     107
Waiting:       31   84  10.5     87     107
Total:         31   85  10.5     87     107
 
Percentage of the requests served within a certain time (ms)
  50%     87
  66%     90
  75%     93
  80%     95
  90%     98
  95%    101
  98%    103
  99%    104
 100%    107 (longest request)
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      10
Time taken for tests:   5.491 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    182.11 [#/sec] (mean)
Time per request:       54.912 [ms] (mean)
Time per request:       5.491 [ms] (mean, across all concurrent requests)
Transfer rate:          193.31 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   1.8      0      27
Processing:    10   54  20.2     49     169
Waiting:        9   53  20.2     49     169
Total:         11   54  20.2     50     169
 
Percentage of the requests served within a certain time (ms)
  50%     50
  66%     57
  75%     63
  80%     67
  90%     81
  95%     96
  98%    111
  99%    124
 100%    169 (longest request)
tomcat
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      10
Time taken for tests:   0.559 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1790.21 [#/sec] (mean)
Time per request:       5.586 [ms] (mean)
Time per request:       0.559 [ms] (mean, across all concurrent requests)
Transfer rate:          1038.46 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:     1    5   2.9      5      87
Waiting:        1    5   2.9      5      87
Total:          2    5   2.9      5      87
 
Percentage of the requests served within a certain time (ms)
  50%      5
  66%      6
  75%      6
  80%      6
  90%      6
  95%      7
  98%      9
  99%     11
 100%     87 (longest request)

1000 requests, concurrency level 100

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      100
Time taken for tests:   8.970 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    111.49 [#/sec] (mean)
Time per request:       896.973 [ms] (mean)
Time per request:       8.970 [ms] (mean, across all concurrent requests)
Transfer rate:          77.95 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:    54  846 175.6    912    1018
Waiting:       54  846 175.6    912    1018
Total:         54  846 175.6    912    1018
 
Percentage of the requests served within a certain time (ms)
  50%    912
  66%    929
  75%    940
  80%    972
  90%    994
  95%   1002
  98%   1014
  99%   1016
 100%   1018 (longest request)
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      100
Time taken for tests:   5.517 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    181.27 [#/sec] (mean)
Time per request:       551.660 [ms] (mean)
Time per request:       5.517 [ms] (mean, across all concurrent requests)
Transfer rate:          192.42 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   2.0      0      23
Processing:    19  526  97.3    544     672
Waiting:       19  525  97.2    544     672
Total:         19  527  97.6    546     672
 
Percentage of the requests served within a certain time (ms)
  50%    546
  66%    559
  75%    567
  80%    574
  90%    594
  95%    613
  98%    628
  99%    644
 100%    672 (longest request)
tomcat
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      100
Time taken for tests:   0.647 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1544.49 [#/sec] (mean)
Time per request:       64.746 [ms] (mean)
Time per request:       0.647 [ms] (mean, across all concurrent requests)
Transfer rate:          895.93 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       3
Processing:    21   61  10.1     63      84
Waiting:       20   61  10.1     63      84
Total:         21   61  10.1     63      84
 
Percentage of the requests served within a certain time (ms)
  50%     63
  66%     63
  75%     65
  80%     67
  90%     71
  95%     75
  98%     78
  99%     79
 100%     84 (longest request)