Difference between revisions of "Xebra Benchmarks"

(→‎Environment)
(→‎Settings)
 
(4 intermediate revisions by the same user not shown)
Line 10: Line 10:
 
*Apache 2.2.11
 
*Apache 2.2.11
 
*ApacheBench 2.3
 
*ApacheBench 2.3
 +
*Tomcat 6.0 with Apache-Coyote/1.1
  
 
==Settings==
 
==Settings==
 
*Using experimental library
 
*Using experimental library
−
*Server and webapps are finalized. Webapp is unmanaged.
+
*Server and webapp are finalized. Webapp is unmanaged.
  
 
The page has the following content:
 
The page has the following content:
Line 32: Line 33:
  
 
{| class="wikitable"
 
{| class="wikitable"
−
! Xebra Webapp
+
! Xebra Webapp on Apache
 +
! Xebra Webapp on IIS
 
! Java JSP Webapp on Tomcat
 
! Java JSP Webapp on Tomcat
 
! Static Page on Apache
 
! Static Page on Apache
Line 78: Line 80:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      1
 +
Time taken for tests:  9.243 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    108.19 [#/sec] (mean)
 +
Time per request:      9.243 [ms] (mean)
 +
Time per request:      9.243 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          114.84 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    0  0.4      0      1
 +
Processing:    7    9  4.0      8      63
 +
Waiting:        7    9  4.0      8      63
 +
Total:          7    9  4.0      8      63
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%      8
 +
  66%      9
 +
  75%      9
 +
  80%      9
 +
  90%    10
 +
  95%    13
 +
  98%    16
 +
  99%    31
 +
100%    63 (longest request)
 
</code>
 
</code>
 +
|
 +
<code>
 +
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
 +
Document Length:        334 bytes
 +
 +
Concurrency Level:      1
 +
Time taken for tests:  1.247 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      555000 bytes
 +
HTML transferred:      334000 bytes
 +
Requests per second:    801.88 [#/sec] (mean)
 +
Time per request:      1.247 [ms] (mean)
 +
Time per request:      1.247 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          434.61 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    0  0.4      0      1
 +
Processing:    0    1  0.3      1      4
 +
Waiting:        0    1  0.4      1      4
 +
Total:          1    1  0.4      1      5
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%      1
 +
  66%      1
 +
  75%      1
 +
  80%      1
 +
  90%      2
 +
  95%      2
 +
  98%      2
 +
  99%      2
 +
100%      5 (longest request)</code>
 
|
 
|
 
<code>
 
<code>
Line 158: Line 225:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      10
 +
Time taken for tests:  5.491 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    182.11 [#/sec] (mean)
 +
Time per request:      54.912 [ms] (mean)
 +
Time per request:      5.491 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          193.31 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    1  1.8      0      27
 +
Processing:    10  54  20.2    49    169
 +
Waiting:        9  53  20.2    49    169
 +
Total:        11  54  20.2    50    169
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%    50
 +
  66%    57
 +
  75%    63
 +
  80%    67
 +
  90%    81
 +
  95%    96
 +
  98%    111
 +
  99%    124
 +
100%    169 (longest request)
 
</code>
 
</code>
 +
|
 +
<code>
 +
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
 +
Document Length:        334 bytes
 +
 +
Concurrency Level:      10
 +
Time taken for tests:  0.828 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      555000 bytes
 +
HTML transferred:      334000 bytes
 +
Requests per second:    1207.55 [#/sec] (mean)
 +
Time per request:      8.281 [ms] (mean)
 +
Time per request:      0.828 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          654.48 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    0  0.5      0      2
 +
Processing:    1    8  1.6      8      19
 +
Waiting:        0    5  2.4      5      19
 +
Total:          2    8  1.6      8      19
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%      8
 +
  66%      8
 +
  75%      9
 +
  80%      9
 +
  90%    10
 +
  95%    12
 +
  98%    14
 +
  99%    15
 +
100%    19 (longest request)</code>
 
|
 
|
 
<code>
 
<code>
Line 238: Line 370:
 
|
 
|
 
<code>
 
<code>
 +
Document Path:          /hellworld/index.xeb
 +
Document Length:        848 bytes
  
 +
Concurrency Level:      100
 +
Time taken for tests:  5.517 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      1087000 bytes
 +
HTML transferred:      848000 bytes
 +
Requests per second:    181.27 [#/sec] (mean)
 +
Time per request:      551.660 [ms] (mean)
 +
Time per request:      5.517 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          192.42 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    1  2.0      0      23
 +
Processing:    19  526  97.3    544    672
 +
Waiting:      19  525  97.2    544    672
 +
Total:        19  527  97.6    546    672
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%    546
 +
  66%    559
 +
  75%    567
 +
  80%    574
 +
  90%    594
 +
  95%    613
 +
  98%    628
 +
  99%    644
 +
100%    672 (longest request)
 
</code>
 
</code>
 +
|
 +
<code>
 +
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
 +
Document Length:        334 bytes
 +
 +
Concurrency Level:      100
 +
Time taken for tests:  1.068 seconds
 +
Complete requests:      1000
 +
Failed requests:        0
 +
Write errors:          0
 +
Total transferred:      555000 bytes
 +
HTML transferred:      334000 bytes
 +
Requests per second:    936.01 [#/sec] (mean)
 +
Time per request:      106.836 [ms] (mean)
 +
Time per request:      1.068 [ms] (mean, across all concurrent requests)
 +
Transfer rate:          507.31 [Kbytes/sec] received
 +
 +
Connection Times (ms)
 +
              min  mean[+/-sd] median  max
 +
Connect:        0    0  0.8      0      15
 +
Processing:    5  101  89.4    81    404
 +
Waiting:        2  72  90.6    45    393
 +
Total:          5  101  89.3    81    404
 +
 +
Percentage of the requests served within a certain time (ms)
 +
  50%    81
 +
  66%    83
 +
  75%    84
 +
  80%    85
 +
  90%    331
 +
  95%    356
 +
  98%    384
 +
  99%    400
 +
100%    404 (longest request)</code>
 
|
 
|
 
<code>
 
<code>

Latest revision as of 10:20, 1 September 2009

About | Installation | Documentation | Tutorials | Frequently Asked Questions


Environment

  • Windows 7 64Bit
  • Xebra revision 80570
  • Eiffel Studio 6.5.7.9743 GPL Edition - windows
  • Eiffel src revision 80570
  • IIS 7.5.7100
  • Apache 2.2.11
  • ApacheBench 2.3
  • Tomcat 6.0 with Apache-Coyote/1.1

Settings

  • Using experimental library
  • Server and webapp are finalized. Webapp is unmanaged.

The page has the following content: 

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 STRICT//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
<title>Xebra Hello World Application</title>
</head>
<body>
Hello {print 'WORLD' or 'world' depending on current time}
</body>
</html>

Results

Xebra Webapp on Apache Xebra Webapp on IIS Java JSP Webapp on Tomcat Static Page on Apache

1000 requests, concurrency level 1 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      1
Time taken for tests:   9.290 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    107.64 [#/sec] (mean)
Time per request:       9.290 [ms] (mean)
Time per request:       9.290 [ms] (mean, across all concurrent requests)
Transfer rate:          75.27 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     7    9   1.4      9      21
Waiting:        7    9   1.4      9      21
Total:          7    9   1.4      9      21
 
Percentage of the requests served within a certain time (ms)
  50%      9
  66%     10
  75%     10
  80%     10
  90%     11
  95%     11
  98%     14
  99%     16
 100%     21 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      1
Time taken for tests:   9.243 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    108.19 [#/sec] (mean)
Time per request:       9.243 [ms] (mean)
Time per request:       9.243 [ms] (mean, across all concurrent requests)
Transfer rate:          114.84 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:     7    9   4.0      8      63
Waiting:        7    9   4.0      8      63
Total:          7    9   4.0      8      63
 
Percentage of the requests served within a certain time (ms)
  50%      8
  66%      9
  75%      9
  80%      9
  90%     10
  95%     13
  98%     16
  99%     31
 100%     63 (longest request)
 
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
Document Length:        334 bytes
 
Concurrency Level:      1
Time taken for tests:   1.247 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      555000 bytes
HTML transferred:       334000 bytes
Requests per second:    801.88 [#/sec] (mean)
Time per request:       1.247 [ms] (mean)
Time per request:       1.247 [ms] (mean, across all concurrent requests)
Transfer rate:          434.61 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:     0    1   0.3      1       4
Waiting:        0    1   0.4      1       4
Total:          1    1   0.4      1       5
 
Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      2
  95%      2
  98%      2
  99%      2
 100%      5 (longest request)
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      1
Time taken for tests:   0.893 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1120.35 [#/sec] (mean)
Time per request:       0.893 [ms] (mean)
Time per request:       0.893 [ms] (mean, across all concurrent requests)
Transfer rate:          649.89 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.3      0       1
Processing:     0    1   0.6      1      11
Waiting:        0    1   0.6      1      11
Total:          0    1   0.5      1      11
 
Percentage of the requests served within a certain time (ms)
  50%      1
  66%      1
  75%      1
  80%      1
  90%      1
  95%      1
  98%      1
  99%      1
 100%     11 (longest request)

1000 requests, concurrency level 10 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      10
Time taken for tests:   8.527 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    117.27 [#/sec] (mean)
Time per request:       85.273 [ms] (mean)
Time per request:       8.527 [ms] (mean, across all concurrent requests)
Transfer rate:          82.00 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       1
Processing:    31   84  10.5     87     107
Waiting:       31   84  10.5     87     107
Total:         31   85  10.5     87     107
 
Percentage of the requests served within a certain time (ms)
  50%     87
  66%     90
  75%     93
  80%     95
  90%     98
  95%    101
  98%    103
  99%    104
 100%    107 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      10
Time taken for tests:   5.491 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    182.11 [#/sec] (mean)
Time per request:       54.912 [ms] (mean)
Time per request:       5.491 [ms] (mean, across all concurrent requests)
Transfer rate:          193.31 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   1.8      0      27
Processing:    10   54  20.2     49     169
Waiting:        9   53  20.2     49     169
Total:         11   54  20.2     50     169
 
Percentage of the requests served within a certain time (ms)
  50%     50
  66%     57
  75%     63
  80%     67
  90%     81
  95%     96
  98%    111
  99%    124
 100%    169 (longest request)
 
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
Document Length:        334 bytes
 
Concurrency Level:      10
Time taken for tests:   0.828 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      555000 bytes
HTML transferred:       334000 bytes
Requests per second:    1207.55 [#/sec] (mean)
Time per request:       8.281 [ms] (mean)
Time per request:       0.828 [ms] (mean, across all concurrent requests)
Transfer rate:          654.48 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.5      0       2
Processing:     1    8   1.6      8      19
Waiting:        0    5   2.4      5      19
Total:          2    8   1.6      8      19
 
Percentage of the requests served within a certain time (ms)
  50%      8
  66%      8
  75%      9
  80%      9
  90%     10
  95%     12
  98%     14
  99%     15
 100%     19 (longest request)
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      10
Time taken for tests:   0.559 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1790.21 [#/sec] (mean)
Time per request:       5.586 [ms] (mean)
Time per request:       0.559 [ms] (mean, across all concurrent requests)
Transfer rate:          1038.46 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:     1    5   2.9      5      87
Waiting:        1    5   2.9      5      87
Total:          2    5   2.9      5      87
 
Percentage of the requests served within a certain time (ms)
  50%      5
  66%      6
  75%      6
  80%      6
  90%      6
  95%      7
  98%      9
  99%     11
 100%     87 (longest request)

1000 requests, concurrency level 100 

Document Path:          /helloworld/index.xeb
Document Length:        331 bytes
 
Concurrency Level:      100
Time taken for tests:   8.970 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      716000 bytes
HTML transferred:       331000 bytes
Requests per second:    111.49 [#/sec] (mean)
Time per request:       896.973 [ms] (mean)
Time per request:       8.970 [ms] (mean, across all concurrent requests)
Transfer rate:          77.95 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       2
Processing:    54  846 175.6    912    1018
Waiting:       54  846 175.6    912    1018
Total:         54  846 175.6    912    1018
 
Percentage of the requests served within a certain time (ms)
  50%    912
  66%    929
  75%    940
  80%    972
  90%    994
  95%   1002
  98%   1014
  99%   1016
 100%   1018 (longest request)
 
Document Path:          /hellworld/index.xeb
Document Length:        848 bytes
 
Concurrency Level:      100
Time taken for tests:   5.517 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      1087000 bytes
HTML transferred:       848000 bytes
Requests per second:    181.27 [#/sec] (mean)
Time per request:       551.660 [ms] (mean)
Time per request:       5.517 [ms] (mean, across all concurrent requests)
Transfer rate:          192.42 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    1   2.0      0      23
Processing:    19  526  97.3    544     672
Waiting:       19  525  97.2    544     672
Total:         19  527  97.6    546     672
 
Percentage of the requests served within a certain time (ms)
  50%    546
  66%    559
  75%    567
  80%    574
  90%    594
  95%    613
  98%    628
  99%    644
 100%    672 (longest request)
 
Document Path:          /examples/jsp/jsp2/simpletag/hello.jsp
Document Length:        334 bytes
 
Concurrency Level:      100
Time taken for tests:   1.068 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      555000 bytes
HTML transferred:       334000 bytes
Requests per second:    936.01 [#/sec] (mean)
Time per request:       106.836 [ms] (mean)
Time per request:       1.068 [ms] (mean, across all concurrent requests)
Transfer rate:          507.31 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.8      0      15
Processing:     5  101  89.4     81     404
Waiting:        2   72  90.6     45     393
Total:          5  101  89.3     81     404
 
Percentage of the requests served within a certain time (ms)
  50%     81
  66%     83
  75%     84
  80%     85
  90%    331
  95%    356
  98%    384
  99%    400
 100%    404 (longest request)
 
Document Path:          /index.html
Document Length:        332 bytes
 
Concurrency Level:      100
Time taken for tests:   0.647 seconds
Complete requests:      1000
Failed requests:        0
Write errors:           0
Total transferred:      594000 bytes
HTML transferred:       332000 bytes
Requests per second:    1544.49 [#/sec] (mean)
Time per request:       64.746 [ms] (mean)
Time per request:       0.647 [ms] (mean, across all concurrent requests)
Transfer rate:          895.93 [Kbytes/sec] received
 
Connection Times (ms)
              min  mean[+/-sd] median   max
Connect:        0    0   0.4      0       3
Processing:    21   61  10.1     63      84
Waiting:       20   61  10.1     63      84
Total:         21   61  10.1     63      84
 
Percentage of the requests served within a certain time (ms)
  50%     63
  66%     63
  75%     65
  80%     67
  90%     71
  95%     75
  98%     78
  99%     79
 100%     84 (longest request)
Retrieved from "https://dev.eiffel.com/index.php?title=Xebra_Benchmarks&oldid=13444"