Results from Simon
These tests are run on a x86 dell laptop. The tests are run on localhost, e.g., both the apache server and siege run on the same host. I have verified with wireshark that the cipher suite is TLS_DHE_RSA_WITH_AES_256_CBC_SHA (0x39) with both mod_ssl and mod_gnutls. The file which is downloaded is the gnutls home page, a 5k html file.
# gnutls TLS_DHE_RSA_WITH_AES_256_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 325 hits Availability: 100.00 % Elapsed time: 9.71 secs Data transferred: 1.71 MB Response time: 0.43 secs Transaction rate: 33.47 trans/sec Throughput: 0.18 MB/sec Concurrency: 14.49 Successful transactions: 325 Failed transactions: 0 Longest transaction: 0.70 Shortest transaction: 0.11 jas@mocca:~$
# openssl TLS_DHE_RSA_WITH_AES_256_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 454 hits Availability: 100.00 % Elapsed time: 9.77 secs Data transferred: 2.39 MB Response time: 0.32 secs Transaction rate: 46.47 trans/sec Throughput: 0.24 MB/sec Concurrency: 14.76 Successful transactions: 454 Failed transactions: 0 Longest transaction: 0.52 Shortest transaction: 0.10 jas@mocca:~$
When transferring a large file, the gnutls.pdf manual (1.7MB), the results are as follows.
# gnutls TLS_DHE_RSA_WITH_AES_256_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 97 hits Availability: 100.00 % Elapsed time: 10.08 secs Data transferred: 157.34 MB Response time: 1.41 secs Transaction rate: 9.62 trans/sec Throughput: 15.61 MB/sec Concurrency: 13.57 Successful transactions: 97 Failed transactions: 0 Longest transaction: 1.71 Shortest transaction: 0.97 jas@mocca:~$
# openssl TLS_DHE_RSA_WITH_AES_256_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 166 hits Availability: 100.00 % Elapsed time: 10.31 secs Data transferred: 269.26 MB Response time: 0.88 secs Transaction rate: 16.10 trans/sec Throughput: 26.12 MB/sec Concurrency: 14.19 Successful transactions: 166 Failed transactions: 0 Longest transaction: 1.12 Shortest transaction: 0.45 jas@mocca:~$
Running with the faster cipher suite, here are the results.
# mod_gnutls TLS_RSA_WITH_AES_128_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 1731 hits Availability: 100.00 % Elapsed time: 10.50 secs Data transferred: 9.12 MB Response time: 0.09 secs Transaction rate: 164.86 trans/sec Throughput: 0.87 MB/sec Concurrency: 14.87 Successful transactions: 1731 Failed transactions: 0 Longest transaction: 0.51 Shortest transaction: 0.00 jas@mocca:~$
# mod_ssl TLS_RSA_WITH_AES_128_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 3441 hits Availability: 100.00 % Elapsed time: 10.05 secs Data transferred: 18.14 MB Response time: 0.04 secs Transaction rate: 342.39 trans/sec Throughput: 1.80 MB/sec Concurrency: 14.81 Successful transactions: 3441 Failed transactions: 0 Longest transaction: 0.22 Shortest transaction: 0.00 jas@mocca:~$
# mod_ssl TLS_RSA_WITH_AES_128_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 271 hits Availability: 100.00 % Elapsed time: 9.64 secs Data transferred: 439.58 MB Response time: 0.51 secs Transaction rate: 28.11 trans/sec Throughput: 45.60 MB/sec Concurrency: 14.44 Successful transactions: 271 Failed transactions: 0 Longest transaction: 0.75 Shortest transaction: 0.29 jas@mocca:~$
# mod_gnutls TLS_RSA_WITH_AES_128_CBC_SHA jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 152 hits Availability: 100.00 % Elapsed time: 9.97 secs Data transferred: 246.56 MB Response time: 0.92 secs Transaction rate: 15.25 trans/sec Throughput: 24.73 MB/sec Concurrency: 14.08 Successful transactions: 152 Failed transactions: 0 Longest transaction: 1.30 Shortest transaction: 0.49 jas@mocca:~$
Results for the 3DES ciphersuite, TLS_RSA_WITH_3DES_EDE_CBC_SHA (0x000a):
# mod_ssl DES-CBC3-SHA large file jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 75 hits Availability: 100.00 % Elapsed time: 10.34 secs Data transferred: 121.66 MB Response time: 1.89 secs Transaction rate: 7.25 trans/sec Throughput: 11.77 MB/sec Concurrency: 13.69 Successful transactions: 75 Failed transactions: 0 Longest transaction: 2.14 Shortest transaction: 1.60 jas@mocca:~$
# mod_ssl DES-CBC3-SHA small file jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 3257 hits Availability: 100.00 % Elapsed time: 10.48 secs Data transferred: 17.17 MB Response time: 0.05 secs Transaction rate: 310.78 trans/sec Throughput: 1.64 MB/sec Concurrency: 14.73 Successful transactions: 3257 Failed transactions: 0 Longest transaction: 0.18 Shortest transaction: 0.00 jas@mocca:~$
# mod_gnutls 3DES small file jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 1591 hits Availability: 100.00 % Elapsed time: 10.28 secs Data transferred: 8.39 MB Response time: 0.10 secs Transaction rate: 154.77 trans/sec Throughput: 0.82 MB/sec Concurrency: 14.81 Successful transactions: 1591 Failed transactions: 0 Longest transaction: 0.42 Shortest transaction: 0.01 jas@mocca:~$
# mod_gnutls 3DES large file jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 60 hits Availability: 100.00 % Elapsed time: 10.43 secs Data transferred: 97.32 MB Response time: 2.41 secs Transaction rate: 5.75 trans/sec Throughput: 9.33 MB/sec Concurrency: 13.86 Successful transactions: 60 Failed transactions: 0 Longest transaction: 2.95 Shortest transaction: 1.90 jas@mocca:~$
Results for DHE-DSS, TLS_DHE_DSS_WITH_RSA_128_CBC_SHA (0x0032):
# mod_ssl dhe-dss small file jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 469 hits Availability: 100.00 % Elapsed time: 9.82 secs Data transferred: 2.47 MB Response time: 0.31 secs Transaction rate: 47.76 trans/sec Throughput: 0.25 MB/sec Concurrency: 14.72 Successful transactions: 469 Failed transactions: 0 Longest transaction: 0.56 Shortest transaction: 0.10 jas@mocca:~$
# mod_ssl dhe-dss large file jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 180 hits Availability: 100.00 % Elapsed time: 9.54 secs Data transferred: 291.97 MB Response time: 0.76 secs Transaction rate: 18.87 trans/sec Throughput: 30.61 MB/sec Concurrency: 14.30 Successful transactions: 180 Failed transactions: 0 Longest transaction: 1.02 Shortest transaction: 0.48 jas@mocca:~$
# mod_gnutls dhe-dss small file jas@mocca:~$ siege -b -t 10s https://localhost/|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 359 hits Availability: 100.00 % Elapsed time: 10.52 secs Data transferred: 1.89 MB Response time: 0.43 secs Transaction rate: 34.13 trans/sec Throughput: 0.18 MB/sec Concurrency: 14.69 Successful transactions: 359 Failed transactions: 0 Longest transaction: 0.69 Shortest transaction: 0.14 jas@mocca:~$
# mod_gnutls dhe-dss large file jas@mocca:~$ siege -b -t 10s https://localhost/gnutls.pdf|grep -v HTTP ** SIEGE 2.66 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 114 hits Availability: 100.00 % Elapsed time: 9.83 secs Data transferred: 184.92 MB Response time: 1.21 secs Transaction rate: 11.60 trans/sec Throughput: 18.81 MB/sec Concurrency: 14.03 Successful transactions: 114 Failed transactions: 0 Longest transaction: 1.61 Shortest transaction: 0.84 jas@mocca:~$
Results from Nikos
Running on an AMD64 dual core Desktop PC The tests for amd64 were done using a 100mbit ethernet switch and two different pc's for client and server. The test results: (a 5k html file and 300k pdf file is downloaded):
# mod_ssl TLS_DHE_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/index.html ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 1537 hits Availability: 100.00 % Elapsed time: 25.73 secs Data transferred: 6.12 MB Response time: 0.17 secs Transaction rate: 59.74 trans/sec Throughput: 0.24 MB/sec Concurrency: 9.89 Successful transactions: 1537 Failed transactions: 0 Longest transaction: 3.47 Shortest transaction: 0.00
# mod_gnutls (0.5.1) TLS_DHE_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/index.html ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 1409 hits Availability: 100.00 % Elapsed time: 23.71 secs Data transferred: 5.61 MB Response time: 0.22 secs Transaction rate: 59.43 trans/sec Throughput: 0.24 MB/sec Concurrency: 12.92 Successful transactions: 1409 Failed transactions: 0 Longest transaction: 13.43 Shortest transaction: 0.00
# mod_ssl TLS_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/index.html ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 14123 hits Availability: 100.00 % Elapsed time: 19.59 secs Data transferred: 56.22 MB Response time: 0.02 secs Transaction rate: 720.93 trans/sec Throughput: 2.87 MB/sec Concurrency: 14.85 Successful transactions: 14123 Failed transactions: 0 Longest transaction: 3.02 Shortest transaction: 0.00
# mod_ssl TLS_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/index.html ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 5693 hits Availability: 100.00 % Elapsed time: 20.14 secs Data transferred: 22.66 MB Response time: 0.05 secs Transaction rate: 282.67 trans/sec Throughput: 1.13 MB/sec Concurrency: 14.78 Successful transactions: 5693 Failed transactions: 0 Longest transaction: 0.39 Shortest transaction: 0.00
# mod_ssl TLS_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/a.pdf ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 717 hits Availability: 100.00 % Elapsed time: 20.29 secs Data transferred: 220.79 MB Response time: 0.42 secs Transaction rate: 35.34 trans/sec Throughput: 10.88 MB/sec Concurrency: 14.83 Successful transactions: 717 Failed transactions: 0 Longest transaction: 0.81 Shortest transaction: 0.11
# mod_gnutls (0.5.1) TLS_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/a.pdf ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 731 hits Availability: 100.00 % Elapsed time: 20.46 secs Data transferred: 225.10 MB Response time: 0.42 secs Transaction rate: 35.73 trans/sec Throughput: 11.00 MB/sec Concurrency: 14.87 Successful transactions: 731 Failed transactions: 0 Longest transaction: 3.44 Shortest transaction: 0.06
# mod_ssl TLS_DHE_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/a.pdf ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 650 hits Availability: 100.00 % Elapsed time: 20.01 secs Data transferred: 200.16 MB Response time: 0.46 secs Transaction rate: 32.48 trans/sec Throughput: 10.00 MB/sec Concurrency: 14.79 Successful transactions: 650 Failed transactions: 0 Longest transaction: 1.09 Shortest transaction: 0.13
# mod_gnutls TLS_DHE_RSA_WITH_AES_128_CBC_SHA $ siege -b -t 20s https://10.100.1.196/a.pdf ** siege 2.65b1 ** Preparing 15 concurrent users for battle. The server is now under siege... Lifting the server siege... done. Transactions: 671 hits Availability: 100.00 % Elapsed time: 20.42 secs Data transferred: 206.62 MB Response time: 0.45 secs Transaction rate: 32.86 trans/sec Throughput: 10.12 MB/sec Concurrency: 14.84 Successful transactions: 671 Failed transactions: 0 Longest transaction: 1.08 Shortest transaction: 0.11
