Recently I read an interesting idea on amazon EC2 forum about Raid0 strip on EBS to improve disk access performance. So I am very curious to know whether this idea actually works. Technically it is also possible to setup a raid system on Linode(referral link) as well, but it will be backed by same hardware (so I didn’t test this idea).
In this test I used bonnie++ 1.03e with direct IO support. These 3 VPS have slightly different configure. Mosso server has 256MB ram with 2.6.24 kernel and 4 AMD virtual cores. Lindoe vps has 360MB ram with custom built 2.6.29 kernel and 4 intel virtual cores. EC2 high-cpu medium instance has 1.7GB ram with 2.6.21 kernel and 2 intel virtual cores.
Here is the raw test result. On each VPS I run bonnie++ 3 times, then use median of 3 tests as the final result. The summary result is unweighted average value of different columns. Due to the memory size difference, I used different test file size. The EBS I used here is 4×10GB raid0.
In this table, -D means that test run with Direct IO option. The best results are highlighted. Direct IO test on EBS taking forever, so I didn’t finish that test.
|
|
|
|
|
|
|
. |
| Write (MB/s)
| Read (MB/s)
| Seek (#/s) |
|
. |
Mosso -D
| 32.4
| 52.9
| 219 |
|
. |
Mosso
| 56.9
| 52.6
| 225 |
|
. |
Linode -D
| 37.7
| 76
| 187 |
|
. |
Lindoe
| 41.5
| 76.1
| 201 |
|
. |
EC2 -D
| 32.4
| 50.7
| 220 |
|
. |
EC2
| 18.9
| 39.2
| 210 |
|
. |
EBS Raid0
| 52.4
| 23.1
| 1076 |
In this chart, I used logarithm scales and shifted origin in order to show the relative difference between them. So the column value does not reflect the real test results. Higher value is better.
Conclusions: There is no clear winner in this test. Each VPS has the their high score in different category. Only one thing is clear, O_Direct does not work very well on EBS. Due to the nature of VPS, the Disk IO test is very unreliable. The performance I show here is not repeatable and may not reflect the true disk performance.
Yejun Linux amazon, aws, bonnie++, disk, ebs, ec2, io, linode, mosso, raid0
I compared some puplar commercial CDN’s global latency by using just-ping.
The raw test result you can downloaded from here.
Result Summary:
|
|
|
|
|
|
. |
Network
| Average
| Median |
|
. |
Akamai
| 9.67
| 2.9 |
|
. |
Aol CDN
| 9.22
| 4 |
|
. |
Panthercdn
| 62.36
| 12.7 |
|
. |
LimeLight
| 58.04
| 13.2 |
|
. |
Mosso Cloud Files
| 56.81
| 13.5 |
|
. |
Amazon Cloudfront
| 62.82
| 18.6 |
|
. |
Google Homepage
| 53.53
| 23.15 |
|
. |
Cachefly
| 54.57
| 28.2 |
|
. |
Google Ajax Library
| 54.96
| 28.5 |
|
. |
Homemade CDN
| 76.31
| 29 |
|
. |
Yahoo Homepage
| 82.77
| 38.4 |
|
. |
Google App Engine
| 76.03
| 42.8 |
|
. |
US East
| 130.11
| 96.9 |
|
. |
SimpleCDN
| 142.84
| 100.8 |
|
. |
US West
| 156.32
| 165.4 |
|
Chart:
Notes:
- Akamai
- Aol CDN is served by Akamai
- Panther Express
- Limelight Networks
- Mosso is served by Limelight
- Amazon CloudFront Images on this page are served by CloudFront
- Google
- CacheFly
- Google AJAX Libraries
- This page is served by my own homemade CDN, you can test speed here
- Yahoo
- Google App Engine
- Single location ip in New Jersey USA listed here for comparison purpose
- SimpleCDN
- Single location ip in California USA listed here for comparison purpose
Disclamer: I am not affiliated to any company mentioned above. Nor do I endorse the accuracy of these results.
Yejun Web akamai, cdn, cdn comparison, cloudfront, comparison, mosso
This is a very simple linux bash script to help uploading files to mosso cloud files.
Mosso uploading script: Mosso.sh
Updates: Here is a Mac OSX Version (provided by Bryan Rehbein)
You will also need curl .
After you sign up mosso cloud files service, first you need to login your mosso cloud files control panel then navigate to Your Account / API Access, where you will generate your API key. Edit the begin of mosso.sh
API_KEY=YOURAPIKEYHERE
USER=yourusername
CONTAINER=bucket
Now change to the directory where you want to upload files. e.g. a wordpress installation:
bash mosso.sh wp-includes/js/jquery
Uploading wp-includes/js/jquery/jquery.table-hotkeys.js .... done.
Uploading wp-includes/js/jquery/interface.js .... done.
Uploading wp-includes/js/jquery/ui.core.js .... done.
Uploading wp-includes/js/jquery/jquery.color.js .... done.
Uploading wp-includes/js/jquery/ui.tabs.js .... done.
Uploading wp-includes/js/jquery/ui.resizable.js .... done.
Uploading wp-includes/js/jquery/jquery.hotkeys.js .... done.
Uploading wp-includes/js/jquery/ui.sortable.js .... done.
Uploading wp-includes/js/jquery/ui.dialog.js .... done.
Uploading wp-includes/js/jquery/jquery.js .... done.
Uploading wp-includes/js/jquery/ui.draggable.js .... done.
Uploading wp-includes/js/jquery/jquery.form.js .... done.
Uploading wp-includes/js/jquery/suggest.js .... done.
Uploading wp-includes/js/jquery/jquery.schedule.js .... done.
HTTP/1.1 202 Accepted
Date: Sat, 14 Mar 2009 00:06:41 GMT
Server: Apache
X-CDN-URI: http://cdn.cloudfiles.mosso.com/c12345
Content-Length: 0
Content-Type: text/plain; charset=UTF-8
Write down the url on the line begn with X-CDN-URI. This is your mosso CDN url. You can also find this url inside your mosso control panel.
If you want to upload entire current directory, you can execute this script without argument.
Yejun Linux, Web cdn, cloud, limelight, mosso, uploading
Mosso’s new CDN service cost $0.22 per GB.
http://blog.mosso.com/2009/03/cloud-files-emerges/
Updates:
Some simple tests show mosso cdn is just as fast as amazon cloud front. I offloaded some of my blog’s static image to mosso cloud files.
Pagetest shows about 10% overall page loading time improvement.
I also wrote a simple bash script to help copying files. It seems mosso does not support gzip encoding yet, nor does cname support.
Some test result:
Pagetest from New Zealand:
New Zealand Waterfall
New Zealand Connection
Pagetest from VA USA:
VA USA Waterfall
VA USA Connection
Yejun Uncategorized cdn, mosso
RSS
Follow