An anonymous reader writes "Amazon just announced that the beta program for their EC2 (Elastic Compute Cloud) service is now open to all developers. They have also added new instance types. It appears that you can now get the equivalent of an 8-core machine. Is cloud computing for the masses finally here?"
It isn't made to have it constantly running.
Best example is if I need to convert 300 video files to.flv files for display on a website. I just load up an image on my EC2 nodes that has FFMPEG on it (with the flv addon) and press go and it will make say 30 nodes to handle 100 each, or 100 nodes to handle 3 each, depending on how fast you want it done (in theory you could have 300 nodes each doing one.) Once your workload is done, everything is written back to your amazon storage account and the node shuts
EC2 allows you to bring up in seconds 10 or 10,000 Xen instances or Virtual Machines of practically any LINUX type (Xen instances).
Don't compare it to a hosting service where you pay for the month. With this you could script your web site to automatically start up instances on EC2 as demand increased, doing load balancing for example and then as the demand went down you could automatically shut down virtual machines.
The cool part of this service (and there are competitors) is the ability to bring up VM's on demand for whatever either automated or manually.
Well just to clarify, as a user of the EC2 service for a while, you do not have unlimited access to starting instances. The maximum number you can have running at the same time would actually be under less than 100 to start, I think default may be around 20. Though you can get it raised, it takes special circumstances. In terms of starting instances, when starting up many at once, let's say greater than 30, you will be looking at around 10 minutes to get the majority up, and probably 15 for all of them to b
That's still a damn sight faster than ordering 30 servers from Dell or Rackspace. We are looking to running them as backup servers in case our main machines come under too much load or break.
Yea, I should of said "theoretically" as it's obvious that Amazon does not have an unlimited amount CPU's. I'm surprised google did not come up with something like this first.
Factoring out the MORAL issues with using it for such a use, just remember you STILL pay 10cents per CPU per hour and still pay the Amazon S3 storage and transfer rates.
So that botnet could get quite expensive (and if you are an Evil Black hat, why bother? There are a million unpatched windows systems waiting around on the net for the hat to use).
And yes....I know you were trying to make a joke.:)
You can actually install any operating system or applications. It's basically a virtual server but you pay hourly rates. So if you do some heavy computing once a month, you can just lease time on a server and not have to buy a server, rack, ups, network gear, etc. They store your image and data for you, up to 1.7TB. It's actually a pretty good idea.
It all makes perfect sense now. Amazon creates the Storm virus botnet. Then it sells computing space. Anyone who tries to compete with them is shutdown by DDSes from the botnet. Amazon ends up owning the entire internet, and leasing it out for profit with suggestions on books about being a good repressed peasant.
It's like some bizarre take on DC comic's 'Amazons Attack!', only with slightly more porn.
If you are interested join the Silicon Valley EC2 user group. Next meeting on the 24'th this month. I think there will be a speaker from Amazon AWS proper
More here [meetup.com]
That is the cost to the economy of all the slashdot users having to waste a minute of their workday to google "Elastic Compute Cloud" because the editor couldn't be bothered to put one sentence in the summary. Yes, I worked it out.
Now compute the cost of the time wasted modding you up, despite the fact you didn't provide any links either. Ok hot stuff, here's the link: http://www.amazon.com/gp/browse.html?node=201590011 [amazon.com]
I don't see any one-sentence summary, but Amazon seems to explain it pretty well. And yes, you can run Windows on it [enomaly.com].
Been playing with Amazon Elastic Compute Cloud more than one year, like its simplicity and great deal of opportunities it provides for businesses and other type of clients.
Forum provides good deal of advice and useful information (see http://developer.amazonwebservices.com/connect/forum.jspa?forumID=30 [amazonwebservices.com] )
Resource center has all kinds of tools to get you running in very short period of time, including pre-configured images of operating systems (currently only Linux), called Public AMIs.
There's also some good blogs ( http://ihatecubicle.blogspot.com/ [blogspot.com] ), that provide help on advanced things like persistence to external services (S3, Nirvanix etc).
SQS provides messaging facility with simple API, so it's easy to work with.
Before we all dream up our cloud nine apps, consider the current shortfalls.
* No persistent storage, other than S3. That means all permanent storage has to be re-acrchitected to an S3 key/value interface. Any file/database on the virtual hard drive (160 GB) is gone, when the instance crashes, or you need an external DB server (latency) and lots of cache to make that hopefully perform.
* IP address is static as long as the instance runs. When it crashes, the replacement instance gets a new IP. That means you need to run dynamic DNS front ends and do your load balancing somehere else.
These two issues make it not as simple as starting a server and installing your Wordpress, bbPHP, etc.
While more powerful instance types are nice, what really is needed to make this a simple to use offering is to have instance types with, identified regular file system storage (somewhere on the SAN?) and with assigned static IP addresses.
For really powerful distributed content delivery, I'd also like to determine where on the globe an instance will be started, so the transport to the client can be optimized.
Just my analysis of where we are.
Since this is a well-known problem, there are of course a lot of people working on solutions. I have recently discovered S3DFS: http://www.openfount.com/blog/s3dfs-for-ec2 [openfount.com]
A FUSE-based file system that mounts like a normal filesystem but reads and writes to S3.
I think you are missing a key point. This service is an enabler. The risk profile for launching a new application is reduced because Joe Blow with a great application idea does not have to procure the gear and cage space to make it run. They can start withing the cloud and then plan a move to their own systems if they have the good problem of rapid adoption and growth.
For application developers I see: lower risk, lower cost. This is enabling. Developers will have less need for large companies and VC's
Not sure if I miss the point. Which Joe Blow has knowledge of hwo to build an efficient multi server app with an unusual largely unknown storage back end S2?
My point is that the vast majority of entrepreneurs are seeking a standard like environment. Why are mySQL and postgres so popular? Why are WAMP/LAMP, Ruby on Rails and cakePHP the basis for so many apps? Because 99,9% of Joe Blows get it and can handle its complexities. But a database is not feasable on an Amazon cloud. Because when the slice dies, y
Support for FreeBSD images is desperately needed before many of us would consider making the jump. The last I heard is that there is some work going on in FreeBSD 7.0 that will make it easier to run FreeBSD instances on EC2 so Amazon can start supporting it. Anyone else got a more recent update?
We've been using it for a few months now and its great.
With a single command we can export computing tasks from our main system to a customized instance at amazon and when complete, import the resulting data. All powered by a few simple bash scripts. We can fire up any number of tasks like this and massively increase our overall processing capacity whenever needed and then shut it all down when not.
So far, after several months of running multiple instances we've not had a single failure or data loss although even if an instance had died it would make little difference since we can easily just export the tasks again at any time.
Once you get the hang of EC2 you will likely come up with all sorts of computing tasks you can 'out source' from your current systems. Overall I highly recommend it.
Is cloud computing for the masses finally here? (Score:2, Insightful)
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
Re:Is cloud computing for the masses finally here? (Score:5, Informative)
Don't compare it to a hosting service where you pay for the month. With this you could script your web site to automatically start up instances on EC2 as demand increased, doing load balancing for example and then as the demand went down you could automatically shut down virtual machines.
The cool part of this service (and there are competitors) is the ability to bring up VM's on demand for whatever either automated or manually.
Parent
Re: (Score:2, Informative)
Re: (Score:2)
Re: (Score:3, Interesting)
Re: (Score:1)
-Jason
Re: (Score:3, Funny)
Re: (Score:2, Funny)
Though it would probably be more efficient to just use a CGI kernel module.
Re: (Score:2)
Re: (Score:2)
So that botnet could get quite expensive (and if you are an Evil Black hat, why bother? There are a million unpatched windows systems waiting around on the net for the hat to use).
And yes....I know you were trying to make a joke.
Re: (Score:3, Insightful)
Re: (Score:2)
Re: (Score:2)
Amazing stuff (Score:1)
hey, you, get off of my cloud
Re:Amazing stuff (Score:4, Funny)
Parent
cloud computing (Score:4, Funny)
It was already here. [slashdot.org]
Re: (Score:1)
Re: (Score:2)
10 or 25 man instance? (Score:4, Funny)
Re: (Score:1)
Re: (Score:1)
What? Did I say something wrong? What? Huh? What!?
So that's who owns the Storm virus. (Score:5, Funny)
It's like some bizarre take on DC comic's 'Amazons Attack!', only with slightly more porn.
Re: (Score:2)
Re: (Score:1)
Weather Forecast (Score:1, Redundant)
Re: (Score:1)
Learn more if you are in Silicon Valley (Score:4, Informative)
$126,934.34 (Score:4, Funny)
Thanks kdawson
Re: (Score:3, Informative)
http://www.amazon.com/gp/browse.html?node=201590011 [amazon.com]
I don't see any one-sentence summary, but Amazon seems to explain it pretty well. And yes, you can run Windows on it [enomaly.com].
Amazon Elastic Compute Cloud (Score:4, Informative)
Nice! (Score:2)
Now if we could just get static IP addresses, ability the assign PTRs and persistent on disk storage we could completely do away with our data center.
Beware of the shortfalls (Score:5, Informative)
Re:Beware of the shortfalls (Score:4, Informative)
A FUSE-based file system that mounts like a normal filesystem but reads and writes to S3.
Parent
Re: (Score:2)
For application developers I see: lower risk, lower cost. This is enabling. Developers will have less need for large companies and VC's
Re: (Score:3, Insightful)
For the masses? (Score:2)
Re: (Score:2)
Get real.
too bad (Score:2)
Re: (Score:2)
Re: (Score:1)
FreeBSD Needed (Score:2)
EC2 is the dogs bollocks (Score:5, Interesting)
With a single command we can export computing tasks from our main system to a customized instance at amazon and when complete, import the resulting data. All powered by a few simple bash scripts. We can fire up any number of tasks like this and massively increase our overall processing capacity whenever needed and then shut it all down when not.
So far, after several months of running multiple instances we've not had a single failure or data loss although even if an instance had died it would make little difference since we can easily just export the tasks again at any time.
There is also the handy EC2UI firefox plugin to manage your instances..
http://developer.amazonwebservices.com/connect/entry.jspa?externalID=609&categoryID=88 [amazonwebservices.com]
Once you get the hang of EC2 you will likely come up with all sorts of computing tasks you can 'out source' from your current systems. Overall I highly recommend it.
In a word... (Score:2)
You seem to know a lot about this stuff (Score:4, Funny)
Storm Worm Botnet Partitions May Be Up For Sale [slashdot.org]
Amazon EC2 Open To All [slashdot.org]
Parent
Re: (Score:2)
Re: (Score:1)
Re: (Score:2)