<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Javatech &#187; Cloud Computing</title>
	<atom:link href="http://javatech.org/category/cloud-computing/feed/" rel="self" type="application/rss+xml" />
	<link>http://javatech.org</link>
	<description>The Bleeding Edge of Java Technology</description>
	<lastBuildDate>Wed, 24 Jun 2009 22:30:48 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.8</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Public Datasets on Amazon WebServices</title>
		<link>http://javatech.org/2009/06/public-datasets-on-amazon-webservices/</link>
		<comments>http://javatech.org/2009/06/public-datasets-on-amazon-webservices/#comments</comments>
		<pubDate>Fri, 19 Jun 2009 06:35:10 +0000</pubDate>
		<dc:creator>deevis</dc:creator>
				<category><![CDATA[Cloud Computing]]></category>
		<category><![CDATA[aws]]></category>
		<category><![CDATA[ec2]]></category>

		<guid isPermaLink="false">http://javatech.org/?p=93</guid>
		<description><![CDATA[Much to my excitement, Amazon is making public some really awesomely huge datasets to their Cloud customers.  These datasets are available as Snapshots which can be mounted as Volumes and then accessed by instances in EC2.  The datasets range in size from 10 Gigabytes to over 300 Gigabytes.  There are a couple [...]]]></description>
			<content:encoded><![CDATA[<p>Much to my excitement, Amazon is making public some <a title="Public Datasets on Amazon WebServices" href="http://developer.amazonwebservices.com/connect/kbcategory.jspa?categoryID=243">really awesomely huge datasets</a> to their Cloud customers.  These datasets are available as Snapshots which can be mounted as Volumes and then accessed by instances in EC2.  The datasets range in size from 10 Gigabytes to over 300 Gigabytes.  There are a couple of real perks that come along with this.  The first is that it doesn&#8217;t take a week to download the dataset in the first place &#8211; it took me only 5 minutes to get access to 50 Gigabytes of data.  Here&#8217;s how:</p>
<p>1) Locate the snapshotId you&#8217;d like to use ( <strong>snap-1781757e</strong> for Wikipedia Extraction (WEX))<br />
2) Create a volume from your AWS console &#8211; use the snapshotId here.  The volume size must be larger than the snapshot.  Also, I&#8217;ve found that I need to create the volume in the same zone as the instance I&#8217;m going to attach it to.<br />
3) Attach the volume to an instance.  Select the volume and then click &#8220;attach volume&#8221;.  Suppose for example you chose &#8220;/dev/sdf&#8221; as the mount point.<br />
4) ssh to your instance and mount the volume: <strong>mount /dev/sdf /vol</strong></p>
<p>There you have it.  But we&#8217;re not quite done &#8211; we still need to import all of this data into MySQL or Postgresql.  But that&#8217;s another post&#8230;</p>
]]></content:encoded>
			<wfw:commentRss>http://javatech.org/2009/06/public-datasets-on-amazon-webservices/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Amazon Cloud</title>
		<link>http://javatech.org/2009/06/amazon-cloud/</link>
		<comments>http://javatech.org/2009/06/amazon-cloud/#comments</comments>
		<pubDate>Fri, 19 Jun 2009 05:41:03 +0000</pubDate>
		<dc:creator>deevis</dc:creator>
				<category><![CDATA[Cloud Computing]]></category>
		<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[aws]]></category>
		<category><![CDATA[ec2]]></category>
		<category><![CDATA[fedora]]></category>
		<category><![CDATA[s3]]></category>

		<guid isPermaLink="false">http://javatech.org/2009/06/amazon-cloud/</guid>
		<description><![CDATA[WHEN YOU TERMINATE AN EC2 INSTANCE, IT'S LIKE YOU STUFFED THE CASE WITH TNT AND THREW IT INTO A CAMPFIRE.]]></description>
			<content:encoded><![CDATA[<p>I&#8217;ve been playing around with a Fedora system out in EC2 of late.  It&#8217;s pretty darn cool and I&#8217;ve got my system almost ready to start playing around seriously.  What this means is that I&#8217;ve got enough stuff installed on it to stop playing the install game.<br />
Being the type to optimize everything, I&#8217;m trying to get my system configured in the least amount of uptime.  So, I&#8217;ll have it up for an hour or two when I have a chance to work on it, and then if I make any good progress I&#8217;ll snap a new AMI and startup from this new AMI when I pick up the next time.<br />
It&#8217;s my first time using Fedora and I&#8217;m getting used to things being different from my comfort zone &#8211; Ubuntu.<br />
The first big difference is that &#8216;apt-get&#8217; doesn&#8217;t exist in Fedora.  But it does have an analog called &#8216;yum&#8217;.<br />
To install mysql on Fedora I simply ran:<br />
<strong>yum install mysql-server mysql</strong></p>
<p>To get apache web server with php/mysql support installed I just ran:<br />
<strong>yum install httpd php-mysql</strong><br />
This is every bit as easy as apt-get.  Making some really good progess.  So, the first time around I terminate the instance and figure I&#8217;ll pick up where I&#8217;ve left off.<br />
The next time when I come back to the AWS console &#8211; my instance isn&#8217;t there for me to restart.  Now, here&#8217;s the thing with the EC2 server instances :</p>
<p><strong>WHEN YOU TERMINATE AN EC2 INSTANCE, IT&#8217;S LIKE YOU STUFFED THE CASE WITH TNT AND THREW IT INTO A CAMPFIRE.</strong></p>
<p>That&#8217;s right, terminate doesn&#8217;t mean power-down.  It means obliterate.  Anything on the drives is G-O-N-E.  It is no more &#8211; it&#8217;s an ex-instance.</p>
<p>That was rather eye-opening.  So, back to the drawing board and this time, to be safe, I made sure to pick an AMI with EC2 utilities installed on it already.    I installed my software on the instance and this time even registered the services to startup automatically.<br />
<strong>service mysql start<br />
service httpd start<br />
</strong>I restarted the instance and tested that it came back up with apache and mysql running &#8211; it did.  Good enough &#8211; it was time to save this instance as an AMI into one of my S3 buckets.   After a bit of finagling I found the correct couple of incantations.<br />
<strong>ec2-bundle-vol &#8211;cert publicCert &#8211;privatekey privatePem &#8211;user awsAccountNumber</strong><br />
The above command will create an imageManifestXml which you&#8217;ll use in the following statement:<br />
<strong>ec2-upload-bundle &#8211;bucket s3BucketName &#8211;accessKey awsAccessKey &#8211;secretKey awsSecretKey &#8211;manifest imageManifestXml</strong></p>
<p>This took maybe ten minutes to run both of the above, but afterwards I had new starting point AMI to use &#8211; in theory at least&#8230;</p>
<p>I double checked everything by starting another instance ( before shutting down the good one ) with the new AMI and making sure that it passed snuff &#8211; which it did.  I shut down both instances and retired for the night &#8211; all of this to save 10 cents an hour.  But more importantly it is to understand the process.  No, it&#8217;s the money <img src='http://javatech.org/wp-includes/images/smilies/icon_wink.gif' alt=';)' class='wp-smiley' /><br />
This virtualization stuff is really powerful &#8211; I&#8217;ll write some more on mounting Volumes and using existing Snapshots of open-sourced datasets soon.</p>
]]></content:encoded>
			<wfw:commentRss>http://javatech.org/2009/06/amazon-cloud/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
