#347 Rubber and Amazon EC2

Excellent episode, thank you

That was one of the best episodes yet. Thank you so much.

Nice episode, but I have a simple question. How can I add a Faye server (or any other independent server) to the application?

Thanks,
Andrei

Hey, Ryan, thanks for the episode!

This may be a silly question, but does rubber also install all we need in the EC2 to deploy?

Thanks in advance.

Awesome!

Sorry if this is a noobish question, but why is the application being split into web, app, and db instances? I don't really understand that part. Is that just for Amazon or cloud-based load balancing, or is that something that I should be doing on a VPS? Thanks

Thanks Brian, for breaking the noobish question ice. Here's another one: Would anybody care to weigh in on the pros & cons of this EC2 service vs. using a VPS? Or maybe offer a link to an article that hits this question?

Thanks everybody and thanks again Ryan.

I've been using Rubber for a bit over a year now and absolutely love it. Version 2.0 is a huge improvement as well.

Ill add another new question re rubber.

If you start of with a small app so only one server required for all roles how well does rubber handle breaking this up once hopefully you start to get bigger. ie creating separate roes for App, Web & DB.

Would you have to convert your existing role to be just DB??

Also what about auto scaling. Is there a way to have rubber auto scale app and db slave servers if required?

And one more to chuck in what about setting up staging environment?

But like Alexander has said this seems a great tool.

Thank you for this very nice cast. Rubber is impressive and makes great use of Capistrano's power. Can it handle non-rails applications and other cloud providers (I am guessing no and no)?

NOOB - when I'm creating the EC2 instance, Amazon wants me to select a AMI (stack). Which one do you select?

NOOB - Getting error
* executing "sudo -p 'sudo password: ' bash -l -c 'cp /home/ubuntu/.ssh/authorized_keys /root/.ssh/'"
servers: ["50.17.145.140"]
.. ** Failed to connect to 50.17.145.140, retrying
* executing `rubber:_allow_root_ssh'

I believe my credentials are correct.

If I look at the EC2 console it says the private ip is 10.111.63.18

Once again, you read my mind with this week's episode topics! Thanks a ton Ryan, keep up the great work.

Thanks a lot Ryan! This episode is just amazing! I was looking for a tutorial like this for months!

Thank you, just what i was looking for.

Thanks, great cast, and just in time for me.

When I configure AMI for us-east-1 things seems to work. But if I change the aws: to region: eu-west-1 even the staging fails with a AMI ID '' does not exist. Any ideas how to solve this? Also what shall I specify for time zone instead of US/Eastern

What kind of cost could I expect for a small site with say between 100 and 500 hits per day? Would it work out cheaper than a linode vps in this case?

I would like to know how to match my own domain name instead of foo.com.

Thanks.

@robbied72, for the first year, it'd be much cheaper, since you can most likely get away with the Amazon free tier, which gives you a micro instance free for a year.

How to config rubber to utilize the free tier? In rubber.yml it seems you can only choose between m1.small not m1.micro

Hi!

Is haproxy required for the web role? Put another way, can I use nginx/apache + passenger for the web role skipping haproxy altogether?

Thx!

rb

Noob getting this error

** [out :: production.genlink.com] rake aborted!
** [out :: production.genlink.com]
** [out :: production.genlink.com] FATAL: role "GenLink" does not exist
** [out :: production.genlink.com]
** [out :: production.genlink.com] Tasks: TOP => environment
** [out :: production.genlink.com]
** out :: production.genlink.com
** [out :: production.genlink.com]
command finished in 16651ms
failed: "/bin/bash -l -c 'cd /mnt/GenLink-production/releases/20120509093404 && bundle exec rake RAILS_ENV=production RAILS_GROUPS=assets assets:precompile'" on production.genlink.com

How does rubber handle adding an extra database instance? Does it automatically copy over the data and add itself as a slave?

Additionally, does the standard rubber config offer failover or would I need to add this in?

Excellent episode. I'm looking forward a "part 2" where you would explain how to set up your own templates!
Thanks!

Is there a reason rubber uses haproxy and not the Amazon Load Balancer? Are there any benefits from using haproxy and is it possible to use the Amazon Load Balancer with rubber?

Very nice episode! But why does rubber upload code to all instance? I would expect it to upload the files only for the instance with the app role.

Awesome episode Ryan! You rocks! ... And awesome gem. Congrats!

this was a great episode. I'm going to give it a try. Two areas that i would be interested in knowing if rubber supports are integrating with ELB and AutoScaling. Any insights from smarter people on this?

thanks

Hey, thanks for the episode. After running the command below:

cap rubber:create_staging

I get the following error:

connection failed for: production.foo.com (Net::SSH::AuthenticationFailed: root)

Assuming that it has something to do with the fact that Ubuntu would not allow a root user to ssh by default I changed my config/deploy.rb file to use ubuntu as user. However, after that I get a similar error:

connection failed for: production.foo.com (Net::SSH::AuthenticationFailed: ubuntu)

Does someone have an idea about why this could be happening. I think it may be related to the ssh keys used but to me things seem ok with them.

Hey great video really appreciate it - trying to figure out how to get past these two errors, wondering if you could point me in the right direction:

1. Rubber[INFO]: Transformation executing post config command: function error_exit { exit 99; }; trap error_exit ERR

2. config : 'option forwardfor' ignored for proxy 'passenger_proxy_ssl' as it requires HTTP mode.

Here is my deploy.rb
http://pastebin.com/6CdCP7DY

and here is my rubber.yml file
http://pastebin.com/7tUcrMqF

Let me know if you need any additional info...thanks!

I've been getting this error when trying to run the cap rubber:create_staging command. It runs for 20 minutes or so successfully, but breaks when it gets here:

executing "cd /mnt/EvrlistSite-production/releases/20120706050602 && bundle exec rake RAILS_ENV=production db:migrate"
servers: ["production.evrlist.com"]
[production.evrlist.com] executing command
** [out :: production.evrlist.com] rake aborted!
** [out :: production.evrlist.com]
** [out :: production.evrlist.com] FATAL: role "EvrlistSite" does not exist
** [out :: production.evrlist.com]
** [out :: production.evrlist.com] Tasks: TOP = > db:migrate
** [out :: production.evrlist.com]

Ryan, thanks for another excellent railscast!

Hi everyone.. I have to say, setting it up initially wasn't very easy. Turns out rubber is not very happy with "complex" database.yml (with conditional environment if's etc..) or with hyphens in the app name which, at least when using mysql templates, confuse rubber.

After having fixed a few annoying issues - and separating the credentials, I now have a weird issue (and a question below):

The problem I hope someone can shed some light on:
cap rubber:create_staging runs without errors. However, it ends with the same output as rubber:bootstrap does. i.e. the last command is:
* executing "sudo -p 'sudo password: ' bash -l /tmp/create_master_db"
and never actually fires up an apache/passenger to run my app.. and thus the link is not accessible.
Also, a bit above, collectd throws an error:
** [out :: production.foo.com] Starting statistics collection and monitoring daemon: collectd
** [out :: production.foo.com] configfile: stat (/etc/collectd/conf.d/*.conf) failed: No such file or directory

Can collectd be the reason why my app doesn't actually start? I'm using rubber 2.0.5 by the way. Or may it be that it requires me to run another command to get things started (even on staging)?

And the other question:
I'm using the complete_passenger_mysql template - which hopefully includes everything - but was tempted to use complete_passenger_nginx_mysql - any benefit in doing this instead??

Typo in ASCII-Cast

$ mkdir ~/.ec2
$ mv ~/Downloads/gsg-keypair.gem ~/.ec2/gsg-keypair
$ chmod 600 ~/.ec2/gsg-keypair

gsg-keypair.gem should be gsg-keypair.pem

I used this tutorial for the free tier, and didn't even finish it due to errors, but I was still charged $40 at the end of the month for barely a couple days of using this service. I terminated my instances within a few days of using rubber. Even the default small instances are only $0.08/hr.

Please can someone tell me what I am doing wrong here?

Thanks!

diglett,
Did you create your instances using the AMI-Type : m1.small or any other option other than t1.micro?

The t1.micro is the free ami-type

Anybody knows what this error is about?

AuthFailure => AWS was not able to validate the provided access credentials (Fog::Compute::AWS::Error)

happens on
cap rubber:create_staging

is this supposed to be filled in

fog:
credentials:
provider: rackspace
rackspace_api_key: 'XXX'
rackspace_username: 'YYY'
image_type: 123
image_id: 123

Anybody know why this happen ?

 ** Instance production created: i-219f8421
Waiting for instances to start..................
 ** Instance running, fetching hostname/ip data
  * executing `rubber:_allow_root_ssh'
  * executing "sudo -p 'sudo password: '  bash -l -c 'cp /home/ubuntu/.ssh/authorized_keys /root/.ssh/'"
    servers: ["54.248.63.94"]
.... ** Failed to connect to 54.248.63.94, retrying
  * executing `rubber:_allow_root_ssh'
  * executing "sudo -p 'sudo password: '  bash -l -c 'cp /home/ubuntu/.ssh/authorized_keys /root/.ssh/'"
    servers: ["54.248.63.94"]

Hi all,

Running cap rubber:create_staging

I get this error:

Missing rule, creating: {"source_group_name"=>"blog_production_default", "source_group_account"=>"1072835180", "protocol"=>"tcp", "from_port"=>"1", "to_port"=>"65535"}
[DEPRECATION] 'account:group' argument is deprecated. Use {account => group} or just group instead
/home/user/.rvm/gems/ruby-1.9.3-p194/gems/excon-0.16.4/lib/excon/connection.rb:290:in `request_kernel': The security group 'blog_production_default' does not exist (Fog::Compute::AWS::NotFound)

Does anybody know whats going on?

Thanks!.

Minor not that may help folks if you aren't familiar with yml files (I am not) :

if you want to put your AWS account, access key, and secret access key in enviornment variables, you must use the <%= %> brackets to access them. For example :

access_key: <%= ENV["AWS_ACCESS_KEY"] %>

This is unlike other rails configuration files. I'm not quite sure why since yml files look ruby-ish.

Hello,

I followed all the steps, and when I visit the ip address ( or domain name set in hosts ) I get apache server's default page "It works". I did not get rails app.

I have an EC2 tiny instance with ubuntu 12.04 in it.

Please help.

One thing that caused me some consternation: a misnamed keyfile.

When you create the keypair at Amazon, the name listed on amazon must match the filename locally.

Also, Ryan removes the .pem extension, from gsg-keypair...and Rubber does not tack .pem onto what you define in rubbery.yml.

So in short, make sure the key files names match everywhere.