Basic 2-node 'add server' problem. Maybe I have the wrong server IP?
I'm new to Couchbase. I'm using one of Couch's provided AMIs on Amazon's EC2, both configured in US-West-1 (point being same DC, same zone, so I'm *not* trying to do XDCR). I'm stuck on a very basic setup stage: I've got node0 all good (I used the default RAM configs, sample data, and changed the admin pass no problem), but I'm failing at getting the second node up and running for a 2-node cluster. I believe my problem is the Server IP, but that's just a guess based off the error message I'm seeing.
Here's the error, anonymized to IP x.x.x.x
Attention - Failed to reach otp port 21100 for node [" ", <<"Timeout connecting to \"x.x.x.x\" on port \"21100\". This could be due to an incorrect host/port combination or a firewall in place between the servers.">>].firstname.lastname@example.org This can be firewall problem.
FWIW I can SSH into both node0 and node1 from my local computer. I can SSH to each node from the other. I get a happy TCP socket on 8091 from the opposing node, too, so I can't imagine there's actually a firewall problem (notably I don't get a TCP reply on 21100, but the error didn't specify TCP v UDP so I'm not sure if that means anything). According to nice posts like http://alestic.com/2009/06/ec2-elastic-ip-internal you're supposed to configure the remote node's address via the external IP since, supposedly, EC2's DNS is smart enough to realize that when a DNS request comes from, say, node0 asking for node1's IP, the request is fulfilled with the private IP and traffic is routed accordingly on the LAN (thus not counting against external bandwidth limits).
Did I miss something in the setup? Googling shows some people say I should get an elastic IP for each node, but I tried to follow the Couch instructions very closely and they didn't say anything about that. How do I get my second node to talk to the first one?