Inter datacenter replication
Fri, 06/24/2011 - 10:43
I see a lot about setting up single clusters and some comments around running clusters across AV zones in AWS however I don't see anything about proper inter-datacenter replication.
Is there a way to have two separate clusters fully replicated?
For example, in separate AWS regions or between AWS and Joyent?
In the scenario where multiple hosts in a cluster are spread across AV zones, is there a way of ensuring that there's at least a copy of the data in each AV zone (without limiting the cluster size) and that hosts only retrieve from the local AV zone?
My concern is for Moxi deciding to do a cross-datacenter trip (even worse if it's from the US to Europe) and our response times going through the roof...
Thanks,
Paul
Hi Paul,
> My concern is for Moxi deciding to do a cross-datacenter trip (even worse if it's from the US to Europe) and our response times going through the roof...
I'm am completely with you on that concern, and we don't recommend you do that.
Membase 1.7 is designed & certified to run with all cluster nodes co-located in the same datacenter (aka, same availability zone). Proper cross-datacenter replication is slated for the Couchbase 2.x release, where you'll start seeing the merger of Couch & Membase features. It's going to leverage the robust replication features of the Couch replication engine, where continuous, optionally filtered streams and sync in the face of occasional non-connectivity have already been well-proven.
That said, folks who couldn't wait have applied combinations of TAP protocol, backups & restores, and deep delving into the core, etc, to engineer up something earlier.
Cheers,
Steve