couchbase hadoop connector
Hi
I am a newbie to both couchbase & swoop.
I am trying to use sqoop to export data from HDFS to couchbase & I get the following error:
> bin/sqoop export --connect http:///pools --table garbage_value --export-dir
Warning: /usr/lib/hbase does not exist! HBase imports will fail.
Please set $HBASE_HOME to the root of your HBase installation.
12/05/20 15:13:01 INFO tool.CodeGenTool: Beginning code generation
12/05/20 15:13:01 INFO orm.CompilationManager: HADOOP_HOME is
12/05/20 15:13:01 INFO orm.CompilationManager: Found hadoop core jar at: /hadoop-0.20.2-core.jar
Note: /tmp/sqoop-/compile/07aa8d04d98f9590cdfe870df94516ac/garbage_value.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
12/05/20 15:13:02 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-/compile/07aa8d04d98f9590cdfe870df94516ac/garbage_value.jar
Exception in thread "main" java.lang.NoSuchMethodError: com.cloudera.sqoop.manager.ExportJobContext.setConnManager(Lcom/cloudera/sqoop/manager/ConnManager;)V
at com.couchbase.sqoop.manager.CouchbaseManager.exportTable(CouchbaseManager.java:153)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:78)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:97)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57)
Appreciate all the help
You will have to use sqoop command the following way as specified in
http://www.couchbase.com/docs/hadoop-plugin/hadoop-plugin-exporting.html
shell> bin/sqoop export --connect http://10.2.1.55:8091/pools --table garbage_value --export-dir dump_4-12-11
Where 10.2.1.55 is the ip address of the node participating in the Couchbase cluster. The export-dir corresponds
to the Hadoop directory.
Currently there are some issues with the Sqoop connector for Hadoop that we are in the process of fixing. This
revolves around export.
Rags