Couchbase
  • Why NoSQL?
  • Couchbase Server
  • Download
  • Resources
  • Careers
Home | Forums | SDKs | SDKs

Sqoop

2 replies [Last post]
  • Login or register to post comments
Wed, 12/05/2012 - 15:12
Tang
Offline
Joined: 12/05/2012
Groups: None

Attempting to move data from Couchbase to HDFS using the sqoop adapter and not sure if there is a version problem with the sqoop adapter and Hadoop or I’m missing something simple. Below is the info.

Versions:

Couchbase: 2.0 build 1723

Jdk version: jdk1.7.0_05

Sqoop:
Sqoop 1.4.1-cdh4.1.2
git commit id 2e16242b69f968eb55e73d60d831d6f150072780
Compiled by jenkins on Thu Nov 1 18:20:03 PDT 2012

Hadoop
Hadoop 2.0.0-cdh4.1.2

Changes made to couchsqoop-manager:
com.couchbase.sqoop.manager.CouchbaseFactory=/usr/lib/sqoop/lib/couchbase-hadoop-plugin-1.0.jar

[root@vega7250 sqoop]# sqoop import --connect http://10.23.0.241:8091/pools --table DUMP --target-dir /couch7

12/12/05 09:50:59 INFO tool.CodeGenTool: Beginning code generation
12/12/05 09:50:59 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop
Note: /tmp/sqoop-root/compile/fe026f4d84b4797cd5efea29c109a468/DUMP.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
12/12/05 09:50:59 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/fe026f4d84b4797cd5efea29c109a468/DUMP.jar
12/12/05 09:50:59 INFO mapreduce.ImportJobBase: Beginning import of DUMP
12/12/05 09:51:00 WARN util.Jars: No such class couchbase doesn't use a jdbc driver available.
12/12/05 09:51:00 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
2012-12-05 09:51:00.803 INFO net.spy.memcached.MemcachedConnection: Added {QA sa=/10.23.0.241:11210, #Rops=0, #Wops=0, #iq=0, topRop=null, topWop=null, toWrite=0, interested=0} to connect queue
2012-12-05 09:51:00.805 INFO net.spy.memcached.MemcachedConnection: Connection state changed for sun.nio.ch.SelectionKeyImpl@78f06b95
2012-12-05 09:51:00.885 INFO net.spy.memcached.MemcachedConnection: Shut down memcached client
12/12/05 09:51:01 INFO mapred.JobClient: Running job: job_201212041417_0010
12/12/05 09:51:02 INFO mapred.JobClient: map 0% reduce 0%
12/12/05 09:51:07 INFO mapred.JobClient: Task Id : attempt_201212041417_0010_m_000000_0, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
..............
12/12/05 09:51:14 INFO mapred.JobClient: Task Id : attempt_201212041417_0010_m_000003_2, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
12/12/05 09:51:17 INFO mapred.JobClient: Job complete: job_201212041417_0010
12/12/05 09:51:17 INFO mapred.JobClient: Counters: 7
12/12/05 09:51:17 INFO mapred.JobClient: Job Counters
12/12/05 09:51:17 INFO mapred.JobClient: Failed map tasks=1
12/12/05 09:51:17 INFO mapred.JobClient: Launched map tasks=16
12/12/05 09:51:17 INFO mapred.JobClient: Rack-local map tasks=16
12/12/05 09:51:17 INFO mapred.JobClient: Total time spent by all maps in occupied slots (ms)=22141
12/12/05 09:51:17 INFO mapred.JobClient: Total time spent by all reduces in occupied slots (ms)=0
12/12/05 09:51:17 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
12/12/05 09:51:17 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
12/12/05 09:51:17 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 17.1884 seconds (0 bytes/sec)
12/12/05 09:51:17 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
12/12/05 09:51:17 INFO mapreduce.ImportJobBase: Retrieved 0 records.
12/12/05 09:51:17 ERROR tool.ImportTool: Error during import: Import job failed!

Top
  • Login or register to post comments
Wed, 12/12/2012 - 08:42
ingenthr
Offline
Joined: 03/16/2010
Groups:

You'll want to move to Couchbase Server 2.0 GA now that it's released.

Which version/distro of hadoop are you using?

Top
  • Login or register to post comments
Wed, 01/02/2013 - 15:06
Tang
Offline
Joined: 12/05/2012
Groups: None

Sorry for the delay, I currently have Cloudera 4.1.2 installed and have upgraded to Couchbase Server 2.0 GA release.

sqoop version
Sqoop 1.4.1-cdh4.1.2

[root@v035 sqoop]# hadoop version
Hadoop 2.0.0-cdh4.1.2
Subversion file:///data/1/jenkins/workspace/generic-package-centos64-5-5/topdir/BUI... -r f0b53c81cbf56f5955e403b49fcd27afd5f082de
Compiled by jenkins on Thu Nov 1 17:33:21 PDT 2012
From source with checksum c5d56e606a3aa6dd5399cee3b2b8054f

Top
  • Login or register to post comments
  • Login or register to post comments
  • Login
  • Register

Company

  • About Us
  • Leadership
  • Customers
  • Partners
  • Contact Us

Product

  • Couchbase Server
  • Couchbase SDKs
  • Use Cases
  • Documentation
  • Forums

Open Source

  • Couchbase Project
  • Couchbase vs. CouchDB

Commercial

  • Subscriptions & Support
  • Training & Services

News

  • Blog
  • Newsletter
  • Press Releases
  • Buzz

Follow Us

    
  • Customer Login
  • Terms of Service
  • Privacy Policy
  • Trademark Policy
  • Site Map

© 2013 COUCHBASE All rights reserved.

Sign in to Couchbase Community

close
  • Create new account
  • Request new password
You are logging into the Forums, Wiki and Issue Tracker