Monday, 7 January 2013

Sqoop integration with hadoop for oracle data import with oraoop

I have been trying to import data from oracle to hadoop using scoop with oraoop.

It took me a couple of days to install the free version of oracle - oracle express edition 11g R2.
Then i installed CDH sqoop and tried to integrate the already running pache hadoop.

I found that oraoop is used correctly but i face the following issue on import. I also tried with apache sqoop with apache hadoop but still faced the following issue.
The web search suggested to use CDH hadoop as well instead of apache Hadoop.


Exception in thread "main" java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.JobContext, but interface was expected
        at com.quest.oraoop.OraOopDataDrivenDBInputFormat.getDesiredNumberOfMappers(OraOopDataDrivenDBInputFormat.java:201)
        at com.quest.oraoop.OraOopDataDrivenDBInputFormat.getSplits(OraOopDataDrivenDBInputFormat.java:51)

To summarize

CDH sqoop + Apache Hadoop - Data import failed with the above exception
Apache Sqoop + Apache hadoop - Data import failed with the above exception
CDH Sqoop +CDH Hadoop - Hope it works!!

I am still working on the  last combination. Will Keep you posted.

Bye for now.

No comments:

Post a Comment