Points to keep in mind when flume is configured to use HDFS sink.
Problem: When i tried to point the HDFS sink to my already running HDFS instance, i got the following exception.
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.io.SequenceFile$CompressionType
Solution: Copied the hadoop-core and the commons-configuration jar from $HADOOP_INSTALL\lib to $FLUME_INSTALL\lib and it worked.
Problem: When i tried to point the HDFS sink to my already running HDFS instance, i got the following exception.
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.io.SequenceFile$CompressionType
Solution: Copied the hadoop-core and the commons-configuration jar from $HADOOP_INSTALL\lib to $FLUME_INSTALL\lib and it worked.
No comments:
Post a Comment