Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the corr

问题描述:

在用MapReduce实现数据去重时遇到报错

Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses

除此之外还有:java.lang.NoClassDefFoundError；java.io.IOException: Cannot initialize Cluster.

问题解决:

这类问题都是由于MapReduce和hadoop的依赖没有导全,导入:

      org.apache.hadoop
      hadoop-common
      3.2.0
    
    
      org.apache.hadoop
      hadoop-hdfs
      3.2.0
    
    
      log4j
      log4j
      1.2.17
    
    
      org.apache.hadoop
      hadoop-client
      3.2.0
    

    
    
      org.apache.hadoop
      hadoop-mapreduce-client-core
      3.2.0
    
    
      org.apache.hadoop
      hadoop-mapreduce-client-common
      3.2.0
    

至此,问题解决.