hadoop部署(4)


3.hadoop安装配置

  * 下载hadoop

 点链接下载。

  * 安装

1.解压
tar -zxvf hadoop-3.2.2.tar.gz
2.移动目录
mv hadoop-3.2.2 /usr/local/hadoop
3.配置hadoop
添加jdk-
cd /usr/local/hadoop
vim etc/hadoop/hadoop-env.sh
vim etc/hadoop/yarn-env.sh
添加JAVA_HOME环境到hadoop-env.sh和yarn-env.sh
JAVA_HOME=/usr/java/jdk1.8.5_151
查看版本
bin/hadoop version

  * 配置hadoop

core-site.xml:

    
        
        fs.default.name  
        hdfs://master:9000  
        
        
        hadoop.tmp.dir  
        /opt/hadoop/tmp  
        
      

hdfs-site.xml

   
        
        dfs.replication  
        2  
        
        
        dfs.namenode.name.dir  
        file:/opt/hadoop/dfs/name  
        
        
        dfs.datanode.data.dir  
        file:/opt/hadoop/dfs/data  
        
      

mapred-site.xml

  
        
        mapreduce.framework.name  
        yarn  
        
        
        mapreduce.jobhistory.address  
        Master:10020  
        
        
        mapreduce.jobhistory.webapp.address  
        Master:19888  
        
      

yarn-site.xml

      
      
        
        yarn.nodemanager.aux-services  
        mapreduce_shuffle  
        
        
        yarn.nodemanager.aux-services.mapreduce.shuffle.class  
        org.apache.hadoop.mapred.ShuffleHandler  
        
        
        yarn.resourcemanager.address  
        master:8032  
        
        
    yarn.resourcemanager.scheduler.address  
        master:8030  
        
        
        yarn.resourcemanager.resource-tracker.address  
        master:8031  
        
        
        yarn.resourcemanager.admin.address  
        master:8033  
        
        
        yarn.resourcemanager.webapp.address  
        master:8088  
        
      

  * 启动hadoop

  在Master服务器启动hadoop,从节点会自动启动,进入/home/hadoop/hadoop-2.7.0目录

(1)初始化,输入命令,bin/hdfs namenode -format
(2)全部启动sbin/start-all.sh,也可以分开sbin/start-dfs.sh、sbin/start-yarn.sh
(3)终止服务器:sbin/stop-all.sh
(4)输入命令jps,可以看到相关信息

 如果失败,可尝试

  * 本机上用浏览器访问
(1)关闭防火墙systemctl stop firewalld.service
(2)浏览器打开http://192.168.198.137:8088/
(3)浏览器打开http://192.168.198:137:50070/

相关