完全分布式搭建

修改ip地址和主机名

修改3台虚拟机的ip地址和主机名
vim /etc/sysconfig/network-scripts/ifcfg-ens33
将IPADDR修改为
192.168.200.81
重新启动网络服务使其生效
systemctl restart network

集群规划

以下操作均只是修改node1

修改配置文件

hadoop-env.sh

修改配置：
export JAVA_HOME=/opt/app/jdk1.8.0_321
export HADOOP_CONF_DIR=/opt/app/hadoop-2.8.5/etc/hadoop

core-site.xml

  fs.defaultFS
  hdfs://node1:9000



  hadoop.tmp.dir
  /opt/app/hadoop-2.8.5/metaData

hdfs-site.xml

      
      
          dfs.replication
          3
      
      
      
          dfs.namenode.secondary.http-address
          node3:50090
      
      
       
          dfs.permissions.enabled
          false
      
  

slaves

node1
node2
node3

yarn-env.sh

export JAVA_HOME=/opt/app/jdk1.8.0_321

yarn-site.xml

  
  
  yarn.nodemanager.aux-services
  mapreduce_shuffle
  

  
  
  yarn.resourcemanager.hostname
  node2
  
  
      yarn.application.classpath
      
      /opt/app/hadoop-2.8.5/etc/hadoop,
      /opt/app/hadoop-2.8.5/share/hadoop/common/*,
      /opt/app/hadoop-2.8.5/share/hadoop/common/lib/*,
      /opt/app/hadoop-2.8.5/share/hadoop/hdfs/*,
      /opt/app/hadoop-2.8.5/share/hadoop/hdfs/lib/*,
      /opt/app/hadoop-2.8.5/share/hadoop/mapreduce/*,
      /opt/app/hadoop-2.8.5/share/hadoop/mapreduce/lib/*,
      /opt/app/hadoop-2.8.5/share/hadoop/yarn/*,
      /opt/app/hadoop-2.8.5/share/hadoop/yarn/lib/*
      
  

mapred-env.sh

修改配置：
export JAVA_HOME=/opt/app/jdk1.8.0_321

mapred-site.xml

  
      mapreduce.framework.name
      yarn
  

拷贝到别的节点上

scp -r 本机的目录 root@node1:/opt/app

scp -r /opt/app/hadoop-2.8.5 root@node2:/opt/app/
scp -r /opt/app/hadoop-2.8.5 root@node3:/opt/app/

只格式化node1上的namenode

hdfs namenode -format

注意：yarn最好在所在节点上启动