hadoop部署(4)
3.hadoop安装配置
* 下载hadoop
点链接下载。
* 安装
1.解压
tar -zxvf hadoop-3.2.2.tar.gz
2.移动目录
mv hadoop-3.2.2 /usr/local/hadoop
3.配置hadoop
添加jdk-
cd /usr/local/hadoop
vim etc/hadoop/hadoop-env.sh
vim etc/hadoop/yarn-env.sh
添加JAVA_HOME环境到hadoop-env.sh和yarn-env.sh
JAVA_HOME=/usr/java/jdk1.8.5_151
查看版本
bin/hadoop version
* 配置hadoop
core-site.xml:
fs.default.name hdfs://master:9000 hadoop.tmp.dir /opt/hadoop/tmp
hdfs-site.xml
dfs.replication 2 dfs.namenode.name.dir file:/opt/hadoop/dfs/name dfs.datanode.data.dir file:/opt/hadoop/dfs/data
mapred-site.xml
mapreduce.framework.name yarn mapreduce.jobhistory.address Master:10020 mapreduce.jobhistory.webapp.address Master:19888
yarn-site.xml
yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.aux-services.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler yarn.resourcemanager.address master:8032 yarn.resourcemanager.scheduler.address master:8030 yarn.resourcemanager.resource-tracker.address master:8031 yarn.resourcemanager.admin.address master:8033 yarn.resourcemanager.webapp.address master:8088
* 启动hadoop
在Master服务器启动hadoop,从节点会自动启动,进入/home/hadoop/hadoop-2.7.0目录
(1)初始化,输入命令,bin/hdfs namenode -format
(2)全部启动sbin/start-all.sh,也可以分开sbin/start-dfs.sh、sbin/start-yarn.sh
(3)终止服务器:sbin/stop-all.sh
(4)输入命令jps,可以看到相关信息
如果失败,可尝试
* 本机上用浏览器访问
(1)关闭防火墙systemctl stop firewalld.service
(2)浏览器打开http://192.168.198.137:8088/
(3)浏览器打开http://192.168.198:137:50070/