【大数据基础】三、hadoop核心配置文件
一、vim core-site.xml
fs.defaultFS hdfs://hadoop101:8020 hadoop.tmp.dir /opt/haoop_store/data hadoop.http.staticuser.user zhyx hadoop.proxyuser.zhyx.hosts * hadoop.proxyuser.zhyx.groups *
二、vim hdfs-site.xml
dfs.namenode.http-address hadoop101:9870 dfs.namenode.secondary.http-address hadoop103:9868
三、vim yarn-site.xml
yarn.nodemanager.aux-services mapreduce_shuffle yarn.resourcemanager.hostname hadoop102 yarn.nodemanager.env-whitelist JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME yarn.log-aggregation-enable true yarn.log.server.url http://hadoop103:19888/jobhistory/logs yarn.log-aggregation.retain-seconds 604800 yarn.nodemanager.vmem-check-enabled false
四、vim mapred-site.xml
mapreduce.framework.name yarn mapreduce.jobhistory.address hadoop103:10020 mapreduce.jobhistory.webapp.address hadoop103:19888
五、vim /opt/module/hadoop-3.1.3/etc/hadoop/workers
hadoop102 hadoop103 hadoop101