【大数据基础】三、hadoop核心配置文件


一、vim core-site.xml


 
 fs.defaultFS
 hdfs://hadoop101:8020
 
 
 
 hadoop.tmp.dir
 /opt/haoop_store/data
 
 
 
 hadoop.http.staticuser.user
 zhyx
 
 

    hadoop.proxyuser.zhyx.hosts
    *


    hadoop.proxyuser.zhyx.groups
    *

二、vim hdfs-site.xml 



 dfs.namenode.http-address
 hadoop101:9870
 

 
 dfs.namenode.secondary.http-address
 hadoop103:9868
 

三、vim yarn-site.xml


 
 yarn.nodemanager.aux-services
 mapreduce_shuffle
 
 
 
 yarn.resourcemanager.hostname
 hadoop102
 
 
 
 yarn.nodemanager.env-whitelist
JAVA_HOME,HADOOP_COMMON_HOME,HADOOP_HDFS_HOME,HADOOP_CONF_DIR,CLASSPATH_PREPEND_DISTCACHE,HADOOP_YARN_HOME,HADOOP_MAPRED_HOME
 
 


 yarn.log-aggregation-enable
 true



 yarn.log.server.url
 http://hadoop103:19888/jobhistory/logs



 yarn.log-aggregation.retain-seconds
 604800




 yarn.nodemanager.vmem-check-enabled
 false

四、vim mapred-site.xml


 
 mapreduce.framework.name
 yarn
 
 


 mapreduce.jobhistory.address
 hadoop103:10020



 mapreduce.jobhistory.webapp.address
 hadoop103:19888

五、vim /opt/module/hadoop-3.1.3/etc/hadoop/workers

hadoop102
hadoop103
hadoop101