Hbase伪集群搭建


一、安装前准备

  1. hadoop3.1.3安装及环境配置
  2. hbase2.3.0安装及环境配置
  3. jdk1.8安装及环境配置
  4. 修改hostname(hostnamectl set-hostname **),本次安装hostname为node02.example.com,启动hadoop,hbase的用户是ambri
  5. 配置ssh,启动hadoop时需要用,在ambri用户下(ssh-keygen -t rsa -C "ambri.rsa" )将生成的公钥分发给本机(ssh-copy-id -i ~/.ssh/id_rsa.pub node02.example.com)

二、配置和启动hadoop

  1. 配置hadoop-env.sh

   

  2. 配置core-site.xml

   3.配置hdfs-site.cml 

  <property>
        <name>dfs.replicationname>
        <value>1value>
    property>
    <property>
          <name>dfs.webhdfs.enabledname>
          <value>truevalue>
    property>

    <property>
        <name>dfs.permissionsname>
        <value>truevalue>
    property>
    <property>
        <name>dfs.datanode.max.transfer.threadsname>
        <value>4096value>
    property>
    <property>
        <name>dfs.namenode.name.dirname>
        <value>/ambari/bigdata/hadoop/local/dfs/namevalue>
    property>

    <property>
        <name>dfs.datanode.data.dirname>
        <value>/ambari/bigdata/hadoop/local/dfs/datavalue>
    property>

    <property>
        <name>dfs.namenode.checkpoint.dirname>
        <value>/ambari/bigdata/hadoop/local/dfs/namesecondaryvalue>
    property>
    <property>
        <name>dfs.namenode.secondary.http-addressname>
        <value>node02.example.com:50090value>
    property>
hdfs-site.xml

  4.配置workers

   5.格式化namenode 

  进入$HADOOP_HOME/bin目录

             

  6.启动hdfs(用非root用户启动)

   cd $HADOOP_HOME/sbin

  ./start-dfs.sh

  7.查看hadoop UI

  IP:9870

 三、配置hbase并启动

  1.配置hbase-env.sh

   

   

   * 注:这里我使用hbase自带的zookeeper

  2.配置hbase-site.xml

  <property>
        <name>hbase.rootdirname>
        <value>hdfs://node02.example.com:9000/hbasevalue>
  property>
  <property>
        <name>hbase.zookeeper.property.dataDirname>
        <value>/ambari/zookeeper/datavalue>
  property>
  <property>
        <name>hbase.cluster.distributedname>
        <value>truevalue>
  property>
  <property>
        <name>hbase.unsafe.stream.capability.enforcename>
        <value>falsevalue>
  property>
  <property>
        <name>hbase.tmp.dirname>
        <value>/ambari/hbase-2.3.0/tmpvalue>
  property>
  <property>
    <name>hbase.zookeeper.quorumname>
    <value>node02.example.comvalue>
  property>
hbase-site.xml

  3.启动hbase

   4.查看hbase UI

  IP:16010