1.组件版本信息
zookeeper | hadoop | hbase | hue |
zookeeper-3.4.12 | hadoop-3.0.3 | hbase-2.1.5 | 4.4.0 |
2.hbase的配置 hue关键要添加thrift服务,才能监听9090端口
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
/**
*
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements. See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership. The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License. You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/
-->
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://do1/hbase</value>
</property>
<!--启用分布式集群-->
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<!--默认HMaster HTTP访问端口-->
<property>
<name>hbase.master.info.port</name>
<value>16010</value>
</property>
<!--默认HRegionServer HTTP访问端口-->
<property>
<name>hbase.regionserver.info.port</name>
<value>16030</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>do1cloud01:2181,do1cloud02:2181,do1cloud03:2181</value>
</property>
<property>
<name>hbase.coprocessor.abortonerror</name>
<value>false</value>
</property>
<property>
<name>hbase.unsafe.stream.capability.enforce</name>
<value>false</value>
</property>
<property>
<name>hbase.regionserver.thrift.http</name>
<value>true</value>
</property>
<property>
<name>hbase.thrift.support.proxyuser</name>
<value>true</value>
</property>
<property>
<name>hadoop.proxyuser.root.hosts</name>
<value>*</value>
</property>
<property>
<name>hadoop.proxyuser.root.groups</name>
<value>*</value>
</property>
</configuration>
3.hue的配置
[desktop]
http_host=0.0.0.0
http_port=61111
time_zone=Asia/Shanghai
dev=true
send_dbug_messages=true
django_email_backend=django.core.mail.backends.console.EmailBackend
[[django_admins]]
[[[admin-1]]]
name=Hue
email=hue@192.168.1.194.com
[[custom]]
[[auth]]
idle_session_timeout=-1
[[ldap]]
[[[users]]]
[[[groups]]]
[[[ldap_servers]]]
[[vcs]]
[[database]]
[[session]]
[[smtp]]
host=192.168.1.194
port=25
user=
password=
tls=no
[[knox]]
[[kerberos]]
[[oauth]]
[[oidc]]
[[metrics]]
[[task_server]]
[notebook]
[[interpreters]]
[dashboard]
[[engines]]
[hadoop]
[[hdfs_clusters]]
[[[default]]]
fs_defaultfs=hdfs://192.168.1.194:8020
[[yarn_clusters]]
[[[default]]]
submit_to=True
[beeswax]
[[ssl]]
[metastore]
[impala]
[[ssl]]
[spark]
[oozie]
[filebrowser]
[pig]
[sqoop]
[proxy]
[hbase]
hbase_clusters=(Cluster1|192.168.1.194:9090)
hbase_conf_dir=/do1cloud/hbase-2.1.5/conf
thrift_transport=buffered
[search]
[libsolr]
[indexer]
[jobsub]
[jobbrowser]
[security]
[zookeeper]
[[clusters]]
[[[default]]]
[useradmin]
[[password_policy]]
[liboozie]
[aws]
[[aws_accounts]]
[azure]
[[azure_accounts]]
[[[default]]]
[[adls_clusters]]
[[[default]]]
[[abfs_clusters]]
[[[default]]]
[libsentry]
[libzookeeper]
[librdbms]
[[databases]]
[libsaml]
[libopenid]
[liboauth]
[kafka]
[[kafka]]
[metadata]
[[manager]]
[[optimizer]]
[[catalog]]
[[navigator]]
[[prometheus]]
3.hue的配置中关于hbase的配置
[hbase]
hbase_clusters=(Hbase|127.0.0.1:9090) #不能用主机名或者localhost,一定要用ip
hbase_conf_dir=/opt/bigdata/hbase/conf
thrift_transport=buffered
4.非 HBase HA集群的启动方式
先
[kfk@master hbase-0.98.6-cdh5.3.0]$ bin/start-hbase.sh
再
[kfk@master hbase-0.98.6-cdh5.3.0]$ bin/hbase-daemon.sh start thrift
用一个例子来演示会更加清晰