注意:
1)n5为Cloudera Server
2)n5、n6、n7为Cloudera Agent
3)首先先分配内存,总共电脑一般超过10G
4)即使输入Cloudera Server启动命令后,真正启动可能需要12分钟及以上
5)开启Cloudera服务前,需开启mysql(命令:service mysqld start)n5
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
2.SSH免密钥登录
3.防火墙关闭
1)service iptables stop
2)chkconfig iptables off
4.SELINUX关闭
1)setenforce 0
2)vi /etc/selinux/configSELINUX=disabled5.安装JDK
1)cd /usr/java/
2)使用Xftp将jdk-7u67-linux-x64.tar.gz
3)tar -zvxf jdk-7u67-linux-x64.tar.gz
4)export JAVA_HOME=/usr/java/jdk1.7.0_67
5)export PATH=PATH
6.设置NTP
1)yum install ntp -y
2)chkconfig ntpd on
3)chkconfig --list ntpd (2-5为on状态则成功)
4)ntpdate -u ntp.api.bz
7.安装MySQL
1)yum install mysql mysql-server -y
2)service mysqld start
3)mysql-secure-installation (其中选项依次填Y Y n n Y,完整命令为/usr/bin/mysql_secure_installation)
4)mysql -uroot -pmysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY '123123' WITH GRANT OPTION;
mysql> use mysql;
mysql> select host,user from user;(查看用户)
mysql> delete from user where host<> "%";(删除除了%以外的其他用户)
mysql> FLUSH PRIVILEGES;8.下载依赖包
1)yum -y install chkconfig
2)yum -y install python (2.6 required for CDH 5)
3)yum -y install bind-utils
4)yum -y install psmisc
5)yum -y install libxslt
6)yum -y install zlib
7)yum -y install sqlite
8)yum -y install cyrus-sasl-plain
9)yum -y install cyrus-sasl-gssapi
10)yum -y install fuse
11)yum -y install portmap
12)yum -y install fuse-libs
13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
9.安装Cloudera Manager Server&Agent
1)mkdir /opt/cloudera-manager
2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
10.创建用户cloudera-scm
1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
11.配置CM Agent
1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n512.配置CM Server的数据库
1)将mysql-connector-java-5.1.26-bin.jar拷贝到节点中
2)mkdir -p /usr/share/java/
3)cp mysql-connector-java-5.1.26-bin.jar /usr/share/java/mysql-connector-java.jar (注意jar包改名)
4)mysql -uroot -p123456mysql> grant all on *.* to 'temp'@'%' identified by 'temp' with grant option;
mysql> create database amon DEFAULT CHARACTER SET utf8;
mysql> create database rman DEFAULT CHARACTER SET utf8;
mysql> create database metastore DEFAULT CHARACTER SET utf8;
mysql> create database sentry DEFAULT CHARACTER SET utf8;
mysql> create database nav DEFAULT CHARACTER SET utf8;
mysql> create database navms DEFAULT CHARACTER SET utf8;
mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon';
mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman';
mysql> grant all on metastore.* TO 'metastore'@'%' IDENTIFIED BY 'metastore';
mysql> grant all on sentry.* TO 'sentry'@'%' IDENTIFIED BY 'sentry';
mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav';
mysql> grant all on navms.* TO 'navms'@'%' IDENTIFIED BY 'navms';
mysql> create database hive DEFAULT CHARACTER SET utf8;
mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive';
mysql> create database oozie DEFAULT CHARACTER SET utf8;
mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie';5)cd /opt/cloudera-manager/cm-5.4.3/share/cmf/schema
6)./scm_prepare_database.sh mysql temp -h n11 -utemp -ptemp --scm-host n11 scm scm scm
13.创建Parcel目录.Manager节点
1)mkdir -p /opt/cloudera/parcel-repo
2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
3)将CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel、CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel.sha、manifest.json拷贝至该目录
14.创建Parcel目录.Agent节点
1)mkdir -p /opt/cloudera/parcels
2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
15.启动CM Manager服务
1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
2)./cloudera-scm-server start
3)tail -100 /opt/cloudera-manager/cm-5.4.3/log/cloudera-scm-server/cloudera-scm-server.log
16.启动CM Agent服务
1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
2)./cloudera-scm-agent start
17.访问浏览器(需要服务启动命令后12分钟及以上)
http://n5:7180 18.CDH的安装
1)登录页
用户名:admin
密码:admin
2)您想要选择哪种版本
Cloudera Express
3)感谢您选择Cloudera Manager和CDH
4)为CDH群集安装指定主机
5)群集安装:选择存储库
选择方法:使用Parcel
选择CDH的版本:CDH-5.4.0-1.cdh5.4.0 p0.27
其他Parcel:无
6)群集安装:正在安装选定Parcel
已下载
已分配
已解压
已激活
7)群集安装:检查主机正确性
echo 0 > /proc/sys/vm/swappiness
8)群集设置:选择您要在群集上安装的CDH 5服务
所有服务
9)群集设置:自定义角色分配
10)群集设置:数据库设置
数据库主机名称 数据库类型 数据库名称 用户名 密码
Hive n5 MySQL hive hive hive
Activity Monitor n5 MySQL amon amon amon
OOzie n5 MySQL oozie oozie oozie
11)群集设置:审核更改
12)群集设置:进度
13)群集设置:恭喜您!
14)修改hdfs,搜索"用户"以及"系统组":均改为root
15)修改Yarn,搜索"用户"以及"系统组":均改为root(搜索"mapred"和"hadoop"修改为root)
16)修改套接字路径的用户和用户组:chown -R root:root /var/run/hdfs-sockets
17)修改ZooKeeper,Hive,Impala,Hbase,Spark,Sqoop2,Flume,Kafka、Hue等的用户和系统组为root
18)重启完成OKn6
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
2.SSH免密钥登录
3.防火墙关闭
1)service iptables stop
2)chkconfig iptables off
4.SELINUX关闭
1)setenforce 0
2)vi /etc/selinux/config
SELINUX=disabled
5.安装JDK
1)cd /usr/java/
2)使用Xftp将jdk-7u67-linux-x64.tar.gz
3)tar -zvxf jdk-7u67-linux-x64.tar.gz
4)export JAVA_HOME=/usr/java/jdk1.7.0_67
5)export PATH=PATH
6.设置NTP
1)yum install ntp -y
2)chkconfig ntpd on
3)chkconfig --list ntpd (2-5为on状态则成功)
4)ntpdate -u ntp.sjtu.edu.cn
7.下载依赖包
1)yum -y install chkconfig
2)yum -y install python (2.6 required for CDH 5)
3)yum -y install bind-utils
4)yum -y install psmisc
5)yum -y install libxslt
6)yum -y install zlib
7)yum -y install sqlite
8)yum -y install cyrus-sasl-plain
9)yum -y install cyrus-sasl-gssapi
10)yum -y install fuse
11)yum -y install portmap
12)yum -y install fuse-libs
13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
8.安装Cloudera Manager Agent
1)mkdir /opt/cloudera-manager
2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
9.创建用户cloudera-scm
1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
10.配置CM Agent
1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n511.创建Parcel目录.Agent节点
1)mkdir -p /opt/cloudera/parcels
2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
12.启动CM Agent服务
1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
2)./cloudera-scm-agent start
13.CDH的安装
echo 0 > /proc/sys/vm/swappinessn7
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
2.SSH免密钥登录
3.防火墙关闭
1)service iptables stop
2)chkconfig iptables off
4.SELINUX关闭
1)setenforce 0
2)vi /etc/selinux/configSELINUX=disabled5.安装JDK
1)cd /usr/java/
2)使用Xftp将jdk-7u67-linux-x64.tar.gz
3)tar -zvxf jdk-7u67-linux-x64.tar.gz
4)export JAVA_HOME=/usr/java/jdk1.7.0_67
5)export PATH=PATH
6.设置NTP
1)yum install ntp -y
2)chkconfig ntpd on
3)chkconfig --list ntpd (2-5为on状态则成功)
4)ntpdate -u ntp.sjtu.edu.cn
7.下载依赖包
1)yum -y install chkconfig
2)yum -y install python (2.6 required for CDH 5)
3)yum -y install bind-utils
4)yum -y install psmisc
5)yum -y install libxslt
6)yum -y install zlib
7)yum -y install sqlite
8)yum -y install cyrus-sasl-plain
9)yum -y install cyrus-sasl-gssapi
10)yum -y install fuse
11)yum -y install portmap
12)yum -y install fuse-libs
13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
8.安装Cloudera Manager Agent
1)mkdir /opt/cloudera-manager
2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
9.创建用户cloudera-scm
1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
10.配置CM Agent
1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n511.创建Parcel目录.Agent节点
1)mkdir -p /opt/cloudera/parcels
2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
12.启动CM Agent服务
1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
2)./cloudera-scm-agent start
13.CDH的安装
echo 0 > /proc/sys/vm/swappiness
本文章为转载内容,我们尊重原作者对文章享有的著作权。如有内容错误或侵权问题,欢迎原作者联系我们进行内容更正或删除文章。