注意:
1)n5为Cloudera Server
 2)n5、n6、n7为Cloudera Agent
 3)首先先分配内存,总共电脑一般超过10G
 4)即使输入Cloudera Server启动命令后,真正启动可能需要12分钟及以上
 5)开启Cloudera服务前,需开启mysql(命令:service mysqld start)n5
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
 2.SSH免密钥登录
 3.防火墙关闭
 1)service iptables stop
 2)chkconfig iptables off
 4.SELINUX关闭
 1)setenforce 0
 2)vi /etc/selinux/configSELINUX=disabled5.安装JDK
 1)cd /usr/java/
 2)使用Xftp将jdk-7u67-linux-x64.tar.gz
 3)tar -zvxf jdk-7u67-linux-x64.tar.gz
 4)export JAVA_HOME=/usr/java/jdk1.7.0_67
 5)export PATH=PATH
 6.设置NTP
 1)yum install ntp -y
 2)chkconfig ntpd on
 3)chkconfig --list ntpd (2-5为on状态则成功)
 4)ntpdate -u ntp.api.bz
 7.安装MySQL
 1)yum install mysql mysql-server -y
 2)service mysqld start
 3)mysql-secure-installation (其中选项依次填Y Y n n Y,完整命令为/usr/bin/mysql_secure_installation)
 4)mysql -uroot -pmysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY '123123' WITH GRANT OPTION;
  mysql> use mysql;
  mysql> select host,user from user;(查看用户)
  mysql> delete from user where host<> "%";(删除除了%以外的其他用户)
  mysql> FLUSH PRIVILEGES;8.下载依赖包
 1)yum -y install chkconfig
 2)yum -y install python (2.6 required for CDH 5)
 3)yum -y install bind-utils
 4)yum -y install psmisc
 5)yum -y install libxslt
 6)yum -y install zlib
 7)yum -y install sqlite
 8)yum -y install cyrus-sasl-plain
 9)yum -y install cyrus-sasl-gssapi
 10)yum -y install fuse
 11)yum -y install portmap
 12)yum -y install fuse-libs
 13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
 9.安装Cloudera Manager Server&Agent
 1)mkdir /opt/cloudera-manager
 2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
 3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
 10.创建用户cloudera-scm
 1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
 11.配置CM Agent
 1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n512.配置CM Server的数据库
 1)将mysql-connector-java-5.1.26-bin.jar拷贝到节点中
 2)mkdir -p /usr/share/java/
 3)cp mysql-connector-java-5.1.26-bin.jar /usr/share/java/mysql-connector-java.jar (注意jar包改名)
 4)mysql -uroot -p123456mysql> grant all on *.* to 'temp'@'%' identified by 'temp' with grant option;
  mysql> create database amon      DEFAULT CHARACTER SET utf8;
  mysql> create database rman      DEFAULT CHARACTER SET utf8;
  mysql> create database metastore DEFAULT CHARACTER SET utf8;
  mysql> create database sentry    DEFAULT CHARACTER SET utf8;
  mysql> create database nav       DEFAULT CHARACTER SET utf8;
  mysql> create database navms     DEFAULT CHARACTER SET utf8;
  mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon';
  mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman';
  mysql> grant all on metastore.* TO 'metastore'@'%' IDENTIFIED BY 'metastore';
  mysql> grant all on sentry.* TO 'sentry'@'%' IDENTIFIED BY 'sentry';
  mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav';
  mysql> grant all on navms.* TO 'navms'@'%' IDENTIFIED BY 'navms';
  mysql> create database hive     DEFAULT CHARACTER SET utf8;
  mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive';
  mysql> create database oozie     DEFAULT CHARACTER SET utf8;
  mysql> grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie';5)cd /opt/cloudera-manager/cm-5.4.3/share/cmf/schema
 6)./scm_prepare_database.sh mysql temp -h n11 -utemp -ptemp --scm-host n11 scm scm scm
 13.创建Parcel目录.Manager节点
 1)mkdir -p /opt/cloudera/parcel-repo
 2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcel-repo
 3)将CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel、CDH-5.4.0-1.cdh5.4.0.p0.27-el6.parcel.sha、manifest.json拷贝至该目录
 14.创建Parcel目录.Agent节点
 1)mkdir -p /opt/cloudera/parcels
 2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
 15.启动CM Manager服务
 1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
 2)./cloudera-scm-server start
 3)tail -100 /opt/cloudera-manager/cm-5.4.3/log/cloudera-scm-server/cloudera-scm-server.log
 16.启动CM Agent服务
 1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
 2)./cloudera-scm-agent start
 17.访问浏览器(需要服务启动命令后12分钟及以上)
 http://n5:7180 18.CDH的安装
 1)登录页
 用户名:admin
 密码:admin
 2)您想要选择哪种版本
 Cloudera Express
 3)感谢您选择Cloudera Manager和CDH
 4)为CDH群集安装指定主机
 5)群集安装:选择存储库
 选择方法:使用Parcel
 选择CDH的版本:CDH-5.4.0-1.cdh5.4.0 p0.27
 其他Parcel:无
 6)群集安装:正在安装选定Parcel
 已下载
 已分配
 已解压
 已激活
 7)群集安装:检查主机正确性
 echo 0 > /proc/sys/vm/swappiness
 8)群集设置:选择您要在群集上安装的CDH 5服务
 所有服务
 9)群集设置:自定义角色分配
 10)群集设置:数据库设置
 数据库主机名称 数据库类型 数据库名称 用户名 密码
 Hive n5 MySQL hive hive hive
 Activity Monitor n5 MySQL amon amon amon
 OOzie n5 MySQL oozie oozie oozie
 11)群集设置:审核更改
 12)群集设置:进度
 13)群集设置:恭喜您!
 14)修改hdfs,搜索"用户"以及"系统组":均改为root
 15)修改Yarn,搜索"用户"以及"系统组":均改为root(搜索"mapred"和"hadoop"修改为root)
 16)修改套接字路径的用户和用户组:chown -R root:root /var/run/hdfs-sockets
 17)修改ZooKeeper,Hive,Impala,Hbase,Spark,Sqoop2,Flume,Kafka、Hue等的用户和系统组为root
 18)重启完成OKn6
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
 2.SSH免密钥登录
 3.防火墙关闭
 1)service iptables stop
 2)chkconfig iptables off
 4.SELINUX关闭
 1)setenforce 0
 2)vi /etc/selinux/config
 SELINUX=disabled
 5.安装JDK
 1)cd /usr/java/
 2)使用Xftp将jdk-7u67-linux-x64.tar.gz
 3)tar -zvxf jdk-7u67-linux-x64.tar.gz
 4)export JAVA_HOME=/usr/java/jdk1.7.0_67
 5)export PATH=PATH
 6.设置NTP
 1)yum install ntp -y
 2)chkconfig ntpd on
 3)chkconfig --list ntpd (2-5为on状态则成功)
 4)ntpdate -u ntp.sjtu.edu.cn
 7.下载依赖包
 1)yum -y install chkconfig
 2)yum -y install python (2.6 required for CDH 5)
 3)yum -y install bind-utils
 4)yum -y install psmisc
 5)yum -y install libxslt
 6)yum -y install zlib
 7)yum -y install sqlite
 8)yum -y install cyrus-sasl-plain
 9)yum -y install cyrus-sasl-gssapi
 10)yum -y install fuse
 11)yum -y install portmap
 12)yum -y install fuse-libs
 13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
 8.安装Cloudera Manager Agent
 1)mkdir /opt/cloudera-manager
 2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
 3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
 9.创建用户cloudera-scm
 1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
 10.配置CM Agent
 1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n511.创建Parcel目录.Agent节点
 1)mkdir -p /opt/cloudera/parcels
 2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
 12.启动CM Agent服务
 1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
 2)./cloudera-scm-agent start
 13.CDH的安装
 echo 0 > /proc/sys/vm/swappinessn7
1.网络配置:/etc/sysconfig/network和/etc/hosts文件
 2.SSH免密钥登录
 3.防火墙关闭
 1)service iptables stop
 2)chkconfig iptables off
 4.SELINUX关闭
 1)setenforce 0
 2)vi /etc/selinux/configSELINUX=disabled5.安装JDK
 1)cd /usr/java/
 2)使用Xftp将jdk-7u67-linux-x64.tar.gz
 3)tar -zvxf jdk-7u67-linux-x64.tar.gz
 4)export JAVA_HOME=/usr/java/jdk1.7.0_67
 5)export PATH=PATH
 6.设置NTP
 1)yum install ntp -y
 2)chkconfig ntpd on
 3)chkconfig --list ntpd (2-5为on状态则成功)
 4)ntpdate -u ntp.sjtu.edu.cn
 7.下载依赖包
 1)yum -y install chkconfig
 2)yum -y install python (2.6 required for CDH 5)
 3)yum -y install bind-utils
 4)yum -y install psmisc
 5)yum -y install libxslt
 6)yum -y install zlib
 7)yum -y install sqlite
 8)yum -y install cyrus-sasl-plain
 9)yum -y install cyrus-sasl-gssapi
 10)yum -y install fuse
 11)yum -y install portmap
 12)yum -y install fuse-libs
 13)yum -y install redhat-lsb (如果版本不一致,可以不管该依赖包)
 8.安装Cloudera Manager Agent
 1)mkdir /opt/cloudera-manager
 2)拷贝cloudera-manager-el6-cm5.4.3_x86_64.tar.gz进入该节点
 3)tar xvzf cloudera-manager*.tar.gz -C /opt/cloudera-manager
 9.创建用户cloudera-scm
 1)useradd --system --home=/opt/cloudera-manager/cm-5.0/run/cloudera-scm-server --no-create-home --shell=/bin/false --comment “Cloudera SCM User” cloudera-scm
 10.配置CM Agent
 1)vi /opt/cloudera-manager/cm-5.4.3/etc/cloudera-scm-agent/config.iniserver_host=n511.创建Parcel目录.Agent节点
 1)mkdir -p /opt/cloudera/parcels
 2)chown cloudera-scm:cloudera-scm /opt/cloudera/parcels
 12.启动CM Agent服务
 1)cd /opt/cloudera-manager/cm-5.4.3/etc/init.d/
 2)./cloudera-scm-agent start
 13.CDH的安装
 echo 0 > /proc/sys/vm/swappiness