CDH5.7.0离线安装

技术

（以下均以root用户进行）

1. 基础环境安装 (这个请忽略，不能进行，不然无法安装成功！！）

# 禁用 fastestmirror 插件
sed -i.backup 's/^enabled=1/enabled=0/' /etc/yum/pluginconf.d/fastestmirror.conf
# 备份
mv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo.backup
# 使用阿里云镜像
wget -O /etc/yum.repos.d/CentOS-Base-aliyun.repo http://mirrors.aliyun.com/repo/Centos-6.repo
# 安装 EPEL 源
wget http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm
wget http://rpms.famillecollet.com/enterprise/remi-release-6.rpm
rpm -Uvh remi-release-6*.rpm epel-release-6*.rpm
# 使用阿里云镜像
if [[ ! -f /etc/yum.repos.d/epel.repo.backup ]]; then
    mv /etc/yum.repos.d/epel.repo /etc/yum.repos.d/epel.repo.backup 2>/dev/null || :
fi
if [[ ! -f /etc/yum.repos.d/epel-testing.repo.backup ]]; then
    mv /etc/yum.repos.d/epel-testing.repo /etc/yum.repos.d/epel-testing.repo.backup 2>/dev/null || :
fi
wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-6.repo
yum clean all
yum makecache
yum update -y
yum groupinstall 'Development tools'
yum install -y tmux vim

2. 下载安装文件

1. CM install bin: http://archive.cloudera.com/cm5/installer/5.8.1/cloudera-manager-installer.bin
2. CM rpms: http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.8.1/RPMS/x86_64/
3. CDH文件：
   
   • http://archive.cloudera.com/cdh5/parcels/5.8/CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel
   • http://archive.cloudera.com/cdh5/parcels/5.8/CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel.sha1
   • http://archive.cloudera.com/cdh5/parcels/5.8/manifest.json
4. 最后的目录结构为(没有的就创建目录，把下载文件放进去吧）：

[root@master ~]# tree cm5.8.1/
cm5.8.1/
├── CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel
├── CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel.sha1
├── cloudera-manager-installer.bin
├── manifest.json
└── rpms
    ├── cloudera-manager-agent-5.8.1-1.cm581.p0.7.el6.x86_64.rpm
    ├── cloudera-manager-daemons-5.8.1-1.cm581.p0.7.el6.x86_64.rpm
    ├── cloudera-manager-server-5.8.1-1.cm581.p0.7.el6.x86_64.rpm
    ├── cloudera-manager-server-db-2-5.8.1-1.cm581.p0.7.el6.x86_64.rpm
    ├── enterprise-debuginfo-5.8.1-1.cm581.p0.7.el6.x86_64.rpm
    ├── jdk-6u31-linux-amd64.rpm
    └── oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm

3. 基础环境配置

1. 修改/etc/sysconfig/network

   NETWORKING=yes
   HOSTNAME=master.com

2. 修改/etc/hosts

   192.168.66.134  master.com master

3. 临时关闭SELinux

   setenforce 0
   # 查看是否生效：
    /usr/sbin/sestatus -v
   # 如果输出disabled，则生效，如果未生效，那运行下面命令(即永久关闭selinux）后重启即可
   sed -i 's/SELINUX=enforcing/SELINUX=disabled/' /etc/selinux/config
   reboot -f

4. 关闭防火墙

   service iptables stop

5. 重启网络

   service network restart

6. 配置ssh免输密码

   rm -rf ~/.ssh
   ssh localhost
   exit
   #生成ssh免登陆密钥，一直回车即可
   cd ~/.ssh
   ssh-keygen -t rsa
   #将公钥拷贝到要免登陆的机器上
   cat id_rsa.pub >>authorized_keys

7. 配置cm安装源，添加/etc/yum.repo.d/cloudera-manager.repo

   [cloudera-manager]
   name = Cloudera Manager, Version 5.8.1
   baseurl = https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.8.1/
   gpgkey = https://archive.cloudera.com/redhat/cdh/RPM-GPG-KEY-cloudera
   gpgcheck = 1

   修改yum配置文件：/etc/yum.conf,加入下面配置

   sslverify=0

   验证repo文件是否起效

   yum list|grep cloudera
   #如果列出的不是你安装的版本，执行下面命令重试
   yum clean all 
   yum list | grep cloudera

8. 配置语言坏境为英文（中文会出错）：

   1. 修改/etc/sysconfig/i18n文件

      LANG="en_US.UTF-8"

   2. 修改运行时语言：

      echo 'LANG=en_US.UTF-8' >>/etc/profile
      source /etc/profile

   3. 重新登录！

9. 开始安装！

   cd ~/cm5.8.1/rpms
   yum -y install *.rpm
   cd ..
   mv CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel* /opt/cloudera/parcel-repo/
   mv /opt/cloudera/parcel-repo/CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel.sha1 /opt/cloudera/parcel-repo/CDH-5.8.0-1.cdh5.8.0.p0.42-el6.parcel.sha
   rm -rf /etc/cloudera-scm-server/db.properties
   chmod +x ./cloudera-manager-installer.bin
   ./cloudera-manager-installer.bin

10. 开始配置！！

    1. 修改/etc/cloudera-scm-agent/config.ini的server_host，改为master.com
    2. 浏览器访问：master.com:7180吧！
    3. 如果是远程的，那把master.com替换替换成ip即可
    4. 若后续出现“Cloudera 建议将 /proc/sys/vm/swappiness 设置为最大值 10。当前设置为 60。”，则运行下面：
       

        sysctl vm.swappiness=5

    并让他永久生效：修改 /etc/sysctl.conf，加入：

    vm.swappiness=5