需要如下的东西

  • Oracle JDK
  • Cloudera Manager Server and Agent packages
  • Supporting database software
  • CDH and managed service software

    使用本地仓库安装:

    ./cloudera-manager-installer.bin --skip_repo_package=1,或者指定hosts
    <hostname> archive.cloudera.com
    

    management port : 7180

    日志在 /var/log/cloudera-scm-server/cloudera-scm-server.log
    默认账号密码admin
    

    机器初始化 for hadoop-master 192.168.126.102

    cd /etc/sysconfig && sed -i '/HOSTNAME/d' network; echo 'HOSTNAME=hadoop-master.ops.ac.cn' >> network
    cd /etc/ && sed -i '1 s:t2::g' hosts ; echo '192.168.126.102 hadoop-master.ops.ac.cn hadoop-master' >> hosts
    cd /etc/selinux && sed -i '/SELINUX=/d' config ; echo 'SELINUX=disabled' >> config
    iptables -t filter -F ; service iptables save; service iptables stop; chkconfig iptables off
    

    机器初始化 for hadoop-node-1 192.168.126.103

    cd /etc/sysconfig && sed -i '/HOSTNAME/d' network; echo 'HOSTNAME=hadoop-node-1.ops.ac.cn' >> network
    cd /etc/ && sed -i '1 s:t3::g' hosts ; echo '192.168.126.103 hadoop-node-1.ops.ac.cn hadoop-master' >> hosts
    cd /etc/selinux && sed -i '/SELINUX=/d' config ; echo 'SELINUX=disabled' >> config
    iptables -t filter -F ; service iptables save; service iptables stop; chkconfig iptables off
    # 机器初始化 for hadoop-node-2 192.168.126.101
    cd /etc/sysconfig && sed -i '/HOSTNAME/d' network; echo 'HOSTNAME=hadoop-node-2.ops.ac.cn' >> network
    cd /etc/ && sed -i '1 s:t1::g' hosts ; echo '192.168.126.101 hadoop-node-2.ops.ac.cn hadoop-master' >> hosts
    cd /etc/selinux && sed -i '/SELINUX=/d' config ; echo 'SELINUX=disabled' >> config
    iptables -t filter -F ; service iptables save; service iptables stop; chkconfig iptables off
    

    mirror

wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-6.repo

wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-6.repo

echo '
[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera Manager
baseurl=http://mirror.ops.ac.cn/cdh5/redhat/6/x86\_64/cdh/5.5.0/

gpgkey = http://mirror.ops.ac.cn/cdh5/redhat/6/x86\_64/cdh/5.5.0/RPM-GPG-KEY-cloudera

gpgcheck = 0
' > /etc/yum.repos.d/cdh.repo

原版的cdh repo

[cloudera-cdh5]
# Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat or CentOS 6 x86_64
name=Cloudera's Distribution for Hadoop, Version 5
#baseurl=https://archive.cloudera.com/cdh5/redhat/6/x86\_64/cdh/5/

baseurl=https://archive.cloudera.com/cdh5/redhat/6/x86\_64/cdh/5.5.0/

gpgkey =https://archive.cloudera.com/cdh5/redhat/6/x86\_64/cdh/RPM-GPG-KEY-cloudera

gpgcheck = 1

/data/soft/soft/cdh/ /data/mirror/cdh5/redhat/6/x86_64/cdh/5.5.0/

下载文件

cd /root/ && rsync -avzP soft.ops.ac.cn::ops1970/cdh/cloudera-manager-installer.bin .
#cd /root/ && rsync -avzP soft.ops.ac.cn::ops1970/cdh/rpms .
mkdir -p /opt/cloudera/parcel-repo
cd /opt/cloudera/parcel-repo && rsync -avzP soft.ops.ac.cn::ops1970/cdh/parcel/* .

如果安装到一半的时候,突然无法安装,杀掉后,再次运行,会提示。

/usr/share/cmf/uninstall-cloudera-manager.sh

端口监控

参考资料

https://geosmart.github.io/2015/08/08/Hadoop%E9%9B%86%E7%BE%A4%E9%83%A8%E7%BD%B2/

镜像梳理

parcels
https://archive.cloudera.com/cdh5/parcels/5.5/

rpms for cdh5, 是各种组件的rpm,如果不以parcels类型安装,那么就是以这类型是进行安装
https://archive.cloudera.com/cdh5/redhat/6/x86\_64/cdh/5.5.0/

rpms for cm5 仅仅是clouder manager和agent daemon 以及java之类
https://archive.cloudera.com/cm5/redhat/6/x86\_64/cm/5.5.0/RPMS/x86\_64/
Copyright © opschina.org 2017 with zzlyzq@gmail.com all right reserved,powered by Gitbook该文件修订时间: 2017-07-11 11:32:48

results matching ""

    No results matching ""