CDH 使用内部Parcel仓库

创建内部Parcel仓库

安装web服务
以apache为例

//# RHEL
$ sudo yum install httpd
$ sudo service httpd start

//# SLES
$ sudo zypper install httpd
$ sudo service apache2 start

//# Ubuntu
$ sudo apt-get install httpd
$ sudo service apache2 start

下载和发布Parcel仓库
下载地址

//# CDH 5: Impala,Kudu,Spark1等等
https://archive.cloudera.com/cdh5/parcels/

//# Accumulo
https://archive.cloudera.com/accumulo-c5/parcels/

//# GPL Extras 
https://archive.cloudera.com/gplextras5/parcels/

//# CDS 2: CDH5 用的spark2 
https://archive.cloudera.com/spark2/parcels/

//# Navigator Key Trustee Server
http://www.cloudera.com/content/www/en-us/downloads/navigator/key-trustee-server.html

//# Navigator Key Trustee KMS and HSM KMS
http://www.cloudera.com/content/www/en-us/downloads/navigator/key-trustee-kms.html

//# Sqoop Connectors
https://archive.cloudera.com/sqoop-connectors/parcels/

下载.parcel和manifest.json到web根目录

//# apache默认根目录
$ sudo cd /var/www/html
$ sudo mkdir -p /var/www/html/cloudera-parcels/cdh5/5.16/

//# CDH
$ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel
$ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/manifest.json

//# 权限
$ sudo chmod -R ugo+rX /var/www/html/cloudera-parcels/cdh5/5.16/

当CM(Cloudera Manager)从web服务器读取parcel时,不使用.sha1,而是从manifest.json里读取SHA1哈希;

配置CMS使用内部parcel地址

设置parcel

导航栏, 点击导向栏上[]或点击主机->Parcel->配置
或管理->设置->类别->Parcel

在"远程 Parcel 存储库 URL",添加内部Parcel地址

使用本地Parcel仓库

打开CM web界面,导航到Parcel页
点周 “配置”, 修改"本地 Parcel 存储库路径" 为内部Parcel仓库目录(httpd根目录)
删除"远程 Parcel 存储库 URL",包括指向Cloudera官网
此设置需要读取.sha1,在httpd根目录里下载

$ sudo cd /var/www/html/cloudera-parcels/cdh5/5.16/
$ sudo wget https://archive.cloudera.com/cdh5/parcels/5.16/CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha1

//# 改文件名
$ sudo mv CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha1 CDH-5.16.2-1.cdh5.16.2.p0.8-el6.parcel.sha

//# 更改属主
$ sudo chown cloudera-scm:cloudera-scm  /var/www/html/cloudera-parcels/cdh5/5.16/

在web界面导向到Parcel页,点击"检查新Parcel"

当新的parcel出现时,就可以下载,分发和激活了;