热门标签
热门文章
- 1uniapp微信小程序地图实现绘制polygon（保姆级教程 全网最全！！！）_uniapp map polygon
- 2Windows 蓝屏代码大全，Bug检查代码参考_bugcheckcode 340
- 3[ Hive ] hive优化一 : 表设计优化_hive数据表设计
- 4Docker (5) 网络配置_docker 网卡配置
- 5什么是OpenCV？OpenCV的用途是什么？OpenCV简介_opencv是干什么的
- 6深度学习易混淆小知识积累—特征选择/特征抽取/学习率衰减/梯度裁剪_梯度剪裁和权重衰减
- 7Kubenets 123_nets123 cn
- 8如何优化一个运行缓慢的SQL查询？有哪些常见的优化技巧？_sql查询慢的优化步骤
- 9k8s指南-Ingress_k8 ingress是什么
- 10Python判断字符串相等_python 字符串相等
当前位置: article > 正文
非常详细的CDH6环境安装（离线版）
作者：你好赵伟 | 2024-08-15 08:29:26
赞
踩
cdh6
CDH6环境安装（离线版）
官网介绍:
CDH是Cloudera的100％开源平台发行版，包括Apache Hadoop，专为满足企业需求而构建。CDH提供开箱即用的企业使用所需的一切。通过将Hadoop与十几个其他关键的开源项目集成，Cloudera创建了一个功能先进的系统，可帮助您执行端到端的大数据工作流程。
简单来说：
CDH 是一个拥有集群自动化安装、中心化管理、集群监控、报警功能的一个工具（软件），使得集群的安装可以从几天的时间缩短为几个小时，运维人数也会从数十人降低到几个人，极大的提高了集群管理的效率。
说人话就是:
你安装CDH平台，然后通过CDH安装hadoop集群、spark集群、zookeeper、kafka、hive、hbase等，可以节省你一大笔安装配置的时间，以及启动成本。是不是很香？
提示：所有操作，均在root用户下进行的！！！
一、预备阶段
1. 集群机器
还不会安装虚拟机的兄嘚，可以看下我上篇环境安装大数据学习记录——基础环境搭建
| 虚拟机IP | hostname | Hadoop | Mysql | Spark | ZooKeeper |
|---|---|---|---|---|---|
| 196.168.44.136 | cdh1 | Y | Y | Y | Y |
| 196.168.44.137 | cdh2 | Y | Y | Y | |
| 196.168.44.138 | cdh3 | Y | Y | Y |
2. 准备安装包
jdk:
oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm
mysql:
mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar
mysql-connector-java-5.1.47.tar.gz
cloudera-repos-6.2.0:
cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm
parcel-6.2.0
CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel
CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel.sha
PHOENIX-1.0.jar
PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel
PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel.sha
manifest.json
下载连接：
链接：https://pan.baidu.com/s/1u8Khvy_nlvCFbcJRtanurg
提取码：wl0w
二、环境安装（关闭防火墙~）
systemctl stop firewalld.service
1.修改hostname和hosts(所有节点)
设置hostname修改配置文件
[root@cdh1 ~]# vi /etc/hostname
cdh1
[root@cdh1 ~]# vi /etc/sysconfig/network
# Created by anaconda
NETWORKING=yes
HOSTNAME=server4
- 1
- 2
- 3
- 4
- 5
- 6
- 7
设置/etc/hosts
[root@cdh1 ~]# vi /etc/hosts
#127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
#::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.44.136 cdh1
192.168.44.137 cdh2
192.168.44.138 cdh3
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
重启！
同样的操作在三台服务器上，完成修改，并重启
2.SSH免密登录（所有节点）
执行指令：ssh-keygen -t rsa -P “”,（在三台机器上都执行！！！）
[root@cdh1 .ssh]# ssh-keygen -t rsa -P "" Generating public/private rsa key pair. Enter file in which to save the key (/root/.ssh/id_rsa): /root/.ssh/id_rsa already exists. Overwrite (y/n)? y Your identification has been saved in /root/.ssh/id_rsa. Your public key has been saved in /root/.ssh/id_rsa.pub. The key fingerprint is: SHA256:iOi8fyUMkomZv/nHwC7TXNjnlDNHJ1BrWSE4ik9u81I root@cdh1 The key's randomart image is: +---[RSA 2048]----+ | oo o. | | + = | | + o . . o+ | |+ +.o.o. .o . | | ..o.O. So o | | o. + X E . | | o* = X + | | =.+ = o | | .=oo . | +----[SHA256]-----+
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
查看生产公钥和私钥
[root@cdh1 ~]# cd .ssh/
[root@cdh1 .ssh]# ll
总用量 16
-rw------- 1 root root 1675 10月 13 19:09 id_rsa
-rw-r--r-- 1 root root 399 10月 13 19:09 id_rsa.pub
-rw-r--r-- 1 root root 542 10月 16 22:03 known_hosts
- 1
- 2
- 3
- 4
- 5
- 6
在cdh1 上创建 authorized_keys 文件
[root@cdh1 ~]# mkdir authorized_keys
[root@cdh1 ~]# cat id_rsa.pub >> authorized_keys
[root@cdh1 .ssh]# cat authorized_keys
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2Y3pNroVHG5VvsIyfIsdBn8HY+OB6Y9r2VxdERzvk8JOE3Sj+U9oX/Ztep5HZDfPEd7MrGQwdYvN9tY/5uhxSTFUciYd5IqG96QKOkipBMC8TSgLF0OvsWq5PBayA0SmRagH2Kx7hJTbcaJvyh0hdQz72ka6FJYHGSZ8Pf5eRW4TJOx5D/jp15kwfnEhLCoBryzSEl8rHl+3Ej+Mk2r04KMlE+N7QMvStFrS3Ohi1FZhAxN8pCi0CROPzu1LqvP7OK5d344w2azyJFjzwLwzjD+AMje2/2j0RrFuieU2iYF+W3h7lJb+DCWMhyeNVKJJsauqTgNGNFIscaphfl2PV root@cdh1
- 1
- 2
- 3
- 4
查看其他两台（cdh2,cdh3）的id_rsa.pub文件，复制内容到cdh1的authorized_keys中。
[root@cdh2 .ssh]# cat id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYFmai7YQ57G8BtbCvG69rLqio1QnTcQGf5XfJdUIpbWwW92VQpjdALFpXRUXlY1J/39G8Ekp226MqmNa7UdnI/ZZEc4rpqJBKl2HrWkLTV+3ViqnObXqjWSJACEiXItaEP47JjQqBrj4mqbMkhd079MsOlRPMHWDmTWsGEm/LS6ou9tgIWK00n59ocgQJpUB/UChk1Hg5cZLQKZk2IYQabPC96L7Rmv3XFpFwma48Q/X+qfbGCRx8YaAGQ7zloF1+DhyAsVLDwgL/RoD8fFWd7uIImziGtq0nrqEyVH3RBI/VioDPscrxITPlzjg5O6ly9W1wszzY0y9D0X49TKQ7 root@cdh2
[root@cdh3 .ssh]# cat id_rsa.pub
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwk+oSEePZkQqensjvCc3FLEmIk9C5T8Pm8Ofo8L/odX//A32dn0WlNdhwej85FKMw8x6ar7HliPSQPc5DZ7yLcmP8GTh1eZwLDVvBMM1mF88IyDFNyQiNR6BDOmexKrzfPhkW48wwisxKc4N1SP/mDeCePbn31ew1ImCitMAW3b3OKOSYwDlVJp5xmzp8v774BD64jomL+y6DUK+O6euvukTW6fN0mCkPapyPWBYIkqsqsM4OcdeGgzdW6b7q8FQ4qmkwaxzNmCPdfW4MVSrkwxPcdtmGXGv9DdOIoHOAO4duET8grLu8rbTe8ByKBzUWmXzxZ0DHxKNkntr0P0yr root@cdh3
##复制之后
[root@cdh1 .ssh]# cat authorized_keys
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2Y3pNroVHG5VvsIyfIsdBn8HY+OB6Y9r2VxdERzvk8JOE3Sj+U9oX/Ztep5HZDfPEd7MrGQwdYvN9tY/5uhxSTFUciYd5IqG96QKOkipBMC8TSgLF0OvsWq5PBayA0SmRagH2Kx7hJTbcaJvyh0hdQz72ka6FJYHGSZ8Pf5eRW4TJOx5D/jp15kwfnEhLCoBryzSEl8rHl+3Ej+Mk2r04KMlE+N7QMvStFrS3Ohi1FZhAxN8pCi0CROPzu1LqvP7OK5d344w2azyJFjzwLwzjD+AMje2/2j0RrFuieU2iYF+W3h7lJb+DCWMhyeNVKJJsauqTgNGNFIscaphfl2PV root@cdh1
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYFmai7YQ57G8BtbCvG69rLqio1QnTcQGf5XfJdUIpbWwW92VQpjdALFpXRUXlY1J/39G8Ekp226MqmNa7UdnI/ZZEc4rpqJBKl2HrWkLTV+3ViqnObXqjWSJACEiXItaEP47JjQqBrj4mqbMkhd079MsOlRPMHWDmTWsGEm/LS6ou9tgIWK00n59ocgQJpUB/UChk1Hg5cZLQKZk2IYQabPC96L7Rmv3XFpFwma48Q/X+qfbGCRx8YaAGQ7zloF1+DhyAsVLDwgL/RoD8fFWd7uIImziGtq0nrqEyVH3RBI/VioDPscrxITPlzjg5O6ly9W1wszzY0y9D0X49TKQ7 root@cdh2
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCwk+oSEePZkQqensjvCc3FLEmIk9C5T8Pm8Ofo8L/odX//A32dn0WlNdhwej85FKMw8x6ar7HliPSQPc5DZ7yLcmP8GTh1eZwLDVvBMM1mF88IyDFNyQiNR6BDOmexKrzfPhkW48wwisxKc4N1SP/mDeCePbn31ew1ImCitMAW3b3OKOSYwDlVJp5xmzp8v774BD64jomL+y6DUK+O6euvukTW6fN0mCkPapyPWBYIkqsqsM4OcdeGgzdW6b7q8FQ4qmkwaxzNmCPdfW4MVSrkwxPcdtmGXGv9DdOIoHOAO4duET8grLu8rbTe8ByKBzUWmXzxZ0DHxKNkntr0P0yr root@cdh3
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
把cdh1上的authorized_keys 分发到cdh2和cdh3上
[root@cdh1 .ssh]# scp authorized_keys root@cdh2:/root/.ssh/
[root@cdh1 .ssh]# scp authorized_keys root@cdh3:/root/.ssh/
- 1
- 2
测试连接
[root@cdh1 ~]# ssh cdh2
Last login: Sat Oct 17 10:59:10 2020
[root@cdh2 ~]# exit
登出
Connection to cdh2 closed.
[root@cdh1 ~]#
- 1
- 2
- 3
- 4
- 5
- 6
3.配置NTP服务（所有节点）
- 修改时区（改为中国标准时区）
[root@cdh1 ~]# ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
- 1
- 安装ntp
[root@cdh1 ~]# ntp yum -y install ntp
- 1
3.修改配置
[root@cdh1 ~]# vim /etc/ntp.conf # For more information about this file, see the man pages # ntp.conf(5), ntp_acc(5), ntp_auth(5), ntp_clock(5), ntp_misc(5), ntp_mon(5). driftfile /var/lib/ntp/drift # Permit time synchronization with our time source, but do not # permit the source to query or modify the service on this system. restrict default nomodify notrap nopeer noquery # Permit all access over the loopback interface. This could # be tightened as well, but to do so would effect some of # the administrative functions. restrict 127.0.0.1 restrict ::1 # Hosts on local network are less restricted. #restrict 192.168.1.0 mask 255.255.255.0 nomodify notrap # Use public servers from the pool.ntp.org project. # Please consider joining the pool (http://www.pool.ntp.org/join.html). #server 0.centos.pool.ntp.org iburst #server 1.centos.pool.ntp.org iburst #server 2.centos.pool.ntp.org iburst #server 3.centos.pool.ntp.org iburst server ntp.aliyun.com #broadcast 192.168.1.255 autokey # broadcast server #broadcastclient # broadcast client #broadcast 224.0.1.1 autokey # multicast server #multicastclient 224.0.1.1 # multicast client #manycastserver 239.255.254.254 # manycast server #manycastclient 239.255.254.254 autokey # manycast client # Enable public key cryptography. #crypto includefile /etc/ntp/crypto/pw # Key file containing the keys and key identifiers used when operating # with symmetric key cryptography. keys /etc/ntp/keys
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
- 32
- 33
- 34
- 35
- 36
- 37
- 38
- 39
- 40
- 41
- 42
- 43
- 44
4.重新启动 ntp 服务：
[root@cdh1 ~]# service ntpd restart
- 1
5.设置开机自启：
[root@cdh1 ~]# systemctl enable ntpd.service
- 1
4.安装httpd（所有节点）
[root@cdh1 ~]# yum -y install httpd
[root@cdh1 ~]# service httpd start
[root@cdh1 ~]# service httpd status
- 1
- 2
- 3
- 4
- 5
5.安装JDK（所有节点）
检查是否安装过java
[root@cdh1 ~]# rpm -qa | grep java
- 1
如果有，则先卸载
[root@cdh1 ~]# yum remove java*
- 1
安装jdk–(这里说明一下，必须要安装cdh对应版本的jdk，不然就gg)
[root@cdh1 ~]# rpm -ivh oracle-j2sdk1.8-1.8.0+update181-1.x86_64.rpm
- 1
配置环境变量
[root@cdh1 ~]# vi /etc/profile
#JDK1.8--添加
export JAVA_HOME=/usr/java/jdk1.8.0_181-cloudera
export PATH=$JAVA_HOME/bin:$PATH
- 1
- 2
- 3
- 4
刷新环境变量
[root@cdh1 ~]# source /etc/profile
- 1
检查是否安装成功
[root@cdh1 ~]# java -version
java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)
- 1
- 2
- 3
- 4
- 5
6.安装Mysql
创建目录
[root@cdh1 ~]# mkdir -p /usr/share/java
- 1
上传mysql-connector-java.jar
[root@cdh1 java]# ll
总用量 984
-rw-r--r-- 1 root root 1007502 8月 7 2018 mysql-connector-java.jar
- 1
- 2
- 3
检查是否安装过mysql
[root@cdh1 java]# rpm -qa | grep mysql
- 1
如果安装了，先卸载
[root@cdh1 java]# yum -y remove mysql
- 1
上传mysql安装包
[root@cdh1 ~]# mkdir -p /opt/mysql [root@cdh1 ~]# cd /opt/mysql [root@cdh1 mysql]# ll -rw-r--r-- 1 root root 530882560 10月 14 18:15 mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar [root@cdh1 mysql]# tar -zxvf mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar [root@cdh1 mysql]# ll -rw-r--r-- 1 root root 530882560 10月 14 18:15 mysql-5.7.26-1.el7.x86_64.rpm-bundle.tar -rw-r--r-- 1 7155 31415 25381952 4月 15 2019 mysql-community-client-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 280904 4月 15 2019 mysql-community-common-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 3838100 4月 15 2019 mysql-community-devel-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 47076368 4月 15 2019 mysql-community-embedded-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 24086952 4月 15 2019 mysql-community-embedded-compat-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 130023844 4月 15 2019 mysql-community-embedded-devel-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 2274268 4月 15 2019 mysql-community-libs-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 2118444 4月 15 2019 mysql-community-libs-compat-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 173541272 4月 15 2019 mysql-community-server-5.7.26-1.el7.x86_64.rpm -rw-r--r-- 1 7155 31415 122249684 4月 15 2019 mysql-community-test-5.7.26-1.el7.x86_64.rpm
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
安装mysql
[root@cdh1 mysql]# rpm -ivh mysql-community-common-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-libs-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-client-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-devel-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-server-5.7.26-1.el7.x86_64.rpm
[root@cdh1 mysql]# rpm -ivh mysql-community-libs-compat-5.7.26-1.el7.x86_64.rpm
- 1
- 2
- 3
- 4
- 5
- 6
启动mysql
## 初始化mysql使mysql目录的拥有者为root用户 [root@cdh1 mysql]# mysqld --initialize --user=root ## 查看密码 [root@cdh1 mysql]# cat /var/log/mysqld.log ## 启动 [root@cdh1 mysql]# systemctl start mysqld.service ## 开机自启 [root@cdh1 mysql]# systemctl enable mysqld ## 登录 [root@cdh1 mysql]# mysql -u root -p Enter password: Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 53 Server version: 5.7.26 MySQL Community Server (GPL) Copyright (c) 2000, 2019, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> use mysql; ERROR 1820 (HY000): You must reset your password using ALTER USER statement before executing this statement. mysql> use mysql ERROR 1820 (HY000): You must reset your password using ALTER USER statement before executing this statement. mysql> alter user user() identified by "root"; Query OK, 0 rows affected (0.00 sec) mysql> exit
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
- 22
- 23
- 24
- 25
- 26
- 27
- 28
- 29
- 30
- 31
重新登录（用户名root,密码root），并创建以下数据表
create database cmserver default charset utf8 collate utf8_general_ci;
grant all on cmserver.* to 'cmserveruser'@'%' identified by 'root';
create database metastore default charset utf8 collate utf8_general_ci;
grant all on metastore.* to 'hiveuser'@'%' identified by 'root';
create database amon default charset utf8 collate utf8_general_ci;
grant all on amon.* to 'amonuser'@'%' identified by 'root';
create database rman default charset utf8 collate utf8_general_ci;
grant all on rman.* to 'rmanuser'@'%' identified by 'root';
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
7.安装CM组件(所有节点)
上传所需安装包（注意保持一直）
##cdh1
[root@cdh1 ~]# ll
总用量 1350216
-rw-------. 1 root root 1259 4月 25 05:49 anaconda-ks.cfg
-rw-r--r-- 1 root root 10215488 10月 15 15:06 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r-- 1 root root 1187380436 10月 15 15:07 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
-rw-r--r-- 1 root root 9984 10月 15 15:06 cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm
- 1
- 2
- 3
- 4
- 5
- 6
###cdh2
[root@cdh2 ~]# ll
总用量 1350192
-rw-------. 1 root root 1259 4月 25 05:49 anaconda-ks.cfg
-rw-r--r-- 1 root root 10215488 10月 15 14:34 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r-- 1 root root 1187380436 10月 15 14:35 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
- 1
- 2
- 3
- 4
- 5
###cdh3
[root@cdh3 ~]# ll
总用量 1350192
-rw-------. 1 root root 1259 4月 25 05:49 anaconda-ks.cfg
-rw-r--r-- 1 root root 10215488 10月 15 14:34 cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
-rw-r--r-- 1 root root 1187380436 10月 15 14:35 cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
- 1
- 2
- 3
- 4
- 5
安装（cdh1 安装三个，cdh2和cdh3 安装两个）
yum localinstall -y cloudera-manager-daemons-6.2.0-968826.el7.x86_64.rpm
yum localinstall -y cloudera-manager-agent-6.2.0-968826.el7.x86_64.rpm
yum localinstall -y cloudera-manager-server-6.2.0-968826.el7.x86_64.rpm
- 1
- 2
- 3
7.CDH6.2.0 (cdh1)
检查jar目录
上传安装包
[root@cdh1 ~ ]# cd /opt/cloudera/parcel-repo
[root@cdh1 parcel-repo]# ll
总用量 4476024
-rw-r--r-- 1 cloudera-scm cloudera-scm 2087665645 10月 15 13:47 CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel
-rw-r--r-- 1 cloudera-scm cloudera-scm 41 10月 15 15:28 CDH-6.2.0-1.cdh6.2.0.p0.967373-el7.parcel.sha
-rw-r--r-- 1 cloudera-scm cloudera-scm 33725 10月 15 13:46 manifest.json
-rw-r--r-- 1 cloudera-scm cloudera-scm 402216960 10月 15 14:23 PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel
-rw-r--r-- 1 cloudera-scm cloudera-scm 41 10月 15 14:23 PHOENIX-5.0.0-cdh6.2.0.p0.1308267-el7.parcel.sha
[root@cdh1 ~ ]# cd /opt/cloudera/csd/
[root@cdh1 csd]# ll
总用量 8
-rw-r--r-- 1 cloudera-scm cloudera-scm 5306 10月 15 14:23 PHOENIX-1.0.jar
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
修改配置
###cdh1
[root@cdh1 ~ ]# vi /etc/cloudera-scm-server/db.properties
# Auto-generated by scm_prepare_database.sh on 2020年 10月 16日 星期五 14:26:26 CST
#
# For information describing how to configure the Cloudera Manager Server
# to connect to databases, see the "Cloudera Manager Installation Guide."
#
com.cloudera.cmf.db.type=mysql
com.cloudera.cmf.db.host=localhost
com.cloudera.cmf.db.name=cmserver
com.cloudera.cmf.db.user=root
com.cloudera.cmf.db.setupType=EXTERNAL
com.cloudera.cmf.db.password=root
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
###cdh1、cdh2、cdh3
修改server_host=cdh1
[root@cdh1 csd]# vi /etc/cloudera-scm-agent/config.ini # Configuration file for cloudera-scm-agent. # Please note that this file supports multi-line values. Multi-line # values are indicated by indenting following lines with a space. # # If you have whitespace in front of a parameter name, it will be # read as a continuation of the previous parameter value. Please # be careful not to leave spaces in front of parameter names. # # To check if this file has spaces in front of parameters names # you can do a grep like this: # grep '^[[:blank:]]' /etc/cloudera-scm-agent/config.ini [General] # Hostname of the CM server. server_host=cdh1 ... ... ...
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
8.启动CM和CDH集群
启动server (cdh1)
[root@cdh1 ~ ]# systemctl start cloudera-scm-server [root@cdh1 csd]# systemctl status cloudera-scm-server ● cloudera-scm-server.service - Cloudera CM Server Service Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-server.service; enabled; vendor preset: disabled) Active: active (running) since 日 2020-10-18 12:47:56 CST; 50min ago Main PID: 939 (java) CGroup: /system.slice/cloudera-scm-server.service └─939 /usr/java/jdk1.8.0_181-cloudera/bin/java -cp .:/usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connect... 10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:48:22 cdh1 cm-server[939]: Sun Oct 18 12:48:22 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:04 cdh1 cm-server[939]: Sun Oct 18 12:49:04 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic 10月 18 12:49:06 cdh1 cm-server[939]: Sun Oct 18 12:49:06 CST 2020 WARN: Establishing SSL connection without server's identity verification is not recommended. Accordin...sting applic Hint: Some lines were ellipsized, use -l to show in full.
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
- 20
- 21
启动agent（所有节点）
[root@cdh1 ~ ]# systemctl start cloudera-scm-agent [root@cdh1 ~]# systemctl status cloudera-scm-agent ● cloudera-scm-agent.service - Cloudera Manager Agent Service Loaded: loaded (/usr/lib/systemd/system/cloudera-scm-agent.service; enabled; vendor preset: disabled) Active: active (running) since 日 2020-10-18 12:47:56 CST; 52min ago Main PID: 938 (cmagent) CGroup: /system.slice/cloudera-scm-agent.service └─938 /usr/bin/python2 /opt/cloudera/cm-agent/bin/cm agent 10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/hadoop-kms 10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/parquet 10月 18 12:53:31 cdh1 cm[938]: ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/parquet 10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/avro 10月 18 12:53:31 cdh1 cm[938]: ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/avro 10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kafka 10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kafka 10月 18 12:53:31 cdh1 cm[938]: ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kudu 10月 18 12:53:31 cdh1 cm[938]: ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.1-1.cdh6.2.1.p0.1425774/lib/kudu 10月 18 12:53:31 cdh1 cm[938]: + env
- 1
- 2
- 3
- 4
- 5
- 6
- 7
- 8
- 9
- 10
- 11
- 12
- 13
- 14
- 15
- 16
- 17
- 18
- 19
8.登录Web界面安装
登录
打开浏览器：http://cdh1:7180/cmf/login
登录名/密码：admin / admin
勾选我同意
选择免费版
进入安装界面
输入集群名
添加集群机器
默认选择
登录
安装完成
9.安装大数据组件
选择自定义安装
勾选组件
默认安装
进入管理界面
至此，安装完成！
本次安装有很多步骤图，在安装时并未截图保存（或者忘记~）。所以不是实时连贯，如有不懂，欢迎评论私信。
注意
安装中可能出现问题：
1. hostname中指定的集群名，不能有下划线！！！！
2.防火墙请关闭，这样你可少很多烦恼？？？
3.执行systemctl start cloudera-scm-agent 和 systemctl start cloudera-scm-server启动失败
请使用：journalctl -xe指令仔细查看错误信息。
然后百度解决！
4. jdk别用自己的，要用官网提供的。
5. 保证集群机器的内存足够！！！
6. 第一次安装完成进入，可能很多都没启动成功爆红。根据提示错误信息，修正配置，重启即可！！
【参考资料】
https://www.cnblogs.com/swordfall/p/10816797.html#auto_id_12
https://blog.csdn.net/weixin_38201936/article/details/106006335
声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/你好赵伟/article/detail/982809?site
推荐阅读
相关标签
