Hadoop安装与伪分布式配置_头歌云计算配置开发环境 - hadoop安装与伪分布式

1.hadoop cdh下载地址

http://archive.cloudera.com/cdh5/cdh/5/

2.下载

wget http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.15.1.tar.gz
1

也可以scp传输文件

3.解压

tar -zxvf hadoop-2.6.0-cdh5.15.1.tar.gz -C ~/app/
1

4.添加环境变量

sudo vim /etc/profile   //所有用户添加
export HADOOP_HOME=/home/ubuntu/app/hadoop-2.6.0-cdh5.15.1
export PATH=$PATH:$HADOOP_HOME/bin
1
2
3

source /etc/profile
echo $HADOOP_HOME
1
2

5.配置Hadoop文件

cd $HADOOP_HOME
cd etc/hadoop
vim hadoop-env.sh
1
2
3

导入echo $JAVA_HOME的位置

export JAVA_HOME=/usr/lib/jvm/java-11-openjdk-amd64
1

etc/hadoop/core-site.xml:

vim core-site.xml
1

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>
1
2
3
4
5
6

etc/hadoop/hdfs-site.xml:

vim hdfs-site.xml
1

Reference
https://ke.qq.com/course/478249