Hadoop 集群搭建_hadoop集群搭建 - wpsshop博客

查看

编辑修改

首页
UNITY
NODEJS
PYTHON
AI
GIT
PHP
GO
CEF3
JAVA
HTML
CSS

笔触狂放9

这个屌丝很懒，什么也没留下！

热门标签

jquery
HTML
CSS
PHP
ASP
PYTHON
GO
AI
C
C++
C#
PHOTOSHOP
UNITY
iOS
android
vue
xml
爬虫
SEO
LINUX
WINDOWS
JAVA
MFC
CEF3
CAD
NODEJS
GIT
Pyppeteer
article

热门文章

1手把手系列！使用 Zilliz Cloud 和 AWS Bedrock 搭建 RAG 应用
2kafka-消费者组-点对点测试
3华为OD机试 - 生成哈夫曼树（Java & JS & Python & C & C++）_生成哈夫曼树华为od
4计算机专业近几年的参考文献,近几年计算机专业发参考文献计算机专业发专著类参考文献哪里找...
5人工智能轨道交通行业周刊-第29期（2023.1.2-1.8）_昆明南站小红车机器人
6清览云题库--数据可视化
7消息队列:RabbitMQ_消息队列rabbitmq
8小华最多能得到多少克黄金【华为OD机试】(JAVA&Python&C++&JS题解)_小华按照地图去寻宝
9Makefile入门_makefile学习
10html标签“”中文本对齐实现，让人蛋疼的知识_html textarea跟前两行数据对齐</a></li></ul></div></div></div><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_detail.css?v=890" type="text/css"><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_clk.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/blog/js/mid_.js?v=890"></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/study/js/j/vs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/study/js/j/highlight.pack.js?v=890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/index_contenthljs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/detail01tj.js?v=531890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/wpsshopindex/css/mid_detail_last.css?v=3890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/mid_detail_last.js?v=33890"></script><style type="text/css"></style><script type="text/javascript"></script><div class="interactive_info" id="body-data-0098" attrv="50958"></div><div class="article_box" style="overflow: hidden;"><div class="article_channel"><div class="channel_top_line"><div class="cn_t_l"></div><div class="cn_t_r"></div></div><div class="article_channel_info">当前位置: <a href="/article/list/1">article</a> > 正文 </div></div><div class="article_title"><h1>Hadoop 集群搭建_hadoop集群搭建</h1></div><div class="article_info"><div class="article_c_info"> 作者：笔触狂放9 | 2024-05-31 06:57:24</div><div class="article_click" style="width: 140px;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div class="article_intro">hadoop集群搭建</div><div class="article_content article_contentheight"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/kdoc_html_views-1a98987dfd.css"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/ck_htmledit_views-044f2cf1dc.css"> <div id="content_views" class="htmledit_views"> <h3 style="margin:0px 0px 10px; padding:0px 0px 9px; font-weight:500; font-size:22px; max-width:100%; word-wrap:break-word!important; border-bottom:1px solid rgb(238,238,238); line-height:1.1em"><a name="t0"></a> 目标<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </h3> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在3台服务器上搭建 Hadoop2.7.3 集群，然后测试验证，要能够向 <a href="https://so.csdn.net/so/search?q=HDFS&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=HDFS&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"HDFS\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=HDFS&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"HDFS\"}"}" data-tit="HDFS" data-pretit="hdfs">HDFS</a> 上传文件，并成功运行 mapreduce 示例程序<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <h3 style="margin:0px 0px 10px; padding:0px 0px 9px; font-weight:500; font-size:22px; max-width:100%; word-wrap:break-word!important; border-bottom:1px solid rgb(238,238,238); line-height:1.1em"><a name="t1"></a> 搭建思路<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </h3> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （1）准备基础设施<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 准备3台服务器，分别命名为 master、slave1、slave2<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 互相配置为 <a href="https://so.csdn.net/so/search?q=SSH&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=SSH&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"SSH\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=SSH&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"SSH\"}"}" data-tit="SSH" data-pretit="ssh">SSH</a> 免密码登录，并都安装好 JAVA 环境<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （2）安装配置 <a href="https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hadoop\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hadoop\"}"}" data-tit="hadoop" data-pretit="hadoop">hadoop</a><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 master 上下载解压 hadoop，修改相应配置文件，包括：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; font-size:14px">core-site.xml、hdfs-site.xml、mapred-site.xml、yarn-site.xml、slaves</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 配置文件比较多，但也比较好理解<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)">core-site.xml</span> 是核心配置，需要为 hadoop 指定基本配置信息<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> hdfs 和 <a href="https://so.csdn.net/so/search?q=mapreduce&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=mapreduce&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"mapreduce\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=mapreduce&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"mapreduce\"}"}" data-tit="mapreduce" data-pretit="mapreduce">mapreduce</a> 是核心构成，自然要配置相应的 <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)"> hdfs-site.xml </span>和 <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)"> mapred-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> mapreduce 用到了 <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)"> yarn</span> 框架，所以也要设置对应的配置文件 <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)"> yarn-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 还需要在 <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)"> slaves</span> 中添加从节点的IP<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 配置完成后，把 master 上的 hadoop 目录复制到 slave1 slave2<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （3）启动 hadoop<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 master 中进行 hdfs 初始化，执行启动命令，打开相应网页查看状态信息<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <h3 style="margin:0px 0px 10px; padding:0px 0px 9px; font-weight:500; font-size:22px; max-width:100%; word-wrap:break-word!important; border-bottom:1px solid rgb(238,238,238); line-height:1.1em"><a name="t2"></a> 搭建过程<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </h3> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <ul class="list-paddingleft-2" style="margin:0px; padding:0px 0px 0px 30px; max-width:100%; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; list-style-type:square; word-wrap:break-word!important"><li style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">准备基础设施</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> </li></ul> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （1）为3台服务器设置名称<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改每台服务器的 /etc/hosts，添加<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; font-size:14px">192.168.31.164 master<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 192.168.31.242 slave1<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 192.168.31.140 slave2</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （改为自己服务器的IP）<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （2）SSH无密码登陆<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在每台服务器上都执行以下命令<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; font-size:14px; color:rgb(2,30,170)">$ ssh-keygen</span><span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; font-size:14px"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(136,136,136)">（执行后会有多个输入提示，不用输入任何内容，全部直接回车即可）</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; color:rgb(2,30,170); word-wrap:break-word!important">$ ssh-copy-id -i /root/.ssh/id_rsa -p 22 root@master<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ ssh-copy-id -i /root/.ssh/id_rsa -p 22 root@slave1<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ ssh-copy-id -i /root/.ssh/id_rsa -p 22 root@slave2</span></span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 注：JAVA环境的安装配置没做介绍，请自己准备好<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <ul class="list-paddingleft-2" style="margin:0px; padding:0px 0px 0px 30px; max-width:100%; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; list-style-type:square; word-wrap:break-word!important"><li style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">安装配置 hadoop</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> </li></ul> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （1）安装<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 master 中执行<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ cd /home<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ wget http://apache.fayea.com/hadoop/common/hadoop-2.7.3/hadoop-2.7.3.tar.gz<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ tar -xzf hadoop-2.7.3.tar.gz<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ mv hadoop-2.7.3 hadoop<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ cd hadoop<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ mkdir tmp hdfs<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ mkdir hdfs/data hdfs/name</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （2）配置<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 master 中执行<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">core-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 <configuration> 块儿中添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; font-size:14px; color:rgb(2,30,170)"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>fs.defaultFS</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>hdfs://master:9000</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>hadoop.tmp.dir</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>file:/home/hadoop/tmp</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>io.file.buffer.size</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>131702</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">hdfs-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 <configuration> 块儿中添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>dfs.namenode.name.dir</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>file:/home/hadoop/hdfs/name</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>dfs.datanode.data.dir</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>file:/home/hadoop/hdfs/data</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>dfs.replication</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>2</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>dfs.namenode.secondary.http-address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:9001</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>dfs.webhdfs.enabled</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>true</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">mapred-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 这个文件默认不存在，需要从 mapred-site.xml.template 复制过来<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ cp mapred-site.xml.template mapred-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 <configuration> 块儿中添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>mapreduce.framework.name</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>yarn</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>mapreduce.jobhistory.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:10020</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>mapreduce.jobhistory.webapp.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:19888</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">yarn-site.xml</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 <configuration> 块儿中添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.nodemanager.aux-services</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>mapreduce_shuffle</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>org.apache.hadoop.mapred.ShuffleHandler</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.resourcemanager.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:8032</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.resourcemanager.scheduler.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:8030</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.resourcemanager.resource-tracker.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:8031</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.resourcemanager.admin.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:8033</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <name>yarn.resourcemanager.webapp.address</name><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <value>master:8088</value><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </property><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">slaves</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 删除已有内容，添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">slave1<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> slave2</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 修改 /home/hadoop/etc/hadoop/<span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">hadoop-env.sh</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 找到 export JAVA_HOME=${JAVA_HOME}，改为自己JAVA_HOME的绝对路径<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （3）复制 hadoop 到 slave1,slave2<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在 master 上执行<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ scp -r /home/hadoop slave1:/home<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ scp -r /home/hadoop slave2:/home</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 注意：如果各台服务器中JAVA_HOME位置不同，记得对 hadoop-env.sh 进行相应修改<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> （4）设置 hadoop 环境变量<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在每台服务器上都执行：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)">$ vim ~/.bashrc</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 添加：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">export PATH=$PATH:/home/hadoop/bin:/home/hadoop/sbin</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 保存退出<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170)">$ source ~/.bashrc</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <ul class="list-paddingleft-2" style="margin:0px; padding:0px 0px 0px 30px; max-width:100%; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; list-style-type:square; word-wrap:break-word!important"><li style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">启动 hadoop</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> </li></ul> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 在master启动hadoop，从节点会自动启动<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 初始化<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ hdfs namenode -format</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 启动<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ hadoop-daemon.sh start namenode<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ hadoop-daemon.sh start datanode<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ start-dfs.sh<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ start-yarn.sh<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> $ mr-jobhistory-daemon.sh start historyserver</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 检查<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 查看状态，在3台服务器上分别执行<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ jps</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh940Ek3CtjhoJf9TjV6HKnrjPYvHTzRsSPeBibCooyAQpIZUK6viaXfDrg/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9QSsXv3zicFGmmv3jqluDsBxqHkTXXtia3jAuyKGgoqomgFDnFZ6OY3sQ/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> 浏览器中访问：<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> http://master ip:50070/<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9nLzVEHmjHMUIeWB2gy1kHEPYWUJBGLSScLjibDdQYj1dH09bWXiaO75g/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> http://master ip:8088/<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9GTibvMuPu2qicSmibM7nnDT4VTdlIPibkDrdvsjqT5zrjdOPD5fziab0Ijw/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 可以正常访问的话，可以说明集群启动成功了，但不一定可以正常运行，还需要下面的实际验证<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <h3 style="margin:0px 0px 10px; padding:0px 0px 9px; font-weight:500; font-size:22px; max-width:100%; word-wrap:break-word!important; border-bottom:1px solid rgb(238,238,238); line-height:1.1em"><a name="t3"></a> 测试验证<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </h3> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">（1）hdfs 操作</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 创建目录<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ hdfs dfs -mkdir -p /user/hadoop/input</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 上传文件，把现有的一些配置文件上传到刚刚创建的目录中<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ hdfs dfs -put /home/hadoop/etc/hadoop/kms*.xml /user/hadoop/input</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 如果没有返回错误信息，说明操作成功<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> 访问 http://master ip:50070/，在文件浏览页面查看<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9XxvS4vibp1liaaqaeXo6Iu6P9unqXcwKibXxpdNeZXV65wfgWLLziceApA/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important">（2）mapreduce 操作</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> hadoop 安装包中提供了一个示例程序，我们可以使用它对刚刚上传的文件进行测试<br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(2,30,170); font-size:14px">$ hadoop jar /home/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar grep /user/hadoop/input /user/hadoop/output 'dfs[a-z.]+'</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9gWqbdSvwkmQ350fwkW1SBBgtZeTOAcpBsGibTceoqCcOTvXjHQ2bJzg/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <img src="http://mmbiz.qpic.cn/mmbiz_png/wv3K6j4ibl90Z3owvcb8JfuiafIYG9vIh9cY6VdJGCyicqp0ibDsAydzbmZhxjAiapLYRiaYNHDGTsibvIcVkWJXVt8HQ/640?wx_fmt=png&tp=webp&wxfrom=5&wx_lazy=1" alt="" style="margin:0px; padding:0px; height:auto!important; max-width:100%; word-wrap:break-word!important; width:auto!important; visibility:visible!important"><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> <span style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important; color:rgb(0,0,0)">注：在执行过程中，如果长时间处于 running 状态不动，虽然没有报错，但实际上是出错了，后台在不断重试，需要到 logs 目录下查看日志文件中的错误信息</span><br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> <p style="margin-top:0px; margin-bottom:0px; padding-top:0px; padding-bottom:0px; max-width:100%; clear:both; min-height:1em; white-space:pre-wrap; color:rgb(62,62,62); font-family:"Helvetica Neue",Helvetica,"Hiragino Sans GB","Microsoft YaHei",Arial,sans-serif; font-size:18px; word-wrap:break-word!important"> <br style="margin:0px; padding:0px; max-width:100%; word-wrap:break-word!important"> </p> </div><div data-report-view="{"mod":"1585297308_001","spm":"1001.2101.3001.6548","dest":"https://blog.csdn.net/u011537073/article/details/52679655","extend1":"pc","ab":"new"}"><div></div></div> <div><div><span>声明：</span>本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：<a href="https://www.wpsshop.cn/w/笔触狂放9/article/detail/650958">https://www.wpsshop.cn/w/笔触狂放9/article/detail/650958</a></div></div></div><div class="article_recommend"><div class="list_top">推荐阅读</div><div class="ListItems"><ul class="NewsList"><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="分布式hbase shell时list没有问题，status时出现ROR: org.apache.h" href="/w/知新_RL/article/detail/632756" target="_blank">分布式<em>hbase</em> <em>shell</em>时<em>list</em>没有问题，<em>status</em>时出现ROR: org.<em>apache</em>.h...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="分布式hbase shell时list没有问题，status时出现ROR: org.apache.h" href="/w/知新_RL/article/detail/632756" target="_blank">- 配置zookeeper地址，两个节点都启用zookeeper -->-- 因为我是两个节点，因此我配置了master... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hbase：报错ERROR: ..hadoop.hbase.Server is not runnin" href="/w/不正经/article/detail/632774" target="_blank">Hbase：报错<em>ERROR</em>: ..<em>hadoop</em>.<em>hbase</em>.<em>Server</em> is not runnin...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hbase：报错ERROR: ..hadoop.hbase.Server is not runnin" href="/w/不正经/article/detail/632774" target="_blank"><em>hbase</em>数据块损坏，导致<em>hadoop</em>进入安全模式，<em>hbase</em>不能使用，jar包不能运行的情况，处理办法，<em>ERROR</em>: ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hbase执行list命令报错：ERROR: org.apache.hadoop.hbase.Ple" href="/w/weixin_40725706/article/detail/632783" target="_blank"><em>hbase</em>执行list命令报错：ERROR: org.apache.<em>hadoop</em>.<em>hbase</em>.Ple...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hbase执行list命令报错：ERROR: org.apache.hadoop.hbase.Ple" href="/w/weixin_40725706/article/detail/632783" target="_blank">今天，可能误删了什么文件，导致在Hbase的<em>hbase</em> shell中执行list命令报如下错误：HDFS前端报错：The... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【ERROR: org.apache.hadoop.hbase.PleaseHoldExceptio" href="/w/小小林熬夜学编程/article/detail/632816" target="_blank">【<em>ERROR</em><em>:</em> org.<em>apache</em>.<em>hadoop</em>.<em>hbase</em>.PleaseHoldExceptio...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【ERROR: org.apache.hadoop.hbase.PleaseHoldExceptio" href="/w/小小林熬夜学编程/article/detail/632816" target="_blank">错误原因：按照林子雨的大数据教程搭建好Hbase环境后，我使用创建表和添加一些属性的命令，一开始非常正常，但是当我输入一... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop启动时出现错误：Cannot execute /home/hadoop/libexec/" href="/w/Monodyee/article/detail/632882" target="_blank"><em>Hadoop</em>启动时出现错误：<em>Cannot</em> <em>execute</em> /home/<em>hadoop</em>/libexec/...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop启动时出现错误：Cannot execute /home/hadoop/libexec/" href="/w/Monodyee/article/detail/632882" target="_blank"><em>Hadoop</em>启动时出现错误：<em>Cannot</em> <em>execute</em> /home/<em>hadoop</em>/libexec/<em>hadoop</em>-con... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop安装过2.7版本之后又安装3.0版本出现:ERROR: Cannot execute /" href="/w/不正经/article/detail/632883" target="_blank"><em>hadoop</em>安装过<em>2.7</em><em>版本</em>之后又安装<em>3.0</em><em>版本</em>出现:ERROR: Cannot <em>execute</em> /...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop安装过2.7版本之后又安装3.0版本出现:ERROR: Cannot execute /" href="/w/不正经/article/detail/632883" target="_blank">我以前安装过Hadoop<em>2.7</em><em>版本</em>之后今天需要重新安装<em>3.0</em><em>版本</em>的时候出现上面的问题，并且删除了<em>2.7</em><em>版本</em>还是无法正常安... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="输入hadoop version时，解决Cannot execute /home/hadoop/li" href="/w/不正经/article/detail/632886" target="_blank">输入<em>hadoop</em> version时，解决<em>Cannot</em> <em>execute</em> /<em>home</em>/<em>hadoop</em>/li...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="输入hadoop version时，解决Cannot execute /home/hadoop/li" href="/w/不正经/article/detail/632886" target="_blank">解决<em>Cannot</em> <em>execute</em> /<em>home</em>/<em>hadoop</em>/<em>libexec</em>/<em>hadoop</em>-config.sh.的方法_c... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【解决】ERROR: Cannot execute /export/server/hadoop-3." href="/w/繁依Fanyi0/article/detail/632891" target="_blank">【解决】<em>ERROR</em>: <em>Cannot</em> execute /<em>export</em>/<em>server</em>/<em>hadoop</em>-3....</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【解决】ERROR: Cannot execute /export/server/hadoop-3." href="/w/繁依Fanyi0/article/detail/632891" target="_blank">我试了网上的各种办法，也试了删除data 和 logs 重新格式化的方法，都不行。然后我注意到上面图片中报错的路径中ha... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="ERROR: Cannot execute /opt/module/hadoop‐3.3.1/lib" href="/w/你好赵伟/article/detail/632892" target="_blank"><em>ERROR</em>: Cannot <em>execute</em> /opt/module/<em>hadoop</em>‐3.3.1/lib...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="ERROR: Cannot execute /opt/module/hadoop‐3.3.1/lib" href="/w/你好赵伟/article/detail/632892" target="_blank">Hadoop格式化<em>hdfs</em>失败：我的问题是没有取消Hadoop全局变量。需要在配置Hadoop环境变量下面添加 unse... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="如何解决Cannot execute /home/hadoop/hadoop/libexec/had" href="/w/AllinToyou/article/detail/632897" target="_blank">如何解决<em>Cannot</em> <em>execute</em> /<em>home</em>/<em>hadoop</em>/<em>hadoop</em>/libexec/had...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="如何解决Cannot execute /home/hadoop/hadoop/libexec/had" href="/w/AllinToyou/article/detail/632897" target="_blank">解决方法：在/etc/profile中找到了这个HADOOP_HOME全局变量，将其删除运行source /etc/pr... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="运行有关hadoop的命令出错_cannot execute hadoop-config.sh" href="/w/花生_TL007/article/detail/632898" target="_blank">运行有关<em>hadoop</em>的命令出错<em>_</em><em>cannot</em> <em>execute</em> <em>hadoop</em>-<em>config</em>.<em>sh</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="运行有关hadoop的命令出错_cannot execute hadoop-config.sh" href="/w/花生_TL007/article/detail/632898" target="_blank">ERROR: Cannot <em>execute</em> /root/software/<em>hadoop</em>-3.2.0/bin/libexe... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="如何解决Cannot execute /home/hadoop/hadoop2.8/libexec/" href="/w/盐析白兔/article/detail/632910" target="_blank">如何解决<em>Cannot</em> <em>execute</em> /<em>home</em>/<em>hadoop</em>/<em>hadoop</em>2.8/<em>libexec</em>/...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="如何解决Cannot execute /home/hadoop/hadoop2.8/libexec/" href="/w/盐析白兔/article/detail/632910" target="_blank">刚刚在centos用./<em>hadoop</em> version遇到了一个错误：<em>Cannot</em> <em>execute</em> /<em>home</em>/hadoo... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop问题小结_org.apache.hadoop.hdfs.blockmissingexce" href="/w/Gausst松鼠会/article/detail/632919" target="_blank"><em>hadoop</em>问题小结_<em>org</em>.<em>apache</em>.<em>hadoop</em>.<em>hdfs</em>.blockmissingexce...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop问题小结_org.apache.hadoop.hdfs.blockmissingexce" href="/w/Gausst松鼠会/article/detail/632919" target="_blank">20211229path does not exist <em>hdfs</em>://k8s04:9001/usr/root/xxx.c... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop安装过2.8版本之后又安装3.1版本出现:ERROR:Cannot execute /o" href="/w/繁依Fanyi0/article/detail/632924" target="_blank"><em>hadoop</em>安装过<em>2.8</em><em>版本</em>之后又安装<em><em>3</em>.1</em><em>版本</em>出现:<em>ERROR</em>:<em>Cannot</em> execute /o...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop安装过2.8版本之后又安装3.1版本出现:ERROR:Cannot execute /o" href="/w/繁依Fanyi0/article/detail/632924" target="_blank">我前段时间安装了Hadoop<em>2.8</em><em>版本</em>之后今天又需重新安装<em><em>3</em>.1</em><em>版本</em>的时候出现上面的问题，并且删除了<em>2.8</em><em>版本</em>还是无法正... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hive启动报错: ..../hadoop: cannot execute binary file_" href="/w/weixin_40725706/article/detail/632927" target="_blank"><em>hive</em>启动报错: ..../<em>hadoop</em>: <em>cannot</em> <em>execute</em> binary file_...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hive启动报错: ..../hadoop: cannot execute binary file_" href="/w/weixin_40725706/article/detail/632927" target="_blank"><em>hive</em>可以在集群的另外2台机器上启动,但是在这台上却启动不了环境变量问题?后面发现不是,在其它目录或者<em>hadoop</em>di... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="dolphinscheduler配置hadoop后执行脚本报错ERROR:Cannot execut" href="/w/花生_TL007/article/detail/632929" target="_blank"><em>dolphinscheduler</em>配置<em>hadoop</em>后执行脚本报错ERROR:Cannot execut...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="dolphinscheduler配置hadoop后执行脚本报错ERROR:Cannot execut" href="/w/花生_TL007/article/detail/632929" target="_blank">问题描述：根据文档正常配置完<em>dolphinscheduler</em>后启动执行<em>sh</em>ell命令，而<em>sh</em>ell命令为sqoop脚本抽... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="工良出品：包教会，Hadoop、Hive 搭建部署简易教程" href="/w/Monodyee/article/detail/633571" target="_blank">工良出品<em>：</em>包教会，<em>Hadoop</em><em>、</em><em>Hive</em> <em>搭建</em><em>部署</em>简易教程...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="工良出品：包教会，Hadoop、Hive 搭建部署简易教程" href="/w/Monodyee/article/detail/633571" target="_blank">目录导读<em>Hadoop</em><em>、</em><em>Hive</em> 是什么运行环境hive-env.shhive-site.xmlcore-site.xml... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="计算机毕业设计PySpark+Hadoop+Hive机票航班数据分析可视化大屏机票预测航班预测系" href="/w/知新_RL/article/detail/633584" target="_blank">计算机<em>毕业设计</em><em>PySpark</em>+<em>Hadoop</em>+Hive机票航班<em>数据</em>分析可视化大屏机票预测航班预测系...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="计算机毕业设计PySpark+Hadoop+Hive机票航班数据分析可视化大屏机票预测航班预测系" href="/w/知新_RL/article/detail/633584" target="_blank">计算机<em>毕业设计</em><em>PySpark</em>+<em>Hadoop</em>+Hive机票航班<em>数据</em>分析可视化大屏机票预测航班预测<em>系统</em> 机票爬虫飞机票... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop-Apache Hadoop大数据解决方案的整体介绍_hadoop 方案" href="/w/盐析白兔/article/detail/633782" target="_blank"><em>Hadoop</em>-<em>Apache</em> <em>Hadoop</em>大<em>数据</em><em>解决<em>方案</em></em>的整体介绍_<em>hadoop</em> <em>方案</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop-Apache Hadoop大数据解决方案的整体介绍_hadoop 方案" href="/w/盐析白兔/article/detail/633782" target="_blank">概述<em>Hadoop</em>_<em>hadoop</em> <em>方案</em><em>hadoop</em> <em>方案</em> 一大数... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank"><em>HADOOP</em>之配置HDFS集群，修改四个文件<em>workers</em>,<em>hadoop</em>-env.sh,<em>core</em>-s...</a></div><div class="NewsInfo"><div class="NewsImg"><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank"><img width="120" height="70" alt="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" src="https://img-blog.csdnimg.cn/img_convert/7ca4c3d494b24fe7ba2ff49f118797b4.png?x-oss-process=image/resize,m_fixed,h_300,image/format,png"></a></div><div class="NewsDesc" style=""><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank">我的jdk，<em>hadoop</em>都在/export/server/目录下。2.配置<em>hadoop</em>-env.sh文件。3.配置cor... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li></ul><div class="list_tools_top">相关标签</div><div class="list_tools_box"><ul><li><a title="分布式" rel="nofollow" href="/s?w=分布式" target="_self">分布式</a></li><li><a title="hbase" rel="nofollow" href="/s?w=hbase" target="_self">hbase</a></li><li><a title="hadoop" rel="nofollow" href="/s?w=hadoop" target="_self">hadoop</a></li><li><a title="list" rel="nofollow" href="/s?w=list" target="_self">list</a></li><li><a title="大数据" rel="nofollow" href="/s?w=大数据" target="_self">大数据</a></li><li><a title="apache" rel="nofollow" href="/s?w=apache" target="_self">apache</a></li><li><a title="hdfs" rel="nofollow" href="/s?w=hdfs" target="_self">hdfs</a></li><li><a title="linux" rel="nofollow" href="/s?w=linux" target="_self">linux</a></li><li><a title="big data" rel="nofollow" href="/s?w=big data" target="_self">big data</a></li><div style="clear: both;"></div></ul></div><div class="list_tools_top"></div></div></div></div><style type="text/css"></style><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/phone.css?v=17352890" type="text/css"><script type="text/javascript"></script></div></div></div></div></div></div><style type="text/css"> /* footer css */ .index006-cover-page-foot { background-color: #F7F7F7; } </style><div class="cppui-row-1_100 cppui-row-view-1 row_1_100 ui-draggable" style="display: block;"><div class="cppui-column-1_100-0-1 column-view-com cppui-column-1_100-0-view-1 ui-sortable"><div class="drag-item-show-view-1 footermsg_view_pic ui-draggable" style="display: block;"><div class="index006-cover-page-foot drag-item-hide-view-1"><p class="copyright">Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。 </p><div style="background-color:#F7F7F7; text-align:center; height:20px;padding-top:5px;"><a target="_blank" href="#" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdnimages.wpsshop.cn/57public/skin/index/default/ui/images/beian_ghs.png" style="float:left;"> <p style="float:left;height:20px;line-height:20px;margin: 0px 0px 0px 5px; color:#939393;">闽ICP备14008679号</p></a> <a href="https://www.wpsshop.cn/xml/w/%E7%AC%94%E8%A7%A6%E7%8B%82%E6%94%BE9/article/detail/650958.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/xml/w/g007/article/detail/new.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/site.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a></div></div></div></div></div><script type="text/javascript">var domain = document.domain;var hr=encodeURIComponent(window.location.href+'=='+document.referrer); document.write('<script src="https://ad.wpsshop.cn/admin.appflux?s=ad_flu_ind&fluxuserauto=yes&hr='+hr+'&p57weburl='+domain+'&p57usercode1='+domain+'&u=Vy1RJQhqAXUEMQNnAm0HaVVu&i='+p57ref("id")+'&r='+escape(document.referrer)+'" language="JavaScript"><\/script>');function p57ref(id){var reg=new RegExp("(^|&)"+id+"=([^&]*)(&|$)");var ref=window.location.search.substr(1).match(reg);if(ref!=null)return unescape(ref[2]);return null;} </script></body></html>