【大数据实验】HDFS的应用：数字排序_hdfs dfs 排序 - wpsshop博客

查看

编辑修改

首页
UNITY
NODEJS
PYTHON
AI
GIT
PHP
GO
CEF3
JAVA
HTML
CSS

羊村懒王

这个屌丝很懒，什么也没留下！

热门标签

jquery
HTML
CSS
PHP
ASP
PYTHON
GO
AI
C
C++
C#
PHOTOSHOP
UNITY
iOS
android
vue
xml
爬虫
SEO
LINUX
WINDOWS
JAVA
MFC
CEF3
CAD
NODEJS
GIT
Pyppeteer
article

热门文章

1手把手系列！使用 Zilliz Cloud 和 AWS Bedrock 搭建 RAG 应用
2kafka-消费者组-点对点测试
3华为OD机试 - 生成哈夫曼树（Java & JS & Python & C & C++）_生成哈夫曼树华为od
4计算机专业近几年的参考文献,近几年计算机专业发参考文献计算机专业发专著类参考文献哪里找...
5人工智能轨道交通行业周刊-第29期（2023.1.2-1.8）_昆明南站小红车机器人
6清览云题库--数据可视化
7消息队列:RabbitMQ_消息队列rabbitmq
8小华最多能得到多少克黄金【华为OD机试】(JAVA&Python&C++&JS题解)_小华按照地图去寻宝
9Makefile入门_makefile学习
10html标签“”中文本对齐实现，让人蛋疼的知识_html textarea跟前两行数据对齐</a></li></ul></div></div></div><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_detail.css?v=890" type="text/css"><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_clk.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/blog/js/mid_.js?v=890"></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/study/js/j/vs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/study/js/j/highlight.pack.js?v=890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/index_contenthljs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/detail01tj.js?v=531890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/wpsshopindex/css/mid_detail_last.css?v=3890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/mid_detail_last.js?v=33890"></script><style type="text/css"></style><script type="text/javascript"></script><div class="interactive_info" id="body-data-0098" attrv="50778"></div><div class="article_box" style="overflow: hidden;"><div class="article_channel"><div class="channel_top_line"><div class="cn_t_l"></div><div class="cn_t_r"></div></div><div class="article_channel_info">当前位置: <a href="/article/list/1">article</a> > 正文 </div></div><div class="article_title"><h1>【大数据实验】HDFS的应用：数字排序_hdfs dfs 排序</h1></div><div class="article_info"><div class="article_c_info"> 作者：羊村懒王 | 2024-05-31 06:17:15</div><div class="article_click" style="width: 140px;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div class="article_intro">hdfs dfs 排序</div><div class="article_content article_contentheight"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/kdoc_html_views-1a98987dfd.css"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/ck_htmledit_views-044f2cf1dc.css"> <div id="content_views" class="htmledit_views"> <p id="main-toc"><strong>目录</strong></p> <p id="-toc" style="margin: 0px;"></p> <p id="" style="margin: 0px 0px 2px; padding-left: 24px;"><a href="#t0" rel="nofollow" title="实验内容" target="_self">实验内容</a></p> <p id="" style="margin: 0px 0px 2px; padding-left: 24px;"><a href="#t1" rel="nofollow" title="实验步骤 " target="_self">实验步骤 </a></p> <p id="" style="margin: 0px 0px 2px; padding-left: 24px;"><a href="#t2" rel="nofollow" title="实验源码 " target="_self">实验源码 </a></p> <p id="" style="margin: 0px 0px 2px; padding-left: 24px;"><a href="#t3" rel="nofollow" title="实验结果" target="_self">实验结果</a></p> <p id="" style="margin: 0px 0px 2px; padding-left: 24px;"><a href="#t4" rel="nofollow" title="实验报告" target="_self">实验报告</a></p> <hr id="hr-toc"> <h2 id="%E5%AE%9E%E9%AA%8C%E5%86%85%E5%AE%B9"><a name="t0"></a>实验内容</h2> <p>熟悉<a href="https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hadoop\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hadoop&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hadoop\"}"}" data-tit="hadoop" data-pretit="hadoop">hadoop</a>文件命令，熟悉在Linux编写、编译、运行Java程序的过程，实现文件的读写操作，读出数据并排序。</p> <h2 id="%E5%AE%9E%E9%AA%8C%E6%AD%A5%E9%AA%A4%C2%A0"><a name="t1"></a>实验步骤 </h2> <blockquote> <p>启动hadoop<br> cd /usr/local/hadoop<br> ./sbin/start-<a href="https://so.csdn.net/so/search?q=dfs&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=dfs&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"dfs\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=dfs&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"dfs\"}"}" data-tit="dfs" data-pretit="dfs">dfs</a>.sh</p> <p>判断hadoop是否启动成功，成功会有显示<br> jps</p> <p>查看jar包</p> <p>cd /usr/local/hadoop/myapp<br> ls </p> <p>上传文件test1.txt 和test2.txt将其存放在input中，test1.txt test2.txt存放需要排序的无序数字。<br> ./bin/<a href="https://so.csdn.net/so/search?q=hdfs&spm=1001.2101.3001.7020" target="_blank" class="hl hl-1" data-report-view="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hdfs&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hdfs\"}"}" data-report-click="{"spm":"1001.2101.3001.7020","dest":"https://so.csdn.net/so/search?q=hdfs&spm=1001.2101.3001.7020","extra":"{\"searchword\":\"hdfs\"}"}" data-tit="hdfs" data-pretit="hdfs">hdfs</a> dfs -put /home/hadoop/test3.txt input</p> <p>查看hadoop目录查看input文件夹下的内容看test1.txt test2.txt是否成功上传<br> ./bin/hdfs dfs -ls<br> ./bin/hdfs dfs -ls input</p> <p>删除output文件夹，不删除会报错<br> ./bin/hdfs dfs -rm -r output./</p> <p>运行实验2程序<br> ./bin/hadoop jar ./myapp/shiyan2.jar <br> 显示运行结果<br> ./bin/hdfs dfs -cat test3.txt</p> <p>关闭hadoop<br> ./sbin/stop-dfs.sh</p> </blockquote> <h2 id="%E5%AE%9E%E9%AA%8C%E6%BA%90%E7%A0%81%C2%A0"><a name="t2"></a>实验源码 </h2> <pre data-index="0" class="set-code-hide" name="code"><code class="language-java hljs"><ol class="hljs-ln" style="width:721px"><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="1"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">package</span> shiyan;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="2"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="3"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> java.io.*;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="4"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> java.nio.charset.StandardCharsets;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="5"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> java.util.*;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="6"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="7"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> org.apache.hadoop.conf.Configuration;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="8"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> org.apache.hadoop.fs.FileSystem;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="9"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> org.apache.hadoop.fs.Path;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="10"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> org.apache.hadoop.fs.FSDataInputStream;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="11"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> org.apache.hadoop.fs.FSDataOutputStream;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="12"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="13"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">import</span> <span class="hljs-keyword">static</span> java.lang.Integer.*;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="14"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="15"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"><span class="hljs-keyword">public</span> <span class="hljs-keyword">class</span> <span class="hljs-title class_">shiyan2</span> {</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="16"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">public</span> <span class="hljs-keyword">static</span> <span class="hljs-keyword">void</span> <span class="hljs-title function_">main</span><span class="hljs-params">(String[] args)</span>{</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="17"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">try</span>{</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="18"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> ArrayList<Integer> a = <span class="hljs-keyword">new</span> <span class="hljs-title class_">ArrayList</span><Integer>();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="19"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> ArrayList<Integer> b = <span class="hljs-keyword">new</span> <span class="hljs-title class_">ArrayList</span><Integer>();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="20"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="21"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">Configuration</span> <span class="hljs-variable">conf</span> <span class="hljs-operator">=</span> <span class="hljs-keyword">new</span> <span class="hljs-title class_">Configuration</span>();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="22"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> conf.set(<span class="hljs-string">"fs.defaultFS"</span>,<span class="hljs-string">"hdfs://localhost:9000"</span>);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="23"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> conf.set(<span class="hljs-string">"fs.hdfs.impl"</span>,<span class="hljs-string">"org.apache.hadoop.hdfs.DistributedFileSystem"</span>);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="24"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">FileSystem</span> <span class="hljs-variable">fs</span> <span class="hljs-operator">=</span> FileSystem.get(conf);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="25"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">Path</span> <span class="hljs-variable">file</span> <span class="hljs-operator">=</span> <span class="hljs-keyword">new</span> <span class="hljs-title class_">Path</span>(<span class="hljs-string">"test1.txt"</span>);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="26"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">FSDataInputStream</span> <span class="hljs-variable">getit</span> <span class="hljs-operator">=</span> fs.open(file);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="27"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">BufferedReader</span> <span class="hljs-variable">d</span> <span class="hljs-operator">=</span> <span class="hljs-keyword">new</span> <span class="hljs-title class_">BufferedReader</span>(<span class="hljs-keyword">new</span> <span class="hljs-title class_">InputStreamReader</span>(getit));</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="28"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="29"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">Path</span> <span class="hljs-variable">file1</span> <span class="hljs-operator">=</span> <span class="hljs-keyword">new</span> <span class="hljs-title class_">Path</span>(<span class="hljs-string">"test2.txt"</span>);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="30"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">FSDataInputStream</span> <span class="hljs-variable">getit1</span> <span class="hljs-operator">=</span> fs.open(file1);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="31"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">BufferedReader</span> <span class="hljs-variable">d1</span> <span class="hljs-operator">=</span> <span class="hljs-keyword">new</span> <span class="hljs-title class_">BufferedReader</span>(<span class="hljs-keyword">new</span> <span class="hljs-title class_">InputStreamReader</span>(getit1));</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="32"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> String str;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="33"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">while</span>((str = d.readLine())!= <span class="hljs-literal">null</span>)</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="34"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> {</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="35"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> a.add(Integer.valueOf(str));</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="36"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="37"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">while</span>((str = d1.readLine())!= <span class="hljs-literal">null</span>)</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="38"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> {</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="39"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> a.add(Integer.valueOf(str));</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="40"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="41"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> d.close();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="42"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> d1.close();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="43"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> a.sort(Comparator.naturalOrder());</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="44"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">for</span> (<span class="hljs-type">int</span> i : a){</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="45"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> System.out.println(i);</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="46"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="47"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="48"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> </div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="49"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">String</span> <span class="hljs-variable">filename</span> <span class="hljs-operator">=</span> <span class="hljs-string">"test3.txt"</span>;</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="50"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-type">FSDataOutputStream</span> <span class="hljs-variable">os</span> <span class="hljs-operator">=</span> fs.create(<span class="hljs-keyword">new</span> <span class="hljs-title class_">Path</span>(filename));</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="51"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> <span class="hljs-keyword">for</span>(Integer i :a){</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="52"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> os.write(i.toString().getBytes());</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="53"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> os.write(<span class="hljs-string">"\r\n"</span>.getBytes());</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="54"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="55"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> os.close();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="56"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> fs.close();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="57"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }<span class="hljs-keyword">catch</span> (Exception e){</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="58"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> e.printStackTrace();</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="59"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="60"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line"> }</div></div></li><li><div class="hljs-ln-numbers"><div class="hljs-ln-line hljs-ln-n" data-line-number="61"></div></div><div class="hljs-ln-code"><div class="hljs-ln-line">}</div></div></li></ol></code><div class="hide-preCode-box"><span class="hide-preCode-bt" data-report-view="{"spm":"1001.2101.3001.7365"}"><img class="look-more-preCode contentImg-no-view" src="https://csdnimg.cn/release/blogv2/dist/pc/img/newCodeMoreWhite.png" alt="" title=""></span></div><div class="hljs-button signin active" data-title="登录复制" data-report-click="{"spm":"1001.2101.3001.4334"}" onclick="hljs.signin(event)"></div></pre> <h2 id="%E5%AE%9E%E9%AA%8C%E7%BB%93%E6%9E%9C"><a name="t3"></a>实验结果</h2> <p><img alt="" height="720" src="https://img-blog.csdnimg.cn/4c782bc3a38c4c1198e840bdd3b84d84.png?x-oss-process=image/watermark,type_d3F5LXplbmhlaQ,shadow_50,text_Q1NETiBA5LqM55Cz54ix5ZCD6IKJ,size_20,color_FFFFFF,t_70,g_se,x_16" width="692"></p> <h2 id="%E5%AE%9E%E9%AA%8C%E6%8A%A5%E5%91%8A"><a name="t4"></a>实验报告</h2> <p><a href="https://download.csdn.net/download/weixin_45906196/60955081" title="《大数据导论》HDFS的应用.docx-Hadoop文档类资源-CSDN下载">《大数据导论》HDFS的应用.docx-Hadoop文档类资源-CSDN下载</a></p> </div><div data-report-view="{"mod":"1585297308_001","spm":"1001.2101.3001.6548","dest":"https://blog.csdn.net/weixin_45906196/article/details/121873532","extend1":"pc","ab":"new"}"><div></div></div> <div><div><span>声明：</span>本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：<a href="https://www.wpsshop.cn/w/羊村懒王/article/detail/650778">https://www.wpsshop.cn/w/羊村懒王/article/detail/650778</a></div></div></div><div class="article_recommend"><div class="list_top">推荐阅读</div><div class="ListItems"><ul class="NewsList"><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="HDFS 组织架构" href="/w/Cpp五条/article/detail/630842" target="_blank"><em>HDFS</em> 组织<em>架构</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="HDFS 组织架构" href="/w/Cpp五条/article/detail/630842" target="_blank">随着数据量越来越多，一个系统存储不下所有的数据，那么就需要分配到多个操作系统的磁盘中进行存储，但是不方便管理和维护，迫切... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hdfs fsck命令检查文件系统健康状态、处理missing blocks问题、hdfs fsck" href="/w/weixin_40725706/article/detail/632811" target="_blank"><em>hdfs</em> <em>fsck</em>命令检查文件系统健康状态、处理<em>missing</em> <em>block</em>s问题、<em>hdfs</em> <em>fsck</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hdfs fsck命令检查文件系统健康状态、处理missing blocks问题、hdfs fsck" href="/w/weixin_40725706/article/detail/632811" target="_blank"> <em>hadoop</em>集群由于磁盘损坏、节点挂机、机架掉电难免造成一些文件块损坏，通过命令，如，出现报错命令：参数含义：2. ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hdfs missing blocks. The following files may be c" href="/w/weixin_40725706/article/detail/632812" target="_blank"><em>hdfs</em> <em>missing</em> <em>blocks</em>. The <em>following</em> <em>files</em> may be c...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hdfs missing blocks. The following files may be c" href="/w/weixin_40725706/article/detail/632812" target="_blank">https://www.cnblogs.com/itboys/p/9596441.htmlThere are 2 mis... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="ERROR: Cannot execute /opt/module/hadoop‐3.3.1/lib" href="/w/你好赵伟/article/detail/632892" target="_blank"><em>ERROR</em>: Cannot <em>execute</em> /opt/module/<em>hadoop</em>‐3.3.1/lib...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="ERROR: Cannot execute /opt/module/hadoop‐3.3.1/lib" href="/w/你好赵伟/article/detail/632892" target="_blank">Hadoop格式化<em>hdfs</em>失败：我的问题是没有取消Hadoop全局变量。需要在配置Hadoop环境变量下面添加 unse... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop问题小结_org.apache.hadoop.hdfs.blockmissingexce" href="/w/Gausst松鼠会/article/detail/632919" target="_blank"><em>hadoop</em>问题小结_<em>org</em>.<em>apache</em>.<em>hadoop</em>.<em>hdfs</em>.blockmissingexce...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop问题小结_org.apache.hadoop.hdfs.blockmissingexce" href="/w/Gausst松鼠会/article/detail/632919" target="_blank">20211229path does not exist <em>hdfs</em>://k8s04:9001/usr/root/xxx.c... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="dolphinscheduler配置hadoop后执行脚本报错ERROR:Cannot execut" href="/w/花生_TL007/article/detail/632929" target="_blank"><em>dolphinscheduler</em>配置<em>hadoop</em>后执行脚本报错ERROR:Cannot execut...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="dolphinscheduler配置hadoop后执行脚本报错ERROR:Cannot execut" href="/w/花生_TL007/article/detail/632929" target="_blank">问题描述：根据文档正常配置完<em>dolphinscheduler</em>后启动执行<em>sh</em>ell命令，而<em>sh</em>ell命令为sqoop脚本抽... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="大数据Hadoop原理介绍+安装+实战操作（HDFS+YARN+MapReduce）_hadoop " href="/w/盐析白兔/article/detail/633787" target="_blank">大<em>数据</em><em>Hadoop</em>原理介绍+安装+实战操作（<em>HDFS</em>+<em>YARN</em>+<em>MapReduce</em>）_<em>hadoop</em> ...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="大数据Hadoop原理介绍+安装+实战操作（HDFS+YARN+MapReduce）_hadoop " href="/w/盐析白兔/article/detail/633787" target="_blank">文章目录一、概述<em>HDFS</em>的设计特点二、<em>HDFS</em>组成1）Client2）NameNode（NN）3）DataNode（DN... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank"><em>HADOOP</em>之配置HDFS集群，修改四个文件<em>workers</em>,<em>hadoop</em>-env.sh,<em>core</em>-s...</a></div><div class="NewsInfo"><div class="NewsImg"><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank"><img width="120" height="70" alt="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" src="https://img-blog.csdnimg.cn/img_convert/7ca4c3d494b24fe7ba2ff49f118797b4.png?x-oss-process=image/resize,m_fixed,h_300,image/format,png"></a></div><div class="NewsDesc" style=""><a title="HADOOP之配置HDFS集群，修改四个文件workers,hadoop-env.sh,core-s" href="/w/小蓝xlanll/article/detail/633832" target="_blank">我的jdk，<em>hadoop</em>都在/export/server/目录下。2.配置<em>hadoop</em>-env.sh文件。3.配置cor... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop配置文件详解系列（二）-hdfs-site.xml篇" href="/w/IT小白/article/detail/633909" target="_blank"><em>hadoop</em><em>配置文件</em>详解系列（二）-<em>hdfs</em>-<em>site</em>.<em>xml</em>篇...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop配置文件详解系列（二）-hdfs-site.xml篇" href="/w/IT小白/article/detail/633909" target="_blank">上一篇介绍了core-<em>site</em>.<em>xml</em>的配置，本篇继续介绍<em>hdfs</em>-<em>site</em>.<em>xml</em>的配置。属性名称属性值描述... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop学习-集群配置文件core-site.xml、hdfs-site.xml、yarn-si" href="/w/不正经/article/detail/633912" target="_blank">Hadoop学习-集群<em>配置文件</em><em>core</em>-<em>site</em>.<em>xml</em>、<em>hdfs</em>-<em>site</em>.<em>xml</em>、<em>yarn</em>-si...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop学习-集群配置文件core-site.xml、hdfs-site.xml、yarn-si" href="/w/不正经/article/detail/633912" target="_blank">集群<em>配置文件</em>，hadoop_将目录内的<em>core</em>-<em>site</em>.<em>xml</em>、<em>hdfs</em>-<em>site</em>.<em>xml</em>、<em>mapred</em>-<em>site</em>.x... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="生产调优3 HDFS-多目录配置_修改hdfs-site.xml" href="/w/繁依Fanyi0/article/detail/633915" target="_blank">生产调优3 <em>HDFS</em>-多<em>目录</em><em>配置</em>_<em>修改</em><em>hdfs</em>-<em>site</em>.<em>xml</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="生产调优3 HDFS-多目录配置_修改hdfs-site.xml" href="/w/繁依Fanyi0/article/detail/633915" target="_blank">文章<em>目录</em><em>HDFS</em>-多<em>目录</em><em>配置</em>NameNode多<em>目录</em><em>配置</em>1.<em>修改</em><em>hdfs</em>-<em>site</em>.<em>xml</em>2.格式化NameNodeDat... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="大数据搭建平台Hadoop完全分布式安装配置_vim hdfs-site.xml" href="/w/Gausst松鼠会/article/detail/633942" target="_blank">大数据搭建平台<em>Hadoop</em>完全分布式安装配置_<em>vim</em> <em>hdfs</em>-<em>site</em>.<em>xml</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="大数据搭建平台Hadoop完全分布式安装配置_vim hdfs-site.xml" href="/w/Gausst松鼠会/article/detail/633942" target="_blank">大数据搭建平台免登录设置复制文件转移到另一个服务器操作解压到指定文件夹环境变量配置和拷贝到另外两台Centos电脑上Ha... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【Hadoop】hdfs-site.xml配置文件参数说明" href="/w/你好赵伟/article/detail/633943" target="_blank">【<em>Hadoop</em>】<em>hdfs</em>-<em>site</em>.<em>xml</em><em>配置文件</em>参数说明...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【Hadoop】hdfs-site.xml配置文件参数说明" href="/w/你好赵伟/article/detail/633943" target="_blank">-- 当全部DN被标记为脏DN的比率高于此阀值，停止不写数据到脏DN的策略，以免造成热点问题（有效的，可写的DN太少，压... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="大数据个人笔记——Zookeeper、Hadoop、flume、hive、sqoop、hbase、k" href="/w/weixin_40725706/article/detail/634230" target="_blank">大数据个人笔记——<em>Zookeeper</em>、Hadoop、<em>flume</em>、<em>hive</em>、<em>sqoop</em>、hbase、k...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="大数据个人笔记——Zookeeper、Hadoop、flume、hive、sqoop、hbase、k" href="/w/weixin_40725706/article/detail/634230" target="_blank">大数据笔记<em>Zookeeper</em>的安装及使用安装步骤如下：[root@localhost ~]# cd /home/soft... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="(防坑笔记)hadoop3.0 (一) 环境部署与伪分布式(hdfs)" href="/w/我家自动化/article/detail/634280" target="_blank">(<em>防坑</em>笔记)<em>hadoop3.0</em> (<em>一</em>) <em>环境</em>部署与伪<em>分布式</em>(<em>hdfs</em>)...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="(防坑笔记)hadoop3.0 (一) 环境部署与伪分布式(hdfs)" href="/w/我家自动化/article/detail/634280" target="_blank"><em>防坑</em>留名：为了避免以后自己遇到什么坑爹的东西，先留脚印给自己。这个hadoop呢，主要是可以让用户可以在不了解<em>分布式</em>底层... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop基础篇-hdfs-01_头歌分布式文件系统hdfs第一关" href="/w/从前慢现在也慢/article/detail/634294" target="_blank"><em>Hadoop</em>基础篇-<em>hdfs</em>-<em>01</em>_头歌<em>分布式文件系统</em><em>hdfs</em><em>第一关</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop基础篇-hdfs-01_头歌分布式文件系统hdfs第一关" href="/w/从前慢现在也慢/article/detail/634294" target="_blank">大数据处理的两个重要指标吞入量单位时间处理数据的数量延迟处理数据的速度，延迟越高说明处理的越慢大数据处理瓶颈问题IO瓶颈... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="HDFS Java API 基本操作实验_头歌hdfs 的基本操作和 java api 操作" href="/w/小蓝xlanll/article/detail/634310" target="_blank"><em>HDFS</em> <em>Java</em> API 基本<em>操作</em>实验_头歌<em>hdfs</em> 的基本<em>操作</em>和 <em>java</em> api <em>操作</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="HDFS Java API 基本操作实验_头歌hdfs 的基本操作和 java api 操作" href="/w/小蓝xlanll/article/detail/634310" target="_blank">本实验已经搭建好了Hadoop HA的完全分布式集群。_头歌<em>hdfs</em> 的基本<em>操作</em>和 <em>java</em> api <em>操作</em>头歌<em>hdfs</em> ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【HDFS】Hadoop分布式文件系统_hadoop ugi" href="/w/凡人多烦事01/article/detail/634349" target="_blank">【<em>HDFS</em>】<em>Hadoop</em><em>分布式文件系统</em>_<em>hadoop</em> ugi...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【HDFS】Hadoop分布式文件系统_hadoop ugi" href="/w/凡人多烦事01/article/detail/634349" target="_blank">【<em>HDFS</em>】<em>Hadoop</em><em>分布式文件系统</em>一、总体介绍二、架构1. 名称节点(NameNode)2. 镜像和日志（Image... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="[Hadoop]Apache Hadoop、HDFS" href="/w/Monodyee/article/detail/634357" target="_blank">[<em>Hadoop</em>]<em>Apache</em> <em>Hadoop</em>、<em>HDFS</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="[Hadoop]Apache Hadoop、HDFS" href="/w/Monodyee/article/detail/634357" target="_blank"><em>Apache</em> Hadopp概述<em>Hadoop</em>介绍<em>Hadoop</em>现状<em>Hadoop</em>特性优点Hadopp架构变迁<em>Apache</em> Ha... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hive插入数据后报错 FAILED: Execution Error, return code 2" href="/w/菜鸟追梦旅行/article/detail/634725" target="_blank"><em>hive</em>插入数据后报错 <em>FAILED</em>: <em>Execution</em> <em>Error</em>, return <em>code</em> 2...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hive插入数据后报错 FAILED: Execution Error, return code 2" href="/w/菜鸟追梦旅行/article/detail/634725" target="_blank"><em>hive</em>插入数据后报错 <em>FAILED</em>: <em>Execution</em> <em>Error</em>, return <em>code</em> 2 from org.... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li></ul><div class="list_tools_top">相关标签</div><div class="list_tools_box"><ul><li><a title="hdfs" rel="nofollow" href="/s?w=hdfs" target="_self">hdfs</a></li><li><a title="架构" rel="nofollow" href="/s?w=架构" target="_self">架构</a></li><li><a title="hadoop" rel="nofollow" href="/s?w=hadoop" target="_self">hadoop</a></li><li><a title="java" rel="nofollow" href="/s?w=java" target="_self">java</a></li><li><a title="职场和发展" rel="nofollow" href="/s?w=职场和发展" target="_self">职场和发展</a></li><li><a title="jvm" rel="nofollow" href="/s?w=jvm" target="_self">jvm</a></li><li><a title="面试" rel="nofollow" href="/s?w=面试" target="_self">面试</a></li><li><a title="big data" rel="nofollow" href="/s?w=big data" target="_self">big data</a></li><li><a title="mapreduce" rel="nofollow" href="/s?w=mapreduce" target="_self">mapreduce</a></li><li><a title="大数据" rel="nofollow" href="/s?w=大数据" target="_self">大数据</a></li><li><a title="运维" rel="nofollow" href="/s?w=运维" target="_self">运维</a></li><li><a title="网络" rel="nofollow" href="/s?w=网络" target="_self">网络</a></li><li><a title="Hadoop" rel="nofollow" href="/s?w=Hadoop" target="_self">Hadoop</a></li><div style="clear: both;"></div></ul></div><div class="list_tools_top"></div></div></div></div><style type="text/css"></style><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/phone.css?v=17352890" type="text/css"><script type="text/javascript"></script></div></div></div></div></div></div><style type="text/css"> /* footer css */ .index006-cover-page-foot { background-color: #F7F7F7; } </style><div class="cppui-row-1_100 cppui-row-view-1 row_1_100 ui-draggable" style="display: block;"><div class="cppui-column-1_100-0-1 column-view-com cppui-column-1_100-0-view-1 ui-sortable"><div class="drag-item-show-view-1 footermsg_view_pic ui-draggable" style="display: block;"><div class="index006-cover-page-foot drag-item-hide-view-1"><p class="copyright">Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。 </p><div style="background-color:#F7F7F7; text-align:center; height:20px;padding-top:5px;"><a target="_blank" href="#" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdnimages.wpsshop.cn/57public/skin/index/default/ui/images/beian_ghs.png" style="float:left;"> <p style="float:left;height:20px;line-height:20px;margin: 0px 0px 0px 5px; color:#939393;">闽ICP备14008679号</p></a> <a href="https://www.wpsshop.cn/xml/w/%E7%BE%8A%E6%9D%91%E6%87%92%E7%8E%8B/article/detail/650778.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/xml/w/g007/article/detail/new.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/site.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a></div></div></div></div></div><script type="text/javascript">var domain = document.domain;var hr=encodeURIComponent(window.location.href+'=='+document.referrer); document.write('<script src="https://ad.wpsshop.cn/admin.appflux?s=ad_flu_ind&fluxuserauto=yes&hr='+hr+'&p57weburl='+domain+'&p57usercode1='+domain+'&u=Vy1RJQhqAXUEMQNnAm0HaVVu&i='+p57ref("id")+'&r='+escape(document.referrer)+'" language="JavaScript"><\/script>');function p57ref(id){var reg=new RegExp("(^|&)"+id+"=([^&]*)(&|$)");var ref=window.location.search.substr(1).match(reg);if(ref!=null)return unescape(ref[2]);return null;} </script></body></html>