《淘宝技术这十年》简评_淘宝网拥有全国最大的hadoop分布式计算集群之一

我家自动化

这个屌丝很懒，什么也没留下！

关注作者

热门标签

热门文章

1python 视频处理，提取视频相关帧，读取Excel
2每天工作 1 小时，谷歌程序员“摸鱼”后年入 100 万，其他时间搞副业？_程序员摸鱼
3AirtestIDE使用之提示adb server version(40) dosen‘t match this client(41)； killing..._adb server version (40) doesn't match this client
4SLS 查询新范式：使用 SPL 对日志进行交互式探索_sls 查询模糊
5异步电机矢量控制matlab simulink
6vscode中如何拉取git代码_工具 | 手把手教你在VSCode中使用Git
7自然语言处理实战项目13-基于GRU模型与NER的关键词抽取模型训练全流程_有图片和图片上每个词的位置怎么训练一个抽取模型
8怎么克隆别人在GitHub上的代码到自己的电脑上_github保存别人的代码到自己的账号
9 Python:XPath与lxml类库_<bookstore> <book category="cooking"> <title lang=</a></li><li><b class="black">10</b><a title="2024年大数据最全【ES专题】ElasticSearch集群架构剖析_es集群_es 技术架构" href="/w/我家自动化/article/detail/882612" target="_blank">2024年大数据最全【ES专题】ElasticSearch集群架构剖析_es集群_es 技术架构</a></li></ul></div></div></div><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_detail.css?v=890" type="text/css"><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/mid_clk.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/blog/js/mid_.js?v=890"></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/study/js/j/vs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/study/js/j/highlight.pack.js?v=890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/index_contenthljs.css?v=890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/detail01tj.js?v=531890" ></script><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/wpsshopindex/css/mid_detail_last.css?v=3890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/wpsshopindex/js/mid_detail_last.js?v=33890"></script><style type="text/css"></style><script type="text/javascript"></script><div class="interactive_info" id="body-data-0098" attrv="38367"></div><div class="article_box" style="overflow: hidden;"><div class="article_channel"><div class="channel_top_line"><div class="cn_t_l"></div><div class="cn_t_r"></div></div><div class="article_channel_info">当前位置: <a href="/article/list/1">article</a> > 正文 </div></div><div class="article_title"><h1>《淘宝技术这十年》简评_淘宝网拥有全国最大的hadoop分布式计算集群之一</h1></div><div class="article_info"><div class="article_c_info"> 作者：我家自动化 | 2024-07-17 06:01:25</div><div class="article_click" style="width: 140px;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div class="article_intro">淘宝网拥有全国最大的hadoop分布式计算集群之一</div><div class="article_content article_contentheight"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/kdoc_html_views-1a98987dfd.css"> <link rel="stylesheet" href="https://csdnimg.cn/release/blogv2/dist/mdeditor/css/editerView/ck_htmledit_views-044f2cf1dc.css"> <div id="content_views" class="htmledit_views"> <div> <div style="color: rgb(0, 0, 0); font-family: Tahoma; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;font-size:14px; text-align: left;"> 《 <a target="_blank" href="http://book.douban.com/subject/24335672/" rel="nofollow noopener noreferrer">淘宝技术这十年</a>》，作者： <a target="_blank" href="http://blog.sina.com.cn/calvinzhaoc" rel="nofollow noopener noreferrer">子柳</a>，书的博文味十足，都是一片片小文构成，作为书确实单薄了些，从淘宝在业内的技术地位，确实希望这类书可以把一些关键话题在深度、广度上再多展开些。 </div> <div style="color: rgb(0, 0, 0); font-family: Tahoma; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;font-size:14px;"> 看完后，技术层面的话题留下的印象不深，但几个淘宝技术大牛的访谈到是有一些收获，这些访谈更朴实也更真实，其中的一些思路对我的工作确实有些启发。 </div> <div style="color: rgb(0, 0, 0); font-family: Tahoma; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;font-size:14px;"> <img src="http://img3.douban.com/lpic/s26713863.jpg" alt=""> <br> </div> </div> </div> 本文内容由网友自发贡献，转载请注明出处：<a href="https://www.wpsshop.cn/w/我家自动化/article/detail/838367?site">https://www.wpsshop.cn/w/我家自动化/article/detail/838367?site</a></div><div class="article_recommend"><div class="list_top">推荐阅读</div><div class="ListItems"><ul class="NewsList"><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【Hadoop】四、Hadoop生态综合案例 ——陌陌聊天数据分析_基于hadoop和hive的在线" href="/w/正经夜光杯/article/detail/819726" target="_blank">【<em>Hadoop</em>】四、<em>Hadoop</em>生态综合案例 ——陌陌<em>聊天</em><em><em>数据</em><em>分析</em></em>_基于<em>hadoop</em><em>和</em><em>hive</em>的在线...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【Hadoop】四、Hadoop生态综合案例 ——陌陌聊天数据分析_基于hadoop和hive的在线" href="/w/正经夜光杯/article/detail/819726" target="_blank">背景介绍陌陌作为<em>聊天</em>平台每天都会有大量的用户在线，会出现大量的<em>聊天</em><em>数据</em>，通过对 <em>聊天</em><em>数据</em>的统计<em>分析</em> ，可以更好的对用户构... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="大数据智能综合训练编程题（Spark、RDD、Hadoop）_大数据编程题" href="/w/笔触狂放9/article/detail/819888" target="_blank"><em>大</em><em>数据</em>智能综合训练<em>编程</em><em>题</em>（<em>Spark</em>、<em>RDD</em>、<em>Hadoop</em>）_<em>大</em><em>数据</em><em>编程</em><em>题</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="大数据智能综合训练编程题（Spark、RDD、Hadoop）_大数据编程题" href="/w/笔触狂放9/article/detail/819888" target="_blank"><em>大</em><em>数据</em>智能综合训练<em>编程</em><em>题</em>（<em>Spark</em>、<em>RDD</em>、<em>Hadoop</em>）做<em>题</em>准备环境准备做<em>题</em>前需要安装好spark环境，以及pyth... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【Hadoop】Windows下安装Hadoop（手把手包成功安装）_windows安装hadoop" href="/w/寸_铁/article/detail/822780" target="_blank">【<em>Hadoop</em>】<em>Windows</em>下<em>安装</em><em>Hadoop</em>（<em>手把手</em>包<em>成功</em><em>安装</em>）_<em>windows</em><em>安装</em><em>hadoop</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【Hadoop】Windows下安装Hadoop（手把手包成功安装）_windows安装hadoop" href="/w/寸_铁/article/detail/822780" target="_blank">【实操】<em>Windows</em>下<em>安装</em><em>Hadoop</em>（<em>手把手</em>包<em>成功</em><em>安装</em>）_<em>windows</em><em>安装</em><em>hadoop</em><em>windows</em><em>安装</em>hadoo... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="在windows上安装hadoop以及案例实现_windows hadoop 例子" href="/w/天景科技苑/article/detail/822786" target="_blank">在<em>windows</em>上<em>安装</em><em>hadoop</em><em>以及</em>案例<em>实现</em>_<em>windows</em> <em>hadoop</em> 例子...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="在windows上安装hadoop以及案例实现_windows hadoop 例子" href="/w/天景科技苑/article/detail/822786" target="_blank">配置好后，点击左侧 Project Explorer 中的 MapReduce Location 就能直接查看 HDFS... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop 实战实例_hadoop实例" href="/w/知新_RL/article/detail/824815" target="_blank"><em>Hadoop</em> 实战实例_<em>hadoop</em>实例...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop 实战实例_hadoop实例" href="/w/知新_RL/article/detail/824815" target="_blank"><em>Hadoop</em>是GoogleMapReduce的一个Java实现。MapReduce是一种简化的分布式编程模式，让程序自... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop MapReduce 代码案例与解读_hadoop的mapreduce配置文件代码" href="/w/小桥流水78/article/detail/824821" target="_blank"><em>Hadoop</em> <em>MapReduce</em> <em>代码</em>案例与解读_<em>hadoop</em>的<em>mapreduce</em><em>配置文件</em><em>代码</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop MapReduce 代码案例与解读_hadoop的mapreduce配置文件代码" href="/w/小桥流水78/article/detail/824821" target="_blank">1. Map 和 Reduce 的具体原理就不描述了，这里简单用一个<em>代码</em>的例子做个介绍（Map Reduce的流程）2.... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop MapReduce原理及实例_基于mapreduce大数据并行计算实例分析" href="/w/从前慢现在也慢/article/detail/824827" target="_blank"><em>Hadoop</em> <em>MapReduce</em>原理及<em>实例</em>_基于<em>mapreduce</em>大<em>数据</em><em>并行计算</em><em>实例</em>分析...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop MapReduce原理及实例_基于mapreduce大数据并行计算实例分析" href="/w/从前慢现在也慢/article/detail/824827" target="_blank">转载自：https://blog.csdn.net/bingduanlbd/article/details/519243... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop 第一个实例 workcout" href="/w/正经夜光杯/article/detail/824833" target="_blank"><em>Hadoop</em> 第一个实例 <em>workcout</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop 第一个实例 workcout" href="/w/正经夜光杯/article/detail/824833" target="_blank">在搭建好<em>Hadoop</em> 集群环境后，迫不及待的想实验一下自己搭建的环境到底能不能跑的通，在这里我做一个简单的介绍。这里我用... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop 集群项目（类似百度网盘）_hadoop云盘项目案例" href="/w/你好赵伟/article/detail/824844" target="_blank"><em>Hadoop</em> 集群<em>项目</em>（类似<em>百度网</em><em>盘</em>）_<em>hadoop</em><em>云<em>盘</em></em><em>项目</em>案例...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop 集群项目（类似百度网盘）_hadoop云盘项目案例" href="/w/你好赵伟/article/detail/824844" target="_blank">一个<em>云<em>盘</em></em>存储系统，将文件存入<em>Hadoop</em>中或者将<em>Hadoop</em>中的文件取出到本地。_<em>hadoop</em><em>云<em>盘</em></em><em>项目</em>案例had... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="万字长文 | Hadoop 上云：存算分离架构设计与迁移实践_为满足业务需求提供" href="/w/小桥流水78/article/detail/824851" target="_blank">万字长文 | <em>Hadoop</em> 上云：存算<em>分离</em><em>架构设计</em>与迁移实践_为满足<em>业务</em><em>需求</em><em>提供</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="万字长文 | Hadoop 上云：存算分离架构设计与迁移实践_为满足业务需求提供" href="/w/小桥流水78/article/detail/824851" target="_blank">一面数据原有的技术架构是在线下机房中使用 CDH 构建的大数据集群。自公司成立以来，每年都保持着高速增长，<em>业务</em>的增长带来... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="基于SpringBoot+Hadoop+python的物品租赁系统(带1w+文档)" href="/w/IT小白/article/detail/825639" target="_blank">基于<em>SpringBoot</em>+<em>Hadoop</em>+<em>python</em><em>的</em><em>物品</em><em>租赁</em><em>系统</em>(带1w+文档)...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="基于SpringBoot+Hadoop+python的物品租赁系统(带1w+文档)" href="/w/IT小白/article/detail/825639" target="_blank"><em>物品</em><em>租赁</em><em>系统</em>是电子、信息技术相结合，是一种必然<em>的</em>发展趋势。以互联网为基础，以服务于广大用户为目<em>的</em>，发展整体优势，扩大规模... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop-22 Sqoop 数据MySQL到HDFS(全量) SQL生成数据 HDFS集群 Sq" href="/w/繁依Fanyi0/article/detail/825640" target="_blank"><em>Hadoop</em>-22 <em>Sqoop</em> <em>数据</em>My<em>SQL</em>到<em>HDFS</em>(全量) <em>SQL</em>生成<em>数据</em> <em>HDFS</em>集群 Sq...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop-22 Sqoop 数据MySQL到HDFS(全量) SQL生成数据 HDFS集群 Sq" href="/w/繁依Fanyi0/article/detail/825640" target="_blank">上节完成了<em>Sqoop</em>介绍和环境配置，本节使用<em>Sqoop</em> 从 My<em>SQL</em>将<em>数据</em>导入到 <em>HDFS</em>集群中，通过MapReduc... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop、Hive安装_hadoop3.1.3环境下安装mysql" href="/w/正经夜光杯/article/detail/827956" target="_blank"><em>Hadoop</em>、<em>Hive</em><em>安装</em>_hadoop<em>3</em>.1.<em>3</em>环境下<em>安装</em><em>mysql</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop、Hive安装_hadoop3.1.3环境下安装mysql" href="/w/正经夜光杯/article/detail/827956" target="_blank">hadoop hive<em>安装</em>_hadoop<em>3</em>.1.<em>3</em>环境下<em>安装</em><em>mysql</em>hadoop<em>3</em>.1.<em>3</em>环境下<em>安装</em><em>mysql</em> ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop—haddop部署、yarn管理器使用、hdfs的高可用、yarn的高可用、Hbase分" href="/w/IT小白/article/detail/827976" target="_blank"><em>hadoop</em>—<em>haddop</em><em>部署</em>、<em>yarn</em>管理器使用、<em>hdfs</em>的高可用、<em>yarn</em>的高可用、<em>Hbase</em>分...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop—haddop部署、yarn管理器使用、hdfs的高可用、yarn的高可用、Hbase分" href="/w/IT小白/article/detail/827976" target="_blank">1、<em>hadoop</em>简介_哈道普<em>分布式</em><em>部署</em>安装是什么原理哈道普<em>分布式</em><em>部署</em>安装是什么原理 ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop 集群安装" href="/w/我家小花儿/article/detail/828038" target="_blank"><em>Hadoop</em> 集群<em>安装</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop 集群安装" href="/w/我家小花儿/article/detail/828038" target="_blank"><em>Hadoop</em> 集群<em>安装</em>_hadoop 集群<em>安装</em>hadoop 集群<em>安装</em> ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="【Hadoop】集群安装_hadoop 3.3.0安装" href="/w/笔触狂放9/article/detail/828049" target="_blank">【<em>Hadoop</em>】<em>集群</em><em>安装</em>_<em>hadoop</em> <em>3.3</em>.0<em>安装</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="【Hadoop】集群安装_hadoop 3.3.0安装" href="/w/笔触狂放9/article/detail/828049" target="_blank"><em>Hadoop</em><em>集群</em>搭建这一篇就够了，超详细，手把手教学_<em>hadoop</em> <em>3.3</em>.0<em>安装</em><em>hadoop</em> <em>3.3</em>.0<em>安装</em> ... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop Datanode节点无法启动（All directories in dfs.data." href="/w/爱喝兽奶帝天荒/article/detail/828066" target="_blank">Hadoop Datanode节点无法启动（All <em>dir</em>ectories <em>in</em> <em>dfs</em>.<em>data</em>....</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop Datanode节点无法启动（All directories in dfs.data." href="/w/爱喝兽奶帝天荒/article/detail/828066" target="_blank">Hadoop Datanode节点无法启动（All <em>dir</em>ectories <em>in</em> <em>dfs</em>.<em>data</em>.<em>dir</em> are <em>in</em>... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="集群扩容DataNode报错：Invalid dfs.datanode.data.dir /data" href="/w/IT小白/article/detail/828067" target="_blank">集群扩容<em>DataNode</em>报错：Invalid <em>dfs</em>.<em>data</em>node.<em>data</em>.dir /<em>data</em>...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="集群扩容DataNode报错：Invalid dfs.datanode.data.dir /data" href="/w/IT小白/article/detail/828067" target="_blank">在尝试集群扩容时，新增<em>DataNode</em>数据目录报EPERM错误。问题根源是目录权限不符，正常目录属于'<em>h<em>dfs</em></em>'用户和'... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="hadoop datanode启动失败（All directories in dfs.data.di" href="/w/煮酒与君饮/article/detail/828076" target="_blank"><em>hadoop</em> <em>data</em>node启动失败（All <em>dir</em>ectories in <em>dfs</em>.<em>data</em>.di...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="hadoop datanode启动失败（All directories in dfs.data.di" href="/w/煮酒与君饮/article/detail/828076" target="_blank">由于<em>hadoop</em>节点的磁盘满了，导致节点死掉，今天对其进行扩容。首先，将原节点的数据拷贝到目标节点下，从而避免数据的丢失... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li><li><div class="NewTitle"><a title="article" class="cat" href="/article/list/1" target="_blank">article<i></i></a><a title="Hadoop 启动 HDFS DataNode 时报错：Invalid dfs.datanode.d" href="/w/爱喝兽奶帝天荒/article/detail/828086" target="_blank"><em>Hadoop</em> 启动 HDFS <em>DataNode</em> 时报错：Invalid <em>dfs</em>.<em>data</em>node.d...</a></div><div class="NewsInfo"><div class="NewsDesc" style=""><a title="Hadoop 启动 HDFS DataNode 时报错：Invalid dfs.datanode.d" href="/w/爱喝兽奶帝天荒/article/detail/828086" target="_blank">文章目录环境描述问题现象问题分析解决方案总结环境描述操作系统：CentOS 6.5<em>Hadoop</em>：Apache Hadoo... </a><div class="article_click rice1" style="width: 240px;float: left;"><p class="operation-b-img operation-b-img-active"><i class="img-up txclick" attc="upclick" attn="0"></i><span class="num"> 赞</span></p><p class="operation-b-img operation-b-img-active"><i class="img-down txclick" attc="downclick" attn="0"></i><span class="num">踩</span></p></div></div><div style="clear: both;"></div></div></li></ul><div class="list_tools_top">相关标签</div><div class="list_tools_box"><ul><li><a title="hadoop" rel="nofollow" href="/s?w=hadoop" target="_self">hadoop</a></li><li><a title="数据分析" rel="nofollow" href="/s?w=数据分析" target="_self">数据分析</a></li><li><a title="大数据" rel="nofollow" href="/s?w=大数据" target="_self">大数据</a></li><li><a title="spark" rel="nofollow" href="/s?w=spark" target="_self">spark</a></li><li><a title="python" rel="nofollow" href="/s?w=python" target="_self">python</a></li><li><a title="分布式" rel="nofollow" href="/s?w=分布式" target="_self">分布式</a></li><li><a title="java" rel="nofollow" href="/s?w=java" target="_self">java</a></li><li><a title="mapreduce" rel="nofollow" href="/s?w=mapreduce" target="_self">mapreduce</a></li><li><a title="spring boot" rel="nofollow" href="/s?w=spring boot" target="_self">spring boot</a></li><li><a title="后端" rel="nofollow" href="/s?w=后端" target="_self">后端</a></li><div style="clear: both;"></div></ul></div><div class="list_tools_top"></div></div></div></div><style type="text/css"></style><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/blog/css/phone.css?v=17352890" type="text/css"><script type="text/javascript"></script></div></div></div></div></div></div><style type="text/css"> /* footer css */ .index006-cover-page-foot { background-color: #F7F7F7; } </style><link rel="stylesheet" href="https://cdn.wpsshop.cn/public/ads/css/ads.css?v=12890" type="text/css"><script type="text/javascript" src="https://cdn.wpsshop.cn/public/ads/js/ads.js?v=1890" ></script><div class="cppui-row-1_100 cppui-row-view-1 row_1_100 ui-draggable" style="display: block;"><div class="cppui-column-1_100-0-1 column-view-com cppui-column-1_100-0-view-1 ui-sortable"><div class="drag-item-show-view-1 footermsg_view_pic ui-draggable" style="display: block;"><div class="index006-cover-page-foot drag-item-hide-view-1"><p class="copyright">Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。 </p><div style="background-color:#F7F7F7; text-align:center; height:20px;padding-top:5px;"><a target="_blank" href="https://beian.mps.gov.cn/#/query/webSearch" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdnimages.wpsshop.cn/57public/skin/index/default/ui/images/beian_ghs.png" style="float:left;"> <p style="float:left;height:20px;line-height:20px;margin: 0px 0px 0px 5px; color:#939393;">闽ICP备14008679号</p></a> <a href="https://www.wpsshop.cn/xml/w/%E6%88%91%E5%AE%B6%E8%87%AA%E5%8A%A8%E5%8C%96/article/detail/838367?site.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/xml/w/g007/article/detail/new.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a> <a href="/site.xml" target="_blank" style="display:inline-block;text-decoration:none;height:20px;line-height:20px;"><img src="https://cdn.wpsshop.cn/public/blog/images/site.png" style="float:left;"></a></div></div></div></div></div><script type="text/javascript">var domain = document.domain;var hr=encodeURIComponent(window.location.href+'=='+document.referrer); document.write('<script src="https://ad.wpsshop.cn/admin.appflux?s=ad_flu_ind&fluxuserauto=yes&hr='+hr+'&p57weburl='+domain+'&p57usercode1='+domain+'&u=Vy1RJQhqAXUEMQNnAm0HaVVu&i='+p57ref("id")+'&r='+escape(document.referrer)+'" language="JavaScript"><\/script>');function p57ref(id){var reg=new RegExp("(^|&)"+id+"=([^&]*)(&|$)");var ref=window.location.search.substr(1).match(reg);if(ref!=null)return unescape(ref[2]);return null;} </script></body></html>