当前位置:   article > 正文

Hadoop报错 Failed to locate the winutils binary in the hadoop

failed to locate the winutils binary in the hadoop binary path java.io.ioexc

分享一下我老师大神的人工智能教程!零基础,通俗易懂!http://blog.csdn.net/jiangjunshow

也欢迎大家转载本篇文章。分享知识,造福人民,实现我们中华民族伟大复兴!

                1 发现问题

在虚拟机中搭建了hadoop集群,在windows中通过代码访问报错

15/06/11 15:35:50 ERROR Shell: Failed to locate the winutils binary in the hadoop binary pathjava.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.    at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356)    at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371)    at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)
  • 1

2 分析问题
打开源码,查看getQualifiedBinPath方法

public static final String getQualifiedBinPath(String executable)   throws IOException {    // construct hadoop bin path to the specified executable    String fullExeName = HADOOP_HOME_DIR + File.separator + "bin"      + File.separator + executable;     File exeFile = new File(fullExeName);    if (!exeFile.exists()) {      throw new IOException("Could not locate executable " + fullExeName        + " in the Hadoop binaries.");    }     return exeFile.getCanonicalPath();  } private static String HADOOP_HOME_DIR = checkHadoopHome();private static String checkHadoopHome() {     // first check the Dflag hadoop.home.dir with JVM scope    String home = System.getProperty("hadoop.home.dir");     // fall back to the system/user-global env variable    if (home == null) {      home = System.getenv("HADOOP_HOME");    }     ...}
  • 1
exeFile不存在会报错,也就是fullExeName不存在。即windows中没有配置HADOOP_HOME。

3 解决问题
配置环境变量E:\\Program Files\\hadoop-2.7.0重启电脑。 或者代码中设置System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0"); 还有一种可能HADOOP_HOME的bin目录下根本没有winutils.exe,下载地址https://github.com/srccodes/hadoop-common-2.2.0-bin

原贴地址:http://www.cnblogs.com/hyl8218/p/5492450.html

           

给我老师的人工智能教程打call!http://blog.csdn.net/jiangjunshow
这里写图片描述
声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/很楠不爱3/article/detail/686150
推荐阅读
相关标签
  

闽ICP备14008679号