当前位置:   article > 正文

Hadoop报错:Failed to locate the winutils binary in the hadoop binary path_error org.apache.hadoop.util.shell - failed to loc

error org.apache.hadoop.util.shell - failed to locate the winutils binary in
1 发现问题

在虚拟机中搭建了hadoop集群,在windows中通过代码访问报错

  1. 15/06/11 15:35:50 ERROR Shell: Failed to locate the winutils binary in the hadoop binary path
  2. java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
  3. at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356)
  4. at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371)
  5. at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)

2 分析问题
打开源码,查看getQualifiedBinPath方法

  1. public static final String getQualifiedBinPath(String executable)
  2. throws IOException {
  3. // construct hadoop bin path to the specified executable
  4. String fullExeName = HADOOP_HOME_DIR + File.separator + "bin"
  5. + File.separator + executable;
  6. File exeFile = new File(fullExeName);
  7. if (!exeFile.exists()) {
  8. throw new IOException("Could not locate executable " + fullExeName
  9. + " in the Hadoop binaries.");
  10. }
  11. return exeFile.getCanonicalPath();
  12. }
  13. private static String HADOOP_HOME_DIR = checkHadoopHome();
  14. private static String checkHadoopHome() {
  15. // first check the Dflag hadoop.home.dir with JVM scope
  16. String home = System.getProperty("hadoop.home.dir");
  17. // fall back to the system/user-global env variable
  18. if (home == null) {
  19. home = System.getenv("HADOOP_HOME");
  20. }
  21. ...
  22. }
exeFile不存在会报错,也就是fullExeName不存在。即windows中没有配置HADOOP_HOME。

3 解决问题
配置环境变量E:\\Program Files\\hadoop-2.7.0重启电脑。 或者代码中设置System.setProperty("hadoop.home.dir", "E:\\Program Files\\hadoop-2.7.0"); 还有一种可能HADOOP_HOME的bin目录下根本没有winutils.exe,下载地址https://github.com/srccodes/hadoop-common-2.2.0-bin

原贴地址:http://www.cnblogs.com/hyl8218/p/5492450.html

声明:本文内容由网友自发贡献,不代表【wpsshop博客】立场,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:https://www.wpsshop.cn/w/2023面试高手/article/detail/686177
推荐阅读
相关标签
  

闽ICP备14008679号