当前位置:   article > 正文

hiveserver2服务异常停止,报错:java.lang.OutOfMemoryError: Java heap space_hive报错 exception in thread "hiveserver2-handler-po

hive报错 exception in thread "hiveserver2-handler-pool: thread-696" java.lan

错误详情如下:

  1. Exception in thread "HiveServer2-Handler-Pool: Thread-956" Exception in thread "HiveServer2-Handler-Pool: Thread-953" java.lang.OutOfMemoryError: Java heap space
  2. at java.util.HashMap.newNode(HashMap.java:1742)
  3. at java.util.HashMap.putVal(HashMap.java:630)
  4. at java.util.HashMap.put(HashMap.java:611)
  5. at org.apache.hive.service.rpc.thrift.TCLIService$Processor.getProcessMap(TCLIService.java:1353)
  6. at org.apache.hive.service.rpc.thrift.TCLIService$Processor.<init>(TCLIService.java:1330)
  7. at org.apache.hive.service.auth.TSetIpAddressProcessor.<init>(TSetIpAddressProcessor.java:48)
  8. at org.apache.hive.service.auth.PlainSaslHelper$SQLPlainProcessorFactory.getProcessor(PlainSaslHelper.java:151)
  9. at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:268)
  10. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
  11. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
  12. at java.lang.Thread.run(Thread.java:745)
  13. java.lang.OutOfMemoryError: Java heap space
  14. at java.util.Arrays.copyOfRange(Arrays.java:3664)
  15. at java.lang.String.<init>(String.java:207)
  16. at org.apache.xerces.xni.XMLString.toString(Unknown Source)
  17. at org.apache.xerces.parsers.AbstractDOMParser.characters(Unknown Source)
  18. at org.apache.xerces.xinclude.XIncludeHandler.characters(Unknown Source)
错误原因:

由java.lang.OutOfMemoryError: Java heap space 可知 hiveserver2运行出现 JVM内存溢出

This Error happened during connect hiveserver2 via beeline, both happened from hiveserver node and remote node.

解决方法:

heapsize太小了,可以适当的调大些
Root cause, the heapsize of hadoop opts is too small, need to increase the size in hive-env.sh as bold.

修改hive-env.sh配置文件,详情修改内容如下

# Hive Client memory usage can be an issue if a large number of clients
# are running at the same time. The flags below have been useful in 
# reducing memory usage:
#
if [ "$SERVICE" = "cli" ]; then
   if [ -z "$DEBUG" ]; then
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -Xmx4096m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:+UseParNewGC -XX:-UseGCOverheadLimit"
   else
     export HADOOP_OPTS="$HADOOP_OPTS -XX:NewRatio=12 -Xms10m -Xmx4096m -XX:MaxHeapFreeRatio=40 -XX:MinHeapFreeRatio=15 -XX:-UseGCOverheadLimit"
   fi
fi

# The heap size of the jvm stared by hive shell script can be controlled via:
#
export HADOOP_HEAPSIZE=4096
#
# Larger heap size may be required when running queries over large number of files or partitions. 
# By default hive shell scripts use a heap size of 256 (MB).  Larger heap size would also be 
# appropriate for hive server.



参考:

http://blog.csdn.net/lulynn/article/details/46455097

http://blog.csdn.net/levy_cui/article/details/53992402


 


声明:本文内容由网友自发贡献,版权归原作者所有,本站不承担相应法律责任。如您发现有侵权的内容,请联系我们。转载请注明出处:【wpsshop博客】
推荐阅读
相关标签
  

闽ICP备14008679号