博客
关于我
强烈建议你试试无所不能的chatGPT,快点击我
hive脚本运行查看错误日志方式
阅读量:2395 次
发布时间:2019-05-10

本文共 4192 字,大约阅读时间需要 13 分钟。

当脚本在运行时报错信息如下:

Examining task ID: task_201201061122_0007_m_000002 (and more) from job job_201201061122_0007

Exception in thread "Thread-23" java.lang.RuntimeException: Error while reading from task log url
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://10.200.187.27:50060/tasklog?taskid=attempt_201201061122_0007_m_000000_2&start=-8193
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
at java.net.URL.openStream(URL.java:1010)
at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)
... 3 more
FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.MapRedTask
MapReduce Jobs Launched: 

将http://10.200.187.27:50060/tasklog?taskid=attempt_201201061122_0007_m_000000_2&start=-8193这段复制出来,输入到IE浏览器的地址栏内,然后出现这样的信息:

HTTP ERROR 400

Problem accessing /tasklog. Reason:

Argument attemptid is required


Powered by Jetty://

这时将attemptid替换浏览器地址栏里的参数taskid,然后就出现以下内容:

Task Logs: 'attempt_201201061122_0006_m_000000_1'

stdout logs
 

stderr logs
Traceback (most recent call last):  File "/bin/is_good_quality.py", line 8, in 
if(temp!="9999" and re.match("[01459]",q)):NameError: name 'q' is not definedorg.apache.hadoop.hive.ql.metadata.HiveException: Hit error while closing .. at org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:193) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249)org.apache.hadoop.hive.ql.metadata.HiveException: Hit error while closing .. at org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:193) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249)org.apache.hadoop.hive.ql.metadata.HiveException: Hit error while closing .. at org.apache.hadoop.hive.ql.exec.ScriptOperator.close(ScriptOperator.java:452) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) at org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:193) at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372) at org.apache.hadoop.mapred.Child$4.run(Child.java:255) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059) at org.apache.hadoop.mapred.Child.main(Child.java:249)

就可以看到具体的错误信息了,以上是基于hadoop-0.20.205.0的版本。

转载地址:http://svzob.baihongyu.com/

你可能感兴趣的文章
B、BL、BX、BLX 和 BXJ
查看>>
ARM linux解析之压缩内核zImage的启动过程 三
查看>>
Linux内核源码分析--zImage出生实录(Linux-3.0 ARMv7)
查看>>
linux命令 ld使用
查看>>
compressed/head.s __setup_mmu
查看>>
__proc_info_begin->__proc_info_end
查看>>
__lookup_processor_type
查看>>
指令+s对cpsr中标志位的影响
查看>>
ARM中MMU地址转换理解
查看>>
GUN ARM汇编中标号的引用在汇编和C语言中区别
查看>>
__vet_atags
查看>>
ARM指令后缀与常用读取指令
查看>>
__create_page_tables
查看>>
__v7_setup
查看>>
__enable_mmu
查看>>
__get_cpu_architecture
查看>>
cat /proc/cpuinfo
查看>>
seq_file文件的内核读取过程
查看>>
Linux __setup解析
查看>>
设计模式--模板方法(Template Method)
查看>>