Hadoop-2.5.1 + Nutch-2.2.1:找到接口org.apache.hadoop.mapreduce.TaskAttemptContext，，但类是预期的
命令：./crawl /urls /mydir XXXXX 2
当我在Hadoop-2.5.1和Nutch-2.2.1中运行这个命令时，我得到了以下错误信息。
14/10/07 19:58:10信息mapreduce.Job:运行作业: job_1411692996443_0016
14/10/07 19:58:17 INFO mapreduce.Job: job_1411692996443_0016在uber模式下运行: false 14/10/07 19:58:17 INFO mapreduce.Job: map 0%减少0%
14/10/07 19:58:21信息mapreduce.Job:任务Id : attempt_1411692996443_0016_m_000000_0，状态:失败
org.apache.hadoop.mapreduce.TaskAttemptContext，错误:找到接口但类被期望为
14/10/07 19:58:26信息mapreduce.Job:任务Id : attempt_1411692996443_0016_m_000000_1，状态:失败
错误:找到接口org.apache.hadoop.mapreduce.TaskAttemptContext，，但类是预期的 14/10/07 19:58:31信息mapreduce.Job:任务Id : attempt_1411692996443_0016_m_000000_2，状态:失败
错误:找到接口org.apache.hadoop.mapreduce.TaskAttemptContext，，但类是预期的 14/10/07 19:58:36 INFO mapreduce.Job: map 100%减少0% 14/10/07 19:58:36 INFO mapreduce.Job:作业job_1411692996443_0016失败而状态失败由于:任务失败task_1411692996443_0016_m_000000
作业失败，任务失败。故障映射:1故障减少:0
14/10/07 19:58:36信息mapreduce.Job:柜台: 12
Job Counters
Failed map tasks=4
Launched map tasks=4
Other local map tasks=3
Data-local map tasks=1
Total time spent by all maps in occupied slots (ms)=11785
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=11785
Total vcore-seconds taken by all map tasks=11785
Total megabyte-seconds taken by all map tasks=12067840
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=014/10/07 19:58:36错误crawl.InjectorJob: InjectorJob: java.lang.RuntimeException:作业失败: name=/mydirinject /urls，jobid=job_1411692996443_0016
at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:55)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:233)
at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:251)
at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:273)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:282)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)回答 2
Stack Overflow用户
发布于 2014-10-10 07:09:17
您可能正在使用用Hadoop 1编译的Gora (或smth else) (来自maven repo?)。您可以下载Gora (0.5?)用Hadoop 2构建它。
也许这只是一系列问题中的第一个问题。请通知我们您的未来步骤。
Stack Overflow用户
发布于 2014-12-16 22:46:43
我在hadoop 2.4.0的nutch 2.x上也有类似的错误
用Hadoop2.5.1依赖项(ivy)重新编译nutch，并排除所有Hadoop1.x依赖项--您可以在lib中找到它们--可能是hadoop-core。
https://stackoverflow.com/questions/26236112
复制相似问题
腾讯云开发者
Copyright © 2013 - 2026 Tencent Cloud. All Rights Reserved. 腾讯云 版权所有
深圳市腾讯计算机系统有限公司 ICP备案/许可证号：粤B2-20090059 
粤公网安备44030502008569号
腾讯云计算（北京）有限责任公司 京ICP证150476号 | 京ICP备11018762号