注册 登录  
 加关注
   显示下一条  |  关闭
温馨提示!由于新浪微博认证机制调整,您的新浪微博帐号绑定已过期,请重新绑定!立即重新绑定新浪微博》  |  关闭

Hao的博客

I'm on my way……

 
 
 

日志

 
 
 
 

Hadoop官方源码编译中的相关问题  

2013-08-18 17:45:37|  分类: 云计算 |  标签: |举报 |字号 订阅

  下载LOFTER 我的照片书  |
以下问题目前均为类似问题,表面上看是解决了(全部BUILD SUCCESS),但是根本原因还是没有定位到(缺失的包是干什么用的?默认生成的以lastUpdated结尾的包又是什么?修改后虽然表面是jar包,但实际上应该是“伪jar包”,为什么又能BUILD成功?),目前能力有限,一时半会无法追溯源头,如果有大牛不吝赐教,感激不尽。

从hadoop svn co出来代码后 mvn clean install -Dmaven.test.skip碰到的问题及解决
svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk
1. 执行到HDFS失败
[INFO] Apache Hadoop HDFS ................................ FAILURE [0.234s]

关键错误信息:
[ERROR] Failed to execute goal on project hadoop-hdfs: Could not resolve dependencies for project org.apache.hadoop:hadoop-hdfs:jar:3.0.0-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-common:jar:tests:3.0.0-SNAPSHOT in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced -> [Help 1]

解决办法:
错 误提示无法解决依赖,通过google查到了HDFS-4041(down下来的trunk貌似也解决了这个bug),但是不顶用。所以直接到maven 的本地repository(~/.m2/repository)下查看这个包是否存在。实际上肯定是不存在的,但是在编译hadoop-hdfs时,会 在repository相应的目录下(~/.m2/repository/org/apache/hadoop/hadoop-common /3.0.0-SNAPSHOT)生成一个hadoop-common-3.0.0-SNAPSHOT-tests.jar.lastUpdated,看 着和找不到的依赖很像。将后面的lastUpdated去掉变成jar包,HDFS就可以编译通过了。

2. 执行到HttpFS失败
[INFO] Apache Hadoop HttpFS .............................. FAILURE [0.168s]

关键错误信息:
[ERROR] Failed to execute goal on project hadoop-hdfs-httpfs: Could not resolve dependencies for project org.apache.hadoop:hadoop-hdfs-httpfs:war:3.0.0-SNAPSHOT: Failure to find org.apache.hadoop:hadoop-hdfs:jar:tests:3.0.0-SNAPSHOT in https://repository.apache.org/content/repositories/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache.snapshots.https has elapsed or updates are forced -> [Help 1]

解决办法:
我会跟你说办法和上面是一样一样的吗

3. 执行到hadoop-yarn-server失败
[INFO] hadoop-yarn-server ................................ FAILURE [0.860s]

关键错误信息:
[ERROR] Failed to execute goal on project hadoop-yarn-server: Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-server:pom:3.0.0-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-yarn-common:jar:tests:3.0.0-SNAPSHOT in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]

解决办法:
我真心觉得下面的错误肯定也和上面一样一样的了

4.执行到hadoop-yarn-server-tests失败
[INFO] hadoop-yarn-server-tests .......................... FAILURE [3.702s]

关键错误信息:
[ERROR] Failed to execute goal on project hadoop-yarn-server-tests: Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-server-tests:jar:3.0.0-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-yarn-server-resourcemanager:jar:tests:3.0.0-SNAPSHOT in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]

解决办法:
你敢来点新意不

5. 执行到hadoop-yarn-client失败
[INFO] hadoop-yarn-client ................................ FAILURE [4.703s]

关键错误信息:
[ERROR] Failed to execute goal on project hadoop-yarn-client: Could not resolve dependencies for project org.apache.hadoop:hadoop-yarn-client:jar:3.0.0-SNAPSHOT: Could not find artifact org.apache.hadoop:hadoop-yarn-server-tests:jar:tests:3.0.0-SNAPSHOT in apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots) -> [Help 1]

解决办法:
除非有其他问题,类似问题真心懒得写了

6. [INFO] hadoop-mapreduce-client-hs ........................ FAILURE [0.989s]
7. [INFO] Apache Hadoop MapReduce Examples .................. FAILURE [3.013s]
  评论这张
 
阅读(4227)| 评论(0)
推荐 转载

历史上的今天

评论

<#--最新日志,群博日志--> <#--推荐日志--> <#--引用记录--> <#--博主推荐--> <#--随机阅读--> <#--首页推荐--> <#--历史上的今天--> <#--被推荐日志--> <#--上一篇,下一篇--> <#-- 热度 --> <#-- 网易新闻广告 --> <#--右边模块结构--> <#--评论模块结构--> <#--引用模块结构--> <#--博主发起的投票-->
 
 
 
 
 
 
 
 
 
 
 
 
 
 

页脚

网易公司版权所有 ©1997-2017