我真的很难与Hadoop一起运行Hbase-MapReduce.
我确实使用Hadoop Hortonwork 2版本.我使用的HBase版本是0.96.1-hadoop2.现在,当我尝试运行我的MapReduce时:
hadoop jar target/invoice-aggregation-0.1.jar start="2014-02-01 01:00:00" end="2014-02-19 01:00:00" firstAccountId=0 lastAccountId=10
Hadoop告诉我,在其文件系统中找不到invoice-aggregation-0.1.jar?我想知道它为什么需要在那里?
这是我得到的错误
14/02/05 10:31:48 ERROR security.UserGroup@R_309_4045@ion: PriviledgedActionException as:adio (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: hdfs://localhost:8020/home/adio/workspace/projects/invoice-aggregation/target/invoice-aggregation-0.1.jar
java.io.FileNotFoundException: File does not exist: hdfs://localhost:8020/home/adio/workspace/projects/invoice-aggregation/target/invoice-aggregation-0.1.jar
at org.apache.hadoop.hdfs.distributedFileSystem$17.doCall(distributedFileSystem.java:1110)
at org.apache.hadoop.hdfs.distributedFileSystem$17.doCall(distributedFileSystem.java:1102)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.distributedFileSystem.getFileStatus(distributedFileSystem.java:1102)
at org.apache.hadoop.mapreduce.filecache.ClientdistributedCacheManager.getFileStatus(ClientdistributedCacheManager.java:288)
at org.apache.hadoop.mapreduce.filecache.ClientdistributedCacheManager.getFileStatus(ClientdistributedCacheManager.java:224)
at org.apache.hadoop.mapreduce.filecache.ClientdistributedCacheManager.determineTimestamps(ClientdistributedCacheManager.java:93)
at org.apache.hadoop.mapreduce.filecache.ClientdistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientdistributedCacheManager.java:57)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:264)
at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:300)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:387)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroup@R_309_404[email protected](UserGroup@R_309_404[email protected]:1491)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
at com.company.invoice.MapReduceStarter.main(MapReduceStarter.java:244)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
我会很感激任何建议,帮助甚至我猜我为什么会收到这个错误?
解决方法:
错误是由于hadoop无法找到放置的罐子.
放置罐子并重新运行工作.
这将解决问题.
版权声明:本文内容由互联网用户自发贡献,该文观点与技术仅代表作者本人。本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌侵权/违法违规的内容, 请发送邮件至 [email protected] 举报,一经查实,本站将立刻删除。