我正在HDInsights上学习Hadoop 1.1.0版本。我按照一步一步的指示在Hadoop命令行上运行这些命令。我首先编译了java代码,然后创建了一个jar文件,然后执行map reduce命令。但当我运行mapreduce命令时,它会给我以下错误。有人能帮我理解这个错误的含义以及我需要做些什么来纠正它吗?
c:hadoop-trainingmrdcache>hadoop jar DCache.jar DCache mrdcache/input/nyse mrdcache/output
13/08/08 23:29:01 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/08/08 23:29:01 INFO mapred.JobClient: Cleaning up the staging area hdfs://localhost:8020/hadoop/hdfs/tmp/mapred/staging/Ramya/.staging/job_201308082321_0001
13/08/08 23:29:01 ERROR security.UserGroupInformation: PriviledgedActionException as:myusername cause:java.io.FileNotFoundException: File does not exist: mrdcache/output Exception in thread "main" java.io.FileNotFoundException: File does not exist: mrdcache/output
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:518)
at org.apache.hadoop.filecache.DistributedCache.getFileStatus(DistributedCache.java:185)
at org.apache.hadoop.filecache.TrackerDistributedCacheManager.determineTimestamps(TrackerDistributedCacheManager.java:750)
at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:763)
at org.apache.hadoop.mapred.JobClient.copyAndConfigureFiles(JobClient.java:655)
at org.apache.hadoop.mapred.JobClient.access$300(JobClient.java:174)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:865)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1261)
at DCache.main(Dcache.java:199)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
感谢您的帮助!谢谢Ramya
文件在哪里?您应该这样使用ASV:hadoop jar C:\Tutorials\log4jMapReduce.jar log4jMapReduceasv:///sample.logasv:///Tutorials/output
http://www.windowsazure.com/en-us/manage/services/hdinsight/using-mapreduce-with-hdinsight/