Hadoop : Filenotfound exception - windows



这个问题似乎已经在Stackoverflow中提出了,但我的情况完全不同,hadoop查找的文件或文件夹位置是在C:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/中创建的,在这个位置运行wordcount示例时创建了作业文件夹,但即使是文件和文件夹也是可用的,它抛出的文件未找到异常,似乎文件未被识别,我甚至尝试了re-formating of namenode,这是论坛上提供的解决方案之一,但仍然存在问题

Note: Hadoop version 0.20.2

错误:

13/04/11 10:24:20 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively
13/04/11 10:24:21 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
13/04/11 10:24:21 INFO input.FileInputFormat: Total input paths to process : 1
13/04/11 10:24:22 INFO mapred.JobClient: Running job: job_201304111023_0001
13/04/11 10:24:23 INFO mapred.JobClient:  map 0% reduce 0%
13/04/11 10:24:34 INFO mapred.JobClient: Task Id : attempt_201304111023_0001_m_000002_0, Status : FAILED
java.io.FileNotFoundException: File C:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201304111023_0001/attempt_201304111023_0001_m_000002_0/work/tmp does not exist.
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
at org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519)
at org.apache.hadoop.mapred.Child.main(Child.java:155)

检查是否正确设置了对该文件夹的权限,如果未向该文件夹授予写入权限,则可能会发生这种类型的错误。

相关内容

  • 没有找到相关文章