线程"main" java.lang.IllegalArgumentException: Wrong FS: Expect: file:///



我正在尝试使用java实现copyFromLocal命令,下面是我的代码。

package com.hadoop;
import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;
import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.FileSystem;
import org.apache.hadoop.fs.Path;

public class CopyFromLocal {
public static void main(String[] args) throws IOException, URISyntaxException {
    Configuration conf =new Configuration();
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/core-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/mapred-site.xml"));
    conf.addResource(new Path("/usr/hdp/2.3.0.0-2557/hadoop/conf/hdfs-site.xml"));
    FileSystem fs = FileSystem.get(conf);
    Path sourcePath = new Path("/root/sample.txt");
    Path destPath = new Path("hdfs://sandbox.hortonworks.com:8020/user/Deepthy");
    if(!(fs.exists(destPath)))
    {
        System.out.println("No Such destination exists :"+destPath);
        return;
    }
fs.copyFromLocalFile(sourcePath, destPath);
}

}

我得到以下异常:

Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS: hdfs://sandbox.hortonworks.com:8020/user/Deepthy, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:305)
at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:47)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:357)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:643)
at com.amal.hadoop.CopyFromLocal.main(CopyFromLocal.java:27)

我将这些jar添加到类路径:
hadoop-0.20.1-core.jar
commons-logging-1.1.3.jar

请告诉我哪里出了问题。

更改配置如下

conf.set("fs.default.name","hdfs://sandbox.hortonworks.com:8020");

请在目的地destPath中提供一个相对路径,如

Path destPath = new Path("/user/Deepthy");

这将修复

问题

相关内容

最新更新