|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.conf.Configured
org.apache.hadoop.fs.FileSystem
org.apache.hadoop.fs.kfs.KosmosFileSystem
public class KosmosFileSystem
A FileSystem backed by KFS.
| Nested Class Summary |
|---|
| Nested classes/interfaces inherited from class org.apache.hadoop.fs.FileSystem |
|---|
FileSystem.Statistics |
| Field Summary |
|---|
| Fields inherited from class org.apache.hadoop.fs.FileSystem |
|---|
FS_DEFAULT_NAME_KEY, LOG, statistics |
| Constructor Summary | |
|---|---|
KosmosFileSystem()
|
|
| Method Summary | |
|---|---|
FSDataOutputStream |
append(Path f,
int bufferSize,
Progressable progress)
This optional operation is not yet supported. |
void |
completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
FSDataOutputStream |
create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Opens an FSDataOutputStream at the indicated Path with write-progress reporting. |
boolean |
delete(Path path)
Deprecated. |
boolean |
delete(Path path,
boolean recursive)
Delete a file. |
long |
getDefaultBlockSize()
Return the number of bytes that large input files should be optimally be split into to minimize i/o time. |
short |
getDefaultReplication()
Get the default replication. |
BlockLocation[] |
getFileBlockLocations(FileStatus file,
long start,
long len)
Return null if the file doesn't exist; otherwise, get the locations of the various chunks of the file file from KFS. |
FileStatus |
getFileStatus(Path path)
Return a file status object that represents the path. |
long |
getLength(Path path)
Deprecated. |
String |
getName()
Deprecated. |
short |
getReplication(Path path)
Deprecated. |
URI |
getUri()
Returns a URI whose scheme and authority identify this FileSystem. |
Path |
getWorkingDirectory()
Get the current working directory for the given file system |
void |
initialize(URI uri,
Configuration conf)
Called after a new FileSystem instance is constructed. |
boolean |
isDirectory(Path path)
Deprecated. |
boolean |
isFile(Path path)
Deprecated. |
FileStatus[] |
listStatus(Path path)
List the statuses of the files/directories in the given path if the path is a directory. |
void |
lock(Path path,
boolean shared)
Deprecated. |
boolean |
mkdirs(Path path,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
FSDataInputStream |
open(Path path,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
void |
release(Path path)
Deprecated. |
boolean |
rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
setReplication(Path path,
short replication)
Set replication for an existing file. |
void |
setWorkingDirectory(Path dir)
Set the current working directory for the given file system. |
Path |
startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
| Methods inherited from class org.apache.hadoop.conf.Configured |
|---|
getConf, setConf |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public KosmosFileSystem()
| Method Detail |
|---|
public URI getUri()
FileSystem
getUri in class FileSystem
public void initialize(URI uri,
Configuration conf)
throws IOException
FileSystem
initialize in class FileSystemuri - a uri whose authority section names the host, port, etc.
for this FileSystemconf - the configuration
IOException@Deprecated public String getName()
getName in class FileSystempublic Path getWorkingDirectory()
FileSystem
getWorkingDirectory in class FileSystempublic void setWorkingDirectory(Path dir)
FileSystem
setWorkingDirectory in class FileSystem
public boolean mkdirs(Path path,
FsPermission permission)
throws IOException
FileSystem
mkdirs in class FileSystemIOException
@Deprecated
public boolean isDirectory(Path path)
throws IOException
isDirectory in class FileSystemIOException
@Deprecated
public boolean isFile(Path path)
throws IOException
FileSystem
isFile in class FileSystemIOException
public FileStatus[] listStatus(Path path)
throws IOException
FileSystem
listStatus in class FileSystempath - given path
IOException
public FileStatus getFileStatus(Path path)
throws IOException
FileSystem
getFileStatus in class FileSystempath - The path we want information from
FileNotFoundException - when the path does not exist;
IOException see specific implementation
IOException
public FSDataOutputStream append(Path f,
int bufferSize,
Progressable progress)
throws IOException
append in class FileSystemf - the existing file to be appended.bufferSize - the size of the buffer to be used.progress - for reporting progress if it is not null.
IOException
public FSDataOutputStream create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
throws IOException
FileSystem
create in class FileSystemfile - the file name to openoverwrite - if a file with this name already exists, then if true,
the file will be overwritten, and if false an error will be thrown.bufferSize - the size of the buffer to be used.replication - required block replication for the file.
IOExceptionFileSystem.setPermission(Path, FsPermission)
public FSDataInputStream open(Path path,
int bufferSize)
throws IOException
FileSystem
open in class FileSystempath - the file name to openbufferSize - the size of the buffer to be used.
IOException
public boolean rename(Path src,
Path dst)
throws IOException
FileSystem
rename in class FileSystemIOException
public boolean delete(Path path,
boolean recursive)
throws IOException
FileSystem
delete in class FileSystempath - the path to delete.recursive - if path is a directory and set to
true, the directory is deleted else throws an exception. In
case of a file the recursive can be set to either true or false.
IOException
@Deprecated
public boolean delete(Path path)
throws IOException
delete in class FileSystemIOException
@Deprecated
public long getLength(Path path)
throws IOException
getLength in class FileSystemIOException
@Deprecated
public short getReplication(Path path)
throws IOException
FileSystem
getReplication in class FileSystempath - file name
IOExceptionpublic short getDefaultReplication()
FileSystem
getDefaultReplication in class FileSystem
public boolean setReplication(Path path,
short replication)
throws IOException
FileSystem
setReplication in class FileSystempath - file namereplication - new replication
IOExceptionpublic long getDefaultBlockSize()
FileSystem
getDefaultBlockSize in class FileSystem
@Deprecated
public void lock(Path path,
boolean shared)
throws IOException
IOException
@Deprecated
public void release(Path path)
throws IOException
IOException
public BlockLocation[] getFileBlockLocations(FileStatus file,
long start,
long len)
throws IOException
getFileBlockLocations in class FileSystemIOException
public void copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
throws IOException
FileSystem
copyFromLocalFile in class FileSystemIOException
public void copyToLocalFile(boolean delSrc,
Path src,
Path dst)
throws IOException
FileSystem
copyToLocalFile in class FileSystemIOException
public Path startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
throws IOException
FileSystem
startLocalOutput in class FileSystemIOException
public void completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
throws IOException
FileSystem
completeLocalOutput in class FileSystemIOException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||