Package | Description |
---|---|
org.apache.hadoop.filecache | |
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.fs.ftp | |
org.apache.hadoop.fs.kfs |
A client for the Kosmos filesystem (KFS)
|
org.apache.hadoop.fs.s3 |
A distributed, block-based implementation of
FileSystem that uses Amazon S3
as a backing store. |
org.apache.hadoop.fs.s3native |
A distributed implementation of
FileSystem for reading and writing files on
Amazon S3. |
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapreduce.lib.input |
Modifier and Type | Method and Description |
---|---|
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
FileStatus fileStatus,
boolean isArchive,
long confFileStamp,
Path currentWorkDir)
Get the locally cached file or archive; it could either be
previously cached (and valid) or copy it from the
FileSystem now. |
static Path |
DistributedCache.getLocalCache(URI cache,
Configuration conf,
Path baseDir,
FileStatus fileStatus,
boolean isArchive,
long confFileStamp,
Path currentWorkDir,
boolean honorSymLinkConf)
Get the locally cached file or archive; it could either be
previously cached (and valid) or copy it from the
FileSystem now. |
Modifier and Type | Method and Description |
---|---|
FileStatus |
FilterFileSystem.getFileStatus(Path f)
Get file status.
|
FileStatus |
RawLocalFileSystem.getFileStatus(Path f) |
FileStatus |
HarFileSystem.getFileStatus(Path f)
return the filestatus of files in har archive.
|
abstract FileStatus |
FileSystem.getFileStatus(Path f)
Return a file status object that represents the path.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern)
Return all the files that match filePattern and are not checksum
files.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
FilterFileSystem.listStatus(Path f)
List files in a directory.
|
FileStatus[] |
RawLocalFileSystem.listStatus(Path f) |
FileStatus[] |
HarFileSystem.listStatus(Path f)
liststatus returns the children of a directory
after looking up the index files.
|
abstract FileStatus[] |
FileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
ChecksumFileSystem.listStatus(Path f)
List the statuses of the files/directories in the given path if the path is
a directory.
|
FileStatus[] |
FileSystem.listStatus(Path[] files)
Filter files/directories in the given list of paths using default
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
FilterFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len) |
BlockLocation[] |
HarFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
get block locations from the underlying fs
|
BlockLocation[] |
FileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return an array containing hostnames, offset and size of
portions of the given file.
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats)
convert an array of FileStatus to an array of Path
|
static Path[] |
FileUtil.stat2Paths(FileStatus[] stats,
Path path)
convert an array of FileStatus to an array of Path.
|
Modifier and Type | Method and Description |
---|---|
FileStatus |
FTPFileSystem.getFileStatus(Path file) |
FileStatus[] |
FTPFileSystem.listStatus(Path file) |
Modifier and Type | Method and Description |
---|---|
FileStatus |
KosmosFileSystem.getFileStatus(Path path) |
FileStatus[] |
KosmosFileSystem.listStatus(Path path) |
Modifier and Type | Method and Description |
---|---|
BlockLocation[] |
KosmosFileSystem.getFileBlockLocations(FileStatus file,
long start,
long len)
Return null if the file doesn't exist; otherwise, get the
locations of the various chunks of the file file from KFS.
|
Modifier and Type | Method and Description |
---|---|
FileStatus |
S3FileSystem.getFileStatus(Path f)
FileStatus for S3 file systems.
|
FileStatus[] |
S3FileSystem.listStatus(Path f) |
Modifier and Type | Method and Description |
---|---|
FileStatus |
NativeS3FileSystem.getFileStatus(Path f) |
FileStatus[] |
NativeS3FileSystem.listStatus(Path f)
If
f is a file, this method will make a single call to S3. |
Modifier and Type | Method and Description |
---|---|
protected FileStatus[] |
FileInputFormat.listStatus(JobConf job)
Deprecated.
List input directories.
|
protected FileStatus[] |
SequenceFileInputFormat.listStatus(JobConf job)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected List<FileStatus> |
FileInputFormat.listStatus(JobContext job)
List input directories.
|
protected List<FileStatus> |
SequenceFileInputFormat.listStatus(JobContext job) |
Copyright © 2010 The Apache Software Foundation