Package | Description |
---|---|
org.apache.hadoop.fs |
An abstract file system API.
|
org.apache.hadoop.mapred |
A software framework for easily writing applications which process vast
amounts of data (multi-terabyte data-sets) parallelly on large clusters
(thousands of nodes) built of commodity hardware in a reliable, fault-tolerant
manner.
|
org.apache.hadoop.mapred.lib |
Library of generally useful mappers, reducers, and partitioners.
|
org.apache.hadoop.mapreduce.lib.input |
Modifier and Type | Method and Description |
---|---|
Path[] |
InMemoryFileSystem.getFiles(PathFilter filter)
Deprecated.
|
int |
InMemoryFileSystem.getNumFiles(PathFilter filter)
Deprecated.
|
FileStatus[] |
FileSystem.globStatus(Path pathPattern,
PathFilter filter)
Return an array of FileStatus objects whose path names match pathPattern
and is accepted by the user-supplied path filter.
|
FileStatus[] |
FileSystem.listStatus(Path[] files,
PathFilter filter)
Filter files/directories in the given list of paths using user-supplied
path filter.
|
FileStatus[] |
FileSystem.listStatus(Path f,
PathFilter filter)
Filter files/directories in the given path using the user-supplied path
filter.
|
Modifier and Type | Class and Description |
---|---|
class |
OutputLogFilter
This class filters log files from directory given
It doesnt accept paths having _logs.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobConf conf)
Deprecated.
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
static void |
FileInputFormat.setInputPathFilter(JobConf conf,
Class<? extends PathFilter> filter)
Deprecated.
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
PathFilter... filters)
Create a new pool and add the filters to it.
|
Modifier and Type | Method and Description |
---|---|
protected void |
CombineFileInputFormat.createPool(JobConf conf,
List<PathFilter> filters)
Create a new pool and add the filters to it.
|
Modifier and Type | Method and Description |
---|---|
static PathFilter |
FileInputFormat.getInputPathFilter(JobContext context)
Get a PathFilter instance of the filter set for the input paths.
|
Modifier and Type | Method and Description |
---|---|
static void |
FileInputFormat.setInputPathFilter(Job job,
Class<? extends PathFilter> filter)
Set a PathFilter to be applied to the input paths for the map-reduce job.
|
Copyright © 2010 The Apache Software Foundation